High-fidelity space far-field time-sensitive target optical data set generation method
By establishing a spatial camera imaging model and simulating complex starry sky backgrounds, high-fidelity space far-field time-sensitive target optical images are generated, and high-fidelity space far-field time-sensitive target optical data sets are solved, and rapid generation and high-precision images are achieved.
Patent Information
- Application Number
- CN202510592143.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-05-09
- Publication Date
- 2025-06-06
- Estimated Expiration
- 2045-05-09
AI Technical Summary
At present, there is a lack of a fast generation method for far-field time-sensitive target optical data set with complete label information in complex spatial environments, which makes it difficult to achieve high fidelity and rapid generation of spatial far-field time-sensitive target optical image generation.
A high-fidelity space far-field time-sensitive target optical data set generation method is adopted. By establishing a space camera imaging model, combining navigation star tables and real time-sensitive target information, rotation transformation and projection transformation are performed to generate an ideal background star map and a simulated image of the time-sensitive target, and simulate spatial stray light and space camera noise, fuse complex starry sky background maps, and finally generate a high-fidelity space far-field time-sensitive target optical image through brightness enhancement.
It realizes the rapid generation of high-fidelity far-field time-sensitive target optical data sets in complex spatial environments, provides complete object detection algorithm test data, and improves the accuracy and speed of image generation.
Smart Images

Figure CN120105761A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a method for generating a spatial far-field time-sensitive target optical data set, and in particular to a method for generating a spatial far-field time-sensitive target optical data set with high fidelity. Background Art
[0002] The generation of optical images of time-sensitive targets in the far field of space is of great significance in the fields of satellite navigation, space debris warning, deep space exploration, etc. The existing detection of time-sensitive targets in the far field of space is mainly based on traditional methods. Although the deep learning-based methods perform significantly better than traditional methods in many computer vision problems, they rely on large-scale annotated data sets to train network models. In the field of optical detection and warning of time-sensitive targets in the far field of space, there is currently no available optical data set of time-sensitive targets in the far field of space, and there is also a lack of methods for rapid generation of optical images of far field space and multi-dimensional information annotation in complex environments.
[0003] At present, the generation of optical images of time-sensitive targets in the far field of space mainly relies on star map simulation and emulation. Star map simulation is a prerequisite for the research of space far field time-sensitive target detection algorithm. Since the real star map is not easy to obtain, it is necessary to digitally simulate the star map. High-precision simulated star map can provide a guarantee for the accuracy of space far field time-sensitive target detection.
[0004] At present, there have been a lot of studies on high-fidelity star map simulation technology. In the article "Simulation of Space Target Sequence Star Maps Based on STK / MATLAB" published in "Infrared and Laser Engineering" Volume 43, Issue 9, 2014, Liu Fucheng et al. proposed a method for generating sequence star maps that can simulate weak point-like moving targets under a complex starry sky background. Using STK software, the space far-field time-sensitive targets are modeled, the relative geometric relationship between the observation satellite and the space far-field time-sensitive targets in the geosynchronous orbit is predicted, and the visibility of high-orbit targets is systematically analyzed. The prediction data of the space target orbit is generated by STK, and it is simulated by Matlab programming based on the Hipparcos star catalog. In the master's thesis "Research on Star Image Recognition Simulation of Star Sensor Based on Scilab / Xcos" published in CNKI in 2020, Fan Meng used the Scilab / Xcos simulation platform and the Hipparcos star catalog to study and analyze the mathematical model of star to grayscale conversion, the star point grayscale diffusion model, and the source of star image noise, thereby completing the work of simulating star images taken by narrow field of view cameras. However, the above star map simulation and emulation work did not take into account the high-fidelity characteristics of visible light optical images. Wang Yupeng et al. published "Fast Simulation Method of Space-based Optical Observation Images of Massive Space Debris" in "Laser and Optoelectronics Progress" Vol. 59, No. 16, 2022, which proposed a fast solution strategy for the visibility of massive non-cooperative targets in space under multiple constraints, ensuring the fidelity of the simulated images and speeding up the imaging simulation, but it lacks the simulation of images containing real time-sensitive target label information.
[0005] In summary, there is currently no public, high-fidelity far-field time-sensitive target optical dataset with complete label information at home and abroad, and there is also a lack of methods for quickly generating far-field time-sensitive target optical datasets with complete label information in complex spatial environments. Summary of the invention
[0006] The purpose of the present invention is to solve the technical problem of the current lack of a method for quickly generating a far-field time-sensitive target optical dataset with complete label information in a complex spatial environment, and to provide a high-fidelity spatial far-field time-sensitive target optical dataset generation method.
[0007] To achieve the above object, the technical solution adopted by the present invention is: A method for generating a high-fidelity spatial far-field time-sensitive target optical data set is characterized in that it includes the following steps: Step 1: Set the space camera parameters, and then establish the rotation relationship between the celestial coordinate system and the space camera coordinate system according to the space camera parameters and the given line of sight of the space camera, as well as the constraints for imaging the stars in the field of view of the space camera, and then use the projection transformation method to obtain the space camera imaging model that transforms the stars from the celestial coordinate system to the space camera imaging coordinate system; Step 2: According to different navigation star catalogs, the right ascension and declination of all stars in the catalog in the celestial coordinate system are obtained. Then, based on the space camera imaging model, the right ascension and declination of the stars in the celestial coordinate system are converted into the coordinates of the space camera imaging coordinate system to obtain an ideal background star map dataset; Step 3: According to the real time-sensitive target information, the right ascension and declination of the time-sensitive target in the celestial coordinate system are obtained, and according to the method of step 2, a simulated image set of the time-sensitive target is obtained; then, the light path of the time-sensitive target in the simulated image set is traced to obtain a spot intensity map of the time-sensitive target in the imaging coordinate system of the space camera, thereby obtaining an initial simulated image set including the position and brightness characteristics of the time-sensitive target; Step 4, simulating spatial stray light and spatial camera noise to obtain a set of spatial stray light simulation images and a spatial camera noise simulation image; Step 5: Using a double loop nesting method, the ideal background star map in the ideal background star map data set is superimposed with each spatial stray light simulation image in the spatial stray light simulation image set to obtain a complex star sky background image data set; then all the complex star sky background images in the complex star sky background image data set are superimposed with the spatial camera noise simulation image to obtain a fused complex star sky background image data set; Step 6. Perform brightness enhancement on the time-sensitive targets in all the initial simulation images in the initial simulation image set to obtain a brightness enhanced image set; then embed the brightness enhanced images in the brightness enhanced image set into the fused complex starry sky background image in the fused complex starry sky background image data set to obtain a high-fidelity spatial far-field time-sensitive target optical data set.
[0008] Furthermore, step 1 is specifically as follows: Step 1.1, setting space camera parameters, wherein the space camera parameters include the field of view of the space camera, the focal length of the space camera, the number of pixels of the space camera, and the pixel size; Step 1.2: According to the visual axis of the space camera, the rotation relationship between the celestial coordinate system and the space camera coordinate system is obtained as shown in the following formula:
[0009]
[0010] in, is the star in the space camera coordinate system O ′- XYZ The direction vector in X , Y , Z are the star coordinates in the space camera system O ′- XYZ The direction vector in X axis, Y axis, Z Components on the axis; is the star in the celestial coordinate system O - UVW The unit direction vector in , U , V , W are the stars in the celestial coordinate system O - UVW The unit direction vector in U axis, V axis, W Components on the axis; R is the rotation matrix; is the right ascension of the visual axis of the space camera in the celestial coordinate system, is the declination of the visual axis of the space camera in the celestial coordinate system; Step 1.3: According to the field of view of the space camera, the constraint condition for the image formation of stars in the field of view of the space camera is obtained as shown in the following formula:
[0011] in, For the i The right ascension of a star in the celestial coordinate system, For the i The declination of a star in the celestial coordinate system, i is an integer, and 1≤ i ≤H, H is the number of stars; r is the field of view radius of the space camera, , represents the field of view of the space camera, Indicates the space camera in the space camera imaging coordinate system x Axis field of view, Indicates the space camera in the space camera imaging coordinate system y Axis field of view; Step 1.4, according to the right ascension and declination of the star in the celestial coordinate system, obtain the calculation formula of the unit direction vector of the star in the celestial coordinate system:
[0012] in, For the i The unit direction vector of a star in the celestial coordinate system, , , Respectively i The unit direction vector of a star in the celestial coordinate system is U axis, V axis, W Components on the axis; Step 1.5: Based on the rotation relationship between the celestial coordinate system and the space camera coordinate system obtained in step 1.2, the constraints for imaging the stars in the field of view of the space camera obtained in step 1.3, and the calculation formula for the unit direction vector of the stars in the celestial coordinate system obtained in step 1.4, a star point spatial distribution model for converting the stars from the celestial coordinate system to the space camera coordinate system is established:
[0013]
[0014] in, For the i The unit direction vector of a star in the space camera coordinate system, , , Respectively i The unit direction vector of a star in the space camera coordinate system is X axis, Y axis, Z Components on the axis; Step 1.6: Use projection transformation to establish the projection relationship between the space camera coordinate system and the space camera imaging coordinate system, and obtain the perspective projection transformation model:
[0015]
[0016] in, , Respectively i The stars in the imaging coordinate system of the space camera x Axis coordinates, y Axis coordinates; f is the focal length of the space camera, L is the number of pixels of the space camera, pixel_size is the pixel size; Step 1.7: Substitute the star point spatial distribution model established in step 1.5 into the perspective projection transformation model obtained in step 1.6 to obtain the spatial camera imaging model:
[0017]
[0018] in, , Represent the imaging coordinate system of the space camera x axis, y Axis pixel number, according to the number of pixels of the space camera L get.
[0019] Furthermore, step 2 is specifically as follows: Step 2.1, define the sky area scanning grid; Step 2.2, obtaining the right ascension and declination of one of the stars in the navigation star catalog in the celestial coordinate system according to the sky area scanning grid; Step 2.3, based on the space camera imaging model, according to the right ascension and declination of the star in the celestial coordinate system, obtain the coordinates of the star in the space camera imaging coordinate system; Step 2.4: According to the following formula, translate the coordinates of the star in the imaging coordinate system of the space camera to obtain the coordinates of the star within the field of view of the space camera on the display:
[0020] in, , Respectively i The horizontal and vertical coordinates of the stars on the display; Step 2.5, define the point spread function, simulate the expansion effect according to the point spread function, convert the star magnitude value into grayscale distribution, and obtain the expanded star image:
[0021] in, Indicates i The star image after the expansion of stars, , Respectively represent the horizontal and vertical coordinates of any point on the display; A 1 is the total energy of all stars, σ 1 is the energy concentration, A 1 and σ 1 All are obtained according to the magnitude of the star; Step 2.6, synthesizing the expanded star image to obtain an ideal background star map for the navigation star catalog; Step 2.7: Repeat steps 2.2 to 2.6 until the ideal background star maps of all navigation star catalogs are obtained, thereby obtaining an ideal background star map data set.
[0022] Furthermore, step 2.3 is specifically as follows: Step 2.3.1, based on the star point spatial distribution model, convert the right ascension and declination of the star in the celestial coordinate system into the unit direction vector of the star in the space camera coordinate system; Step 2.3.2: According to the unit direction vector of the star in the space camera coordinate system, use the following formula to select the stars that can be imaged in the space camera imaging coordinate system:
[0023] in, , represents the spatial direction vector of the visual axis of the space camera in the space camera coordinate system, , , They are the spatial direction vectors of the visual axis of the space camera in the space camera coordinate system. X axis, Y axis, Z Components on the axis; , indicating the i The unit direction vector of a star in the space camera coordinate system; Step 2.3.3: Based on the perspective projection transformation model, the unit direction vector of the star that can be imaged in the space camera imaging coordinate system in the space camera coordinate system is converted into the coordinate in the space camera imaging coordinate system.
[0024] Furthermore, in step 2.5, when 0<star magnitude≤3, A 1 =0.8, ; 3<When the magnitude of the star is ≤6, A1 =0.5, .
[0025] Furthermore, in step 4, the simulated spatial stray light is simulated linearly distributed spatial stray light or simulated Gaussian distributed spatial stray light.
[0026] Furthermore, in step 4, the linearly distributed spatial stray light is simulated by the following formula:
[0027] in, is a simulation diagram of linearly distributed spatial stray light. is the column vector of spatial stray light on the display, is the row vector of spatial stray light on the display; is the bias coefficient; is the gain factor of the linear distribution background, set k = (255 -30) / (img_width*a), img_width is the size of the spatial stray light simulation image, and a is the variation coefficient of the background gray value; by adjusting the variation coefficient a of the background gray value, the linear distribution of spatial stray light simulation images with different gray values is obtained, thereby obtaining a set of spatial stray light simulation images; In step 4, the Gaussian-distributed spatial stray light is simulated by the following formula:
[0028] in, is a simulation diagram of Gaussian distribution of spatial stray light, A 2 is the amplitude, σ 2 is the standard deviation of the Gaussian distribution; , are the horizontal and vertical coordinates of the Gaussian function diffusion center on the display; by adjusting the diffusion center The value and amplitude of A 2 , a Gaussian distribution of spatial stray light simulation images with different illumination angles can be formed, thereby obtaining a set of spatial stray light simulation images.
[0029] Furthermore, in step 4, the space camera noise is simulated by the following formula:
[0030] in, This is a simulation diagram of the noise of a space camera. It means that the generated rules have a mean of 0 and a variance of The size of a normal distribution is M× N Simulation diagram of space camera noise; is the standard deviation of the space camera noise; M , N are the number of pixel rows and columns of the space camera, respectively, and M = N .
[0031] Furthermore, in step 5, the specific method of the double loop nesting method is: Step a1, superimposing a spatial stray light simulation image in the spatial stray light simulation image set with all the ideal background star images in the ideal background star image data set; Step a2: Process the next spatial stray light simulation image according to the method of step a1 until all spatial stray light simulation images in the spatial stray light simulation image data set are traversed.
[0032] Further, in step 6, the specific method of embedding the brightness enhanced image in the brightness enhanced image set into the fused complex starry sky background image in the fused complex starry sky background image data set is: The fused complex starry sky background image in the fused complex starry sky background image data set is read, the brightness enhanced image in the brightness enhanced image data set is matched by modulo operation, and the complex starry sky background image and the matched brightness enhanced image are superimposed one by one.
[0033] Compared with the prior art, the present invention has the following beneficial effects: 1. A method for generating a high-fidelity space far-field time-sensitive target optical data set provided by the present invention is based on a three-stage framework of physical modeling and multi-layer synthesis. First, a space camera imaging model is established to convert stars from a celestial coordinate system to a space camera imaging coordinate system according to space camera parameters and a given line of sight of the space camera. The celestial coordinate system is mapped to the space camera imaging coordinate system through rotation transformation and projection transformation according to the navigation star catalog and the real time-sensitive target information, respectively, to obtain an ideal background star map and a simulated image of the time-sensitive target. Then, the simulated image of the time-sensitive target is subjected to ray path tracing to obtain an initial simulated image including the position and brightness characteristics of the time-sensitive target. At the same time, spatial stray light and space camera noise are simulated and fused with the ideal background star map to construct a fused complex starry sky background map. Finally, the initial simulated image is subjected to brightness enhancement and then fused with the fused complex starry sky background map to generate a high-fidelity space far-field time-sensitive target optical image, which completely realizes the detection simulation imaging process of the space optical sensor for the time-sensitive target in the deep space environment, and can provide high-fidelity test data for the subsequent target detection algorithm. 2. The present invention provides a method for generating a high-fidelity space far-field time-sensitive target optical data set. The space camera imaging model divides the imaging link of a star in a space camera into the rotation transformation of the star from the celestial coordinate system to the space camera coordinate system, and the perspective projection transformation from the space camera coordinate system to the space camera imaging coordinate system, which can simplify the modeling and calibration process, improve the model accuracy, and enhance the flexibility and compatibility of the model. 3. A high-fidelity spatial far-field time-sensitive target optical data set generation method provided by the present invention defines a point spread function that can simulate the expansion effect caused by focal distortion, thereby adjusting the size and width of the star according to the magnitude, so as to better extract the center of mass of the star; 4. The present invention provides a high-fidelity spatial far-field time-sensitive target optical data set generation method, which simulates space camera noise through Gaussian distribution. It can simulate background noise, dark current noise, photon noise, etc. in actual shooting, conforms to the physical characteristics of space camera noise, simplifies modeling, and facilitates parameter estimation of space camera noise. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 is a flow chart of a method according to an embodiment of the present invention; Figure 2 Schematic diagram of the rotation transformation from the celestial coordinate system to the space camera coordinate system in step 1.2 of the embodiment of the present invention; Figure 3 This is a schematic diagram of the spatial camera projection transformation in step 1.6 of an embodiment of the present invention; Figure 4 The ideal background star map obtained in step 2.5 of the embodiment of the present invention; Figure 5 The initial simulated image of the time-sensitive target obtained in step 3 of the embodiment of the present invention, wherein (a) is the initial simulated image of a single time-sensitive target, and (b) is the initial simulated image of a dual time-sensitive target; Figure 6 The spatial stray light simulation diagram obtained in step 4 of the embodiment of the present invention, wherein (a) is a spatial stray light simulation diagram of linear distribution, and (b) is a spatial stray light simulation diagram of Gaussian distribution; Figure 7 The fused complex starry sky background image obtained in step 5 of the embodiment of the present invention, (a) is a fused complex starry sky background image with linear distribution, and (b) is a fused complex starry sky background image with Gaussian distribution; Figure 8 The high-fidelity spatial far-field time-sensitive target optical image obtained in step 6 of the embodiment of the present invention, wherein (a) is a high-fidelity spatial far-field time-sensitive target optical image of a single time-sensitive target, and (b) is a high-fidelity spatial far-field time-sensitive target optical image of a dual time-sensitive target. DETAILED DESCRIPTION
[0035] The following is a further detailed description of a high-fidelity spatial far-field time-sensitive target optical data set generation method proposed by the present invention in conjunction with the accompanying drawings and specific embodiments. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the scope of protection of the present invention.
[0036] A method for generating high-fidelity spatial far-field time-sensitive target optical data set, such as Figure 1 As shown, the following steps are included: Step 1: Set the space camera parameters, and then establish the rotation relationship between the celestial coordinate system and the space camera coordinate system according to the space camera parameters and the given line of sight of the space camera, as well as the constraints for imaging stars in the field of view of the space camera, and then use the projection transformation method to obtain the space camera imaging model that transforms stars from the celestial coordinate system to the space camera imaging coordinate system. Specifically: Step 1.1, set the space camera parameters, including the field of view of the space camera, the focal length of the space camera, the number of pixels of the space camera, the magnitude sensitivity limit and the pixel size. The specific parameters are shown in Table 1.
[0037] Table 1
[0038] Step 1.2: According to the visual axis of the space camera, the rotation relationship between the celestial coordinate system and the space camera coordinate system is obtained as shown in the following formula:
[0039]
[0040] in, is the star in the space camera coordinate system O ′- XYZ The direction vector in X , Y , Z are the star coordinates in the space camera system O ′- XYZ The direction vector in X axis, Y axis, Z Components on the axis; is the star in the celestial coordinate system O - UVW The unit direction vector in , U , V , W are the stars in the celestial coordinate system O - UVW The unit direction vector in U axis, V axis, W Components on the axis;R is the rotation matrix; is the right ascension of the visual axis of the space camera in the celestial coordinate system, is the declination of the visual axis of the space camera in the celestial coordinate system.
[0041] Let the coordinates of the star in the celestial coordinate system be expressed in terms of right ascension and declination, and denote them as , the direction vector in the space camera coordinate system is , the coordinates in the imaging plane coordinate system of the space camera are The starting point of right ascension is the vernal equinox, and the starting point of declination is the celestial equator. The northern range is 0°~90°, and the southern range is 0°~-90°. In the celestial coordinate system, the direction vector of a star is derived as follows: The space camera is fixed on the spacecraft. The distance from the center of the space camera to the center of the spacecraft is negligible compared to the distance from the star to the earth. Therefore, the center of the space camera and the center of the spacecraft are considered to coincide. Figure 2 As shown, O - UVW represents the celestial coordinate system, where O It is the center of the celestial sphere. O ′- XYZ represents the space camera coordinate system, where O ′ is the center of the space camera. Since the distance between the star and the earth is far, the radius of the earth can be ignored, so the coordinate center of the space camera is O ′ and the center of the earth (i.e. the center of the celestial sphere O ) can be considered as approximately overlapping.
[0042] Celestial Coordinate System O - UVW After three rotations, it becomes the space camera coordinate system O ′- XYZ , the rotation relationship between the two coordinate systems can be expressed as:
[0043] Celestial Coordinate System O - UVW , first go around W Axis rotation , and obtain the coordinate system O - U 1 V 1 W 1 , then around U 1 Axis rotation ,make W 1 andZ The axes coincide and the coordinate system is obtained O - U 2 V 2 W 2 , and finally around W 2 Axis rotation , and obtain the coordinate system O - XYZ , then after three rotations the rotation matrix It is expressed as:
[0044] like Figure 2 As shown, in the celestial coordinate system, The axis points to the vernal equinox, The axis points to the celestial north pole, , and The three axes form a right-handed coordinate system. In the space camera coordinate system, The axis is the visual axis of the space camera. The direction coordinate of the visual axis of the space camera in the celestial coordinate system is marked as , then the visual axis of the space camera is Axis Angle , Axis Projection in a plane and The angle between the axes is .when Axis and When the axes do not coincide and do not reverse, Axis and The axes together form a plane .because and Parallel and There is an intersection , then we can conclude plane. Plane, and Flat, so flat , and the two planes have an intersection line .set up Axis and intersection The angle is , The angle between the axis and .because axis, The axis is related to the installation position of the space camera. Different installation positions, The value of is different. The space camera is mounted on the spacecraft. If its installation position is determined, is a fixed value. For the convenience of calculation, According to the rotation relationship, we can conclude that: , , then the rotation matrix It can be expressed as: .
[0045] In step 1.2, the celestial coordinate system is mapped to the space camera coordinate system using the third Euler rotation transformation.
[0046] Step 1.3: According to the field of view of the space camera, the constraint condition for the image formation of stars in the field of view of the space camera is obtained as shown in the following formula:
[0047] in, For the i The right ascension of a star in the celestial coordinate system, For the i The declination of a star in the celestial coordinate system, i is an integer, and 1≤ i ≤H, H is the number of stars; r is the field of view radius of the space camera, , represents the field of view of the space camera, Indicates the space camera in the space camera imaging coordinate system x Axis field of view, Indicates the space camera in the space camera imaging coordinate system y Axis field of view.
[0048] Step 1.4, according to the right ascension and declination of the star in the celestial coordinate system, obtain the calculation formula of the unit direction vector of the star in the celestial coordinate system:
[0049] in, For the i The unit direction vector of a star in the celestial coordinate system, , , Respectively i The unit direction vector of a star in the celestial coordinate system is U axis, V axis, W Components on the axis.
[0050] Step 1.5: Based on the rotation relationship between the celestial coordinate system and the space camera coordinate system obtained in step 1.2, the constraints for imaging the stars in the field of view of the space camera obtained in step 1.3, and the calculation formula for the unit direction vector of the stars in the celestial coordinate system obtained in step 1.4, a star point spatial distribution model for converting the stars from the celestial coordinate system to the space camera coordinate system is established:
[0051]
[0052] in, For the i The unit direction vector of a star in the space camera coordinate system, , , Respectively i The unit direction vector of a star in the space camera coordinate system is X axis, Y axis, Z Components on the axis.
[0053] Step 1.6: Figure 3 As shown, by using projection transformation and based on the geometric principle of similar triangles, the projection relationship between the space camera coordinate system and the space camera imaging coordinate system is established to obtain the perspective projection transformation model:
[0054]
[0055] in, , Respectively i The stars in the imaging coordinate system of the space camera x Axis coordinates, y Axis coordinates; f is the focal length of the space camera, L is the number of pixels of the space camera, pixel_size is the pixel size.
[0056] Step 1.7: Substitute the star point spatial distribution model established in step 1.5 into the perspective projection transformation model obtained in step 1.6 to obtain the spatial camera imaging model:
[0057]
[0058] in, , Represent the imaging coordinate system of the space camera x axis, yAxis pixel number, according to the number of pixels of the space camera L get.
[0059] In this embodiment, step 1 divides the imaging link of the star in the space camera into the rotation transformation of the star from the celestial coordinate system to the space camera coordinate system, and the perspective projection transformation from the space camera coordinate system to the space camera imaging coordinate system, which can simplify the modeling and calibration process, improve the model accuracy, and enhance the flexibility and compatibility of the model.
[0060] Step 2: According to different navigation star catalogs, the right ascension and declination of all stars in the catalog in the celestial coordinate system are obtained, and then based on the space camera imaging model, the right ascension and declination of the stars in the celestial coordinate system are converted to the coordinates of the space camera imaging coordinate system to obtain the ideal background star map data set. Specifically: Step 2.1: Define the sky area scanning grid as follows: the sky area scanning range is 0.1°~359.9° in right ascension and -89.9°~89.9° in declination, and the sky area scanning step is 1°.
[0061] To reduce the amount of calculation, according to the grid where the visual axis of the space camera is located, in step 2.2, only the navigation star catalogs of the eight adjacent grids near the grid are searched.
[0062] Step 2.2, obtain the right ascension and declination of one of the stars in the navigation star catalog in the celestial coordinate system according to the sky area scanning grid.
[0063] Step 2.3: Based on the space camera imaging model, the coordinates of the star in the space camera imaging coordinate system are obtained according to the right ascension and declination of the star in the celestial coordinate system. Specifically: Step 2.3.1: Based on the star point spatial distribution model, convert the right ascension and declination of the star in the celestial coordinate system into the unit direction vector in the space camera coordinate system.
[0064] Step 2.3.2: According to the unit direction vector of the star in the space camera coordinate system, use the following formula to select the stars that can be imaged in the space camera imaging coordinate system:
[0065] in, , represents the spatial direction vector of the visual axis of the space camera in the space camera coordinate system, , , They are the spatial direction vectors of the visual axis of the space camera in the space camera coordinate system. X axis, Y axis, Z Components on the axis; , indicating the i The unit direction vector of a star in the space camera coordinate system.
[0066] Step 2.3.3: Based on the perspective projection transformation model, the unit direction vector of the star that can be imaged in the space camera imaging coordinate system in the space camera coordinate system is converted into the coordinate in the space camera imaging coordinate system.
[0067] Step 2.4: According to the following formula, translate the coordinates of the star in the imaging coordinate system of the space camera to obtain the coordinates of the star within the field of view of the space camera on the display:
[0068] in, , Respectively j The horizontal and vertical coordinates of the stars that can be imaged in the imaging coordinate system of the space camera on the display, j is an integer, and 1≤ j ≤J, J is the number of stars that can be imaged in the imaging coordinate system of the space camera; , Respectively j The stars that can be imaged in the space camera imaging coordinate system are x Axis coordinates, y Axis coordinates.
[0069] In this step, the coordinate origin of the space camera imaging coordinate system is located at the center of the imaging plane, while the coordinate origin of the display is in the upper left corner. If the ideal background star map is to be displayed on the display, the coordinates of the stars in the space camera imaging coordinate system need to be translated so that the final ideal background star map can be displayed normally on the display.
[0070] Step 2.5, define the point spread function, simulate the expansion effect according to the point spread function, convert the star magnitude value into grayscale distribution, and obtain the expanded star image:
[0071] in, Indicates j An expanded star image of a star that can be imaged in the imaging coordinate system of a space camera, , Respectively represent the horizontal and vertical coordinates of any point on the display; A 1 is the total energy of all stars that can be imaged in the imaging coordinate system of the space camera, σ 1 is the energy concentration, A 1 and σ 1 All are obtained based on the magnitude of the star: 0<When the magnitude of the star is ≤3, A 1 =0.8, ; 3<When the magnitude of the star is ≤6, A 1 =0.5, .
[0072] Since the grayscale distribution of star images obeys the point spread function of the optical system, it can be approximated by a two-dimensional Gaussian distribution function. The main function of the point spread function is to adjust the size and width of the star according to the magnitude so as to better extract the center of mass in subsequent verification. For each star, a point spread function is applied to simulate the expansion effect caused by focal distortion.
[0073] Step 2.6: Synthesize the expanded star image to obtain the ideal background star map for the navigation star catalog, such as Figure 4 shown.
[0074] Step 2.7: Repeat steps 2.2 to 2.6 until the ideal background star maps of all navigation star catalogs are obtained, thereby obtaining an ideal background star map data set.
[0075] Step 3: According to the real time-sensitive target information, the right ascension and declination of the time-sensitive target in the celestial coordinate system are obtained, and according to the method of step 2, a simulated image set of the time-sensitive target is constructed; then, the light path of the time-sensitive target in the simulated image set is traced to obtain the spot intensity map of the time-sensitive target in the imaging coordinate system of the space camera, thereby obtaining an initial simulated image set including the position and brightness characteristics of the time-sensitive target, providing high-precision input data for subsequent fusion. The initial simulated image is as follows: Figure 5 As shown, (a) is the initial simulated image of a single time-sensitive target, and (b) is the initial simulated image of a dual time-sensitive target. The real time-sensitive target information includes the real time-sensitive target position, the real time-sensitive target size, and the real time-sensitive target brightness. The specific method of ray path tracing is: based on the principle of reversibility of the light path, a ray is emitted from the viewpoint of the space camera, and the reflection path of the intersection of the ray and the time-sensitive target in the simulated image set is recursively calculated to obtain the spot intensity map of the time-sensitive target in the imaging coordinate system of the space camera.
[0076] Step 4: simulate spatial stray light and spatial camera noise to obtain a set of spatial stray light simulation images and a spatial camera noise simulation image. Simulating spatial stray light is to simulate linearly distributed spatial stray light or Gaussian distributed spatial stray light, and the following can be obtained: Figure 6 The spatial stray light simulation diagram shown in the figure, where (a) is a linearly distributed spatial stray light simulation diagram, and (b) is a Gaussian distributed spatial stray light simulation diagram. The linearly distributed spatial stray light is simulated by the following formula:
[0077] in, is a simulation diagram of linearly distributed spatial stray light. is the column vector of spatial stray light on the display, is the row vector of spatial stray light on the display; is the bias coefficient; is the gain factor of the linear distribution background, set k = (255 -30) / (img_width*a), img_width is the size of the spatial stray light simulation image, a is the variation coefficient of the background gray value, and by adjusting the variation coefficient a of the background gray value, the linear distribution of spatial stray light simulation images with different gray values can be obtained, thereby obtaining a set of spatial stray light simulation images.
[0078] The Gaussian-distributed spatial stray light is simulated by the following formula:
[0079] in, is a simulation diagram of Gaussian distribution of spatial stray light, A 2 is the amplitude, σ 2 is the standard deviation of the Gaussian distribution; , They are the horizontal and vertical coordinates of the Gaussian function diffusion center on the display. The value and amplitude of A 2 , a Gaussian-distributed spatial stray light simulation map of different illumination angles can be formed, thereby obtaining a set of spatial stray light simulation images.
[0080] The spatial camera noise is simulated by the following formula:
[0081] in, This is a simulation diagram of the noise of a space camera. It means that the generated rules have a mean of 0 and a variance of The size of a normal distribution is M × N Simulation diagram of space camera noise; is the standard deviation of the space camera noise; M , N are the number of pixel rows and columns of the space camera, respectively, and M = N .
[0082] There are two main sources of star map background noise: one is the starry sky background noise, including the influence of stray light; the other is the noise caused by the imaging device itself, mainly shot noise, transfer noise, output noise, dark current noise, etc. As for the noise caused by the imaging device itself, with the improvement of manufacturing process technology, transfer noise and output noise have been reduced to a very low level and can be ignored in the simulation. Dark current and shot noise are mainly related to temperature and exposure time, and can be approximately regarded as white noise. Therefore, in this embodiment, a Gaussian distributed random number is used to represent the total noise of the space camera.
[0083] Step 5: Using a double loop nesting method, the ideal background star map in the ideal background star map data set is superimposed with each spatial stray light simulation image in the spatial stray light simulation image set to obtain a complex star background image data set. Then, the complex star background images in the complex star background image data set are superimposed with the spatial camera noise simulation images to obtain a fused complex star background image data set. The fused complex star background image is as follows: Figure 7 As shown, (a) is a fused complex starry sky background image with linear distribution, and (b) is a fused complex starry sky background image with Gaussian distribution. The double loop nesting method is specifically as follows: a spatial stray light simulation image in the spatial stray light simulation image dataset is superimposed with all the ideal background star images in the ideal background star image dataset, and then the next spatial stray light simulation image is processed according to the above method until all the spatial stray light simulation images in the spatial stray light simulation image dataset are traversed.
[0084] In this embodiment, step 5 adopts a double loop nesting method, which can realize the full combination and superposition of multiple types of spatial stray light simulation images and ideal background star images, and realize the synthesis of complex starry sky background.
[0085] Step 6: Perform brightness enhancement on the time-sensitive targets in all the initial simulation images in the initial simulation image set to obtain a brightness enhanced image set, and then embed the brightness enhanced images in the brightness enhanced image set into the fused complex starry sky background image in the fused complex starry sky background image dataset to obtain a high-fidelity space far-field time-sensitive target optical dataset. The high-fidelity space far-field time-sensitive target optical image is as follows: Figure 8 As shown, (a) is a high-fidelity spatial far-field time-sensitive target optical image of a single time-sensitive target, and (b) is a high-fidelity spatial far-field time-sensitive target optical image of a dual time-sensitive target. The specific method of embedding the brightness enhanced image in the brightness enhanced image set into the fused complex starry sky background image in the fused complex starry sky background image data set is: Read the fused complex starry sky background image in the fused complex starry sky background image dataset, match the brightness enhanced image in the brightness enhanced image dataset through modulo operation, and superimpose the complex starry sky background image and the matched brightness enhanced image in pairs. The matching method through modulo operation is: If the number of fused complex starry sky background images in the fused complex starry sky background image data set is ≤ the number of brightness enhanced images in the brightness enhanced image data set, then the complex starry sky background images and the matching brightness enhanced images are superimposed in sequence; If the number of fused complex sky background images in the fused complex sky background image data set is greater than the number of brightness enhanced images in the brightness enhanced image data set, the matching index is "folded back" to the first brightness enhanced image in the brightness enhanced image data set through modulo operation. Specifically, if the number of brightness enhanced images is P and the number of complex sky background images is Q (Q>P), the brightness enhanced image index matched by the pth background image is p mod Q. If P=5, the 6th fused complex sky background image matches the 1st brightness enhanced image, the 7th fused complex sky background image matches the 2nd brightness enhanced image, and so on. Since the simulated target is a time-sensitive target, it may appear in all starry sky backgrounds, and the complex sky background image can be reused by cyclically reading it.
[0086] In this embodiment, step 6 improves the target saliency by brightness gain, and truncates the pixel value to the dynamic range of [0, 1] after linear superposition. To maintain the quantization accuracy, the image in the high-fidelity spatial far-field time-sensitive target optical data set is converted to a 16-bit integer, and the final high-fidelity image is output according to the original background file name rule to obtain the low signal-to-noise ratio target detection scene required for the target detection algorithm test.
[0087] The present invention provides a method for generating a high-fidelity space far-field time-sensitive target optical data set. First, according to the given space camera's visual axis and space camera parameters, a space camera imaging model is constructed to transform stars from the celestial coordinate system to the space camera imaging coordinate system; then, the space camera imaging model is used to transform the coordinates of each star in the field of view of the space camera and the magnitude from the magnitude to the grayscale according to the navigation star catalog and the right ascension, declination and magnitude in the real time-sensitive target information, and the stars are displayed on the display in the form of a two-dimensional image, respectively generating an ideal background star map and a simulated image of the time-sensitive target. At the same time, during the imaging process, due to the influence of stray light in space and the space camera itself, a large amount of noise will appear in the image, reducing the imaging quality of the image. Therefore, the simulation of factors such as the star background noise and brightness non-uniformity is also considered, thereby completing the generation of a high-fidelity space far-field time-sensitive target optical image.
Claims
1. A method for generating a high-fidelity spatial far-field time-sensitive target optical data set, characterized in that: The following steps are involved: Step 1: Set the space camera parameters, and then establish the rotation relationship between the celestial coordinate system and the space camera coordinate system according to the space camera parameters and the given line of sight of the space camera, as well as the constraints for imaging the stars in the field of view of the space camera, and then use the projection transformation method to obtain the space camera imaging model that transforms the stars from the celestial coordinate system to the space camera imaging coordinate system; Step 2: According to different navigation star catalogs, the right ascension and declination of all stars in the catalog in the celestial coordinate system are obtained. Then, based on the space camera imaging model, the right ascension and declination of the stars in the celestial coordinate system are converted into the coordinates of the space camera imaging coordinate system to obtain an ideal background star map dataset; Step 3: According to the real time-sensitive target information, the right ascension and declination of the time-sensitive target in the celestial coordinate system are obtained, and according to the method of step 2, a simulated image set of the time-sensitive target is obtained; Then, the light path of the time-sensitive target in the simulated image set is traced to obtain the spot intensity map of the time-sensitive target in the imaging coordinate system of the space camera, thereby obtaining an initial simulated image set including the position and brightness characteristics of the time-sensitive target; Step 4, simulating spatial stray light and spatial camera noise to obtain a set of spatial stray light simulation images and a spatial camera noise simulation image; Step 5: Using a double loop nesting method, the ideal background star map in the ideal background star map data set is superimposed with each spatial stray light simulation image in the spatial stray light simulation image set to obtain a complex star sky background image data set; then all the complex star sky background images in the complex star sky background image data set are superimposed with the spatial camera noise simulation image to obtain a fused complex star sky background image data set; Step 6, performing brightness enhancement on the time-sensitive targets in all the initial simulation images of the initial simulation image set to obtain a brightness enhanced image set; Then, the brightness enhanced images in the brightness enhanced image set are embedded into the fused complex starry sky background images in the fused complex starry sky background image dataset to obtain a high-fidelity spatial far-field time-sensitive target optical dataset.
2. The method for generating a high-fidelity spatial far-field time-sensitive target optical data set according to claim 1, characterized in that: Step 1 is as follows: Step 1.1, setting the space camera parameters, wherein the space camera parameters include the field of view of the space camera, the focal length of the space camera, the number of pixels of the space camera and the pixel size; Step 1.2: According to the visual axis of the space camera, the rotation relationship between the celestial coordinate system and the space camera coordinate system is obtained as shown in the following formula: ; ; in, is the star in the space camera coordinate system O ′- XYZ The direction vector in X , Y , Z are the star coordinates in the space camera system O ′- XYZ The direction vector in X axis, Y axis, Z Components on the axis; is the star in the celestial coordinate system O - UVW The unit direction vector in , U , V , W are the stars in the celestial coordinate system O - UVW The unit direction vector in U axis, V axis, W Components on the axis; R is the rotation matrix; is the right ascension of the visual axis of the space camera in the celestial coordinate system, is the declination of the visual axis of the space camera in the celestial coordinate system; Step 1.3: According to the field of view of the space camera, the constraint condition for the image formation of stars in the field of view of the space camera is obtained as shown in the following formula: ; in, For the i The right ascension of a star in the celestial coordinate system, For the i The declination of a star in the celestial coordinate system, i is an integer, and 1≤ i ≤H, H is the number of stars; r is the field of view radius of the space camera, , represents the field of view of the space camera, Indicates the space camera in the space camera imaging coordinate system x Axis field of view, Indicates the space camera in the space camera imaging coordinate system y Axis field of view; Step 1.4, according to the right ascension and declination of the star in the celestial coordinate system, obtain the calculation formula of the unit direction vector of the star in the celestial coordinate system: ; in, For the i The unit direction vector of a star in the celestial coordinate system, , , Respectively i The unit direction vector of a star in the celestial coordinate system is U axis, V axis, W Components on the axis; Step 1.5: Based on the rotation relationship between the celestial coordinate system and the space camera coordinate system obtained in step 1.2, the constraints for imaging the stars in the field of view of the space camera obtained in step 1.3, and the calculation formula for the unit direction vector of the stars in the celestial coordinate system obtained in step 1.4, a star point spatial distribution model for converting the stars from the celestial coordinate system to the space camera coordinate system is established: ; ; in, For the i The unit direction vector of a star in the space camera coordinate system, , , Respectively i The unit direction vector of a star in the space camera coordinate system is X axis, Y axis, Z Components on the axis; Step 1.6: Use projection transformation to establish the projection relationship between the space camera coordinate system and the space camera imaging coordinate system, and obtain the perspective projection transformation model: ; ; in, , Respectively i The stars in the imaging coordinate system of the space camera x Axis coordinates, y Axis coordinates; f is the focal length of the space camera, L is the number of pixels of the space camera, pixel_size is the pixel size; Step 1.7: Substitute the star point spatial distribution model established in step 1.5 into the perspective projection transformation model obtained in step 1.6 to obtain the spatial camera imaging model: ; ; in, , Represent the imaging coordinate system of the space camera x axis, y Axis pixel number, according to the number of pixels of the space camera L get.
3. The method for generating a high-fidelity spatial far-field time-sensitive target optical data set according to claim 1, characterized in that: Step 2 is as follows: Step 2.1, define the sky area scanning grid; Step 2.2, obtaining the right ascension and declination of one of the stars in the navigation star catalog in the celestial coordinate system according to the sky area scanning grid; Step 2.3, based on the space camera imaging model, according to the right ascension and declination of the star in the celestial coordinate system, obtain the coordinates of the star in the space camera imaging coordinate system; Step 2.4: According to the following formula, translate the coordinates of the star in the imaging coordinate system of the space camera to obtain the coordinates of the star within the field of view of the space camera on the display: ; in, , Respectively i The horizontal and vertical coordinates of the stars on the display; Step 2.5, define the point spread function, simulate the expansion effect according to the point spread function, convert the star magnitude value into grayscale distribution, and obtain the expanded star image: ; in, Indicates i The star image after the expansion of stars, , Respectively represent the horizontal and vertical coordinates of any point on the display; A 1 is the total energy of all stars, σ 1 is the energy concentration, A 1 and σ 1All are obtained based on the magnitude of the star; Step 2.6, synthesizing the expanded star image to obtain an ideal background star map for the navigation star catalog; Step 2.7: Repeat steps 2.2 to 2.6 until the ideal background star maps of all navigation star catalogs are obtained, thereby obtaining an ideal background star map data set.
4. The method for generating a high-fidelity spatial far-field time-sensitive target optical data set according to claim 3, characterized in that: Step 2.3 is as follows: Step 2.3.1, based on the star point spatial distribution model, convert the right ascension and declination of the star in the celestial coordinate system into the unit direction vector of the star in the space camera coordinate system; Step 2.3.2: According to the unit direction vector of the star in the space camera coordinate system, use the following formula to select the stars that can be imaged in the space camera imaging coordinate system: ; in, , represents the spatial direction vector of the visual axis of the space camera in the space camera coordinate system, , , They are the spatial direction vectors of the visual axis of the space camera in the space camera coordinate system. X axis, Y axis, Z Components on the axis; , indicating the i The unit direction vector of a star in the space camera coordinate system; Step 2.3.3: Based on the perspective projection transformation model, the unit direction vector of the star that can be imaged in the space camera imaging coordinate system in the space camera coordinate system is converted into the coordinate in the space camera imaging coordinate system.
5. The method for generating a high-fidelity spatial far-field time-sensitive target optical data set according to claim 3, characterized in that: In step 2.5, when 0<star magnitude≤3, A 1=0.8, ; 3<When the magnitude of the star is ≤6, A 1=0.5, .
6. The method for generating a high-fidelity spatial far-field time-sensitive target optical data set according to claim 1, characterized in that: In step 4, the simulated spatial stray light is simulated linearly distributed spatial stray light or simulated Gaussian distributed spatial stray light.
7. The method for generating a high-fidelity spatial far-field time-sensitive target optical data set according to claim 6, characterized in that: In step 4, the linearly distributed spatial stray light is simulated by the following formula: ; in, is a simulation diagram of linearly distributed spatial stray light. is the column vector of spatial stray light on the display, is the row vector of spatial stray light on the display; is the bias coefficient; is the gain factor of the linear distribution background, set k =(255 -30) / (img_width*a), img_width is the size of the spatial stray light simulation image, a is the coefficient of change of the background gray value; In step 4, the Gaussian-distributed spatial stray light is simulated by the following formula: ; in, is a simulation diagram of Gaussian distribution of spatial stray light, A 2 is the amplitude, σ 2 is the standard deviation of the Gaussian distribution; , They are respectively the horizontal and vertical coordinates of the Gaussian function diffusion center on the display.
8. The method for generating a high-fidelity spatial far-field time-sensitive target optical data set according to claim 6, characterized in that: In step 4, the spatial camera noise is simulated by the following formula: ; in, This is a simulation diagram of the noise of a space camera. It means that the generated rules have a mean of 0 and a variance of The size of a normal distribution is M × N Simulation diagram of space camera noise; is the standard deviation of the space camera noise; M , N are the number of pixel rows and columns of the space camera, respectively, and M = N .
9. The method for generating a high-fidelity spatial far-field time-sensitive target optical data set according to claim 1, characterized in that: In step 5, the specific method of the double loop nesting method is: Step a1, superimposing a spatial stray light simulation image in the spatial stray light simulation image set with all the ideal background star images in the ideal background star image data set; Step a2: Process the next spatial stray light simulation image according to the method of step a1 until all spatial stray light simulation images in the spatial stray light simulation image data set are traversed.
10. The method for generating a high-fidelity spatial far-field time-sensitive target optical data set according to claim 1, characterized in that: In step 6, the specific method of embedding the brightness enhanced image in the brightness enhanced image set into the fused complex starry sky background image in the fused complex starry sky background image data set is: The fused complex starry sky background image in the fused complex starry sky background image data set is read, the brightness enhanced image in the brightness enhanced image data set is matched by modulo operation, and the complex starry sky background image and the matched brightness enhanced image are superimposed one by one.
Citation Information
Patent Citations
Time sensitivity target detection positioning method under airport space relation constraint
CN103456027A
Space-based complex multi-scene space target simulation data set construction method
CN116933567A
Method and apparatus for backlight simulation
US20070124122A1
Cited By
Load identification method and device based on feature restoration
CN120822137A
Load identification method and device based on feature repair
CN120822137B
Space target sequence image generation method and device facing deep space background
CN121213751A
