Laser interference image simulation method, device and storage medium

By constructing a laser interference definite scene in a three-dimensional scene and using an open scene rendering engine, the problem of difficult laser interference simulation imaging in the existing technology is solved, and efficient and convenient laser interference image simulation is achieved, reducing the testing cost.

CN116778051BActive Publication Date: 2025-05-02VIRE TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310701924.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-06-14
Publication Date
2025-05-02
Estimated Expiration
2043-06-14

AI Technical Summary

Technical Problem

The prior art is difficult to realize laser interference simulation imaging without constructing a real test environment, resulting in high testing costs and high difficulty.

Method used

By constructing a laser interference definite scene in a three-dimensional scene, using the open scene diagram rendering engine, the intersection point between the laser beam and the head-up display camera is determined, and the laser interference texture image is drawn on the plane of the head-up display camera viewport, thereby realizing laser interference simulation imaging.

Benefits of technology

It realizes that when combined testing of actual equipment is separated from actual equipment, software simulation is used to generate laser interference image simulation effects, providing efficient and convenient image data support, and maximizes the experimental testing cost.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116778051B_ABST
    Figure CN116778051B_ABST
Patent Text Reader

Abstract

The present application provides a laser interference image simulation method, device and storage medium. The method includes: constructing a laser interference hypothetical scene in a three-dimensional scene, the hypothetical scene includes an interfered target and a laser interference transmitter, wherein the laser interference transmitter emits a laser beam to interfere with the interfered target by laser irradiation; constructing a main camera viewport with the interfered target, and constructing a head-up display camera on the main camera viewport; determining the intersection of the laser beam and the spatial plane where the head-up display camera is located; drawing a laser interference texture image on the head-up display camera viewport plane; and rendering the laser interference texture image using an open scene graph rendering engine. According to the technical solution of the present application, it is achieved that the laser interference image simulation effect is generated by software simulation without the actual equipment joint test.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of simulation, and in particular to a laser interference image simulation method, device and storage medium. Background Art

[0002] Since the real environment is complex and changeable, and the testing cost is high, it is difficult to collect data from various real environments for testing and data analysis at any time. Therefore, it is particularly important to use the data of laser interference simulation imaging for data testing and analysis. The Chinese patent document "Laser Interference Effect Simulation Method Based on Measured Images" (CN107507237A) discloses a technical solution that uses a bulletin board (Billboard) to extract measured information for laser interference simulation. Tsinghua University Press's "Open Scene Graph (OSG) 3D Rendering Engine Programming Guide" (ISBN 978-7-302-21303-1) explains the use of OSG 3D rendering engine to build 3D simulation scenes and related imaging technologies. The existing technology cannot yet achieve laser simulation interference imaging. Summary of the invention

[0003] In view of this, the present application provides a laser interference image simulation method, device and storage medium to overcome the problems of high cost and difficulty in building a real test environment.

[0004] According to one aspect of the present application, the present application provides a laser interference image simulation method, the method comprising:

[0005] Constructing a laser jamming scenario in a three-dimensional scene, the scenario including a jammed target and a laser jamming transmitter, wherein the laser jamming transmitter emits a laser beam to perform laser irradiation interference on the jammed target;

[0006] Construct the main camera viewport with the disturbed target, and construct the head-up display camera on the main camera viewport;

[0007] Determine the intersection point of the laser beam and the spatial plane where the head-up display camera is located;

[0008] Draw the laser interference texture image on the HUD camera viewport plane;

[0009] The laser interference texture image is rendered using the open scene graph rendering engine.

[0010] Preferably, after drawing the laser interference texture image on the head-up display camera viewport plane, the method further includes: processing the laser interference texture image by using a shader to generate a dynamic diffraction aperture.

[0011] Preferably, the laser beam is a regular quadrangular prism laser beam.

[0012] Preferably, the intersection points of the laser beam and the space plane where the head-up display camera is located are four intersection points of the regular quadrangular prism laser beam and the space plane where the head-up display camera is located.

[0013] Preferably, drawing the laser interference texture image on the head-up display camera viewport plane includes: using the four intersection points as four vertices of the interference texture image, converting from the open scene graph world coordinates to the head-up display camera viewport two-dimensional coordinates, and drawing the laser interference texture image on the head-up display camera viewport plane.

[0014] Preferably, processing the laser interference texture image by using a shader to generate a dynamic diffraction aperture comprises:

[0015] Taking the center of the laser interference texture image as the origin, expand outwards to a preset radius pixel length to form a main light spot;

[0016] The transparency of the corresponding texture pixel unit is calculated using trigonometric functions with the length λ as the wavelength outside the preset radius, and a halo with a gradient transparency is obtained.

[0017] Preferably, the method further comprises:

[0018] Aperture fluctuation is achieved by coordinating the timing of the color filter system.

[0019] The present application provides a laser interference image simulation device, which includes:

[0020] A construction module is used to construct a laser jamming scenario in a three-dimensional scene, wherein the scenario includes a jammed target and a laser jammer, wherein the laser jammer emits a laser beam to perform laser irradiation interference on the jammed target; a main camera viewport is constructed with the jammed target, and a head-up display camera is constructed on the main camera viewport;

[0021] An intersection determination module, used to determine the intersection of the laser beam and the spatial plane where the head-up display camera is located;

[0022] A drawing module, used to draw the laser interference texture image on the head-up display camera viewport plane;

[0023] The rendering module is used to render the laser interference texture image using an open scene graph rendering engine.

[0024] Preferably, the drawing module is further used to process the laser interference texture image using a shader to generate a dynamic diffraction aperture.

[0025] Preferably, the laser beam is a regular quadrangular prism laser beam.

[0026] The present application also provides a computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, enable the processors to perform any of the methods described.

[0027] According to the technical solution of the present application, it is well achieved that the laser interference image simulation effect is generated by software simulation without the actual equipment joint test, which provides more efficient and convenient image data support for the testing and analysis of various optical sensors and anti-interference equipment, and compresses the experimental testing cost to the greatest extent. According to the technical solution of the present application, it is avoided to use real equipment to construct laser interference test scenarios in various real environments, so as not to be restricted by the environment and experimental equipment. Other features and advantages of the present application will be described in detail in the subsequent specific implementation method section. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The accompanying drawings constituting a part of the present application are used to provide a further understanding of the present application, and the schematic implementation modes and descriptions of the present application are used to explain the present application. In the accompanying drawings:

[0029] Figure 1 This is the process of laser interference simulation imaging based on OSG rendering engine provided by this application;

[0030] Figure 2 It is a schematic diagram of a laser interference scenario constructed using an OSG rendering engine provided by the present application;

[0031] Figure 3 It is a schematic diagram of the intersection of the laser beam and the HUD camera plane and texture provided by the present application;

[0032] Figure 4 A schematic diagram of generating a Poisson diffraction aperture by using a shader to calculate the interference texture plane provided in this application;

[0033] Figure 5-Figure 10 It is the final effect diagram generated by the laser jammer provided by the present application irradiating the target sensor at different angles;

[0034] Fig.11 It is a schematic diagram of the laser interference simulation device provided in this application. DETAILED DESCRIPTION

[0035] It should be noted that, in the absence of conflict, the embodiments of the present application and the features in each embodiment may be combined with each other.

[0036] The present application will be described in detail below with reference to the accompanying drawings and in combination with implementation modes.

[0037] The present application provides a laser interference simulation method, the method comprising:

[0038] Constructing a laser jamming scenario in a three-dimensional scene, the scenario including a jammed target and a laser jamming transmitter, wherein the laser jamming transmitter emits a laser beam to perform laser irradiation interference on the jammed target;

[0039] Construct the main camera viewport with the disturbed target, and construct the head-up display camera on the main camera viewport;

[0040] Determine the intersection point of the laser beam and the spatial plane where the head-up display camera is located;

[0041] Draw the laser interference texture image on the HUD camera viewport plane;

[0042] The laser interference texture image is rendered using the open scene graph rendering engine.

[0043] Preferably, after drawing the laser interference texture image on the head-up display camera viewport plane, the method further includes: processing the laser interference texture image by using a shader to generate a dynamic diffraction aperture.

[0044] Figure 1 The flowchart of the laser interference simulation imaging method based on the OSG rendering engine of this application is presented, which specifically includes:

[0045] Step 101, constructing a laser jamming scenario in the OSG world coordinate system, including necessary laser transmitter models, jammed models (missiles) and other model objects;

[0046] like Figure 2 As shown, for the display, the OSG world coordinate system OXYZ has an X-axis pointing to the right side of the screen, a Y-axis pointing to the inside of the screen, and a Z-axis pointing to the top of the screen.

[0047] For example, in the current hypothetical scenario, a fighter jet launches a missile to attack a detector, and a laser transmitter emits a light beam to track and illuminate the warhead to interfere with its guidance state, preventing the missile from destroying the detector.

[0048] In the OSG three-dimensional scene, the real-time coordinates of the laser emitter are known to be LEPos and the real-time coordinates of the missile are known to be MPos. By calculating the azimuth and pitch of MPos relative to LEPos with the emitter coordinate LEPos as the center, the laser can be locked on the detector head of the missile according to the azimuth and pitch.

[0049] Step 102, constructing a Head Up Display (HUD) camera on the main camera viewport (ballistic view);

[0050] like Figure 3As shown, point F is the focus of the main viewport camera, A, B, C, and D represent the four corner points of the viewport and also the four intersection points of the screen. Based on the main camera, a HUD camera plane A`B`C`D` is constructed to draw the realistic laser interference texture image.

[0051] Step 103, using a regular quadrangular prism to simulate a light column, and obtaining four intersection points according to the laser incident vector and the space plane where the HUD is located;

[0052] exist Figure 3 Before solving the intersection point, the camera principal axis vector in the OSG world coordinate system must be calculated. and Assume that the initial unit vector in the OSG world coordinate system is Then calculate The formula is as follows:

[0053]

[0054] Among them, M a is the orientation rotation matrix, M p is the pitch rotation matrix, M r is the roll rotation matrix, M pos is the translation matrix, which can also be calculated through the above process vector. Since the beam is going to intersect the plane, the vector and The angle θ between them must be greater than 90°:

[0055]

[0056] When θ is greater than 90°, it means there is an intersection point. At this time, the unit normal vector of the HUD camera plane is known ( Unitization is sufficient), and the real-time viewpoint coordinates P or P` (X P ,Y P ,Z P ), according to the point method:

[0057] A(XX P )+B(YY P )+C(ZZ P )=0;

[0058] You can get the equation expression of the plane in the OSG coordinate system, and then according to the vector The real-time coordinates of the laser emission point E (X E ,Y E ,Z E ) and the radius r of the light column, and after translation, we get the three-dimensional parameterized equations of the straight lines GG`, HH`, KK`, and JJ`:

[0059]

[0060] Where (m,n,p) is a vector The unit vector of , where (X0, Y0, Z0) represent Pan The coordinates of the points G, H, K, and J after the distance to GG`, HH`, KK`, and JJ` can be obtained by intersecting the straight line and the plane equation to obtain the coordinates of the four intersection points G`(X G` ,Y G` ,Z G` ), H`(X H` ,Y H` ,Z H` ), K`(X K` ,Y K` ,Z K` ), J`(X J` ,Y J` ,Z J` ). Where (m,n,p) is a vector The normal vector of , t is the parameter in the parametric equation.

[0061] Step 104, drawing a laser interference texture image on the HUD camera plane;

[0062] In step 103, the coordinates of the four intersection points in the OSG world coordinate system have been calculated. Since the laser interference texture image is drawn on the HUD camera plane, that is, on the screen two-dimensional coordinate system, it is necessary to convert the OSG world coordinates into the screen two-dimensional coordinates, according to the formula for converting the OSG world coordinates to the screen two-dimensional coordinate system:

[0063] ScreenPos(X,Y)=WordPos(X,Y,Z)*M V *M P *M W

[0064] Where M V is the main camera view matrix, M P is the projection matrix, M W is the window transformation matrix. The four HUD screen coordinate points obtained by calculation are used as the four vertex coordinates of the interference texture image, and the projected and deformed laser interference texture image is drawn to the HUD camera viewport plane. Among them, WordPos(X,Y,Z) corresponds to the coordinates of the intersection points G', H', K', and J'.

[0065] Step 105: perform secondary processing on the drawn laser interference texture image using a shader to generate a dynamic diffraction aperture.

[0066] like Figure 4As shown, with the center of the texture as the origin, the pixel length of the radius d is expanded outward. The main spot area in this circular area is not calculated. From the radius d, the transparency of the corresponding texture pixel unit is calculated using trigonometric functions with the length λ as the wavelength, and a circle of halo with gradually changing transparency is obtained. The refresh increment of the rendering frame time is used as the trigonometric function angle parameter factor (50.*(d+osg_FrameTime*0.1)*3.1415926) to achieve the aperture fluctuation effect. The fragment shader calculation program is as follows:

[0067]

[0068]

[0069] Among them, vCoord is the pixel coordinate, color is the pixel unit rgba value, osg_FrameTime is the rendering frame time of the OSG rendering engine, and gl_FragColor is the rendering color of the final texture fragment.

[0070] Step 106, based on the step-by-step construction and calculation of steps 101-105, the laser interference texture image is rendered and displayed on the window interface using the OSG rendering engine.

[0071] like Figure 5-Figure 10 As shown, this is the final effect produced by the laser emitter irradiating the missile detector at various angles. The diffraction fluctuation effect cannot be viewed through images and requires watching the video to see the effect.

[0072] This application provides a method for realizing laser interference simulation imaging based on the OSG rendering engine. The method includes the construction of a laser interference scenario; constructing a HUD camera for laser interference imaging in the OSG rendering scene; dynamically calculating the vertex coordinates of the laser interference texture image on the HUD camera in real time according to the logical and spatial relationship of each instance model object in the scenario; using a shader to calculate the dynamic fluctuation of the Poisson diffraction aperture under laser interference; dynamically rendering and displaying the final effect of the interference; according to the technical solution of this application, it is well realized that in the case of being separated from the actual equipment joint test, the laser interference image simulation effect is simulated and generated using a pure software algorithm, providing more efficient and convenient image data support for the testing and analysis of various optical sensors and anti-interference equipment, and compressing the experimental test cost to the greatest extent.

[0073] The present application provides a method for implementing laser interference simulation imaging based on an OSG rendering engine, the method comprising:

[0074] Construct a scenario of laser interference model system in a three-dimensional scene;

[0075] The hypothetical scene includes the interfered target, laser jammer, background terrain, etc. All models are added to the scene according to the OSG world coordinates;

[0076] In a three-dimensional scene, the laser jammer emits a laser beam to interfere with the interfered target, thereby limiting the movement of the interfered target.

[0077] Taking the detection sensor of the interfered target as the first perspective, the real-time motion state of the interfered target including position and posture is simulated. The OSG 3D scene viewport will render and display the 3D scene image from the perspective of the interfered target in real time.

[0078] The image of the three-dimensional scene is displayed with the sensor of the disturbed target model as the first perspective;

[0079] A HUD camera for displaying and drawing the laser jamming effect is superimposed on the first viewport. When the laser emitter illuminates the jammed target sensor, the jamming effect will be drawn on the HUD camera in real time.

[0080] A HUD camera that overlays the scene's main viewport camera to display interference.

[0081] When both the laser emitter and the interfered target are moving in the scene, the intersection of the light beam emitted by the laser emitter and the spatial plane where the HUD camera is located is calculated based on the real-time position and posture of the laser emitter and the interfered target;

[0082] In order to facilitate the drawing of interference texture and reflect the parallel characteristics of the laser beam, the intersection coordinates of the four prism and the HUD camera plane are calculated, that is, the vertex coordinates of the interference texture are drawn, and then the texture is drawn to the HUD camera in real time according to the vertex coordinates.

[0083] Calculate the vertex coordinates of the interference texture in real time and draw the texture onto the HUD camera plane.

[0084] After the texture is drawn, in order to reflect the authenticity of the interference, the texture image is post-processed using the Shader shader to generate a dynamically fluctuating Poisson diffraction aperture, and then the final effect is displayed in the interface viewport.

[0085] According to one aspect of the present application, a method for implementing laser interference simulation imaging based on an OSG rendering engine is provided, the method comprising:

[0086] Use OSG rendering engine to build laser interference scenario;

[0087] Add moving model nodes in the scene according to the OSG world coordinate system;

[0088] Draw a HUD camera that displays the interference effect overlayed on the main viewport camera;

[0089] The intersection point between the light beam emitted by the laser jammer and the plane where the HUD camera is located is calculated in real time, and the jamming effect diagram is drawn according to the coordinates of the intersection point.

[0090] On the basis of the existing interference effect, the texture of the interference image is processed again using a shader to form a fluctuating Poisson diffraction aperture, ultimately showing a real interference effect.

[0091] The present application also provides a laser interference image simulation device, such as Fig.11 As shown, the device includes: a construction module, which is used to construct a laser interference hypothetical scene in a three-dimensional scene, and the hypothetical scene includes an interfered target and a laser interference transmitter, wherein the laser interference transmitter emits a laser beam to perform laser irradiation interference on the interfered target; a main camera viewport is constructed with the interfered target, and a head-up display camera is constructed on the main camera viewport; an intersection determination module is used to determine the intersection of the laser beam and the space plane where the head-up display camera is located; a drawing module is used to draw a laser interference texture image on the head-up display camera viewport plane; and a rendering module is used to render the laser interference texture image using an open scene graph rendering engine.

[0092] The present application also provides a computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, enable the processors to perform any of the methods described.

[0093] The above description is only a preferred implementation mode of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A laser interference image simulation method, characterized in that: The method includes: Constructing a laser jamming scenario in a three-dimensional scene, the scenario including a jammed target and a laser jamming transmitter, wherein the laser jamming transmitter emits a laser beam to perform laser irradiation interference on the jammed target; Construct the main camera viewport with the disturbed target, and construct the head-up display camera on the main camera viewport; Determine the intersection point of the laser beam and the spatial plane where the head-up display camera is located; Draw the laser interference texture image on the HUD camera viewport plane; Rendering laser interference texture images using the open scene graph rendering engine; The laser beam is a regular quadrangular prism laser beam; The intersection points of the laser beam and the space plane where the head-up display camera is located are four intersection points of the regular quadrangular prism laser beam and the space plane where the head-up display camera is located; Drawing the laser interference texture image on the head-up display camera viewport plane includes: using the four intersection points as four vertices of the interference texture image, converting from the open scene graph world coordinates to the head-up display camera viewport two-dimensional coordinates, and drawing the laser interference texture image on the head-up display camera viewport plane.

2. The method according to claim 1, characterized in that After drawing the laser interference texture image on the head-up display camera viewport plane, the method also includes: using a shader to process the laser interference texture image to generate a dynamic diffraction aperture.

3. The method according to claim 1, characterized in that The use of shaders to process laser interference texture images to generate dynamic diffraction apertures includes: Taking the center of the laser interference texture image as the origin, expand outwards to a preset radius pixel length to form a main light spot; The transparency of the corresponding texture pixel unit is calculated using trigonometric functions with the length λ as the wavelength outside the preset radius, and a halo with a gradient transparency is obtained.

4. The method according to claim 3, characterized in that The method further includes: Aperture fluctuation is achieved by coordinating the timing of the color filter system.

5. A laser interference image simulation device, characterized in that: The device includes: A construction module is used to construct a laser jamming scenario in a three-dimensional scene, wherein the scenario includes a jammed target and a laser jammer, wherein the laser jammer emits a laser beam to perform laser irradiation interference on the jammed target; a main camera viewport is constructed with the jammed target, and a head-up display camera is constructed on the main camera viewport; An intersection determination module, used to determine the intersection of the laser beam and the spatial plane where the head-up display camera is located; A drawing module, used to draw the laser interference texture image on the head-up display camera viewport plane; A rendering module, used for rendering the laser interference texture image using an open scene graph rendering engine; The laser beam is a regular quadrangular prism laser beam; The intersection points of the laser beam and the space plane where the head-up display camera is located are four intersection points of the regular quadrangular prism laser beam and the space plane where the head-up display camera is located; Drawing the laser interference texture image on the head-up display camera viewport plane includes: using the four intersection points as four vertices of the interference texture image, converting from the open scene graph world coordinates to the head-up display camera viewport two-dimensional coordinates, and drawing the laser interference texture image on the head-up display camera viewport plane.

6. The device according to claim 5, characterized in that The drawing module is also used to process the laser interference texture image using a shader to generate a dynamic diffraction aperture.

7. A computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, cause the processors to perform the method according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Actual measurement image-based laser source interference effect simulation method

    CN107507237A

  • Saturated crosstalk and lateral spot modeling simulation method for laser irradiation TDI-CCD (Trandport Driver Interface-Charge Coupled Device)

    CN108269252A