Method, system and device for simulating luminous objects in a flight simulator visual scene

Abstract

The present invention relates to a method, system, and device for simulating luminous objects in a flight simulator visual scene. The method of the present invention divides imaging intervals in advance according to the simulated distance between the observer and the luminous object, and specifies corresponding control strategies for each imaging interval; determines the imaging interval to which it belongs based on the actual distance between the observer and the luminous object, and controls the light spots emitted by the luminous object using the corresponding control strategies specified for the imaging interval; and displays the controlled light spots in the flight simulator visual scene. The present invention uses the different distances between the luminous object and the observer as a basic basis, combined with a reasonable, differentiated, clear, and stable graphic image rendering strategy, and ultimately controls the display as corresponding simulated light spots in the visual scene system. Therefore, the present invention can ensure that the light spots are clearly visible within a considerable range and are relatively reasonable overall.

Description

Technical Field

[0001] The present invention belongs to the technical field of flight simulators, and in particular relates to a method, system and device for simulating luminous objects in a flight simulator visual scene. Background Art

[0002] The virtual airport lighting imaging in a flight simulator's visual system involves a comprehensive process involving multiple optical effects, the interrelationship of multiple optical interactions, and the integration of multiple light emitters, light receivers, and camera sensing. The size of the light spot image, the position, color, and direction of the airport's light sources (light fixtures), the conditions for the presentation of the optical effects, and the complete controllability of the regularity of airport lighting groups are all crucial elements of the simulator's quality and performance. The virtual airport and its corresponding lighting are essential components of the simulator's visual system. Their performance at night and in scenes with specific light sources is crucial to flight training and instructional effectiveness, the visual system's optical realism, and the rationality of its images.

[0003] In order to meet the requirements of pilot training, the lighting rendering of the flight simulator visual system should meet the following requirements:

[0004] ⒈For the observer, the brightness of a light at a specific location should be accurate and consistent with experience.

[0005] ⒉ For the observer, lights at a longer but upper-bounded distance range should still be visible in the viewing system even if they are less than one pixel according to the perspective law.

[0006] ⒊ Visible light spots should be clear, not affected by post-processing algorithms such as anti-aliasing algorithms, and have no aliasing phenomenon.

[0007] ⒋ The display of light spots should be continuous and should not appear intermittently or flicker.

[0008] However, the current light spot implementation method has the following disadvantages:

[0009] ① Model the lamp and assign specific material properties to the corresponding luminous surfaces of the lamp model. This approach ignores or simplifies the optical physics of the light and considers only ordinary perspective relationships. This method allows the lamp and its light to be visible at close range, and is suitable for rendering many common objects with surface materials and reflective fabrics. However, its representation of objective light sources does not conform to real optical phenomena. When the camera is far away, considering only ordinary perspective relationships may make the light point invisible in the calculated image, and it also does not meet relevant regulations and specifications.

[0010] ② Combining luminous surface material settings with Level of Detail (LOD) technology, long-distance imaging is linearly adjusted through geometric deformation. This solves the long-distance imaging problem to a certain extent, but due to anti-aliasing algorithms and edge blending, the light spot will appear "smudged" at the edges, affecting image clarity. When observing the light spot from different angles, due to the irregular shape of the light spot itself, flickering and aliasing may also occur.

[0011] ③ Offline algorithms and multiple image processing cycles consider only a certain range of viewpoint positions. This approach can mitigate algorithmic time constraints, allowing developers to dynamically observe and refine the imaging results, effectively treating it as an offline rendering process. However, during flight, the simulator generates a continuous 3D spatial coordinate system in real time. The visual system must be able to respond to observations of this changing position in real time, making this approach difficult to apply. Summary of the Invention

[0012] In order to overcome the problems existing in the prior art, the present invention provides a method, system and device for simulating luminous objects in a flight simulator visual scene, which are used to overcome the current defects.

[0013] A method for simulating a luminous object in a flight simulator visual scene, the method comprising the steps of:

[0014] S1. Divide the imaging intervals in advance according to the simulated distance between the observer and the luminous object, and prescribe corresponding control strategies for each of the imaging intervals;

[0015] S2. According to the actual distance between the observer and the luminous object, the imaging interval is determined, and the corresponding control strategy prescribed in the imaging interval is used to control the light spot emitted by the luminous object;

[0016] S3. Display the controlled light spots in the flight simulator visuals.

[0017] According to the above aspects and any possible implementation, an implementation is further provided, characterized in that the imaging interval is an algebraic fitting performance interval, a minimum visible interval, an exit buffer interval and an exit display interval.

[0018] According to the above aspects and any possible implementation manner, an implementation manner is further provided, characterized in that the light-emitting object is a lamp.

[0019] According to the aspects and any possible implementation methods described above, an implementation method is further provided, characterized in that, when the simulation distance is 0 < d < 200m, it belongs to the algebraic fitting performance range; when the simulation distance is 200m≤d < 400m, it belongs to the minimum visible range; when the simulation distance is 400m≤d < 450m, it belongs to the exit buffer zone; when the simulation distance is d ≥450m, it belongs to the exit display area.

[0020] According to the above aspects and any possible implementation, an implementation is further provided, in which the brightness of the light of the lamp is simulated using an attenuation function within the algebraic fitting performance range.

[0021] According to the above aspects and any possible implementation, an implementation is further provided, characterized in that, in the minimum visible range, the perspective and attenuation of the light of the lamp are simulated by using an algebraic fitting function.

[0022] According to the aspects described above and any possible implementation method, an implementation method is further provided, which is characterized in that a behavior decision table is used to control the display of the light of the lamp between the exit display interval and the exit buffer zone, wherein the behavior decision table is a control strategy adopted for light imaging when the lamp belongs to different intervals at the current simulation moment and the previous simulation moment during the simulation process.

[0023] According to the above aspects and any possible implementation, an implementation is further provided, characterized in that when the attenuation function is used for simulation, the brightness of the light of the lamp is at least proportional to the cube of the simulation distance.

[0024] The present invention also provides an airport lighting imaging simulation control system for a flight simulator, wherein the system implements the method of the present invention and includes the following modules:

[0025] The interval judgment module is used to judge the imaging interval according to the simulated distance between the observer and the luminous object during simulation;

[0026] a control module configured to control the light spot emitted by the luminous object by adopting a corresponding control strategy specified in a corresponding imaging interval according to an output of the interval judgment module;

[0027] The display module is used to display the controlled light spots in the visual field of the flight simulator.

[0028] The present invention further provides a computer device, comprising a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the method of the present invention.

[0029] Beneficial effects of the present invention

[0030] Compared with the prior art, the present invention has the following beneficial effects:

[0031] (1) Use different observer distances to achieve reasonable, differentiated, clear, and stable imaging control. Lighting is of great significance to the flight process. At a relatively close distance, it meets the basic lighting simulation characteristics and can still ensure that the light spot is basically visible within the visible range shown by experience.

[0032] (2) The design of the minimal visible area and the exit buffer zone in the present invention solves the problems of flickering and aliasing in light imaging. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 A schematic diagram of partitions according to an embodiment of the present invention;

[0034] Figure 2 A schematic diagram of a method flow diagram of an embodiment of the present invention;

[0035] Figure 3 A schematic diagram of the normal vector of a square drawn for the control of the present invention;

[0036] Figure 4 (a)-4(b) are comparison diagrams of the effects of the present invention and the scaling of the existing three-dimensional model of the simulated lamp;

[0037] Figure 5 (a)-5(b) are comparison diagrams of the effects of the conventional square drawing without orientation control and the present invention. DETAILED DESCRIPTION

[0038] To better understand the technical solutions of the present invention, the present invention includes but is not limited to the specific embodiments described below. Similar technologies and methods should be considered within the scope of protection of the present invention. To further clarify the technical problems, technical solutions, and advantages to be solved by the present invention, the following detailed description is provided in conjunction with the accompanying drawings and specific embodiments.

[0039] It should be understood that the embodiments described herein are only a portion of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative effort are within the scope of protection of the present invention.

[0040] like Figure 2 As shown, a method for simulating a luminous object in a flight simulator visual scene of the present invention comprises the steps of:

[0041] S1. Divide the imaging intervals in advance according to the simulated distance between the observer and the luminous object, and prescribe corresponding control strategies for each of the imaging intervals;

[0042] S2. According to the actual distance between the observer and the luminous object, determine the imaging interval to which it belongs, and use the corresponding control strategy prescribed in the imaging interval to control the light spot emitted by the luminous object;

[0043] S3. Display the controlled light spots in the flight simulator visuals.

[0044] Preferably, the imaging interval consists of four intervals, namely, an algebraic fitting performance interval, a minimum visible interval, an exit buffer zone, and an exit display interval.

[0045] Specifically, the method steps of the present invention are as follows:

[0046] The luminous object of the present invention is realized by using a lamp as a light source. The observer can be a real person or a camera or a video camera, and the present invention does not impose any limitation on this.

[0047] Step 1, such as Figure 1 As shown, the present invention divides the algebraic fitting performance interval, the minimum visible interval, the exit buffer interval and the exit display interval according to the simulated distance between the observer and the luminous object, and determines the brightness representation function f(d) and the pixel size representation function p(d) used in the corresponding interval.

[0048] Here, we use the runway centerline lights at Beijing International Airport as an example to explain and illustrate the simulation. While different airports and lighting fixtures may require different depictions and controls for lighting imaging, this method consistently produces accurate, expected, and designed results.

[0049] The distance between the simulated position of the person and the simulated position of the lamp is d, divided by the following parameters:

[0050] (a) When 0 < d < 200m, it belongs to the algebraic fitting performance range. The control strategy used in this range is to simulate the attenuation characteristics of the light emitted by the lamp with distance. For example, the brightness of the light of the lamp is eight times the cube of the simulated distance, that is, the brightness representation function Or eight times the cube of the simulation distance plus 0.5, that is , or eight times the cube of the simulation distance plus twice the distance, that is, A similar approach can be used to simulate the brightness of light in different ranges, that is, different functions can be used to characterize it, which will not be repeated below.

[0051] (b) When 200m < d < 400m, this is the extremely low visibility range. The control strategy employed in this range involves not only simulating the light's brightness but also controlling the spot size and rendering clarity. Depending on the light's function and color (searchlight, floodlight), the imaging pixels can be controlled using algebraic or statistical fitting. For example, assuming a constant pixel size of four pixels, the pixel size representation function p(d) = 4 is used to control the runway centerline light's imaging pixels. Therefore, when the distance between the person and the light is greater than 200m and less than 400m, the runway centerline light's imaging should always be four pixels. As described below, exiting the buffer and exiting the display area also involve controlling the pixel size of the light spot when drawing. This will not be repeated below.

[0052] (c) When 400m < d < 450m, this is the exit buffer zone. The control strategy for this zone, in addition to controlling the light brightness and imaging pixels, also needs to address issues such as unstable, unreasonable flickering, and aliasing caused by the rapid and irregular switching of the light point's rendering pixels between 1 and 0 during the relative motion of the person and the lamp. To this end, within this exit buffer zone, a behavior decision table is used to determine whether rendering is necessary, taking into account the person-lamp distance at the previous simulation moment.

[0053] (d) When d > 450m, the person exits the display zone. In addition to simulating light brightness and controlling imaging pixels, the control strategy in this zone also addresses issues such as unstable, unreasonable flickering, and aliasing caused by the rapid and irregular transitions between 1 and 0 pixels during motion. To this end, the person-lamp distance at the previous simulation moment is combined with a behavior decision table to determine whether drawing is necessary.

[0054] Furthermore, the behavior decision table referred to in the present invention refers to the specific provisions of the control strategy for light imaging when the current simulation moment and the previous simulation moment belong to different intervals during the simulation process. The behavior decision table of this method is as follows:

[0055]

[0056] The control strategies listed in the above table belong to the control strategies specified in the present invention. Among them, the blank tables in the above table indicate that in discontinuous intervals, such as when the interval to which the previous simulation moment belongs is a buffer zone (with drawing) and the interval to which the current simulation moment belongs is a fitting zone, it indicates that light imaging is impossible, that is, it will not occur in the real world. In this case, the control strategy is blank in the above table of the present invention and will not be described in detail in the present invention.

[0057] Step 2. According to the actual distance between the observer and the luminous object, determine the imaging interval to which it belongs, and use the corresponding control strategy specified in the imaging interval to control the light spot emitted by the luminous object.

[0058] Based on the division of the simulated position of the person and the simulated distance of the lamp in step 1 above, the range of the real-time simulation can be determined during the actual simulation process. It is easy to know that at any time, for any person-lamp pair, based on the distance between the person and the lamp, it can always be determined that for this lamp and the simulated position of the person, the light point characterization applies to a certain range of control strategies. This range is always in one of the algebraic fitting performance range, the minimum visible range, the exit buffer range, or the exit display range. The following is a description of the specific sub-range:

[0059] Step 1. Algebraic fitting to represent the imaging interval

[0060] During the simulation process, for the simulated positions of a lamp and a person, if the distance between them is within the algebraic fitting performance range, steps 2, 3, and 4 will not be implemented when this step is implemented. At the same time, if the distance does not fall within this range, this step does not need to be implemented.

[0061] Based on the brightness representation function f(d) determined in step 1 and the simulated position of the person and the simulated position of the lamp at the current simulation moment, the value of the distance d can be calculated, and thus the value of f(d) can be calculated. Based on the calculated f(d) value, the image is portrayed, that is, a light spot with a brightness of f(d) is drawn. This can be completed by relevant existing hardware equipment, and the drawn light spot is displayed in the visual system.

[0062] Step 2. Imaging of the smallest visible region

[0063] During the simulation process, for the simulated positions of a lamp and a person, if their distance is within the minimum visible range, this step is implemented. Specifically, similar to step 1, the image is portrayed based on the calculated brightness value, that is, the light point corresponding to the brightness value is drawn, the light brightness is simulated, and a regular square is drawn. The other contents of steps 1, 3, and 4 are no longer implemented. At the same time, this step does not need to be implemented when the distance does not belong to this range.

[0064] Similar to step 1, in the extremely small visible range, the distance d and the brightness representation function f(d) can be calculated, and the brightness of the light spot can be calculated from this.

[0065] According to the pixel size representation function p(d) in step 1 and the simulated position of the person and the simulated position of the lamp at the current simulation moment, the value of the distance d can be calculated, and thus the value of p(d) can be calculated.

[0066] In particular, a drawing request is formed at this time, with the light brightness as the analog value, the image as p(d) pixels (width), and the content as a regular square whose normal vector is always parallel to the front of the observer. The image drawn according to this request is as follows Figure 3 This drawing can be completed by related existing hardware devices, and the drawn light spots are displayed in the visual system.

[0067] It should be noted that in the prior art, the 3D model of the simulated lamp is directly scaled and then drawn, and is not replaced with the square as described above. The effect of the prior art and the effect of the method of the present invention are different in imaging under the same scene and observer distance, as shown in FIG. Figure 4 (a) with Figure 4 (b) It can be clearly seen that the prior art linearly scales the original 3D model and then draws it, resulting in an image that is approximately a square with messy light spots around it. When there are a large number of light spots in the image, the large number of messy edges will cause the image to appear flickering and blurred, reducing the image clarity. In addition, the prior art directly draws a square without controlling its normal vector to control the orientation of the square. The imaging differences between its effect and the effect of the method of the present invention under the same scene and observer distance are shown in Figure 2. Figure 5 (a) with Figure 5 (b) It is clear that the existing technology only controls the pixel size. When the model changes its orientation toward the viewpoint, the model's irregularities in various directions, without controlling the normal vector, can lead to messy edges. However, the light points obtained by this method, due to the control of the specified pixels (four in this invention) and the special characteristics of the drawn square, have a near-normal light attenuation around them.

[0068] Step 3. Exit the imaging buffer

[0069] During the simulation, for a lamp and a person, if their distance is within the exit buffer zone, this step is performed, including the light brightness simulation similar to step 1 and the square drawing similar to step 2. Alternatively, no drawing is performed and the other contents of steps 1, 2, and 4 are not performed. Otherwise, this step is not performed.

[0070] In combination with the behavior decision table provided in the present invention, the following control strategy is adopted when exiting the buffer zone:

[0071] ① If the previous simulation moment is in the exit buffer and there is light drawing, or in the minimal visible area, draw a square with brightness and pixel size equal to the pixel size of the square drawn at the previous simulation moment, and facing the current position.

[0072] ② The last simulation moment was in the exit display area, or in the exit buffer and the light was not displayed. In this case, no relevant drawing request is required, or a transparent image with no display effect is drawn.

[0073] Step 4. Exit the imaging display interval

[0074] During the simulation process, for the simulated positions of a lamp and a person, based on their distance, if they are in the exit display range, this step must be implemented and steps 1, 2, and 3 will no longer be implemented. Otherwise, this step of control does not need to be implemented.

[0075] The key to exiting the display interval is to do absolutely nothing, to not contribute to the final image. Upon exiting the display interval, calculations for the relevant light sources can be considered to have ceased. These light sources no longer produce light points and no longer need to participate in scene generation. At this point, there's no need to initiate any drawing requests, or to draw a completely transparent image with no visual effects.

[0076] Step 3. Display the image drawn in step 2 in the visual field of the flight simulator, for example, by projecting it onto a screen or a display device.

[0077] By applying the method of the present invention, it is possible to fully and comprehensively meet various specifications and realize the imaging requirements of the airport's runway centerline lights, runway edge lights, runway touchdown zone lights, runway lights, runway approach lights, runway entrance wing row lights, taxiway exit lights, taxiway edge lights, taxiway centerline lights, marquees, etc. in the visual system, including but not limited to the requirements for color, brightness, visibility, etc. of the imaging images corresponding to the lights. When parameters such as the virtual camera position, the simulated position of a person, or the simulated position of a lamp change during the simulation process, as long as the distance between the two positions can be obtained, the method can be correctly implemented to fully and comprehensively meet the relevant requirements dynamically.

[0078] This method can be implemented as software on hardware devices, systematically simulating and depicting light points in real time to create virtual images. During flight simulation, the simulated motion, along with the brightness and pixel size of the lights visible before and after the motion, can be displayed on the simulator's display for both flight trainees and human viewers.

[0079] By adopting the method of the present invention, the imaging requirements of the airport's runway centerline lights, runway edge lights, runway touchdown zone lights, runway lights, runway approach lights, runway entrance wing row lights, taxiway exit lights, taxiway edge lights, taxiway centerline lights, marquees, etc. in the visual scene can be fully and comprehensively implemented in compliance with various specifications, including but not limited to the requirements of the imaging picture corresponding to the lights in terms of color, brightness, visibility, etc. When parameters such as camera position or virtual scene change, the relevant requirements can also be fully and comprehensively dynamically met.

[0080] The present invention also provides an airport lighting imaging simulation control system for a flight simulator. The system implements the method of the present invention and includes the following modules:

[0081] The interval judgment module is used to judge the imaging interval according to the simulated distance between the observer and the luminous object during simulation;

[0082] a control module configured to control the light spot emitted by the luminous object by adopting a corresponding control strategy specified in a corresponding imaging interval according to an output of the interval judgment module;

[0083] The display module is used to display the controlled light spots in the visual field of the flight simulator.

[0084] The present invention further provides a computer device, comprising a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the method of the present invention.

[0085] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The singular forms "a", "an", "the" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise.

[0086] The foregoing description shows and describes several preferred embodiments of the present invention. However, as previously stated, it should be understood that the present invention is not limited to the form disclosed herein and should not be construed as excluding other embodiments. Rather, the present invention can be used in various other combinations, modifications, and environments and can be modified within the scope of the application concept described herein by the teachings above or by techniques or knowledge in the relevant field. Modifications and variations made by those skilled in the art that do not depart from the spirit and scope of the present invention are intended to be protected by the appended claims.

Claims

1. A method for simulating luminous objects in a flight simulator visual scene, characterized in that: The method comprises the steps of: S1. Divide the imaging intervals in advance based on the simulated distance between the observer and the luminous object, and define corresponding control strategies for each imaging interval. Specifically, when the simulated distance is 0 < d < 200m, the imaging interval is the algebraic fitting performance interval; when the simulated distance is 200m ≤ d < 400m, the imaging interval is the minimum visible interval; when the simulated distance is 400m ≤ d < 450m, the imaging interval is the exit buffer zone; and when the simulated distance is d ≥ 450m, the imaging interval is the exit display zone. S2. Determine the imaging interval based on the actual distance between the observer and the luminous object and control the light point emitted by the luminous object using the corresponding control strategy specified in the imaging interval. The luminous object is a lamp. Within the algebraic fitting performance interval, the brightness of the lamp light is simulated using an attenuation function; S3. Display the controlled light spots in the flight simulator visuals.

2. The method for simulating luminous objects in a flight simulator visual scene according to claim 1, characterized in that: In the minimum visible range, the perspective and attenuation of the light of the lamp are simulated using an algebraic fitting function.

3. The method for simulating luminous objects in a flight simulator visual scene according to claim 1, characterized in that: A behavior decision table is used between the exit display interval and the exit buffer to control the display of the light of the lamp, wherein the behavior decision table is a control strategy adopted for light imaging when the lamp belongs to different intervals at the current simulation moment and the previous simulation moment during the simulation process.

4. The method for simulating luminous objects in a flight simulator visual scene according to claim 1, characterized in that: When the attenuation function is used for simulation, the brightness of the light of the lamp is at least proportional to the cube of the simulation distance.

5. An airport lighting imaging simulation control system for a flight simulator, characterized in that: The system implements the method according to any one of claims 1 to 4, and includes the following modules: The interval judgment module is used to judge the imaging interval according to the simulated distance between the observer and the luminous object during simulation; a control module configured to control the light spot emitted by the luminous object by adopting a corresponding control strategy specified in a corresponding imaging interval according to an output of the interval judgment module; The display module is used to display the controlled light spots in the visual field of the flight simulator.

6. A computer device, characterized in that: The computer device includes a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the method according to any one of claims 1 to 4.

Images