Multi-eye point correction method and device for projection image

Abstract

The present invention provides a method and device for correcting multiple eye points of a projected image, and a computer-readable storage medium. The method comprises the following steps: determining the first coordinates of multiple pixel points of the projected image in the first coordinate system of the projection screen; respectively determining the conversion relationship of the second coordinate system of multiple observation eye points relative to the first coordinate system; respectively determining the second coordinate of each pixel point in each second coordinate system according to each conversion relationship; determining the attention coefficient of each observation eye point; respectively calculating the minimum error of at least one pixel point of each picture unit moving in the same direction according to the attention coefficient of each observation eye point and the second coordinate of at least one pixel point of each picture unit in the corresponding second coordinate system; and correcting the position of at least one pixel point of the corresponding picture unit according to the moving direction and moving distance corresponding to the minimum error.

Description

Technical Field

[0001] The present invention relates to a correction technology for projection images, and in particular to a multi-eye point correction method for projection images, a multi-eye point correction device for projection images, and a computer-readable storage medium. Background Art

[0002] A flight simulator is a machine used to simulate flight scenes of aviation / aerospace devices such as airplanes and spacecraft. It can reproduce the internal and external environment of the aircraft and provide the trainee with a corresponding operating interface for flight training or flight testing. According to different performances, simulators can be divided into four levels from low to high: A, B, C, and D. Among them, the visual system of the highest level D simulator generally adopts multi-channel projection to produce a more impactful and immersive visual effect. However, image distortion is inevitable in the process of multi-channel projection, so the visual image generated by the projection needs to be geometrically corrected.

[0003] The existing multi-channel projection technology mainly focuses on the image fusion correction direction of multi-channel projection, and only involves the projection image correction scheme of a single eye point. However, for a flight simulator, its projection image involves two observation eye points of the main pilot and the co-pilot. Observing the projection image from different eye points will produce different distortion effects. For the distortion correction of the main and co-pilot eye points in the simulator cockpit, the existing schemes mostly use a theodolite to measure and correct each point projected onto the Mylar film based on the left (main pilot) and right (co-pilot) eye points, and repeat this operation in large quantities until the correction of multiple observation eye points is finally completed. Therefore, there are defects such as cumbersome operation and long time consumption.

[0004] In order to overcome the above-mentioned defects of the prior art, the art urgently needs a projection picture correction technology for efficiently and reliably realizing multi-eye point correction of the projection picture, thereby promoting the standardization and intelligent development of multi-channel projection technology. Summary of the invention

[0005] A brief summary of one or more aspects is given below to provide a basic understanding of these aspects. This summary is not an exhaustive overview of all conceived aspects, and is neither intended to identify the key or decisive elements of all aspects nor to define the scope of any or all aspects. Its only purpose is to give some concepts of one or more aspects in a simplified form as a prelude to a more detailed description that will be given later.

[0006] In order to overcome the above-mentioned defects of the prior art, the present invention provides a multi-eye point correction method for a projection picture, a multi-eye point correction device for a projection picture, and a computer-readable storage medium, which can efficiently and reliably realize multi-eye point correction of the projection picture, thereby promoting the standardization and intelligent development of multi-channel projection technology.

[0007] Specifically, the multi-eye-point correction method for the above-mentioned projection screen provided according to the first aspect of the present invention includes the following steps: determining the first coordinates of multiple pixel points of the projection screen in the first coordinate system of the projection screen, wherein each at least one pixel point constitutes a screen unit; respectively determining the transformation relationship of the second coordinate system of multiple observation eye points relative to the first coordinate system; according to each of the transformation relationships, respectively determining the second coordinate of each of the pixel points in each of the second coordinate systems; determining the attention coefficient of each of the observation eye points; according to the attention coefficient of each of the observation eye points and the second coordinate of at least one of the pixel points of each of the screen units in the corresponding second coordinate system, respectively calculating the minimum error of at least one of the pixel points of each of the screen units for the same-direction movement; and correcting the position of at least one of the pixel points of the corresponding screen unit according to the moving direction and moving distance corresponding to the minimum error.

[0008] Furthermore, in some embodiments of the present invention, the step of determining the first coordinates of multiple pixel points of the projection image in the first coordinate system of the projection screen includes: constructing the first coordinate system of the projection screen with the design eye point of the projection screen as the origin; and determining the first coordinate of each pixel point based on the relative position of each pixel point and the design eye point.

[0009] Further, in some embodiments of the present invention, the projection screen is a projection spherical screen. The projection spherical screen includes, but is not limited to, various forms of curved projection screens such as standard spheres, ellipsoids, and distorted spheres. The step of constructing the first coordinate system of the projection screen with the design eye point of the projection screen as the origin includes: establishing an XYZ coordinate system with the design eye point as the origin, the positive longitude direction as the positive direction of the X axis, and the positive latitude direction as the positive direction of the Z axis, wherein the positive direction of the Y axis is perpendicular to the positive direction of the X axis and the positive direction of the Z axis.

[0010] Further, in some embodiments of the present invention, the step of respectively determining the conversion relationship of the second coordinate system of multiple observation points relative to the first coordinate system includes: taking each observation point as the origin, respectively constructing a second coordinate system for each observation point, wherein the second coordinate system is a longitude and latitude coordinate system, including longitude coordinates indicating longitude positions and latitude coordinates indicating latitude positions; and according to the relative positions of each observation point and the design point, respectively determining the conversion relationship of converting any point (x, y, z) in the first coordinate system to the corresponding second coordinate system.

[0011] Further, in some embodiments of the present invention, the step of determining the second coordinates of each pixel point in each second coordinate system according to each conversion relationship includes: determining the second coordinates (lat', lon') of each pixel point (x, y, z) of the projection screen in each second coordinate system according to each conversion relationship.

[0012] Furthermore, in some embodiments of the present invention, the step of determining the attention coefficient of each observation eye point includes: determining the attention coefficient of each observation eye point with respect to each picture unit according to the position of each picture unit in the projection picture.

[0013] Furthermore, in some embodiments of the present invention, the step of determining the attention coefficient of each observation eye point with respect to each picture unit according to the position of each picture unit in the projection picture includes: configuring a higher attention coefficient for an observation eye point that is closer to the picture unit, and configuring a lower attention coefficient for an observation eye point that is farther from the picture unit.

[0014] Furthermore, in some embodiments of the present invention, the step of configuring a higher attention coefficient for an observation eye point that is closer to the picture unit and configuring a lower attention coefficient for an observation eye point that is farther from the picture unit includes: dividing the multiple pixel points into multiple correction areas according to the positions of the multiple pixel points in the projection picture; and for each of the correction areas, configuring a higher attention coefficient for the observation eye point that is closer to the picture unit therein, and configuring a lower attention coefficient for the observation eye point that is farther from the picture unit therein.

[0015] Further, in some embodiments of the present invention, the projection screen is symmetrical about the design eye point. The multiple observation eye points are also symmetrical about the design eye point. The step of correcting the position of at least one pixel point of the corresponding picture unit according to the moving direction and moving distance corresponding to the minimum error includes: dividing the multiple pixel points into multiple correction areas according to the design eye point, wherein each correction area is symmetrical about the design eye point; correcting the position of at least one pixel point of the corresponding picture unit of the corresponding correction area according to the moving direction and moving distance corresponding to the minimum error; and in response to completing the correction of the position of each pixel point of the corresponding correction area, performing symmetrical correction on each pixel point of the remaining correction areas according to the position of each pixel point that has undergone the correction about the design eye point.

[0016] Furthermore, in some embodiments of the present invention, the moving direction and moving distance corresponding to the minimum error include longitude displacement and latitude displacement.

[0017] Furthermore, in some embodiments of the present invention, the projection screen is provided in a flight simulator. The projection screen is a flight simulation screen. The multiple observation eye points include a primary pilot eye point and a secondary pilot eye point.

[0018] In addition, the multi-eyepoint correction device for the projection image provided according to the second aspect of the present invention comprises a memory and a processor. The processor is connected to the memory and configured to implement the multi-eyepoint correction method for the projection image provided according to the first aspect of the present invention.

[0019] In addition, the computer-readable storage medium provided according to the third aspect of the present invention stores computer instructions, which, when executed by a processor, implement the multi-eye point correction method for projection images provided by the first aspect of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above features and advantages of the present invention can be better understood after reading the detailed description of the embodiments of the present disclosure in conjunction with the following drawings. In the drawings, the components are not necessarily drawn to scale, and components with similar related properties or features may have the same or similar reference numerals.

[0021] Figure 1 A schematic flow chart of a method for correcting multiple eye points of a projection image according to some embodiments of the present invention is shown.

[0022] Figure 2A and Figure 2B A schematic diagram of an XYZ coordinate system provided according to some embodiments of the present invention is shown.

[0023] Figure 3 A schematic diagram of a projection picture to be corrected according to some embodiments of the present invention is shown.

[0024] Figure 4 A schematic diagram of a curve showing the horizontal interval in longitude between pixels in a projection picture to be corrected according to some embodiments of the present invention is shown.

[0025] Figure 5 A schematic diagram of a projection picture after left area correction provided according to some embodiments of the present invention is shown.

[0026] Figure 6 A schematic diagram of a curve showing the horizontal interval in longitude between pixels when observing a corrected projection picture based on a left eye point according to some embodiments of the present invention is shown. DETAILED DESCRIPTION

[0027] The following specific embodiments illustrate the implementation of the present invention, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Although the description of the present invention will be introduced in conjunction with the preferred embodiment, this does not mean that the features of this invention are limited to this implementation. On the contrary, the purpose of introducing the invention in conjunction with the implementation is to cover other options or modifications that may be extended based on the claims of the present invention. In order to provide a deep understanding of the present invention, the following description will include many specific details. The present invention can also be implemented without using these details. In addition, in order to avoid confusion or blurring the focus of the present invention, some specific details will be omitted in the description.

[0028] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0029] In addition, the terms "upper", "lower", "left", "right", "top", "bottom", "horizontal" and "vertical" used in the following description should be understood as the directions shown in the paragraph and the related drawings. Such relative terms are only used for the convenience of description and do not mean that the device described therein must be manufactured or operated in a specific direction, and therefore should not be understood as limiting the present invention.

[0030] It is understood that although the terms "first", "second", "third", etc. may be used herein to describe various components, regions, layers and / or parts, these components, regions, layers and / or parts should not be limited by these terms, and these terms are only used to distinguish different components, regions, layers and / or parts. Therefore, the first component, region, layer and / or part discussed below may be referred to as a second component, region, layer and / or part without departing from some embodiments of the present invention.

[0031] As mentioned above, the existing multi-channel projection technology mainly focuses on the image fusion correction direction of multi-channel projection, and only involves the projection image correction scheme of a single eye point. However, for a flight simulator, its projection image involves two observation eye points of the main pilot and the co-pilot. Observing the projection image from different eye points will produce different distortion effects. For the distortion correction of the main and co-pilot eye points in the simulator cockpit, the existing schemes mostly use a theodolite to measure and correct each point projected onto the Mylar film based on the left (main pilot) and right (co-pilot) eye points, and repeat this operation in large quantities until the correction of multiple observation eye points is finally completed. Therefore, there are defects such as cumbersome operation and long time consumption.

[0032] In order to overcome the above-mentioned defects of the prior art, the present invention provides a multi-eye point correction method for a projection picture, a multi-eye point correction device for a projection picture, and a computer-readable storage medium, which can efficiently and reliably realize multi-eye point correction of the projection picture, thereby promoting the standardization and intelligent development of multi-channel projection technology.

[0033] In some non-limiting embodiments, the multi-eyepoint correction method for the above-mentioned projection screen provided by the first aspect of the present invention can be implemented by the multi-eyepoint correction device provided by the second aspect of the present invention. Specifically, the multi-eyepoint correction device can be configured in the projection system of the flight simulator and / or the projection device mounted on the flight simulator in the form of a software program and / or a hardware device. Further, the multi-eyepoint correction device can be configured with a memory and a processor. The memory includes but is not limited to the computer-readable storage medium provided by the third aspect of the present invention, on which computer instructions are stored. The processor is connected to the memory and is configured to execute the computer instructions stored on the memory to implement the multi-eyepoint correction method for the above-mentioned projection screen provided by the first aspect of the present invention.

[0034] The working principle of the above-mentioned multi-eyepoint correction device will be described below in conjunction with some embodiments of the multi-eyepoint correction method. Those skilled in the art will understand that these multi-eyepoint correction methods are only some non-limiting implementation methods provided by the present invention, which are intended to clearly demonstrate the main concept of the present invention and provide some specific solutions that are convenient for the public to implement, rather than to limit all functions or all working modes of the multi-eyepoint correction device. Similarly, the multi-eyepoint correction device is also only a non-limiting implementation method provided by the present invention, and does not constitute a limitation on the implementation subject of each step in these multi-eyepoint correction methods.

[0035] Please refer to Figure 1 , Figure 1 A schematic flow chart of a method for correcting multiple eye points of a projection image according to some embodiments of the present invention is shown.

[0036] like Figure 1As shown, in the process of projecting a flight simulation picture onto a projection screen of a flight simulator, the multi-eye point correction device may first determine first coordinates of a plurality of pixel points of the projection picture in a first coordinate system of the projection screen.

[0037] In some embodiments, the projection screen configured in the flight simulator can be a projection spherical screen made of Mylar film to produce a more impactful and immersive visual effect. Here, the projection spherical screen includes but is not limited to various forms of curved projection screens such as partial (e.g., 1 / 4, 1 / 3, 1 / 2, 2 / 3, 3 / 4) standard spherical surface, partial ellipsoidal surface, partial distorted spherical surface, etc. The multi-eye point correction device can first use the design eye point of the projection screen as the origin O to construct the first coordinate system of the projection screen.

[0038] Please refer to Figure 2A and Figure 2B , Figure 2A and Figure 2B Schematic diagram of an XYZ coordinate system provided according to some embodiments of the present invention is shown. Figure 2A and Figure 2B In the embodiment shown, the first coordinate system can be selected as an XYZ three-dimensional coordinate system. The multi-eyepoint correction device can determine the design eyepoint of the projection screen as the origin O of the XYZ three-dimensional coordinate system, determine the positive longitude direction as the positive direction of the X axis, determine the negative longitude direction as the positive direction of the X axis, determine the positive latitude direction as the positive direction of the Z axis, and determine the negative latitude direction as the negative direction of the Z axis, and then determine the positive Y axis direction and the negative Y axis direction of the XYZ three-dimensional coordinate system according to the vertical direction of the positive X axis and the positive Z axis, so as to establish the XYZ coordinate system (i.e., the first coordinate system) of the projection screen. In the first coordinate system, the XOY plane is parallel to the horizontal plane of the flight simulator cockpit, and the YOZ plane is perpendicular to the horizontal plane of the flight simulator cockpit.

[0039] Further, in some embodiments, considering that the Civil Aviation Administration requires the visual system to have a horizontal field of view of 180° and a vertical field of view of 40° for a Class D simulator, the uniform angular spacing of a 5° square does not exceed ±1°, and the angular spacing of adjacent squares does not exceed ±1.5°, in the above-mentioned first coordinate system, the value range of the X coordinate may be [-90,90], and the value range of the Y coordinate may be [-20,20]. Further, for ease of understanding, the following description will be based on a projection screen of a standard sphere.

[0040] After constructing the first coordinate system of the projection screen, the multi-eye point correction device can determine the first coordinate of each pixel point in the first coordinate system according to the relative position of each pixel point in the projection picture and the designed eye point.

[0041] Please refer to Figure 3 , Figure 3FIG. 1 is a schematic diagram showing a projection image to be corrected according to some embodiments of the present invention. Figure 3 In the illustrated embodiment, the multi-eyepoint correction device may first configure a standard pixel position every 10° longitude / latitude in the projection screen, thereby determining multiple pixel points of the projection image. Afterwards, the multi-eyepoint correction device may determine the first coordinates (x, y, z) of each pixel point in the first coordinate system of the projection screen according to the relative position (Δx, Δy, Δz) of each pixel point to the designed eyepoint O(0,0,0). The position (x, y, z) of any point on the standard spherical projection screen satisfies the following equation:

[0042] x 2 +y 2 +z 2 =R 2 (1)

[0043] Where R is the radius of the standard spherical projection screen, that is, the distance from the design eye point O to any point on the standard spherical projection screen.

[0044] like Figure 1 As shown, after determining the first coordinates of multiple pixel points of the projection image, the multi-eye point correction device can respectively determine the transformation relationship between the second coordinate system of multiple observation eye points and the first coordinate system, and determine the second coordinate of each pixel point in each second coordinate system according to each transformation relationship.

[0045] Specifically, take the eye point of the main pilot (i.e., the left eye point) and the eye point of the co-pilot (i.e., the right eye point) of the flight simulator as an example. Assuming that the left and right eye points are symmetrical about the center of the design eye point O, and the distance from the design eye point O is L, then the position of the left eye point in the first coordinate system is (-L, 0, 0), the position of the right eye point in the first coordinate system is (L, 0, 0), and the distance d from any point on the projection screen to the left eye point satisfies the following equation:

[0046]

[0047] Afterwards, the multi-eye point correction device can determine the conversion relationship between the XYZ coordinates and the longitude and latitude coordinates according to the above equation (2), that is,

[0048]

[0049] Where lat is the longitude coordinate of any point on the projection screen, and lon is the latitude coordinate of any point on the projection screen.

[0050] Afterwards, the multi-eye point correction device can use the left eye point (-L, 0, 0) as the origin to establish the longitude and latitude coordinate system of the left eye point (i.e., the second coordinate system), and convert the first coordinate (lat, lon) in the first coordinate system into the second coordinate (lat', lon') in the second coordinate system in combination with the above conversion relationship (3). The second coordinate (lat', lon') satisfies the following equation:

[0051]

[0052] Similarly, the multi-eye point correction device can also use the right eye point (L, 0, 0) as the origin to establish a latitude and longitude coordinate system (i.e., a second coordinate system) of the right eye point, and convert the first coordinate (lat, lon) in the first coordinate system into the corresponding second coordinate (lat', lon') in combination with the above conversion relationship (3). The principle is similar to that of the above embodiment and will not be elaborated here.

[0053] After that, the multi-eyepoint correction device can project a 5°×5° grid image on the spherical screen based on the designed eyepoint O, and calculate the longitude and latitude coordinates (lat', lon') corresponding to all nodes on the left eyepoint observation grid according to formula (4). At this time, each grid can constitute a picture unit, and each picture unit includes at least one pixel. Assuming L = 0.05·R, then Figure 3 The “*” mark shown is the 5°×5° longitude and latitude standard point, and the “○” node is the point data calculated based on the left eye point at this time.

[0054] Please refer to further Figure 4 , Figure 4 FIG. 2 is a schematic diagram showing a curve of the horizontal interval of longitude between pixels in a projection image to be corrected according to some embodiments of the present invention. Figure 4 As shown, when observing two standard points "*" with a longitude difference of 10° (i.e., ΔX=10°) based on the left eye point, the longitude difference (ΔX) between the two corresponding "○" nodes will shift between 9.4° and 10.6°, and the shift of the longitude difference (ΔX) will increase with the increase of positive and negative longitude values.

[0055] In order to enable the pilot and the co-pilot to obtain a better visual display effect at their own seats (i.e., the left and right eye points), the multi-eye point correction device can determine the corresponding attention coefficient λ for each observation eye point n. n For each attention coefficient λ n , the multi-eye point correction device can determine the mean square error Δ of the longitude and latitude of all pixel points in each area based on the following formula, that is,

[0056]

[0057] In the formula, i represents the index value of the pixel point, λ i represents the attention coefficient of the location of point i, N represents the total number of points, Δ represents the mean square error of the longitude and latitude of all points, and E i Represents the sum of squares of the longitude and latitude errors of point i.

[0058] Furthermore, considering that during actual flight, the pilot at the left eye point pays more attention to the left visual picture, while the co-pilot at the right eye point pays more attention to the right visual picture, the multi-eye point correction device can determine the attention coefficient of each observation eye point with respect to each picture unit according to the position of each picture unit in the projection picture.

[0059] In some embodiments, the multi-eye point correction device can divide each pixel point of each picture unit into two parts, a left area and a right area, according to the position of each picture unit in the projection picture, and determine the attention coefficient of each pixel point in the left area as λ 1 =0.8,λ 2 =0.2, where λ 1 is the attention coefficient of the left eye point closer to the left picture unit, and λ 2 is the attention coefficient of the right eye point that is farther from the left picture unit. In addition, for each pixel point of each picture unit in the right area of ​​the projection picture, the multi-eye point correction device can determine the attention coefficient of each pixel point in the right area as λ according to the position of each picture unit in the projection picture. 1 =0.2,λ 2 =0.8, where λ 1 is the attention coefficient of the left eye point that is far away from the right picture unit, and λ 2 It is the attention coefficient of the right eye point that is closer to the right picture unit.

[0060] like Figure 1 As shown, when determining the attention coefficient λ of each observation point n n Then, the multi-eye point correction device can calculate the attention coefficient λ of each observation eye point n. n , and at least one pixel point of each picture unit at the corresponding second coordinate (lat', lon'), respectively calculate the minimum error of at least one pixel point of each picture unit moving in the same direction.

[0061] Specifically, in the process of calculating the minimum error of the same-direction movement, the multi-eye point correction device can introduce the longitude displacement variable dev_lat and the latitude displacement variable dev_lon, and move at least one (for example, 4) pixel points of the same picture unit in the same direction according to the longitude displacement variable dev_lat and the latitude displacement variable dev_lon, and then express the second coordinates of each pixel point after the same-direction movement by the following formula (6), that is,

[0062]

[0063] Wherein, (lat1, lon1), (lat2, lon2), (lat3, lon3), and (lat4, lon4) are the second coordinates of four adjacent pixels of the same picture unit.

[0064] Afterwards, the multi-eye point correction device can determine the second coordinates of each pixel point after the same-direction movement in each second coordinate system according to the conversion relationship between the second coordinate system of each observation eye point n and the first coordinate system as described above. For example, the multi-eye point correction device can calculate the second longitude and latitude (lat1_l, lon1_l), (lat2_l, lon2_l), (lat3_l, lon3_l), (lat4_l, lon4_l) of each pixel point after the same-direction movement based on the left eye point coordinate system according to each first coordinate (lat1, lon1), (lat2, lon2), (lat3, lon3), (lat4, lon4), and calculate the second longitude and latitude (lat1_r, lon1_r), (lat2_r, lon2_r), (lat3_r, lon3_r), (lat4_r, lon4_r) of each pixel point after the same-direction movement based on the right eye point coordinate system. Afterwards, the multi-eye point correction device can combine the above-mentioned left eye point attention coefficient λ 1 and the right eye point attention coefficient λ 2 , to obtain the following formula:

[0065]

[0066] In this way, the multi-eye point correction device can solve the minimum error Δ_E of each pixel point of each picture unit for the same-direction movement according to the above formula (7), and determine the movement direction and movement distance (dev_lat, dev_lon) corresponding to the minimum error Δ_E as the optimal solution for the same-direction movement of four adjacent points of the picture unit. Afterwards, the multi-eye point correction device can synchronously adjust the position of each pixel point of the corresponding picture unit according to the optimal solution (dev_lat, dev_lon) for the same-direction movement, so as to synchronously correct the picture distortion of the picture unit with respect to each observation eye point n (for example: left eye point and right eye point).

[0067] Furthermore, the multi-eye point correction device can solve the minimum error Δ_E of the same-direction movement for all picture units in the projection picture in sequence as described above, and synchronously adjust the position of each pixel point of each picture unit according to the corresponding movement direction and movement distance (dev_lat, dev_lon) to achieve multi-eye point correction of the entire projection picture.

[0068] Furthermore, in some preferred embodiments, for the case where the standard spherical projection screen is symmetrical about the design eye point O, and the multiple observation eye points are also symmetrical about the design eye point O, the multi-eye point correction device can preferably divide the multiple pixel points of the projection screen into multiple correction areas (for example, left and right areas) according to the design eye point O, and ensure that the multiple correction areas are symmetrical about the design eye point O. Afterwards, the multi-eye point correction device can first calculate the attention coefficient (for example, λ) of each observation eye point n with respect to one of the correction areas (for example, the left area) based on the attention coefficient (for example, λ 1 =0.8,λ 2 =0.2), respectively calculate the minimum error Δ_E and the corresponding moving direction and moving distance (dev_lat, dev_lon) of each picture unit in the left area after synchronous displacement, and then synchronously correct the position of each pixel point of the corresponding picture unit according to the moving direction and moving distance (dev_lat, dev_lon). Afterwards, in response to completing the correction of the position of each pixel point in the left area, the multi-eye point correction device can perform symmetrical correction on each pixel point in the remaining correction areas (for example, the right area) about the design eye point according to the position of each pixel point that has been corrected in the left area, thereby further improving the efficiency of multi-eye point correction of the projection picture.

[0069] Those skilled in the art will appreciate that the above-mentioned symmetric correction scheme is only a non-limiting implementation mode provided by the present invention, which is intended to clearly illustrate the concept of the present invention and provide a preferred solution for improving the efficiency of multi-eye point correction, but is not intended for the protection scope of the present invention.

[0070] Optionally, in other embodiments, for the case where the projection screen is symmetrical or asymmetrical about the designed eye point O, and / or the multiple observation eye points are symmetrical or asymmetrical about the designed eye point O, after completing the multi-eye point correction of each pixel point position in the left area, the multi-eye point correction device may further calculate the attention coefficient of each observation eye point n with respect to the right area based on the attention coefficient (for example: λ 1 =0.2,λ 2 =0.8), respectively calculate the minimum error Δ_E of each picture unit in the right area after synchronous displacement and its corresponding moving direction and moving distance (dev_lat, dev_lon), and then synchronously correct the position of each pixel point of the corresponding picture unit according to the moving direction and moving distance (dev_lat, dev_lon), so as to achieve the effect of multi-eye point correction of the entire projection picture.

[0071] Please refer to Figure 5 and Figure 6 . Figure 5 A schematic diagram of a corrected projection image provided according to some embodiments of the present invention is shown. Figure 6A schematic diagram of a curve showing the horizontal interval in longitude between pixels when observing a corrected projection picture based on a left eye point according to some embodiments of the present invention is shown.

[0072] like Figure 5 As shown, based on the attention coefficient λ 1 = 0.8 and λ 2 =0.2 Perform multi-eyepoint correction on the left area of ​​the projection image, and based on the attention coefficient λ 1 = 0.2 and λ 2 = 0.8 After multi-eyepoint correction is performed on the right area of ​​the projection image, in the left area where lat<0°, the longitude lines move a total of about 1.8°, which is more consistent with the 5°×5° grid. Figure 6 As shown in the figure, when the left area with higher attention is observed based on the left eye point (i.e., lat<0°), the longitude difference (ΔX) between the pixels in the left area is compressed within the range of 10.08° to 10.23°, achieving a better correction effect. When the right area with lower attention is observed based on the left eye point (i.e., lat>0°), the longitude difference (ΔX) between the pixels in the longitude range of 0° to 50° is controlled within the range of 9.9° to 9.46° (corresponding), achieving a suboptimal correction effect, and the longitude difference (ΔX) between the pixels in the longitude range of 50° to 90° is also controlled within the range of 9.46° to 9.12°, without more serious picture distortion, so as to meet the correction requirement that the left picture has higher attention than the right.

[0073] Similarly, when observing various areas of the projected image based on the right eye point, a better correction effect can be achieved in the right area with higher attention, and a suboptimal correction effect can be achieved in the right area with lower attention, so as to meet the correction requirement that the attention of the right side of the image is higher than that of the left side.

[0074] In summary, by introducing corresponding attention coefficients for multiple observation eye points respectively, the present invention can adjust the error based on one observation eye point (for example, the left eye point) while taking into account the impact of the adjustment on other observation eye points (for example, the right eye point), thereby efficiently and reliably realizing multi-eye point correction of the projected image.

[0075] Those skilled in the art can also understand that the above-mentioned solution of dividing the projection screen into two left and right areas is only a non-limiting implementation mode provided by the present invention, which is intended to clearly demonstrate the concept of the present invention and provide a preferred solution for improving the efficiency of multi-eye point correction, but is not intended for the protection scope of the present invention.

[0076] Optionally, in other embodiments, the multi-eye point correction device may further divide each pixel of each picture unit into more than three regions m according to the position of each picture unit in the projection picture. Taking the left, middle and right regions as an example, the multi-eye point correction device may determine that the attention coefficient of each pixel i in the left region (for example, the left side of the left eye point) is λ 1i =0.8,λ 2i =0.2, where λ 1i is the attention coefficient of the left eye point closer to the left picture unit, and λ 2i is the attention coefficient of the right eye point that is farther from the left picture unit. In addition, for each pixel point of each picture unit in the right area of ​​the projection picture (for example, to the right of the right eye point), the multi-eye point correction device can determine the attention coefficient of each pixel point in the right area as λ 1 =0.2,λ 2 =0.8, where λ 1 is the attention coefficient of the left eye point that is far from the right picture unit, and λ 2 is the attention coefficient of the right eye point that is closer to the right picture unit. In addition, for each pixel point of each picture unit in the middle area of ​​the projection picture (for example, between the left and right eye points), the multi-eye point correction device can determine the attention coefficient of each pixel point i in the middle area as λ 1i =λ 2i =0.5, where λ 1i and 2i are the attention coefficients of the left and right eye points that are close to the middle picture unit. Then, the multi-eye point correction device can calculate the attention coefficients λ of the multiple observation eye points n based on the attention coefficients λ of the multiple observation eye points n as described above. n , multi-eye point correction is performed on each pixel point of each area m in turn to achieve the corresponding technical effect. The details and principles are similar to those in the above embodiment and will not be repeated here.

[0077] Those skilled in the art can also understand that the above-mentioned projection screen based on the standard sphere is only a non-limiting implementation mode provided by the present invention, which is intended to clearly demonstrate the main concept of the present invention and provide a specific solution that is convenient for the public to implement, rather than to limit the scope of protection of the present invention.

[0078] Optionally, in other embodiments, the flight simulator may also be equipped with various forms of flat or curved projection screens, such as a flat projection screen, an ellipsoidal projection screen, and a distorted spherical projection screen. Accordingly, technicians may also make simple adaptive modifications based on the above concept provided by the present invention, and adopt the multi-eye point correction method of the above projection screen provided by the present invention to perform multi-eye point correction on the projection screens in these projection screens, and the specific implementation methods thereof will not be described in detail herein.

[0079] Although the above methods are illustrated and described as a series of actions for simplicity of explanation, it should be understood and appreciated that these methods are not limited by the order of the actions, because according to one or more embodiments, some actions may occur in a different order and / or concurrently with other actions from those illustrated and described herein or not illustrated and described herein but understandable to those skilled in the art.

[0080] Those skilled in the art will appreciate that information, signals, and data may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips cited throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or optical particles, or any combination thereof.

[0081] Those skilled in the art will further appreciate that the various illustrative logic blocks, modules, circuits, and algorithm steps described in conjunction with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or a combination of the two. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps are generally described above in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the specific application and the design constraints imposed on the overall system. The technician may implement the described functionality in different ways for each specific application, but such implementation decisions should not be interpreted as resulting in a departure from the scope of the present invention.

[0082] Although the multiple eye point correction device described in the above embodiments can be implemented by a combination of software and hardware. However, it can be understood that the multiple eye point correction device can also be implemented in software or hardware alone. For hardware implementation, the multiple eye point correction device can be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, other electronic devices for performing the above functions, or a selected combination of the above devices. For software implementation, the multiple eye point correction device can be implemented by independent software modules such as procedures and functions running on a general chip, wherein each module performs one or more functions and operations described herein.

[0083] The various illustrative logic modules and circuits described in conjunction with the embodiments disclosed herein may be implemented or executed with a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. The processor may also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in cooperation with a DSP core, or any other such configuration.

[0084] The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. Thus, the disclosure is not intended to be limited to the examples and designs described herein, but should be granted the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for correcting multiple eye points of a projected image, characterized in that: The following steps are involved: Determine first coordinates of a plurality of pixel points of the projection picture in a screen coordinate system of the projection screen, wherein each at least one pixel point constitutes a picture unit; respectively determining the conversion relationship between the eye point coordinate systems of the plurality of observation eye points and the screen coordinate system; According to each of the conversion relationships, respectively determine the second coordinates of each of the pixel points in each of the eye point coordinate systems; Determining the attention coefficient of each observation eye point; Calculating the minimum error of at least one pixel point of each picture unit moving in the same direction according to the attention coefficient of each observation eye point and the second coordinate of at least one pixel point of each picture unit in the corresponding eye point coordinate system; and According to the moving direction and the moving distance corresponding to the minimum error, the position of at least one pixel point of the corresponding picture unit is corrected.

2. The multi-eye point correction method according to claim 1, wherein: The step of determining first coordinates of a plurality of pixel points of the projection picture in the screen coordinate system of the projection screen comprises: Taking the design eye point of the projection screen as the origin, constructing the screen coordinate system of the projection screen; and The first coordinate of each pixel point is determined according to the relative position of each pixel point and the designed eye point.

3. The multi-eye point correction method according to claim 2, wherein: The projection screen is a projection spherical screen, and the step of constructing a screen coordinate system of the projection screen with the design eye point of the projection screen as the origin comprises: An XYZ coordinate system is established with the design eye point as the origin, the positive longitude direction as the positive direction of the X axis, and the positive latitude direction as the positive direction of the Z axis, wherein the positive direction of the Y axis is perpendicular to the positive direction of the X axis and the positive direction of the Z axis.

4. The multi-eye point correction method according to claim 3, wherein: The step of respectively determining the conversion relationship between the eye point coordinate systems of the plurality of observation eye points and the screen coordinate system comprises: Taking each of the observation eye points as the origin, constructing an eye point coordinate system for each of the observation eye points, wherein the eye point coordinate system is a longitude and latitude coordinate system, including a longitude coordinate indicating a longitude position and a latitude coordinate indicating a latitude position; and According to the relative positions of the observation eye points and the design eye points, the transformation relationships for transforming any point (x, y, z) in the screen coordinate system to the corresponding eye point coordinate system are respectively determined.

5. The multi-eye point correction method according to claim 4, characterized in that: The step of respectively determining the second coordinates of each pixel point in each eye point coordinate system according to each conversion relationship comprises: According to each of the conversion relationships, the second coordinates (lat', lon') of each of the pixel points (x, y, z) of the projection image in each of the eye point coordinate systems are determined respectively.

6. The multi-eye point correction method according to claim 5, wherein: The step of determining the attention coefficient of each observation eye point comprises: According to the position of each picture unit on the projection picture, the attention coefficient of each observation eye point with respect to each picture unit is determined respectively.

7. The multi-eye point correction method according to claim 6, wherein: The step of determining the attention coefficient of each observation eye point with respect to each picture unit according to the position of each picture unit in the projection picture comprises: A higher attention coefficient is configured for an observation eye point that is closer to the picture unit, and a lower attention coefficient is configured for an observation eye point that is farther from the picture unit.

8. The multi-eye point correction method according to claim 7, wherein: The step of configuring a higher attention coefficient for an observation eye point closer to the picture unit and configuring a lower attention coefficient for an observation eye point farther from the picture unit comprises: Dividing the plurality of pixel points into a plurality of correction areas according to positions of the plurality of pixel points on the projection screen; and For each of the correction areas, a higher attention coefficient is configured for an observation eye point that is closer to the picture unit therein, and a lower attention coefficient is configured for an observation eye point that is farther from the picture unit therein.

9. The multi-eye point correction method according to any one of claims 2 to 7, characterized in that: The projection screen is symmetrical about the designed eye point, the multiple observation eye points are symmetrical about the designed eye point, and the step of correcting the position of at least one pixel point of the corresponding picture unit according to the moving direction and moving distance corresponding to the minimum error comprises: Dividing the plurality of pixel points into a plurality of correction areas according to the design eye point, wherein each of the correction areas is symmetrical about the design eye point; Correcting the position of at least one pixel point of the corresponding picture unit of the corresponding correction area according to the moving direction and the moving distance corresponding to the minimum error; and In response to completing the correction of the positions of the pixels in the corresponding correction area, symmetrical correction is performed on the pixels in the remaining correction areas about the designed eye point according to the positions of the corrected pixels.

10. The multi-eye point correction method according to claim 4, wherein: The moving direction and moving distance corresponding to the minimum error include longitude displacement and latitude displacement.

11. The multi-eye point correction method according to claim 1, wherein: The projection screen is arranged on a flight simulator, the projection picture is a flight simulation picture, and the multiple observation eye points include the main pilot's eye point and the co-pilot's eye point.

12. A multi-eye point correction device for a projected image, characterized in that: include: Memory; as well as A processor is connected to the memory and is configured to implement the multi-eye point correction method for a projection picture according to any one of claims 1 to 11.

13. A computer-readable storage medium having computer instructions stored thereon, characterized in that: When the computer instructions are executed by the processor, the multi-eye point correction method for the projection picture according to any one of claims 1 to 11 is implemented.

Images