Long-distance imaging display and display control method thereof

Abstract

The present invention proposes a long-distance imaging display and a display control method thereof. The method detects whether there is a user watching the long-distance imaging display. When there is a user watching the long-distance imaging display, the eye position of the user is monitored in real time. A standard graphic for implementing distortion correction is generated at a position of an observation window of the long-distance imaging display in a distortion correction space corresponding to the user. It is determined that a line between the eye position of the user and each correction element in the standard graphic corresponds to an optical path in the optical system. A distortion graphic for implementing distortion correction is generated at a position of a display screen in the distortion correction space corresponding to the optical path. The display picture of the long-distance imaging display is subjected to distortion correction according to the standard graphic and the correction element offset of the distorted image. This method can overcome the influence of optical distortion on the display content of the long-distance imaging display and effectively improve the viewing experience of the user.

Description

Technical Field

[0001] The present invention relates to the field of display control technology, and in particular to a long-distance imaging display and a display control method thereof. Background Art

[0002] With the promotion and popularization of digital education, digital education resources are becoming more and more abundant, and people are beginning to use more and more electronic devices such as personal computers, tablet computers and even smart phones to learn. However, whether it is a personal computer, a tablet computer or a smart phone, it is not a special digital learning device, and long-term viewing is not conducive to the vision development of young children. To this end, the applicant has developed a long-distance imaging display for improving vision, which uses red light to promote the development of fundus cells and choroidal cells of the eye, increase the blood supply of the choroid and retina, and can reverse the elongation of the eye axis and play a role in treating myopia. The long-distance imaging display, with the cooperation of a spectroscope and a concave mirror, extends the imaging distance of the display screen content, and the concave mirror can also magnify the screen image, which can effectively reduce the damage to the eyes caused by watching the screen at close range. However, the long-distance imaging display uses a concave mirror to magnify the display image, which will inevitably introduce optical distortion, which will make the content in the picture, especially the content at the edge of the picture, less readable. When the user is watching the screen, his head is not completely still. When the position of the user's head changes slightly, the degree of optical distortion varies with the angle of the optical path, which will cause some of the image content to change shape significantly, affecting the user experience. Summary of the invention

[0003] Based on the above problems, the present invention proposes a long-distance imaging display and a display control method thereof, which can overcome the influence of optical distortion on the display content of the long-distance imaging display and effectively improve the user's viewing experience.

[0004] In view of this, a first aspect of the present invention provides a long-distance imaging display, comprising a display system, an optical system, a positioning system and a control system, wherein the display system comprises a display screen and a circuit board, wherein the display screen is arranged at the bottom of the long-distance imaging display with its front side facing upward, the optical system comprises a beam splitter arranged above the display screen, a concave mirror arranged on one side of the beam splitter and an observation window arranged on the other side of the beam splitter, the positioning system comprises an image sensor for monitoring the eye position of the user in real time, and the control system comprises a controller connected to the circuit board and the image sensor, wherein the controller is configured as follows:

[0005] Constructing a distortion correction space, wherein the distortion correction space is a three-dimensional space including a long-distance imaging display and a preset viewing distance range in front of the long-distance imaging display;

[0006] Detecting whether there is a user watching in front of the long-distance imaging display;

[0007] When a user is viewing the remote imaging display, monitoring the eye position of the user in real time;

[0008] Generating a standard graph for implementing distortion correction at a position corresponding to an observation window of the long-distance imaging display in the distortion correction space;

[0009] Determine that a line between the eye position of the user and each correction element in the standard graph corresponds to an optical path in the optical system;

[0010] Generating a distortion pattern for implementing distortion correction according to the position of the display screen in the distortion correction space corresponding to the optical path;

[0011] The display image of the long-distance imaging display is subjected to distortion correction according to the correction element offset of the standard pattern and the distorted image.

[0012] A second aspect of the present invention provides a display control method for a long-distance imaging display, comprising:

[0013] Constructing a distortion correction space, wherein the distortion correction space is a three-dimensional space including a long-distance imaging display and a preset viewing distance range in front of the long-distance imaging display;

[0014] Detecting whether there is a user watching in front of the long-distance imaging display;

[0015] When a user is viewing the remote imaging display, monitoring the eye position of the user in real time;

[0016] Generating a standard graph for implementing distortion correction at a position corresponding to an observation window of the long-distance imaging display in the distortion correction space;

[0017] Determine that a line between the eye position of the user and each correction element in the standard graph corresponds to an optical path in the optical system;

[0018] Generating a distortion pattern for implementing distortion correction according to the position of the display screen in the distortion correction space corresponding to the optical path;

[0019] The display image of the long-distance imaging display is subjected to distortion correction according to the correction element offset of the standard pattern and the distorted image.

[0020] Furthermore, the step of generating a standard pattern for implementing distortion correction at a position corresponding to the observation window of the long-distance imaging display in the distortion correction space specifically includes:

[0021] Determine the enlarged pixel size of each pixel on the display screen of the long-distance imaging display that falls on the plane where the observation window is located after being enlarged by the optical system ;

[0022] Obtaining the resolution of the display screen of the remote imaging display ,in is the horizontal resolution of the display screen, is the vertical resolution of the display screen;

[0023] Determine a lateral resolution less than or equal to The horizontal width of the dot matrix , and a vertical resolution less than or equal to the Vertical width of the dot matrix ;

[0024] Construct a rectangular lattice, the rectangular lattice is composed of The size of the first dots is the magnified pixel size. .

[0025] Furthermore, the step of determining the size of each pixel on the display screen of the long-distance imaging display that falls within the plane where the observation window is located after being magnified by the optical system specifically includes:

[0026] Obtaining the size of the observation area on the observation window of the remote imaging display ,in is the width of the observation area on the observation window, is the height of the observation area on the observation window;

[0027] Calculate the enlarged pixel size:

[0028] ,or

[0029] .

[0030] Furthermore, the step of determining that the line between the user's eye position and each correction element in the standard graph corresponds to the optical path in the optical system specifically includes:

[0031] Obtaining a first coordinate of a midpoint of a line connecting two eyes of the user in the distortion correction space and a second coordinate of a center point of each correction element in the distortion correction space;

[0032] determining a straight line connecting the first coordinate and the second coordinate as a first straight line;

[0033] Calculate the third coordinate of a first intersection point of the first straight line and a concave mirror surface in the optical system of the long-distance imaging display;

[0034] Determine a first reflection angle of the first straight line on the concave mirror according to the third coordinate to obtain a second straight line corresponding to a reflection line of the first straight line on the surface of the concave mirror;

[0035] Calculating a fourth coordinate of a second intersection point between the second straight line and the beam splitter surface;

[0036] Determine a second reflection angle of the second straight line on the beam splitter according to the fourth coordinate to obtain a third straight line corresponding to a reflection line of the second straight line on the surface of the beam splitter;

[0037] Calculating a fifth coordinate of a third intersection point between the third straight line and the surface of the display screen;

[0038] A set of line segments connecting the first coordinate, the second coordinate, the third coordinate, the fourth coordinate, and the fifth coordinate is determined as the optical path.

[0039] Furthermore, each of the first dots has a unique first number in the rectangular dot matrix, and the step of generating a distortion pattern for implementing distortion correction according to the position of the display screen corresponding to the optical path in the distortion correction space specifically includes:

[0040] Traversing each first dot in the rectangular dot matrix;

[0041] Calculate the mapping point coordinates of the first dot on the display screen according to the optical path corresponding to the first dot;

[0042] A second dot having a unique second number is generated in the distorted pattern at the coordinate position of the mapping point, and the size of the second dot is the original pixel size. ;

[0043] Determine the set of the second dots as the distorted pattern;

[0044] The first number, the mapping point coordinates and the second number are associated and saved.

[0045] Furthermore, the standard pattern is a rectangular dot matrix, the correction element of the standard pattern is the first dot, and the step of performing distortion correction on the display screen of the long-distance imaging display according to the correction element offset of the standard pattern and the distorted image specifically includes:

[0046] Calculate the dot correction parameters of the corresponding correction elements in the standard pattern and the distorted pattern:

[0047] ;

[0048] The dot matrix correction parameters include horizontal dot matrix correction parameters and vertical dot matrix correction parameters. , , The standard figure Ledi The horizontal coordinate of the correction element on the row, The standard figure Ledi The vertical coordinate of the correction element on the row, is the first Ledi The horizontal coordinate of the correction element on the row, is the first Ledi The vertical coordinate of the correction element on the row, The standard figure Ledi The lateral lattice correction parameters of the correction elements on the row, The standard figure Ledi Longitudinal lattice correction parameters of the correction elements on the row;

[0049] Calculate pixel correction parameters on the display screen according to the dot matrix correction parameters, and the pixel correction parameters include horizontal pixel correction parameters and vertical pixel correction parameters ,in , ;

[0050] Acquire each frame of the display content of the remote imaging display;

[0051] The pixel values ​​of the screen image are corrected according to the pixel correction parameters.

[0052] Furthermore, the step of calculating the pixel correction parameters on the display screen according to the dot matrix correction parameters specifically includes:

[0053] The size of the plane where the observation window is located is constructed A pixel correction matrix, wherein each correction point in the pixel correction matrix corresponds one-to-one to the position of each pixel point in the display image of the long-distance imaging display;

[0054] Traverse each correction point in the pixel correction matrix to perform the following steps:

[0055] When traversing to the pixel correction matrix Ledi When the current correction point is a correction point, the horizontal pixel distance between the current correction point and the first closest point is calculated. and vertical pixel distance ;

[0056] Determine the position of the closest first circle point in the rectangular dot matrix ,in Refers to the closest first point in the rectangular dot matrix List, Refers to the closest first point in the rectangular dot matrix OK;

[0057] Get the closest first dot horizontal dot correction parameters and longitudinal correction parameters ;

[0058] Calculate the correction parameters for the current correction point:

[0059] ,

[0060] in is the pixel correction matrix Ledi The horizontal pixel correction parameters of the correction points of the row, is the pixel correction matrix Ledi The vertical pixel correction parameters of the correction points of the row, is a preconfigured linear offset coefficient.

[0061] Furthermore, the step of correcting the pixel value of the screen image according to the pixel correction parameter specifically includes:

[0062] The size of the plane where the observation window is located is constructed A pixel filling matrix, wherein each pixel point in the pixel filling matrix corresponds one-to-one to the position of each pixel point in the display screen of the long-distance imaging display;

[0063] Traverse each pixel in the screen image to perform the following steps:

[0064] When traversing to the first Ledi When the pixel point of the row is Ledi The correction parameter of the row is used as the offset of the current pixel to calculate the filling position of the current pixel in the pixel filling matrix:

[0065] ,

[0066] in The first Ledi The horizontal filling position of the pixel point of the row in the pixel filling matrix, The first Ledi The vertical filling position of the pixel points of the row in the pixel filling matrix;

[0067] The screen image is Ledi The pixel values ​​of the pixels in the row are filled into the pixel filling matrix Ledi OK;

[0068] After the pixel points in the screen image are traversed, a corrected target screen image is generated based on the pixel filling matrix.

[0069] Further, the screen image is Ledi The pixel values ​​of the pixels in the row are filled into the pixel filling matrix Ledi The specific steps include:

[0070] Get the screen image Ledi The pixel value of the pixel in the row And the pixel filling matrix Ledi The pixel value of the row ;

[0071] When the pixels fill the matrix Ledi When the pixel value of a row is not null, the pixel fills the matrix Ledi The pixel value of the row is modified to ;

[0072] When the pixels fill the matrix Ledi When the pixel value of a row is null, the pixel fills the matrix Ledi The pixel value of the row is modified to ;

[0073] The step of generating a corrected target screen image based on the pixel filling matrix specifically includes:

[0074] Determine the pixel filling matrix Ledi Whether the pixel value of the row is null;

[0075] When the pixels fill the matrix Ledi When the pixel value of the row is not a null value, the pixel is filled into the matrix Ledi The pixel values ​​of the first row are filled into the target screen image. Ledi The pixel position of the row;

[0076] When the pixels fill the matrix Ledi When the pixel value of a row is null, fill the matrix first based on the pixel Ledi The surrounding pixel values ​​of the row pixel position generate the target screen image Ledi The pixel value of the row.

[0077] The present invention proposes a long-distance imaging display and a display control method thereof. The method detects whether there is a user watching the long-distance imaging display. When there is a user watching the long-distance imaging display, the eye position of the user is monitored in real time. A standard graphic for implementing distortion correction is generated at a position of an observation window of the long-distance imaging display in a distortion correction space corresponding to the user. It is determined that a line between the eye position of the user and each correction element in the standard graphic corresponds to an optical path in the optical system. A distortion graphic for implementing distortion correction is generated at a position of a display screen in the distortion correction space corresponding to the optical path. The display picture of the long-distance imaging display is subjected to distortion correction according to the standard graphic and the correction element offset of the distorted image. This method can overcome the influence of optical distortion on the display content of the long-distance imaging display and effectively improve the viewing experience of the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] Figure 1 is a schematic diagram of a long-distance imaging display provided by an embodiment of the present invention;

[0079] Figure 2 It is a flow chart of a display control method of a long-distance imaging display provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0080] In order to more clearly understand the above-mentioned purpose, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0081] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.

[0082] In the description of the present invention, the term "multiple" refers to two or more. Unless otherwise clearly defined, the orientation or positional relationship indicated by the terms "upper", "lower", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation of the present invention. The terms "connection", "installation", "fixation", etc. should be understood in a broad sense. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; it can be directly connected or indirectly connected through an intermediate medium. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to the specific circumstances. In addition, the terms "first", "second", etc. are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first", "second", etc. can explicitly or implicitly include one or more of the features. In the description of the present invention, unless otherwise specified, the meaning of "multiple" is two or more.

[0083] In the description of this specification, the description of the terms "one embodiment", "some implementations", "specific embodiments", etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0084] A long-distance imaging display and a display control method thereof provided according to some embodiments of the present invention will be described below with reference to the accompanying drawings.

[0085] like Figure 1As shown, a first aspect of the present invention proposes a long-distance imaging display, including a display system, an optical system, a positioning system and a control system, wherein the display system includes a display screen and a circuit board, wherein the display screen is arranged face up at the bottom of the long-distance imaging display, the optical system includes a beam splitter arranged above the display screen, a concave mirror arranged on one side of the beam splitter and an observation window arranged on the other side of the beam splitter, the positioning system includes an image sensor for monitoring the user's eye position in real time, and the control system includes a controller connected to the circuit board and the image sensor.

[0086] In the technical solutions of other embodiments of the present invention, the display system further includes a communication module and an external terminal that communicates with the circuit board through the communication module. In this embodiment, the external terminal provides display content to the display screen through the communication module. The communication module can be a wired communication module such as a USB communication module, a serial communication module, etc., and the communication module can also be a wireless communication module such as a Bluetooth communication module or a wifi communication module. Further, the display screen includes a liquid crystal panel and a backlight module connected to the circuit board.

[0087] In the optical system, the concave mirror is used to magnify the display image of the display screen reflected from the beam splitter and pass it through the beam splitter to reach the observation window. The observation window is a transparent glass panel with good light transmittance, so that the user can view the display image magnified by the concave mirror through the observation window.

[0088] like Figure 2 As shown, the controller is configured as follows:

[0089] Constructing a distortion correction space, wherein the distortion correction space is a three-dimensional space including a long-distance imaging display and a preset viewing distance range in front of the long-distance imaging display;

[0090] Detecting whether there is a user watching in front of the long-distance imaging display;

[0091] When a user is viewing the remote imaging display, monitoring the eye position of the user in real time;

[0092] Generating a standard graph for implementing distortion correction at a position corresponding to an observation window of the long-distance imaging display in the distortion correction space;

[0093] Determine that a line between the eye position of the user and each correction element in the standard graph corresponds to an optical path in the optical system;

[0094] Generating a distortion pattern for implementing distortion correction according to the position of the display screen in the distortion correction space corresponding to the optical path;

[0095] The display image of the long-distance imaging display is subjected to distortion correction according to the correction element offset of the standard pattern and the distorted image.

[0096] Specifically, the distortion correction space is constructed in the computer cache space, with the remote imaging display as a reference, and is a three-dimensional coordinate space for implementing distortion correction on the display screen of the remote imaging display. In order to clearly see the display content of the remote imaging display, the user needs to maintain a certain viewing distance from the remote imaging display for viewing, and this viewing distance is usually related to the size of the remote imaging display and the magnification of its display screen.

[0097] In the step of detecting whether there is a user watching the long-distance imaging display, the image acquisition unit acquires the environment image in front of the long-distance imaging display, and performs face recognition on the environment image, thereby judging whether there is a user watching the long-distance imaging display according to whether there is a qualified face in the environment image. Further, in the step of real-time monitoring the face position of the user, when there is a user watching the long-distance imaging display, the image acquisition unit continuously acquires the environment image in front of the long-distance imaging display, and analyzes the face image in each frame of the environment image, thereby obtaining the real-time position of the user's face and eyes.

[0098] Further, after the step of monitoring the eye position of the user in real time, the controller is configured to:

[0099] Identifying the sight direction of the user according to the facial image on the environmental image;

[0100] Determining whether the user's line of sight falls within the observation window of the long-distance imaging display;

[0101] When the sight line direction of the user falls within the observation window of the long-distance imaging display, generating a standard graph for implementing distortion correction at a position corresponding to the observation window of the long-distance imaging display in the distortion correction space and subsequent steps;

[0102] Otherwise, the steps of generating a standard graph for implementing distortion correction corresponding to the position of the observation window of the long-distance imaging display in the distortion correction space and its subsequent steps are not performed.

[0103] Furthermore, in the step of generating a standard pattern for implementing distortion correction at a position corresponding to the observation window of the long-distance imaging display in the distortion correction space, the controller is configured to:

[0104] Determine the enlarged pixel size of each pixel on the display screen of the long-distance imaging display that falls on the plane where the observation window is located after being enlarged by the optical system ;

[0105] Obtaining the resolution of the display screen of the remote imaging display ,in is the horizontal resolution of the display screen, is the vertical resolution of the display screen;

[0106] Determine a lateral resolution less than or equal to The horizontal width of the dot matrix , and a vertical resolution less than or equal to the Vertical width of the dot matrix ;

[0107] Construct a rectangular lattice, the rectangular lattice is composed of The size of the first dots is the magnified pixel size. .

[0108] The horizontal resolution of the display is the number of pixels in the horizontal direction of the display screen. Similarly, the vertical resolution of the display screen is the number of pixels of the display screen in the vertical direction. is the number of first dots in the horizontal direction of the rectangular dot matrix. is the number of first dots of the rectangular dot matrix in the longitudinal direction.

[0109] In the technical solution of the above-mentioned embodiment, a rectangular dot matrix is ​​used as a standard pattern for implementing distortion correction, and each first dot in the rectangular dot matrix is ​​used as a correction element in the standard correction pattern. Since the correction element, i.e., the first dot, has the same size as the pixel of the display screen on the plane where the observation window is located, when it is mapped to the distorted image through the corresponding optical path on the optical system, its mapping point has approximately the same size as the pixel of the display screen on the plane where the display screen is located. Preferably, the horizontal width of the dot matrix is Smaller than the lateral resolution , the longitudinal width of the dot matrix Smaller than the vertical resolution The center point of the rectangular dot matrix overlaps with the center point position of the observation window in the distortion correction space, and the first dots are evenly distributed at a certain distance in the rectangular dot matrix. The size of the first dots specifically refers to the diameter of the first dots.

[0110] Furthermore, in the step of determining the size of each pixel on the display screen of the long-distance imaging display that falls within the plane where the observation window is located after being magnified by the optical system, the controller is configured as follows:

[0111] Obtaining the size of the observation area on the observation window of the remote imaging display ,in is the width of the observation area on the observation window, is the height of the observation area on the observation window;

[0112] Calculate the enlarged pixel size:

[0113] ,or

[0114] .

[0115] Specifically, the observation area on the observation window of the remote imaging display is the area where the display image of the remote imaging display falls on the observation window. The size of the observation area on the observation window of the remote imaging display is It can be pre-measured and configured data.

[0116] Furthermore, the controller is also configured to:

[0117] Get the size of the display area of ​​the display screen ;

[0118] Calculate the native pixel size of the display:

[0119] ,or

[0120] ;

[0121] Calculate the horizontal magnification of the display image:

[0122] ,

[0123] And the vertical magnification:

[0124] ;

[0125] when When the deviation is less than the preset threshold, the pixel size is enlarged. Pick , Similarly, let Pick , Any value among ;

[0126] when When it is greater than a preset deviation threshold, the enlarged pixel size is:

[0127] ;

[0128] .

[0129] Further, in the step of determining that a line between the user's eye position and each correction element in the standard graph corresponds to an optical path in the optical system, the controller is configured to:

[0130] Obtaining a first coordinate of a midpoint of a line connecting two eyes of the user in the distortion correction space and a second coordinate of a center point of each correction element in the distortion correction space;

[0131] determining a straight line connecting the first coordinate and the second coordinate as a first straight line;

[0132] Calculate the third coordinate of a first intersection point of the first straight line and a concave mirror surface in the optical system of the long-distance imaging display;

[0133] Determine a first reflection angle of the first straight line on the concave mirror according to the third coordinate to obtain a second straight line corresponding to a reflection line of the first straight line on the surface of the concave mirror;

[0134] Calculating a fourth coordinate of a second intersection point between the second straight line and the beam splitter surface;

[0135] Determine a second reflection angle of the second straight line on the beam splitter according to the fourth coordinate to obtain a third straight line corresponding to a reflection line of the second straight line on the surface of the beam splitter;

[0136] Calculating a fifth coordinate of a third intersection point between the third straight line and the surface of the display screen;

[0137] A set of line segments connecting the first coordinate, the second coordinate, the third coordinate, the fourth coordinate, and the fifth coordinate is determined as the optical path.

[0138] It can be known that when the user's eye position is different, the optical path corresponding to the line connecting the user and each correction element is also different. Therefore, when the user's head position changes during viewing the display image of the remote imaging display, it is necessary to obtain the user's eye position in real time to determine the optical path corresponding to each correction element. Preferably, in order to reduce the amount of calculation, in the distortion correction calculation, the midpoint of the line connecting the two eyes of the user can be used as the eye position of the user, without performing correction calculations on the two eyes of the user at the same time.

[0139] Furthermore, in the step of determining that the line between the user's eye position and each correction element in the standard figure corresponds to the optical path in the optical system, since the correction element usually has a relatively large size, that is, the correction element usually has a larger area on the plane where the observation window is located, the line between the user's eye position and each correction element in the standard figure referred to here refers to the line between the midpoint of the line connecting the user's two eyes and the center point of the correction element.

[0140] In the step of determining the reflection angle of the first straight line on the concave mirror according to the third coordinate, since the distortion correction space is a coordinate space with the long-distance imaging display as a reference, the coordinate value in the distortion correction space is a fixed value relative to any point in the long-distance imaging display, and the concave mirror is a component fixedly mounted on the long-distance imaging display, so each point on the surface of the concave mirror has a fixed coordinate value in the distortion correction space. In the technical solutions of some embodiments of the present invention, the curvature data of the concave mirror surface is pre-configured, and the curvature of each point on the concave mirror surface can be known by determining the position and posture of the concave mirror, so that after knowing the coordinate value of the first intersection, the corresponding first reflection angle can be obtained according to the curvature data and the incident angle of the first straight line. In the technical solutions of other embodiments of the present invention, in the case where the curvature data of the concave mirror is not pre-configured, the first reflection angle can be obtained by constructing the tangent of the concave mirror at the first intersection in the distortion correction space. Similarly, the beam splitter is a plane mirror, and the second reflection angle of the second straight line on the surface of the beam splitter can be known by determining the position and posture of the beam splitter and the incident angle of the second straight line.

[0141] Before the step of determining a set of line segments connecting the first coordinate, the second coordinate, the third coordinate, the fourth coordinate, and the fifth coordinate as the optical path, the controller is configured to:

[0142] Determining whether the fifth coordinate falls within the display area of ​​the display screen;

[0143] When the fifth coordinate falls within the display area of ​​the display screen, performing the step of determining a set of line segments connecting the first coordinate, the second coordinate, the third coordinate, the fourth coordinate and the fifth coordinate as the optical path;

[0144] Otherwise, the step of determining a set of line segments connecting the first coordinate, the second coordinate, the third coordinate, the fourth coordinate, and the fifth coordinate as the optical path is not performed.

[0145] Further, each of the first dots has a unique first number in the rectangular dot matrix, and in the step of generating a distortion pattern for implementing distortion correction according to the position of the display screen in the distortion correction space corresponding to the optical path, the controller is configured as follows:

[0146] Traversing each first dot in the rectangular dot matrix;

[0147] Calculate the mapping point coordinates of the first dot on the display screen according to the optical path corresponding to the first dot;

[0148] A second dot having a unique second number is generated in the distorted pattern at the coordinate position of the mapping point, and the size of the second dot is the original pixel size. ;

[0149] Determine the set of the second dots as the distorted pattern;

[0150] The first number, the mapping point coordinates and the second number are associated and saved.

[0151] Specifically, the mapping point coordinates of the first dot on the display screen refer to the fifth coordinates on the optical path corresponding to the first dot. Similarly, the size of the second dot specifically refers to the diameter of the second dot. In the technical solution of the above-mentioned implementation mode, for each second dot in the distorted graph, the mapping relationship between it and the first dot in the rectangular dot matrix is ​​associated and saved by constructing a corresponding ["first number", "second number", "mapping point coordinates"] array.

[0152] Further, the standard pattern is a rectangular dot matrix, the correction element of the standard pattern is the first dot, and in the step of performing distortion correction on the display screen of the long-distance imaging display according to the correction element offset of the standard pattern and the distorted image, the controller is configured as follows:

[0153] Calculate the dot correction parameters of the corresponding correction elements in the standard pattern and the distorted pattern:

[0154] ;

[0155] The dot matrix correction parameters include horizontal dot matrix correction parameters and vertical dot matrix correction parameters. , , The standard figure Ledi The horizontal coordinate of the correction element on the row, The standard figure Ledi The vertical coordinate of the correction element on the row, is the first Ledi The horizontal coordinate of the correction element on the row, is the first Ledi The vertical coordinate of the correction element on the row, The standard figure Ledi The lateral lattice correction parameters of the correction elements on the row, The standard figure Ledi Longitudinal lattice correction parameters of the correction elements on the row;

[0156] Calculate pixel correction parameters on the display screen according to the dot matrix correction parameters, and the pixel correction parameters include horizontal pixel correction parameters and vertical pixel correction parameters ,in , ;

[0157] Acquire each frame of the display content of the remote imaging display;

[0158] The pixel values ​​of the screen image are corrected according to the pixel correction parameters.

[0159] Specifically, a correction element in the standard pattern is mapped to the mapping point coordinates obtained on the display screen through its corresponding optical path, and the correction element of the distortion pattern located at the mapping point coordinates is the correction element corresponding to the correction element in the standard pattern. Taking the above-mentioned embodiment as an example, the first dot of the second coordinate and the second dot of the fifth coordinate on the same optical path are the corresponding correction elements.

[0160] The display content of the remote imaging display includes a screen image arranged frame by frame in a time sequence at a preset frame rate for display on the display screen. In the technical solution of the above-mentioned embodiment, the step of acquiring each frame of the screen image in the display content of the remote imaging display is specifically to acquire the screen image to be displayed on the display screen, so as to perform a process of correcting the pixel value of the screen image according to the pixel correction parameter.

[0161] Further, in the step of calculating the pixel correction parameters on the display screen according to the dot matrix correction parameters, the controller is configured to:

[0162] The size of the plane where the observation window is located is constructed A pixel correction matrix, wherein each correction point in the pixel correction matrix corresponds one-to-one to the position of each pixel point in the display image of the long-distance imaging display;

[0163] Traverse each correction point in the pixel correction matrix to perform the following steps:

[0164] When traversing to the pixel correction matrix Ledi When the current correction point is a correction point, the horizontal pixel distance between the current correction point and the first closest point is calculated. and vertical pixel distance ;

[0165] Determine the position of the closest first circle point in the rectangular dot matrix ,in Refers to the closest first point in the rectangular dot matrix List, Refers to the closest first point in the rectangular dot matrix OK;

[0166] Get the closest first dot horizontal dot correction parameters and longitudinal correction parameters ;

[0167] Calculate the correction parameters for the current correction point:

[0168] ,

[0169] in is the pixel correction matrix Ledi The horizontal pixel correction parameters of the correction points of the row, is the pixel correction matrix Ledi The vertical pixel correction parameters of the correction points of the row, is a preconfigured linear offset coefficient.

[0170] Specifically, the pixel correction matrix is ​​a correction parameter matrix for performing pixel value correction of the screen image, and each correction point in the pixel correction matrix corresponds to two pixel correction parameters, namely, a horizontal pixel correction parameter and a vertical correction parameter. The pixel correction matrix coincides with the display area of ​​the display screen projected by the remote imaging display on the observation window. In the technical solution of the above-mentioned implementation, the linear offset coefficient It can be an integer or non-integer pre-configured based on empirical values. The rounding function.

[0171] Further, in the step of correcting the pixel value of the screen image according to the pixel correction parameter, the controller is configured to:

[0172] The size of the plane where the observation window is located is constructed A pixel filling matrix, wherein each pixel point in the pixel filling matrix corresponds one-to-one to the position of each pixel point in the display screen of the long-distance imaging display;

[0173] Traverse each pixel in the screen image to perform the following steps:

[0174] When traversing to the first Ledi When the pixel point of the row is Ledi The correction parameter of the row is used as the offset of the current pixel to calculate the filling position of the current pixel in the pixel filling matrix:

[0175] ,

[0176] in The first Ledi The horizontal filling position of the pixel point of the row in the pixel filling matrix, The first Ledi The vertical filling position of the pixel points of the row in the pixel filling matrix;

[0177] The screen image is Ledi The pixel values ​​of the pixels in the row are filled into the pixel filling matrix Ledi OK;

[0178] After the pixel points in the screen image are traversed, a corrected target screen image is generated based on the pixel filling matrix.

[0179] Specifically, the pixel filling matrix is ​​a temporary screen image template for recording the pixel value offset of the display screen, and only the offset of each pixel is considered when filling the display screen into the pixel filling matrix.

[0180] In the technical solution of the above-mentioned implementation mode, when the screen image is Ledi The horizontal filling position of the pixel point of the row in the pixel filling matrix is , the vertical filling position is When the screen image is Ledi The pixel values ​​of the pixels in the row are filled into the pixel filling matrix with coordinates of The coordinates here are The pixel coordinates in the matrix are filled for the pixel, rather than the spatial coordinates in the distortion-corrected space.

[0181] Further, when the screen image is Ledi The pixel values ​​of the pixels in the row are filled into the pixel filling matrix Ledi In the steps of the above, the controller is configured to:

[0182] Get the screen image Ledi The pixel value of the pixel in the row And the pixel filling matrix Ledi The pixel value of the row ;

[0183] When the pixels fill the matrix Ledi When the pixel value of a row is not null, the pixel fills the matrix Ledi The pixel value of the row is modified to ;

[0184] When the pixels fill the matrix Ledi When the pixel value of a row is null, the pixel fills the matrix Ledi The pixel value of the row is modified to ;

[0185] In the step of generating a corrected target screen image based on the pixel filling matrix, the controller is configured to:

[0186] Determine the pixel filling matrix Ledi Whether the pixel value of the row is null;

[0187] When the pixels fill the matrix Ledi When the pixel value of the row is not a null value, the pixel is filled into the matrix Ledi The pixel values ​​of the first row are filled into the target screen image. Ledi The pixel position of the row;

[0188] When the pixels fill the matrix Ledi When the pixel value of a row is null, fill the matrix first based on the pixel Ledi The surrounding pixel values ​​of the row pixel position generate the target screen image Ledi The pixel value of the row.

[0189] Specifically, in the initial state, when any pixel position in the pixel filling matrix is ​​not filled, its pixel value is configured as a null value. In the technical solution of the above-mentioned embodiment, when the pixel value of a pixel point in the screen image is filled into a pixel position in the pixel filling matrix, if the pixel value of the pixel position in the pixel filling matrix is ​​a null value, the pixel value of the pixel position is directly filled into the pixel value of the pixel point in the screen image. Since the offset of each pixel in the display screen is different, it may cause the pixel values ​​of multiple pixel points in the display screen to be filled into the same pixel position in the pixel filling matrix, and there may also be a situation where some pixel positions in the pixel filling matrix are not filled.

[0190] After the pixel points in the picture image are traversed, when the pixel fills the matrix Ledi When the pixel value of the row pixel position is null, fill the matrix first based on the pixel Ledi The surrounding pixel values ​​of the row pixel position generate the target screen image Ledi The step of obtaining pixel values ​​of a row of the target screen image is specifically to generate the pixel values ​​of the target screen image by interpolation. Ledi The pixel value of the row.

[0191] like Figure 2 As shown, the second aspect of the present invention provides a display control method for a long-distance imaging display, comprising:

[0192] Constructing a distortion correction space, wherein the distortion correction space is a three-dimensional space including a long-distance imaging display and a preset viewing distance range in front of the long-distance imaging display;

[0193] Detecting whether there is a user watching in front of the long-distance imaging display;

[0194] When a user is viewing the remote imaging display, monitoring the eye position of the user in real time;

[0195] Generating a standard graph for implementing distortion correction at a position corresponding to an observation window of the long-distance imaging display in the distortion correction space;

[0196] Determine that a line between the eye position of the user and each correction element in the standard graph corresponds to an optical path in the optical system;

[0197] Generating a distortion pattern for implementing distortion correction according to the position of the display screen in the distortion correction space corresponding to the optical path;

[0198] The display image of the long-distance imaging display is subjected to distortion correction according to the correction element offset of the standard pattern and the distorted image.

[0199] Specifically, the distortion correction space is constructed in the computer cache space, with the remote imaging display as a reference, and is a three-dimensional coordinate space for implementing distortion correction on the display screen of the remote imaging display. In order to clearly see the display content of the remote imaging display, the user needs to maintain a certain viewing distance from the remote imaging display for viewing, and this viewing distance is usually related to the size of the remote imaging display and the magnification of its display screen.

[0200] In the step of detecting whether there is a user watching the long-distance imaging display, the image acquisition unit acquires the environment image in front of the long-distance imaging display, and performs face recognition on the environment image, thereby judging whether there is a user watching the long-distance imaging display according to whether there is a qualified face in the environment image. Further, in the step of real-time monitoring the face position of the user, when there is a user watching the long-distance imaging display, the image acquisition unit continuously acquires the environment image in front of the long-distance imaging display, and analyzes the face image in each frame of the environment image, thereby obtaining the real-time position of the user's face and eyes.

[0201] Furthermore, after the step of monitoring the eye position of the user in real time, the method further includes:

[0202] Identifying the sight direction of the user according to the facial image on the environmental image;

[0203] Determining whether the user's line of sight falls within the observation window of the long-distance imaging display;

[0204] When the sight line direction of the user falls within the observation window of the long-distance imaging display, generating a standard graph for implementing distortion correction at a position corresponding to the observation window of the long-distance imaging display in the distortion correction space and subsequent steps;

[0205] Otherwise, the steps of generating a standard graph for implementing distortion correction corresponding to the position of the observation window of the long-distance imaging display in the distortion correction space and its subsequent steps are not performed.

[0206] Furthermore, the step of generating a standard pattern for implementing distortion correction at a position corresponding to the observation window of the long-distance imaging display in the distortion correction space specifically includes:

[0207] Determine the enlarged pixel size of each pixel on the display screen of the long-distance imaging display that falls on the plane where the observation window is located after being enlarged by the optical system ;

[0208] Obtaining the resolution of the display screen of the remote imaging display ,in is the horizontal resolution of the display screen, is the vertical resolution of the display screen;

[0209] Determine a lateral resolution less than or equal to The horizontal width of the dot matrix , and a vertical resolution less than or equal to the Vertical width of the dot matrix ;

[0210] Construct a rectangular lattice, the rectangular lattice is composed of The size of the first dots is the magnified pixel size. .

[0211] The horizontal resolution of the display is the number of pixels in the horizontal direction of the display screen. Similarly, the vertical resolution of the display screen is the number of pixels of the display screen in the vertical direction. is the number of first dots in the horizontal direction of the rectangular dot matrix. is the number of first dots of the rectangular dot matrix in the longitudinal direction.

[0212] In the technical solution of the above-mentioned embodiment, a rectangular dot matrix is ​​used as a standard pattern for implementing distortion correction, and each first dot in the rectangular dot matrix is ​​used as a correction element in the standard correction pattern. Since the correction element, i.e., the first dot, has the same size as the pixel of the display screen on the plane where the observation window is located, when it is mapped to the distorted image through the corresponding optical path on the optical system, its mapping point has approximately the same size as the pixel of the display screen on the plane where the display screen is located. Preferably, the horizontal width of the dot matrix is Smaller than the lateral resolution , the longitudinal width of the dot matrix Smaller than the vertical resolution The center point of the rectangular dot matrix overlaps with the center point position of the observation window in the distortion correction space, and the first dots are evenly distributed at a certain distance in the rectangular dot matrix. The size of the first dots specifically refers to the diameter of the first dots.

[0213] Furthermore, the step of determining the size of each pixel on the display screen of the long-distance imaging display that falls within the plane where the observation window is located after being magnified by the optical system specifically includes:

[0214] Obtaining the size of the observation area on the observation window of the remote imaging display ,in is the width of the observation area on the observation window, is the height of the observation area on the observation window;

[0215] Calculate the enlarged pixel size:

[0216] ,or

[0217] .

[0218] Specifically, the observation area on the observation window of the remote imaging display is the area where the display image of the remote imaging display falls on the observation window. The size of the observation area on the observation window of the remote imaging display is It can be pre-measured and configured data.

[0219] Furthermore, the display control method of the remote imaging display further includes:

[0220] Get the size of the display area of ​​the display screen ;

[0221] Calculate the native pixel size of the display:

[0222] ,or

[0223] ;

[0224] Calculate the horizontal magnification of the display image:

[0225] ,

[0226] And the vertical magnification:

[0227] ;

[0228] when When the deviation is less than the preset threshold, the pixel size is enlarged. Pick , Similarly, let Pick , Any value among ;

[0229] when When it is greater than a preset deviation threshold, the enlarged pixel size is:

[0230] ;

[0231] .

[0232] Furthermore, the step of determining that the line between the user's eye position and each correction element in the standard graph corresponds to the optical path in the optical system specifically includes:

[0233] Obtaining a first coordinate of a midpoint of a line connecting two eyes of the user in the distortion correction space and a second coordinate of a center point of each correction element in the distortion correction space;

[0234] determining a straight line connecting the first coordinate and the second coordinate as a first straight line;

[0235] Calculate the third coordinate of a first intersection point of the first straight line and a concave mirror surface in the optical system of the long-distance imaging display;

[0236] Determine a first reflection angle of the first straight line on the concave mirror according to the third coordinate to obtain a second straight line corresponding to a reflection line of the first straight line on the surface of the concave mirror;

[0237] Calculating a fourth coordinate of a second intersection point between the second straight line and the beam splitter surface;

[0238] Determine a second reflection angle of the second straight line on the beam splitter according to the fourth coordinate to obtain a third straight line corresponding to a reflection line of the second straight line on the surface of the beam splitter;

[0239] Calculating a fifth coordinate of a third intersection point between the third straight line and the surface of the display screen;

[0240] A set of line segments connecting the first coordinate, the second coordinate, the third coordinate, the fourth coordinate, and the fifth coordinate is determined as the optical path.

[0241] It can be known that when the user's eye position is different, the optical path corresponding to the line connecting the user and each correction element is also different. Therefore, when the user's head position changes during viewing the display image of the remote imaging display, it is necessary to obtain the user's eye position in real time to determine the optical path corresponding to each correction element. Preferably, in order to reduce the amount of calculation, in the distortion correction calculation, the midpoint of the line connecting the two eyes of the user can be used as the eye position of the user, without performing correction calculations on the two eyes of the user at the same time.

[0242] Furthermore, in the step of determining that the line between the user's eye position and each correction element in the standard figure corresponds to the optical path in the optical system, since the correction element usually has a relatively large size, that is, the correction element usually has a larger area on the plane where the observation window is located, the line between the user's eye position and each correction element in the standard figure referred to here refers to the line between the midpoint of the line connecting the user's two eyes and the center point of the correction element.

[0243] In the step of determining the reflection angle of the first straight line on the concave mirror according to the third coordinate, since the distortion correction space is a coordinate space with the long-distance imaging display as a reference, the coordinate value in the distortion correction space is a fixed value relative to any point in the long-distance imaging display, and the concave mirror is a component fixedly mounted on the long-distance imaging display, so each point on the surface of the concave mirror has a fixed coordinate value in the distortion correction space. In the technical solutions of some embodiments of the present invention, the curvature data of the concave mirror surface is pre-configured, and the curvature of each point on the concave mirror surface can be known by determining the position and posture of the concave mirror, so that after knowing the coordinate value of the first intersection, the corresponding first reflection angle can be obtained according to the curvature data and the incident angle of the first straight line. In the technical solutions of other embodiments of the present invention, in the case where the curvature data of the concave mirror is not pre-configured, the first reflection angle can be obtained by constructing the tangent of the concave mirror at the first intersection in the distortion correction space. Similarly, the beam splitter is a plane mirror, and the second reflection angle of the second straight line on the surface of the beam splitter can be known by determining the position and posture of the beam splitter and the incident angle of the second straight line.

[0244] Before the step of determining a set of line segments connecting the first coordinate, the second coordinate, the third coordinate, the fourth coordinate, and the fifth coordinate as the optical path, the method further includes:

[0245] Determining whether the fifth coordinate falls within the display area of ​​the display screen;

[0246] When the fifth coordinate falls within the display area of ​​the display screen, performing the step of determining a set of line segments connecting the first coordinate, the second coordinate, the third coordinate, the fourth coordinate and the fifth coordinate as the optical path;

[0247] Otherwise, the step of determining a set of line segments connecting the first coordinate, the second coordinate, the third coordinate, the fourth coordinate, and the fifth coordinate as the optical path is not performed.

[0248] Furthermore, each of the first dots has a unique first number in the rectangular dot matrix, and the step of generating a distortion pattern for implementing distortion correction according to the position of the display screen corresponding to the optical path in the distortion correction space specifically includes:

[0249] Traversing each first dot in the rectangular dot matrix;

[0250] Calculate the mapping point coordinates of the first dot on the display screen according to the optical path corresponding to the first dot;

[0251] A second dot having a unique second number is generated in the distorted pattern at the coordinate position of the mapping point, and the size of the second dot is the original pixel size. ;

[0252] Determine the set of the second dots as the distorted pattern;

[0253] The first number, the mapping point coordinates and the second number are associated and saved.

[0254] Specifically, the mapping point coordinates of the first dot on the display screen refer to the fifth coordinates on the optical path corresponding to the first dot. Similarly, the size of the second dot specifically refers to the diameter of the second dot. In the technical solution of the above-mentioned implementation mode, for each second dot in the distorted graph, the mapping relationship between it and the first dot in the rectangular dot matrix is ​​associated and saved by constructing a corresponding ["first number", "second number", "mapping point coordinates"] array.

[0255] Furthermore, the standard pattern is a rectangular dot matrix, the correction element of the standard pattern is the first dot, and the step of performing distortion correction on the display screen of the long-distance imaging display according to the correction element offset of the standard pattern and the distorted image specifically includes:

[0256] Calculate the dot correction parameters of the corresponding correction elements in the standard pattern and the distorted pattern:

[0257] ;

[0258] The dot matrix correction parameters include horizontal dot matrix correction parameters and vertical dot matrix correction parameters. , , The standard figure Ledi The horizontal coordinate of the correction element on the row, The standard figure Ledi The vertical coordinate of the correction element on the row, is the first Ledi The horizontal coordinate of the correction element on the row, is the first Ledi The vertical coordinate of the correction element on the row, The standard figure Ledi The lateral lattice correction parameters of the correction elements on the row, The standard figure Ledi Longitudinal lattice correction parameters of the correction elements on the row;

[0259] Calculate pixel correction parameters on the display screen according to the dot matrix correction parameters, and the pixel correction parameters include horizontal pixel correction parameters and vertical pixel correction parameters ,in , ;

[0260] Acquire each frame of the display content of the remote imaging display;

[0261] The pixel values ​​of the screen image are corrected according to the pixel correction parameters.

[0262] Specifically, a correction element in the standard pattern is mapped to the mapping point coordinates obtained on the display screen through its corresponding optical path, and the correction element of the distortion pattern located at the mapping point coordinates is the correction element corresponding to the correction element in the standard pattern. Taking the above-mentioned embodiment as an example, the first dot of the second coordinate and the second dot of the fifth coordinate on the same optical path are the corresponding correction elements.

[0263] The display content of the remote imaging display includes a screen image arranged frame by frame in a time sequence at a preset frame rate for display on the display screen. In the technical solution of the above-mentioned embodiment, the step of acquiring each frame of the screen image in the display content of the remote imaging display is specifically to acquire the screen image to be displayed on the display screen, so as to perform a process of correcting the pixel value of the screen image according to the pixel correction parameter.

[0264] Furthermore, the step of calculating the pixel correction parameters on the display screen according to the dot matrix correction parameters specifically includes:

[0265] The size of the plane where the observation window is located is constructed A pixel correction matrix, wherein each correction point in the pixel correction matrix corresponds one-to-one to the position of each pixel point in the display image of the long-distance imaging display;

[0266] Traverse each correction point in the pixel correction matrix to perform the following steps:

[0267] When traversing to the pixel correction matrix Ledi When the current correction point is a correction point, the horizontal pixel distance between the current correction point and the first closest point is calculated. and vertical pixel distance ;

[0268] Determine the position of the closest first circle point in the rectangular dot matrix ,in Refers to the closest first point in the rectangular dot matrix List, Refers to the closest first point in the rectangular dot matrix OK;

[0269] Get the closest first dot horizontal dot correction parameters and longitudinal correction parameters ;

[0270] Calculate the correction parameters for the current correction point:

[0271] ,

[0272] in is the pixel correction matrix Ledi The horizontal pixel correction parameters of the correction points of the row, is the pixel correction matrix Ledi The vertical pixel correction parameters of the correction points of the row, is a preconfigured linear offset coefficient.

[0273] Specifically, the pixel correction matrix is ​​a correction parameter matrix for performing pixel value correction of the screen image, and each correction point in the pixel correction matrix corresponds to two pixel correction parameters, namely, a horizontal pixel correction parameter and a vertical correction parameter. The pixel correction matrix coincides with the display area of ​​the display screen projected by the remote imaging display on the observation window. In the technical solution of the above-mentioned implementation, the linear offset coefficient It can be an integer or non-integer pre-configured based on empirical values. The rounding function.

[0274] Furthermore, the step of correcting the pixel value of the screen image according to the pixel correction parameter specifically includes:

[0275] The size of the plane where the observation window is located is constructed A pixel filling matrix, wherein each pixel point in the pixel filling matrix corresponds one-to-one to the position of each pixel point in the display screen of the long-distance imaging display;

[0276] Traverse each pixel in the screen image to perform the following steps:

[0277] When traversing to the first Ledi When the pixel point of the row is Ledi The correction parameter of the row is used as the offset of the current pixel to calculate the filling position of the current pixel in the pixel filling matrix:

[0278] ,

[0279] in The first Ledi The horizontal filling position of the pixel point of the row in the pixel filling matrix, The first Ledi The vertical filling position of the pixel points of the row in the pixel filling matrix;

[0280] The screen image is Ledi The pixel values ​​of the pixels in the row are filled into the pixel filling matrix Ledi OK;

[0281] After the pixel points in the screen image are traversed, a corrected target screen image is generated based on the pixel filling matrix.

[0282] Specifically, the pixel filling matrix is ​​a temporary screen image template for recording the pixel value offset of the display screen, and only the offset of each pixel is considered when filling the display screen into the pixel filling matrix.

[0283] In the technical solution of the above-mentioned implementation mode, when the screen image is Ledi The horizontal filling position of the pixel point of the row in the pixel filling matrix is , the vertical filling position is When the screen image is Ledi The pixel values ​​of the pixels in the row are filled into the pixel filling matrix with coordinates of The coordinates here are The pixel coordinates in the matrix are filled for the pixel, rather than the spatial coordinates in the distortion-corrected space.

[0284] Further, the screen image is Ledi The pixel values ​​of the pixels in the row are filled into the pixel filling matrix Ledi The specific steps include:

[0285] Get the screen image Ledi The pixel value of the pixel in the row And the pixel filling matrix Ledi The pixel value of the row ;

[0286] When the pixels fill the matrix Ledi When the pixel value of a row is not null, the pixel fills the matrix Ledi The pixel value of the row is modified to ;

[0287] When the pixels fill the matrix Ledi When the pixel value of a row is null, the pixel fills the matrix Ledi The pixel value of the row is modified to ;

[0288] The step of generating a corrected target screen image based on the pixel filling matrix specifically includes:

[0289] Determine the pixel filling matrix Ledi Whether the pixel value of the row is null;

[0290] When the pixels fill the matrix Ledi When the pixel value of the row is not a null value, the pixel is filled into the matrix Ledi The pixel values ​​of the first row are filled into the target screen image. Ledi The pixel position of the row;

[0291] When the pixels fill the matrix Ledi When the pixel value of a row is null, fill the matrix first based on the pixel Ledi The surrounding pixel values ​​of the row pixel position generate the target screen image Ledi The pixel value of the row.

[0292] Specifically, in the initial state, when any pixel position in the pixel filling matrix is ​​not filled, its pixel value is configured as a null value. In the technical solution of the above-mentioned embodiment, when the pixel value of a pixel point in the screen image is filled into a pixel position in the pixel filling matrix, if the pixel value of the pixel position in the pixel filling matrix is ​​a null value, the pixel value of the pixel position is directly filled into the pixel value of the pixel point in the screen image. Since the offset of each pixel in the display screen is different, it may cause the pixel values ​​of multiple pixel points in the display screen to be filled into the same pixel position in the pixel filling matrix, and there may also be a situation where some pixel positions in the pixel filling matrix are not filled.

[0293] After the pixel points in the picture image are traversed, when the pixel fills the matrix Ledi When the pixel value of the row pixel position is null, fill the matrix first based on the pixel Ledi The surrounding pixel values ​​of the row pixel position generate the target screen image Ledi The step of obtaining pixel values ​​of a row of the target screen image is specifically to generate the pixel values ​​of the target screen image by interpolation. Ledi The pixel value of the row.

[0294] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0295] According to the embodiments of the present invention as described above, these embodiments do not describe all the details in detail, nor do they limit the invention to the specific embodiments described. Obviously, many modifications and changes can be made based on the above description. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that those skilled in the art can make good use of the present invention and the modified use based on the present invention. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. A long-distance imaging display, characterized in that: The invention comprises a display system, an optical system, a positioning system and a control system. The display system comprises a display screen and a circuit board. The display screen is arranged at the bottom of the long-distance imaging display with its front side facing upward. The optical system comprises a beam splitter arranged above the display screen, a concave mirror arranged on one side of the beam splitter and an observation window arranged on the other side of the beam splitter. The positioning system comprises an image sensor for real-time monitoring of the user's eye position. The control system comprises a controller connected to the circuit board and the image sensor. The controller is configured as follows: Constructing a distortion correction space, wherein the distortion correction space is a three-dimensional space including a long-distance imaging display and a preset viewing distance range in front of the long-distance imaging display; Acquire an environment image in front of the long-distance imaging display, and perform face recognition on the environment image to detect whether there is a user watching in front of the long-distance imaging display; When there is a user watching the long-distance imaging display, continuously acquiring the environment image in front of the long-distance imaging display, and analyzing the face image in each frame of the environment image to monitor the eye position of the user in real time; Identifying the sight direction of the user according to the facial image on the environmental image; Determining whether the user's line of sight falls within the observation window of the long-distance imaging display; When the user's sight direction falls within the observation window of the long-distance imaging display, the following steps are performed: Generating a standard graph for implementing distortion correction at a position corresponding to an observation window of the long-distance imaging display in the distortion correction space; Determine that a line between the eye position of the user and each correction element in the standard graph corresponds to an optical path in the optical system; Generating a distortion pattern for implementing distortion correction according to the position of the display screen in the distortion correction space corresponding to the optical path; The display image of the long-distance imaging display is subjected to distortion correction according to the correction element offset of the standard pattern and the distortion pattern.

2. A display control method for a long-distance imaging display, characterized in that: include: Constructing a distortion correction space, wherein the distortion correction space is a three-dimensional space including a long-distance imaging display and a preset viewing distance range in front of the long-distance imaging display; Acquire an environment image in front of the long-distance imaging display, and perform face recognition on the environment image to detect whether there is a user watching in front of the long-distance imaging display; When there is a user watching the long-distance imaging display, continuously acquiring the environment image in front of the long-distance imaging display, and analyzing the face image in each frame of the environment image to monitor the eye position of the user in real time; Identifying the sight direction of the user according to the facial image on the environmental image; Determining whether the user's line of sight falls within the observation window of the long-distance imaging display; When the user's sight direction falls within the observation window of the long-distance imaging display, the following steps are performed: Generating a standard graph for implementing distortion correction at a position corresponding to an observation window of the long-distance imaging display in the distortion correction space; Determine that a line between the user's eye position and each correction element in the standard graph corresponds to an optical path in the optical system; Generating a distortion pattern for implementing distortion correction according to the position of the display screen in the distortion correction space corresponding to the optical path; The display image of the long-distance imaging display is subjected to distortion correction according to the correction element offset of the standard pattern and the distortion pattern.

3. The display control method of the long-distance imaging display according to claim 2, characterized in that: The step of generating a standard pattern for implementing distortion correction at a position corresponding to the observation window of the long-distance imaging display in the distortion correction space specifically comprises: Determine the enlarged pixel size pse of each pixel on the display screen of the long-distance imaging display that falls within the plane where the observation window is located after being enlarged by the optical system; Obtaining a resolution of the display screen of the long-distance imaging display: hr_screen×vr_screen, wherein hr_screen is the horizontal resolution of the display screen, and vr_screen is the vertical resolution of the display screen; Determine a dot matrix horizontal width hr_matrix that is less than or equal to the horizontal resolution hr_screen, and a dot matrix vertical width vr_matrix that is less than or equal to the vertical resolution vr_screen; A rectangular dot matrix is ​​constructed, where the rectangular dot matrix is ​​composed of hr_matrix×vr_matrix first dots, and the size of the first dots is the enlarged pixel size pse.

4. The display control method of the long-distance imaging display according to claim 3, characterized in that: The step of determining the size of each pixel on the display screen of the long-distance imaging display that falls within the plane where the observation window is located after being magnified by the optical system specifically includes: Obtaining the size of the observation area on the observation window of the long-distance imaging display, i.e., lh_window×lv_window, wherein lh_window is the width of the observation area on the observation window, and lv_window is the height of the observation area on the observation window; Calculate the enlarged pixel size: or 5. The display control method of the long-distance imaging display according to claim 4, characterized in that: The step of determining that the line between the user's eye position and each correction element in the standard graph corresponds to the optical path in the optical system specifically includes: Obtaining a first coordinate of a midpoint of a line connecting two eyes of the user in the distortion correction space and a second coordinate of a center point of each correction element in the distortion correction space; determining a straight line connecting the first coordinate and the second coordinate as a first straight line; Calculate the third coordinate of a first intersection point of the first straight line and a concave mirror surface in the optical system of the long-distance imaging display; Determine a first reflection angle of the first straight line on the concave mirror according to the third coordinate to obtain a second straight line corresponding to a reflection line of the first straight line on the surface of the concave mirror; Calculating a fourth coordinate of a second intersection point of the second straight line and the beam splitter surface; Determine a second reflection angle of the second straight line on the beam splitter according to the fourth coordinate to obtain a third straight line corresponding to a reflection line of the second straight line on the surface of the beam splitter; Calculating a fifth coordinate of a third intersection point between the third straight line and the surface of the display screen; A set of line segments connecting the first coordinate, the second coordinate, the third coordinate, the fourth coordinate, and the fifth coordinate is determined as the optical path.

6. The display control method of the long-distance imaging display according to claim 5, characterized in that: Each of the first dots has a unique first number in the rectangular dot matrix, and the step of generating a distortion pattern for implementing distortion correction according to the position of the display screen corresponding to the optical path in the distortion correction space specifically includes: Traversing each first dot in the rectangular dot matrix; Calculate the mapping point coordinates of the first dot on the display screen according to the optical path corresponding to the first dot; Generate a second dot having a unique second number in the distorted pattern at the coordinate position of the mapping point, wherein the size of the second dot is the original pixel size pso; Determine the set of the second dots as the distorted pattern; The first number, the mapping point coordinates and the second number are associated and saved.

7. The display control method of the long-distance imaging display according to claim 3, characterized in that: The standard pattern is a rectangular dot matrix, the correction element of the standard pattern is the first dot, and the step of performing distortion correction on the display screen of the long-distance imaging display according to the correction element offset of the standard pattern and the distortion pattern specifically includes: Calculate the dot correction parameters of the corresponding correction elements in the standard pattern and the distorted pattern: The dot matrix correction parameters include horizontal dot matrix correction parameters and vertical dot matrix correction parameters, 1≤i≤hr_matrix, 1≤j≤vr_matrix, he ij is the horizontal coordinate of the correction element on the i-th column and j-th row of the standard graph, ve ij is the vertical coordinate of the correction element on the i-th column and j-th row of the standard graph, ho ij is the horizontal coordinate of the correction element on the i-th column and j-th row of the distortion pattern, vo ij is the vertical coordinate of the correction element on the i-th column and j-th row of the distortion pattern, hco_matrix ij is the horizontal lattice correction parameter of the correction element on the i-th column and j-th row of the standard pattern, vco_matrix ij is the longitudinal lattice correction parameter of the correction element on the i-th column and the j-th row of the standard pattern; Calculate the pixel correction parameters on the display screen according to the dot matrix correction parameters, and the pixel correction parameters include horizontal pixel correction parameters hco_screen lm and vertical pixel correction parameter vco_screen lm , where 1≤l≤hr_screen, 1≤m≤vr_screen; Acquire each frame of the display content of the remote imaging display; The pixel values ​​of the screen image are corrected according to the pixel correction parameters.

8. The display control method of the long-distance imaging display according to claim 7, characterized in that: The step of calculating the pixel correction parameters on the display screen according to the dot matrix correction parameters specifically includes: Constructing a pixel correction matrix of a size of hr_screen×vr_screen on the plane where the observation window is located, wherein each correction point in the pixel correction matrix corresponds one-to-one to the position of each pixel point in the display screen of the long-distance imaging display; Traverse each correction point in the pixel correction matrix to perform the following steps: When traversing to the correction point in the lth column and the mth row of the pixel correction matrix, calculating the horizontal pixel distance dh and the vertical pixel distance dv between the current correction point and the first closest circle point; Determine the position (it, jt) of the closest first dot in the rectangular dot matrix, where it refers to the it-th column of the closest first dot in the rectangular dot matrix, and jt refers to the jt-th row of the closest first dot in the rectangular dot matrix; Get the closest first dot horizontal matrix correction parameter hco_matrix it,jt and longitudinal correction parameters vco_matrix it,jt ; Calculate the correction parameters for the current correction point: where hco_pixcel lm is the horizontal pixel correction parameter of the correction point in the lth column and the mth row in the pixel correction matrix, vco_pixcel lm is the longitudinal pixel correction parameter of the correction point in the lth column and the mth row in the pixel correction matrix, and σ is a pre-configured linear offset coefficient.

9. The display control method of the long-distance imaging display according to claim 8, characterized in that: The step of correcting the pixel value of the screen image according to the pixel correction parameter specifically includes: Constructing a pixel filling matrix of a size of hr_screen×vr_screen on the plane where the observation window is located, wherein each pixel point in the pixel filling matrix corresponds one-to-one to the position of each pixel point in the display screen of the long-distance imaging display; Traverse each pixel in the screen image to perform the following steps: When traversing to the pixel point in the lth column and the mth row in the screen image, the filling position of the current pixel point in the pixel filling matrix is ​​calculated using the correction parameter in the lth column and the mth row in the pixel correction matrix as the offset of the current pixel point: where l_fill lm m_fill is the horizontal filling position of the pixel point in the lth column and the mth row on the screen image in the pixel filling matrix, lm is the vertical filling position of the pixel point in the lth column and the mth row on the screen image in the pixel filling matrix; Fill the pixel value of the pixel point in the lth column and the mth row of the screen image into the l_fill matrix of the pixel filling matrix lm Column m_fill lm OK; After the pixel points in the screen image are traversed, a corrected target screen image is generated based on the pixel filling matrix.

10. The display control method of the long-distance imaging display according to claim 9, characterized in that: Fill the pixel value of the pixel point in the lth column and the mth row of the screen image into the l_fill matrix of the pixel filling matrix lm Column m_fill lm The specific steps include: Get the pixel value (R0, G0, B0) of the pixel point in the lth column and the mth row of the screen image and the l_fill matrix of the pixel filling matrix. lm Column m_fill lm The pixel value of the row (R f ,G f ,B f ); When the pixel fills the matrix l_fill lm Column m_fill lm When the pixel value of a row is not null, the pixel fills the matrix l_fill lm Column m_fill lm The pixel value of the row is modified to When the pixel fills the matrix l_fill lm Column m_fill lm When the pixel value of a row is null, the pixel fills the matrix l_fill lm Column m_fill lm The pixel value of the row is modified to (R0, G0, B0); The step of generating a corrected target screen image based on the pixel filling matrix specifically includes: Determine the pixel filling matrix l_fill lm Column m_fill lm Whether the pixel value of the row is null; When the pixel fills the matrix l_fill lm Column m_fill lm When the pixel value of a row is not null, fill the matrix with the pixel l_fill lm Column m_fill lm The pixel values ​​of the row are filled into the l_fill row of the target screen image. lm Column m_fill lm The pixel position of the row; When the pixel fills the matrix l_fill lm Column m_fill lm When the pixel value of a row is null, fill the matrix l_fill based on the pixel lm Column m_fill lm The surrounding pixel values ​​of the row pixel position generate the target screen image l_fill lm Column m_fill lm The pixel value of the row.

Images