Method and device for stabilizing cockpit screen image under large-amplitude shaking scene of airplane

Abstract

The invention belongs to the technical field of cockpits, and relates to a cockpit screen image stabilizing method and device in a large-amplitude shaking scene of an airplane. In an unstable scene of an airplane, when a driver and a display screen generate relatively large relative position deviation due to shaking and the readability of a display picture is reduced, the method provided by the invention dynamically adjusts the position of the display picture relative to a human body through observing the image position by human eyes and the shaking direction of the human body relative to the display screen, so that the readability of the display picture is improved. The stability of an image picture relative to human eyes is realized, so that the readability of a driver to a display picture in a scene that an airplane shakes greatly is enhanced.

Description

Technical Field

[0001] The present invention belongs to the technical field of cockpits, and relates to a method and device for stabilizing the cockpit screen image in the scenario of significant aircraft shaking. Background Art

[0002] In the traditional display screen display scheme, the driver and the display are two independent individuals. When the display screen is displayed, it is assumed that the position of the driver is fixed and cannot be dynamically adjusted according to the change of the driver's position; when the aircraft encounters unstable air currents and shakes significantly at high frequencies, both the display screen and the driver will shake. Since the shaking amplitudes and frequencies of the display screen and the human body are inconsistent, and coupled with the phenomenon of visual persistence of the human eye, the driver will experience image deformation, elongation, etc. when observing the image, which will further lead to the inability to identify the content of the screen. Especially on a display screen with touch operations, it will also affect the pilot's flight operations. Summary of the Invention

[0003] In view of the above technical problems, the present invention discloses a method and device for stabilizing the cockpit screen image in the scenario of significant aircraft shaking. By dynamically adjusting the position of the image relative to the human body according to the position of the human eye observing the image and the shaking direction of the human body relative to the display screen, the stability of the image screen relative to the human eye is achieved, thereby enhancing the readability of the display screen by the driver in the scenario of significant aircraft shaking.

[0004] To achieve the above technical objectives, the present invention provides the following technical solutions:

[0005] A device for stabilizing the cockpit screen image in the scenario of significant aircraft shaking, the device comprising: a camera, a display screen, and a control computer; the camera and the display screen are both connected to the control computer;

[0006] The display screen is used for displaying a picture, and the display screen includes a display area and an active area. The display area is located at the center position of the display screen; in the initialization stage, the display picture is at the position of the display area;

[0007] The camera is installed and fixed on the display screen, and is used for detecting the position of the driver and the observation point of the driver's eyes. When the camera detects that the driver is staring at the display screen, it obtains the position of the driver relative to the screen and sends the position of the driver relative to the display screen to the control computer;

[0008] The control computer receives the position of the driver relative to the display screen sent by the camera, calculates the new display position of the display picture on the display screen according to the position of the driver relative to the display screen, and generates a display control instruction; the control computer sends the display control instruction to the display screen so that the display picture is displayed at the new display position on the display screen.

[0009] Further, the camera is fixedly arranged above the display screen.

[0010] Further, the control computer determines whether it is necessary to calculate a new display position of the display screen on the display screen according to the position of the driver relative to the display screen; the specific determination method is as follows:

[0011] In the startup initialization stage, clear the deviation counter and driver position information;

[0012] The fixed camera captures the driver's image, and calculates the position P0 of the driver in the camera image; after an interval of T seconds, the camera captures the driver's image again, and calculates the position P1 of the driver in the camera image; calculate the position deviation ΔP = P1 - P0 between the two times, and determine whether ΔP is greater than a preset threshold P; if ΔP is greater than the threshold P, the deviation counter N is incremented by 1, that is, N = N + 1. If the cumulative value N of the deviation counter is greater than the threshold M, it is considered that a continuous large-amplitude shaking situation has occurred, and it is necessary to calculate a new display position of the display screen on the display screen.

[0013] A method for stabilizing the cockpit screen image in a large-amplitude shaking scenario of an aircraft, the method comprising the following steps:

[0014] (1) Position calculation: The camera detects the position of the driver and the observation point of the driver's eyes. When the camera detects that the driver is looking at the display screen, obtain the position of the driver relative to the screen, and send the position of the driver relative to the display screen to the control computer;

[0015] The control computer receives the position of the driver relative to the display screen sent by the camera, and determines whether it is necessary to calculate a new display position of the display screen on the display screen; when it is determined that a new display position needs to be calculated, the control computer generates a display control instruction and sends the display control instruction to the display screen;

[0016] (2) Display control: The display screen receives the display control instruction sent by the computer and displays the display position of the picture on the display screen according to the display control instruction.

[0017] Further, step (1) specifically includes:

[0018] (1.1) In the startup initialization stage, clear the deviation counter and driver position information;

[0019] (1.2) The fixed camera captures the driver's image, and calculates the position P0 of the driver in the camera image;

[0020] After an interval of T seconds, the camera captures the driver's image again, and calculates the position P1 of the driver in the camera image;

[0021] Calculate the position deviation ΔP = P1 - P0 twice, and determine whether ΔP is greater than a preset threshold P; if ΔP is greater than the threshold P, the deviation counter N is incremented by 1, i.e., N = N + 1, and proceed to step (1.3);

[0022] If ΔP is less than the threshold P, clear the deviation counter and return to step (1.1);

[0023] (1.3) If, through accumulation, the deviation counter N is greater than the threshold M, it is considered that a continuous large - amplitude shaking situation has occurred. Output the deviation amount ΔP, control the computer to generate a display control instruction, and send the display control instruction to the display screen; if N is less than the threshold M, proceed to step (1.2).

[0024] Further, step (2) specifically includes:

[0025] (2.1) In the initialization stage, adjust the center position of the display screen on the display screen, that is, adjust the display screen so that it is located at the position of the display area; and record the initial image coordinates of the display screen as x0 and y0, where x0 is the abscissa of the display screen and y0 is the ordinate of the display screen;

[0026] (2.2) Read the deviation amount ΔP sent by the control computer, ΔP = (ΔP x , ΔP y ), where ΔP x represents the component of the deviation amount ΔP on the horizontal coordinate system, and ΔP y represents the component of the deviation amount ΔP on the vertical coordinate system;

[0027] Accumulate the deviation amount to the initial image coordinates of the display screen to generate the new display position (x1, y1) of the display screen on the display screen, where x1 = x0 + ΔP x , y1 = y0 + ΔP y ; x1 is the abscissa of the new display position of the display screen, and y1 is the ordinate of the new display position of the display screen;

[0028] (2.3) The control computer sends the new display position of the display screen to the display screen;

[0029] (2.4) The display screen is displayed at the new display position on the display screen.

[0030] Further, if the new display position (x1, y1) of the display screen on the display screen exceeds the display range of the display screen, set the new display position of the display screen on the display screen to the screen edge position.

[0031] The beneficial effects of the present invention are:

[0032] When there is a large relative position deviation between the driver and the display screen due to shaking in an unstable aircraft scenario, resulting in a decrease in the readability of the display screen, the method provided by the present invention dynamically adjusts the position of the display screen relative to the human body by observing the position of the image by the human eye and the shaking direction of the human body relative to the display screen, so as to achieve the stability of the image screen relative to the human eye, thereby enhancing the readability of the display screen by the driver in a scenario of large aircraft shaking.

[0033] The method provided by the present invention increases the ability of the driver to timely obtain the aircraft operation status through the display screen under unstable flight conditions, and improves flight safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 It is a schematic structural diagram of a cockpit screen image stabilization device in a scenario of large aircraft shaking according to an embodiment of the present invention;

[0035] Figure 2 It is a schematic diagram of a display screen according to an embodiment of the present invention;

[0036] Figure 3 It is a position calculation flowchart in the method of cockpit screen image in a scenario of large aircraft shaking according to an embodiment of the present invention;

[0037] Figure 4 It is a display control flowchart in the method of cockpit screen image in a scenario of large aircraft shaking according to an embodiment of the present invention;

[0038] Reference numerals: 1. Camera; 2. Display screen; 3. Control computer. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0039] The technical solutions of the present invention will be further described below in conjunction with specific embodiments and drawings.

[0040] Embodiment 1: A cockpit screen image stabilization device in a scenario of large aircraft shaking, as Figure 1 shown, the device includes: a camera, a display screen, and a control computer; the camera and the display screen are both connected to the control computer;

[0041] The display screen is used to display the picture, as Figure 2 shown, the display screen includes a display area and an active area, and the display area is located in the center of the display screen; in the initialization stage, the display picture is at the position of the display area;

[0042] The camera is installed and fixed on the display screen, and is used to detect the position of the driver and the observation point of the driver's eyes. When the camera detects that the driver is looking at the display screen, it obtains the position of the driver relative to the screen and sends the position of the driver relative to the display screen to the control computer;

[0043] The control computer receives the position of the driver relative to the display screen sent by the camera, calculates the new display position of the display image on the display screen according to the position of the driver relative to the display screen, and generates a display control instruction; the control computer sends the display control instruction to the display screen so that the display image is displayed at the new display position on the display screen.

[0044] In this embodiment, the camera is fixedly arranged above the display screen. Specifically, it is used to identify and detect the position of the driver's head and the observation point of the eyes. The resolution of the camera meets the requirement of being able to identify the driver's eyes, and the viewing angle range of the camera should be able to cover the entire seat of the driver.

[0045] In this embodiment, the control computer determines whether it is necessary to calculate the new display position of the display image on the display screen according to the position of the driver relative to the display screen; the specific judgment method is as follows:

[0046] In the startup initialization stage, clear the deviation counter and the driver position information;

[0047] The fixed camera captures the driver's image and calculates the position P0 of the driver in the camera image; after an interval of T seconds, the camera captures the driver's image again and calculates the position P1 of the driver in the camera image; calculate the two - position deviation ΔP = P1 - P0, and determine whether ΔP is greater than a preset threshold P; if ΔP is greater than the threshold P, the deviation counter N is incremented by 1, that is, N = N + 1. If the cumulative value N of the deviation counter is greater than the threshold M, it is considered that a continuous large - amplitude shaking situation has occurred, and it is necessary to calculate the new display position of the display image on the display screen.

[0048] Embodiment 2: A method for stabilizing the cockpit screen image in a situation of large - amplitude shaking of an aircraft. Using the device described in Embodiment 1, the method includes the following steps:

[0049] (1) Position calculation: The camera detects the position of the driver and the observation point of the driver's eyes. When the camera detects that the driver is looking at the display screen, it obtains the position of the driver relative to the screen and sends the position of the driver relative to the display screen to the control computer;

[0050] The control computer receives the position of the driver relative to the display screen sent by the camera, and determines whether it is necessary to calculate the new display position of the display picture on the display screen; when it is determined that it is necessary to calculate the new display position, the control computer generates a display control instruction and sends the display control instruction to the display screen;

[0051] (2) Display control: The display screen receives the display control instruction sent by the computer and displays the display position of the picture on the display screen according to the display control instruction.

[0052] In this embodiment, as Figure 3 shown, step (1) specifically includes:

[0053] (1.1) In the startup initialization stage, clear the deviation counter and the driver position information;

[0054] (1.2) The fixed camera captures the driver's image and calculates the position P0 of the driver in the camera picture;

[0055] After an interval of T seconds, the camera captures the driver's image again and calculates the position P1 of the driver in the camera picture;

[0056] Calculate the position deviation ΔP = P1 - P0 between the two times, and determine whether ΔP is greater than the preset threshold P; if ΔP is greater than the threshold P, the deviation counter N is incremented by 1, that is, N = N + 1, and step (1.3) is entered;

[0057] If ΔP is less than the threshold P, clear the deviation counter and return to step (1.1) to restart the comparison of the position change of the driver relative to the camera at different times;

[0058] Specifically, in the present invention, both the position P0 and the position P1 include the position coordinates in the horizontal and vertical directions.

[0059] (1.3) If the deviation counter accumulates and N is greater than the threshold M, it is considered that a continuous large-amplitude shaking situation has occurred, output the deviation amount ΔP, the control computer generates a display control instruction, and sends the display control instruction to the display screen; if N is less than the threshold M, enter step (1.2).

[0060] In this embodiment, as Figure 4 shown, step (2) specifically includes:

[0061] (2.1) In the initialization stage, adjust the center position of the display picture on the display screen, that is, adjust the display picture so that the display picture is located at the position of the display area; and record the initial image coordinates of the display picture as x0 and y0, where x0 is the abscissa of the display picture and y0 is the ordinate of the display picture;

[0062] (2.2) Read the deviation ΔP sent by the control computer, where ΔP = (ΔP x , ΔP y ), and ΔP x represents the component of the deviation ΔP on the horizontal coordinate system, and ΔP y represents the component of the deviation ΔP on the vertical coordinate system;

[0063] Add the deviation to the initial image coordinates of the display screen to generate a new display position of the display screen on the display screen. The coordinates of the new display position are: x1 = x0 + ΔP x , y1 = y0 + ΔP y ; x1 is the abscissa of the new display position of the display screen, and y1 is the ordinate of the new display position of the display screen;

[0064] (2.3) The control computer sends the new display position of the display screen to the display screen;

[0065] (2.4) The display screen is displayed at the new display position on the display screen. Specifically, if the new display position (x1, y1) of the display screen on the display screen exceeds the display range of the display screen, the new display position of the display screen on the display screen is set to the screen edge position.

[0066] The method provided by the present invention realizes real-time adjustment of the position of the screen image relative to the driver by adding the detection of the driver's position relative to the display screen and the detection of the driver's viewing point on the screen, achieving the stability of the screen relative to the driver in the scenarios of aircraft and driver shaking, avoiding the situation that the display screen is not clear due to shaking, and improving the readability and operation safety of the driver for the display screen.

[0067] Finally, it should be noted that the above are only the preferred embodiments of the present invention and are not used to limit the present invention. For those of ordinary skill in the art, they can still modify or improve the aforementioned technical solutions, and these all belong to the protection scope of the present invention.

Claims

1. A cockpit screen image stabilization device in a scenario where an aircraft shakes significantly, characterized in that: The device comprises: a camera, a display screen, and a control computer; the camera and the display screen are both connected to the control computer; The display screen is used to display a picture, and the display screen includes a display area and an activity area, and the display area is located at the center of the display screen; in the initialization stage, the display picture is located at the position of the display area; The camera is installed and fixed on the display screen, and is used to detect the position of the driver and the observation point of the driver's eyes. When the camera detects that the driver is looking at the display screen, the position of the driver relative to the screen is obtained, and the position of the driver relative to the display screen is sent to the control computer; The control computer receives the position of the driver relative to the display screen sent by the camera, calculates a new display position of the display image on the display screen according to the position of the driver relative to the display screen, and generates a display control instruction; the control computer sends the display control instruction to the display screen so that the display image is displayed at the new display position on the display screen.

2. According to claim 1, a cockpit screen image stabilization device in a scenario where the aircraft shakes significantly, characterized in that: The camera is fixedly arranged above the display screen.

3. According to claim 1, a cockpit screen image stabilization device in a scenario where the aircraft shakes significantly, characterized in that: The control computer determines whether it is necessary to calculate a new display position of the display image on the display screen according to the position of the driver relative to the display screen; the specific determination method is: During the startup initialization phase, the deviation counter and driver position information are cleared; A fixed camera captures the driver's image and calculates the driver's position P0 in the camera screen; after an interval of T seconds, the camera captures the driver's image again and calculates the driver's position P1 in the camera screen; the two position deviations ΔP=P1-P0 are calculated, and it is determined whether ΔP is greater than a preset threshold value P; if ΔP is greater than the threshold value P, the deviation counter N increases by 1, that is, N=N+1. If the deviation counter passes through a cumulative value N greater than a threshold value M, it is considered that continuous large shaking has occurred, and it is necessary to calculate the new display position of the display image on the display screen.

4. A method for stabilizing cockpit screen images in a scenario where an aircraft shakes significantly, using the device described in any one of claims 1 to 3, characterized in that: The method comprises the following steps: (1) Position calculation: The camera detects the position of the driver and the observation point of the driver's eyes. When the camera detects that the driver is looking at the display screen, the position of the driver relative to the screen is obtained and sent to the control computer; The control computer receives the position of the driver relative to the display screen sent by the camera, and determines whether it is necessary to calculate a new display position of the display image on the display screen; when it is determined that the new display position needs to be calculated, the control computer generates a display control instruction and sends the display control instruction to the display screen; (2) Display control: The display screen receives the display control instructions sent by the computer and displays the picture on the display screen according to the display control instructions.

5. According to claim 4, a method for stabilizing cockpit screen images in a scenario where the aircraft shakes significantly, characterized in that: Step (1) specifically includes: (1.1) During the startup initialization phase, clear the deviation counter and driver position information; (1.2) A fixed camera captures the driver's image and calculates the driver's position P0 in the camera image; After an interval of T seconds, the camera captures the driver's image again and calculates the driver's position P1 in the camera image; Calculate the position deviation ΔP=P1-P0 twice, and determine whether ΔP is greater than the preset threshold value P; if ΔP is greater than the threshold value P, the deviation counter N increases by 1, that is, N=N+1, and enter step (1.3); If ΔP is less than the threshold value P, the deviation counter is cleared and the process returns to step (1.1); (1.3) If the deviation counter accumulates and N is greater than the threshold value M, it is considered that continuous large shaking has occurred, and the deviation amount ΔP is output. The control computer generates a display control instruction and sends the display control instruction to the display screen; if N is less than the threshold value M, go to step (1.2).

6. According to claim 4, a method for stabilizing cockpit screen images in a scenario where the aircraft shakes significantly, characterized in that: Step (2) specifically includes: (2.1) In the initialization stage, the display image is adjusted to be centered on the display screen, that is, the display image is adjusted so that the display image is located at the position of the display area; and the initial image coordinates of the display image are recorded as x0 and y0, where x0 is the horizontal coordinate of the display image and y0 is the vertical coordinate of the display image; (2.2) Read the deviation ΔP sent by the control computer, ΔP = (ΔP x , ΔP y ), ΔP x It represents the component of the deviation ΔP in the transverse coordinate system, ΔP y Represents the component of the deviation ΔP in the longitudinal coordinate system; The deviation is accumulated to the initial image coordinates of the display image to generate a new display position (x1, y1) of the display image on the display screen, where x1 = x0 + ΔP x , y1=y0+ΔP y ; x1 is the horizontal coordinate of the new display position of the display screen, and y1 is the vertical coordinate of the new display position of the display screen; (2.3) The control computer sends the new display position of the display image to the display screen; (2.4) The display picture is displayed at the new display position on the display screen.

7. The method for stabilizing cockpit screen images in a scenario where the aircraft shakes significantly according to claim 6, characterized in that: If the new display position (x1, y1) of the display picture on the display screen exceeds the display range of the display screen, the new display position of the display picture on the display screen is set to the screen edge position.

Images