Interactive marine HUD working system based on binocular vision

Abstract

The invention discloses an interactive marine HUD working system based on binocular vision, which comprises at least one display screen, the display screen is fixed through a bottom shell and a shading plate which are oppositely arranged front and back, a control system and an input module are arranged on the bottom shell, and an image generation module for converting an electric signal into an image on the display screen is arranged in the bottom shell. The input module and the image generation module are electrically connected with the control system; a binocular camera is arranged on the bottom shell, and meanwhile an interaction information processing module electrically connected with the binocular camera is arranged in the bottom shell. The control system comprises a master controller, a lighting signal output end of the master controller is connected with a lighting signal input end of a lighting controller, a driving signal output end of the lighting controller is connected with a driving signal input end of a headlight driver, a display driving signal output end of the master controller is connected with a display signal input end of a display driving module, and the control system further comprises a power supply adaptation module. And the HUD can be stably driven for display.

Description

Technical Field

[0001] This invention relates to the field of marine display equipment technology, and more specifically to an interactive marine HUD working system based on binocular vision. Background Technology

[0002] A head-up display (HUD) is a transparent display technology that projects critical information into the user's field of vision. Originally designed for fighter pilots, it is now widely used in the automotive, marine, aerospace, and industrial sectors. Its core objective is to allow users to access information without looking down, thereby improving operational safety and efficiency.

[0003] Common HUDs have poor environmental adaptability, especially those used on ships. Since ships often sail in vast waters such as rivers, lakes and seas, there are no obstructions and direct sunlight. When exposed to direct sunlight, the display is more likely to be covered by strong light due to insufficient brightness, which poses a safety hazard.

[0004] Chinese patent CN109683322A discloses a multifunctional marine HUD display system, but it only discloses a method for processing marine information and does not reveal the specific structure of the HUD, making it impossible to install and fix in a ship. Furthermore, since some ships sail on the sea, they need to access maritime communication protocols, radar, AIS, and other protocols to ensure navigational safety. Common HUDs have poor compatibility and cannot meet these connectivity requirements. Summary of the Invention

[0005] This invention aims to solve the technical problems existing in the prior art, and innovatively proposes an interactive marine HUD working system based on binocular vision, which can stably drive the HUD to display.

[0006] To achieve the above objectives, the present invention provides an interactive marine HUD working system based on binocular vision, including at least one display screen for displaying ship information. The display screen is fixed by a bottom shell and a light shield arranged opposite each other. The bottom shell is equipped with a control system for realizing the display screen function and an input module for receiving information sent by the ship's display and control console. An image generation module for converting electrical signals into images on the display screen is installed inside the bottom shell. Both the input module and the image generation module are electrically connected to the control system. A binocular camera is installed on the bottom shell, and an interactive information processing module electrically connected to the binocular camera is installed inside the bottom shell.

[0007] The control system includes a main controller, whose lighting signal output terminal is connected to the lighting signal input terminal of the lighting controller, whose drive signal output terminal is connected to the drive signal input terminal of the headlight driver, whose display drive signal output terminal is connected to the display signal input terminal of the display driver module, and also includes a power adapter module for supplying power to various electrical devices.

[0008] In the above scheme: the display screen has three sides, and the left and right sides form a certain angle with the front display screen. Each display screen is fixed to the bottom shell by a corresponding light shield.

[0009] The bottom shell includes two bottom beams arranged opposite each other. On each bottom beam, there are mounting boxes for installing image generation modules on the left and right sides of each display screen. The front side of the mounting box is set as an opening, and the upper and lower ends of the mounting box are installed with the bottom beams on the corresponding sides. The mounting box is provided with mounting blocks for installing light shields.

[0010] In the above scheme: each bottom beam has a right-angle bend at its front end to limit the display screen from the rear;

[0011] The base is equipped with a mounting bracket for mounting the entire device in the cab. The mounting bracket includes a vertical frame connected to the base and a horizontal frame connected to the cab. Reinforcing ribs are provided between the vertical frame and the horizontal frame. In order to facilitate the adjustment of the installation height of the HUD device, multiple mounting holes are provided vertically and vertically on the horizontal frame.

[0012] In the above scheme: the power adapter module includes a synchronous buck converter. The power input terminal of the synchronous buck converter is connected to one end of capacitor C31, one end of capacitor C37, one end of resistor R540, one end of capacitor C41, and one end of capacitor C23. The other end of capacitor C23 is connected to one end of inductor L5 and the ship's main information output terminal. The other end of inductor L5 is connected to one end of terminal block J1 and one end of capacitor C571. The ground terminal of the synchronous buck converter, the other end of capacitor C31, capacitor C37, capacitor C41, capacitor C23, and capacitor C571 are all connected to the power ground. The other end of resistor R540 is connected to the enable terminal of the synchronous buck converter. The VCC terminal of the synchronous buck converter is connected to one end of capacitor C587, and the other end of capacitor C587 is connected to the power ground.

[0013] The BOOT terminal of the synchronous buck converter is connected to one end of capacitor C38. The other end of capacitor C38 is connected to the NC terminal of the synchronous buck converter and one end of inductor L2. The other end of inductor L2 is connected to one end of capacitor C26, one end of capacitor C536, one end of resistor R535, one end of capacitor C19, one end of capacitor C18, one end of resistor R20, one end of capacitor C537, the VIN terminal of the switching regulator, the VIN terminal of the load switch, and the VIN terminal of the regulator. The other end of capacitor C26 is connected to resistor R536. The other end of resistor R544 is connected to the feedback terminal of the synchronous buck converter and one end of resistor R544. The other ends of resistor R544, capacitor C536, capacitor C19, and capacitor C18 are all connected to power ground. The other end of resistor R20 is connected to the CTRL terminal of the switching regulator and the PG terminal of the synchronous buck converter. The COMP terminal of the switching regulator is connected to one end of resistor R517. The other end of resistor R517 is connected to the other end of capacitor C519. The other end of capacitor C519 is connected to power ground.

[0014] The SW terminal of the switching regulator is connected to one end of inductor L516 and the positive terminal of diode D1. The other end of inductor L516 is connected to the VIN terminal of the switching regulator. The negative terminal of diode D1 is connected to one end of resistor R508, one end of capacitor C2, one end of capacitor C513, one end of resistor R505, one end of capacitor C512, and the IN and IN2 terminals of the linear regulator. The other end of resistor R508 is connected to the feedback terminal of the switching regulator and one end of resistor R4. The other end of resistor R4, the ground terminal of the switching regulator, the other end of capacitor C2, the other end of capacitor C513, the other end of capacitor C512, and the ground terminal of the linear regulator are all connected to the power supply ground. The output terminal and SNS terminal of the linear regulator are both connected to one end of resistor R500. The other end of resistor R500 is connected to one end of capacitor C516. The other end of capacitor C516 is connected to the power supply ground.

[0015] In the above scheme: the ON terminal of the load switch is connected to the enable terminal of the lighting controller and one end of the resistor R5, the other end of the resistor R5 and the ground terminal of the load switch are connected to the power supply ground, the output terminal of the load switch outputs 3.3V voltage, which is the 3.3V power supply terminal of the power adapter module, and is connected to one end of the resistor R9, the other end of the resistor R9 is connected to the QOD terminal of the load switch, and the CT terminal of the load switch is connected to the power supply ground;

[0016] The first enable terminal of the voltage regulator is connected to the enable terminal of the lighting controller and one end of resistor R13. The second enable terminal of the voltage regulator is connected to the enable terminal of the lighting controller and one end of resistor R16. The other ends of resistor R13, resistor R16, and the voltage regulator's ground terminal are connected to the power supply ground. The voltage regulator's MODE / DATA terminal is connected to one end of resistor R21, and the other end of resistor R21 is connected to the power supply ground. The first output terminal of the voltage regulator is connected to one end of inductor L518. The other end of inductor L518 outputs a 1.8V voltage, which is the 1.8V power supply terminal for the power adapter module. The other end of inductor L518 is also connected to the voltage regulator's feedback terminal, one end of resistor R513, one end of capacitor C526, and one end of capacitor C525. The other end of resistor R513 is connected to one end of resistor R514. The other ends of resistor R514, capacitor C526, and capacitor C525 are all connected to the power supply ground. The second output terminal of the voltage regulator is connected to one end of inductor L520. The other end of inductor L520 outputs a 1.1V voltage, which is the 1.1V power supply terminal for the power adapter module. The other end of inductor L520 is also connected to one end of capacitor C561, one end of resistor R24, one end of capacitor C559, and one end of capacitor C27. The other end of resistor R24 ​​is connected to one end of resistor R32. The other ends of resistor R32, capacitor C559, and capacitor C27 are all connected to the power supply ground. The other end of capacitor C561 is connected to the ADJ2 terminal of the voltage regulator.

[0017] In the above scheme: the input terminal of the main controller PLL_REFCLK is connected to one end of capacitor C518, one end of resistor R509, and the first terminal of oscillator Y500; the output terminal of the main controller PLL_REFCLK is connected to the other end of resistor R509 and one end of resistor R520; one end of resistor R520 is connected to the third terminal of oscillator Y500 and one end of capacitor C521; the other end of capacitor C521 and the other end of capacitor C518 are connected to power ground; the VCC3IO_COSC terminal of the main controller is connected to one end of ferrite bead L519 and one end of capacitor C542; the other end of ferrite bead L519 is connected to the 3.3V power supply terminal; the GNDIOLA_COSC terminal of the main controller is connected to the other end of capacitor C542 and connected to power ground; the VCC11AD_PLLM terminal of the main controller is connected to the power supply ground. One end of capacitor C533, one end of capacitor C4, and one end of ferrite bead L512 are connected. The main controller's GND11AD_PLLM terminal is connected to the other end of capacitor C533, the other end of capacitor C4, and one end of ferrite bead L513. The other end of ferrite bead L512 is connected to the 1.1V power supply terminal and one end of capacitor C1. The other end of capacitor C1 and the other end of ferrite bead L513 are connected to power ground. The main controller's VCC11AD_PLLD terminal is connected to one end of capacitor C534, one end of capacitor C5, and one end of ferrite bead L515. The main controller's GND11AD_PLLD terminal is connected to the other end of capacitor C534, the other end of capacitor C5, and one end of ferrite bead L517. The other end of ferrite bead L515 is connected to the 1.1V power supply terminal and one end of capacitor C9. The other end of capacitor C9 and the other end of ferrite bead L517 are connected to power ground.

[0018] The PMIC_SPI_DIN terminal of the master controller is connected to the SPI1_DOUT terminal of the lighting controller. The PMIC_SPI_DOUT terminal of the master controller is connected to the SPI1_DIN terminal of the lighting controller and one end of resistor R574. The other end of resistor R574 is connected to power ground. The PMIC_SPI_CSZ_0 terminal of the master controller is connected to the SPI1_SS terminal of the lighting controller and one end of resistor R61. The PMIC_SPI_CLK terminal of the master controller is connected to the SPI1_CLK terminal of the lighting controller and one end of resistor R575. The other ends of resistor R61 and resistor R575 are connected to power ground.

[0019] The GPIO_00 pin of the main controller is connected to one end of resistor R532. The other end of resistor R532 is connected to one end of ferrite bead FB1 and one end of resistor R512. The other end of resistor R512 is connected to power ground. The other end of ferrite bead FB1 is connected to the seventh pin of the headlight driver interface J2, and is connected to the headlight driver through the headlight driver interface J2. The PMIC_LEDSEL_0_S pin of the main controller is connected to one end of resistor R521. The other end of resistor R521 is connected to the first pin of the headlight driver interface J2. The main controller PMIC_LEDSEL_1_S terminal is connected to one end of resistor R12, and the other end of resistor R12 is connected to the second terminal of the headlight driver interface J2. The main controller PMIC_LEDSEL_2_S terminal is connected to one end of resistor R522, and the other end of resistor R522 is connected to the third terminal of the headlight driver interface J2. The main controller PMIC_LEDSEL_3_S terminal is connected to one end of resistor R11, and the other end of resistor R11 is connected to the fourth terminal of the headlight driver interface J2.

[0020] The main controller's GPIO_04 terminal is connected to one end of resistor R54 and the lighting controller's D_EN terminal, with the other end of resistor R54 connected to the power supply ground. The main controller's GPIO_03 terminal is connected to one end of resistor R569 and the lighting controller's S_EN terminal, with the other end of resistor R569 connected to the power supply ground. The main controller's PMIC_AD3_POCI terminal is connected to the lighting controller's AD3_MISO terminal. The main controller's PMIC_AD3_PICO terminal is connected to one end of resistor R41 and the lighting controller's AD3_MOSI terminal, with the other end of resistor R41 connected to the power supply ground. The main controller's PMIC_AD3_SEQ_CLK terminal is connected to one end of resistor R41 and the lighting controller's SEQ_CLK terminal, with the other end of resistor R41 connected to the power supply ground.

[0021] The main controller PMIC_WD1_S terminal is connected to one end of resistor R546, and the other end of resistor R546 is connected to the lighting controller WD1 terminal. The main controller PMIC_SEQ_STRT_S terminal is connected to one end of resistor R19, and the other end of resistor R19 is connected to the lighting controller WD2 terminal. The main controller PWM1_COMPOUT_S terminal is connected to one end of resistor R10, and the other end of resistor R10 is connected to one end of ferrite bead FB2. The other end of ferrite bead FB2 is connected to the eighth terminal of the headlight driver interface J2. The main controller PMIC_INTZ terminal is connected to one end of resistor R561 and the lighting controller INT terminal, and the other end of resistor R561 is connected to the 3.3V power supply terminal. The main controller PMIC_PARKZ terminal is connected to one end of resistor R559 and the lighting controller PARK terminal, and the other end of resistor R559 is connected to the power supply ground. The main controller RESETZ terminal is connected to one end of resistor R50 and the lighting controller reset terminal, and the other end of resistor R50 is connected to the power supply ground.

[0022] The lighting controller R_EN terminal is connected to one end of ferrite bead L506, and the other end of ferrite bead L506 is connected to the tenth terminal of terminal block J500. The headlight driver is connected through terminal block J500. The lighting controller G_EN terminal is connected to one end of ferrite bead L505, and the other end of ferrite bead L505 is connected to the eleventh terminal of terminal block J500. The lighting controller B_EN terminal is connected to one end of ferrite bead L504, and the other end of ferrite bead L504 is connected to the twelfth terminal of terminal block J500. The lighting controller PMIC_SEN1 terminal is connected to one end of ferrite bead L509, and the other end of ferrite bead L509 is connected to the fifth terminal of terminal block J500. The lighting controller PMIC_SEN2 terminal is connected to one end of ferrite bead L507, and the other end of ferrite bead L507 is connected to the eighth terminal of terminal block J500.

[0023] The lighting controller PMIC_CMODE terminal is connected to one end of ferrite bead L508, and the other end of ferrite bead L508 is connected to the seventh terminal of terminal block J500. The lighting controller PMIC_LM3409_DRVEN terminal is connected to one end of ferrite bead L510, and the other end of ferrite bead L510 is connected to the third terminal of terminal block J500. The lighting controller PMIC_LS_SENSE_P terminal is connected to one end of ferrite bead L502, and the other end of ferrite bead L502 is connected to the sixteenth terminal of terminal block J500. The MIC_LS_SENSE_N terminal is connected to one end of the ferrite bead L501, and the other end of the ferrite bead L501 is connected to the seventeenth terminal of the terminal block J500. The lighting controller PMIC_LM3409_SYNC terminal is connected to one end of the ferrite bead L511, and the other end of the ferrite bead L511 is connected to the first terminal of the terminal block J500. The lighting controller PMIC_LM3409_IADJ terminal is connected to one end of the ferrite bead L500, and the other end of the ferrite bead L500 is connected to the nineteenth terminal of the terminal block J500.

[0024] The above solution also includes a HUD control and headlight control switching module, comprising a signal switch U10, wherein terminal U10A is connected to the other end of resistor R523, the low-level enable terminal of signal switch U10 is connected to the GPIO_9 terminal of the main controller, terminal U10B is connected to the PMIC_LM3409_DRVEN terminal of the lighting controller, and terminal U10VCC is connected to a 3.3V power supply terminal; and a signal switch U9, wherein terminal U9A is connected to the PMIC_COMPOUT terminal of the lighting controller, the low-level enable terminal of signal switch U9 is connected to the GPIO_9 terminal of the main controller, terminal U9B is connected to the PWM1_COMPOUT_S terminal of the main controller, and terminal U9VCC is connected to a 3.3V power supply terminal;

[0025] It also includes a NOT gate buffer U13, whose VCC terminal is connected to one end of resistor R570, the 3.3V power supply terminal, and one end of capacitor C59. The other end of resistor R570 and the A terminal of NOT gate buffer U13 are both connected to the GPIO_9 terminal of the main controller, and the other end of capacitor C59 is connected to the power supply ground. The Y terminal of NOT gate buffer U13 is connected to the first input terminal of each AND gate group of AND gate chip U14. The other input terminal of the first group of AND gate chip U14 is connected to the other end of resistor R521. The first group of output terminals of AND gate chip U14 is connected to the lighting controller HUD_LEDS. The AND gate chip U14 has the following terminals: EL_0 terminal; another input terminal of the second group of AND gate chip U14 is connected to the other end of resistor R521, and the output terminal of the second group of AND gate chip U14 is connected to the HUD_LEDSEL_1 terminal of the lighting controller; another input terminal of the third group of AND gate chip U14 is connected to the other end of resistor R521, and the output terminal of the third group of AND gate chip U14 is connected to the HUD_LEDSEL_2 terminal of the lighting controller; another input terminal of the fourth group of AND gate chip U14 is connected to the other end of resistor R521, and the output terminal of the fourth group of AND gate chip U14 is connected to the HUD_LEDSEL_3 terminal of the lighting controller.

[0026] The JTAGRSTZ terminal of the main controller is connected to one end of resistor R531, and the other end of resistor R531 is connected to power ground; the GPIO_11 terminal of the main controller is connected to one end of resistor R18, and the other end of resistor R18 is connected to power ground; the GPIO_12 terminal of the main controller is connected to one end of resistor R533, and the other end of resistor R533 is connected to power ground; the GPIO_10 terminal of the main controller is connected to one end of resistor R536, and the other end of resistor R536 is connected to power ground; the GPIO_13 terminal of the main controller is connected to resistor R22. One end of resistor R22 is connected to power ground; the main controller GPIO_22 is connected to one end of resistor R548, and the other end of resistor R548 is connected to power ground; the main controller GPIO_23 is connected to one end of resistor R547, and the other end of resistor R547 is connected to power ground; the main controller GPIO_24 is connected to one end of resistor R542, and the other end of resistor R542 is connected to power ground; the main controller GPIO_25 ​​is connected to one end of resistor R550, and the other end of resistor R550 is connected to power ground.

[0027] The main controller's TESTPT0 terminal is connected to one end of resistor R549, and the other end of resistor R549 is connected to the digital bus switch U510B terminal. The digital bus switch U510A terminal and VCC terminal are both connected to the 3.3V power supply terminal. The low-level enable terminal of the digital bus switch U510 is connected to one end of resistor R571, and the other end of resistor R571 is connected to the 3.3V power supply terminal. The ground terminal of the digital bus switch U510 is connected to the power supply ground.

[0028] The main controller's CHKSUM_SEL terminal is connected to one end of resistor R552, the other end of resistor R552 is connected to the first terminal of DIP switch SW1, and the second terminal of DIP switch SW1 is connected to the 3.3V power supply terminal; the main controller's HOST_IF_SEL terminal is connected to one end of resistor R37, the other end of resistor R37 is connected to the first terminal of DIP switch SW2, and the second terminal of DIP switch SW2 is connected to the 3.3V power supply terminal; the main controller's HOST_SPI_MODE terminal is connected to one end of resistor R38, the other end of resistor R38 is connected to the first terminal of DIP switch SW3, and the second terminal of DIP switch SW3 is connected to the 3.3V power supply terminal; the main controller's TESTPT5 terminal is connected to one end of resistor R556, the other end of resistor R556 is connected to the first terminal of DIP switch SW4, and the second terminal of DIP switch SW4 is connected to the 3.3V power supply terminal.

[0029] In the above scheme: the display driver module includes a DVI receiver, the parallel data bus signal terminal of the main controller is connected to the parallel data bus signal terminal of the DVI receiver, the differential signal terminal of the DVI receiver is connected to the differential signal terminal of the filter module, and the filtered signal output terminal of the filter module is connected to the filtered signal input terminal of the HDMI input interface J4.

[0030] The filtering module includes four modules: a first filtering module, a second filtering module, a third filtering module, and a fourth filtering module. The positive terminal of the third channel of the differential signal of the DVI receiver is connected to the C1 terminal of the fourth filtering module, and the negative terminal of the third channel of the differential signal of the DVI receiver is connected to the C2 terminal of the fourth filtering module. The positive terminal of the third channel of the filtered signal of the fourth filtering module is connected to the J4TMDS_data_2+ terminal of the HDMI input interface, and the negative terminal of the third channel of the filtered signal of the fourth filtering module is connected to the J4TMDS_data_2- terminal of the HDMI input interface.

[0031] The positive terminal of the second differential signal channel of the DVI receiver is connected to the C1 terminal of the third filter module, the negative terminal of the second differential signal channel of the DVI receiver is connected to the C2 terminal of the third filter module, the positive terminal of the second filtered signal channel of the third filter module is connected to the J4TMDS_data_1+ terminal of the HDMI input interface, and the negative terminal of the second filtered signal channel of the third filter module is connected to the J4TMDS_data_1- terminal of the HDMI input interface.

[0032] The positive terminal of the first differential signal channel of the DVI receiver is connected to the C1 terminal of the second filter module, the negative terminal of the first differential signal channel of the DVI receiver is connected to the C2 terminal of the second filter module, the positive terminal of the first filtered signal channel of the second filter module is connected to the J4TMDS_data_1+ terminal of the HDMI input interface, and the negative terminal of the first filtered signal channel of the second filter module is connected to the J4TMDS_data_1- terminal of the HDMI input interface.

[0033] The positive terminal of the differential signal clock channel of the DVI receiver is connected to the C1 terminal of the first filter module, the negative terminal of the differential signal clock channel of the DVI receiver is connected to the C2 terminal of the first filter module, the positive terminal of the filter signal clock channel of the first filter module is connected to the J4TMDS_clock+ terminal of the HDMI input interface, and the negative terminal of the filter signal clock channel of the first filter module is connected to the J4TMDS_clock+ terminal of the HDMI input interface.

[0034] The HDMI input interface J4 DDC_data terminal is connected to the second input terminal of the ESD protection module U502, one end of resistor R507, and the SDA terminal of the storage module U503. The other end of resistor R507 is connected to the HDMI input interface J4+5V_power terminal. The HDMI input interface J4 DDC_clock terminal is connected to the second input terminal of the ESD protection module U502, one end of resistor R518, and the SCL terminal of the storage module U503. The other end of resistor R518 and the VCC terminal of the storage module U503 are connected to the HDMI input interface J4+5V_power terminal. The third terminal of the ESD protection module U502 is connected to the power ground.

[0035] The host controller's HOST_IRQ_S terminal is connected to one end of resistor R39. The other end of resistor R39 is connected to the NOT gate buffer U15A terminal and the SPI protection chip U17D1+. The NOT gate buffer U15VCC terminal is connected to the 3.3V power supply terminal. The NOT gate buffer U15Y terminal is connected to one end of resistor R572 and the bridge U11GPIO_16 terminal. The other end of resistor R572 is connected to the other end of inductor L2. The host controller's HOST_I2C_SDA terminal is connected to the level converter U7A1 terminal and the first input terminal of the ESD protection chip U16. The host controller's HOST_I2C_SCL terminal is connected to the level converter U7A2 terminal and the second input terminal of the ESD protection chip U16. The ground terminal of the ESD protection chip U16 is connected to the power supply ground.

[0036] The above solution also includes a jumper module for switching between Cypress and SPI buses. This includes connecting the host controller's HOST_SPI_CLK terminal to the second terminal of connector J10; connecting the first terminal of connector J10 to one end of resistor R582; connecting the other end of resistor R582 to the seventh terminal of SPI connector J15 and the SPI protection chip U512D1+; connecting the third terminal of connector J10 to one end of resistor R567; and connecting the other end of resistor R567 to the SPI bus transceiver U12B3 terminal.

[0037] The host controller HOST_SPI_CSZ terminal is connected to the second terminal of connector J12. The first terminal of connector J12 is connected to one end of resistor R581. The other end of resistor R581 is connected to the ninth terminal of SPI connector J15 and the D2- terminal of SPI protection chip U512. The third terminal of connector J12 is connected to one end of resistor R564. The other end of resistor R564 is connected to the SPI bus transceiver U12B4 terminal.

[0038] The host controller HOST_SPI_PICO terminal is connected to the second terminal of connector J11. The first terminal of connector J11 is connected to one end of resistor R583 and the SPI protection chip U512D1- terminal. The other end of resistor R583 is connected to the eighth terminal of SPI connector J15. The third terminal of connector J11 is connected to one end of resistor R568. The other end of resistor R568 is connected to the SPI bus transceiver U12B1 terminal.

[0039] One end of resistor R555 at the HOST_SPI_POCI terminal of the master controller is connected to the second end of connector J13. The first end of connector J10 is connected to the fifth end of SPI connector J15 and the SPI protection chip U512D2+. The third end of connector J10 is connected to the SPI bus transceiver U12B2.

[0040] The bridge U11 VBUS terminal is connected to the first terminal of the USB input interface J9 and one terminal of the capacitor C603. The other terminal of the capacitor C603 is connected to the power ground. The bridge U11 USBDM terminal is connected to the second terminal of the USB input interface J9. The bridge U11 USBDP terminal is connected to the third terminal of the USB input interface J9.

[0041] The bridge U11GPIO_7 terminal is connected to one end of resistor R560 and the NOT gate buffer U8A terminal. The NOT gate buffer U8B terminal is connected to the master controller PROJ_ON terminal. The other end of resistor R560 is connected to one end of capacitor C593, the NOT gate buffer U8VCC terminal and the other end of inductor L2. The other end of capacitor C593 is connected to power ground.

[0042] The bridge U11CY_HOST_SCL terminal is connected to the level converter U7B2 terminal and one end of resistor R49. The other end of resistor R49 is connected to the other end of inductor L2. The bridge U11CY_HOST_SDA terminal is connected to the level converter U7B1 terminal and one end of resistor R48. The other end of resistor R48 is connected to the other end of inductor L2. The bridge U11CY_HOST_I2C_OE terminal is connected to the level converter U7OE terminal and one end of resistor R40. The other end of resistor R40 is connected to power ground.

[0043] The above plan also includes the following steps:

[0044] S1: HUD screen display;

[0045] S2: Binocular detection;

[0046] S2-1: Establish the system's relative reference coordinate system and the mathematical equations for the HUD display plane;

[0047] S2-1-1: Establish the system's relative reference coordinate system;

[0048] S2-1-2: Calculate the mathematical equations for the HUD display plane;

[0049] S2-1-2-1: The operator places the left index finger perpendicular to the plane of the HUD display area, with the left finger pointing towards the center of the HUD display area, and acquires images through at least two binocular cameras spaced apart on the left and right.

[0050] S2-1-2-2: Calculate the line containing the left index finger;

[0051] S2-1-2-3: Move the left hand fingers k meters and point the left index finger to the center of the HUD display area. Acquire images through at least two binocular cameras set at left and right intervals and record the tilt angle.

[0052] S2-1-2-5: Calculate the plane mathematical equations based on the bias angle, the distance moved, and the normal vector;

[0053] The mathematical equation for a plane is expressed as follows:

[0054]

[0055] In the formula, (x 0 ,y 0 ,z 0 () is a point on the line; t is the parametric equation, which is expressed as:

[0056] S2-2: Define the area to be operated on;

[0057] S2-2-1: Facial feature detection;

[0058] S2-2-2: Calculate the visual direction;

[0059] S2-3: Determine the target location for the operation;

[0060] S2-3-1: Detection of key points on the left index finger;

[0061] S2-3-2: Detection of the direction pointed by the left index finger;

[0062] S2-4: Determine the location of the operation;

[0063] S2-5: Determine the actions to be performed;

[0064] S2-5-1: Right index fingertip detection;

[0065] S2-5-2: Detection of the movement trajectory of the right index fingertip;

[0066] S3: Generate operation instructions based on the binocular detection results;

[0067] S4: Control the HUD screen via operation commands.

[0068] In summary, the beneficial effects of this invention are: it can stably drive the HUD to display various parameters during navigation, while also meeting the needs of ship lighting and communication, ensuring stable navigation, and improving driving efficiency and control experience. The power adapter module can stably supply power to various electrical devices, and the lighting controller can stably drive the headlight driver for illumination. The display driver module can stably display prompts, and the HUD control and headlight control switching module can meet the main controller's needs for HUD display and headlight control under different conditions, offering diverse functions. The operating steps can use binocular cameras to identify the viewing direction, the range of movement of the left index finger, and the gesture of the right index finger, thereby controlling the HUD screen and improving human-computer interaction efficiency. The at least two binocular cameras can reduce blind spots, improve the accuracy of facial and gesture capture, improve the accuracy of human-computer interaction commands, and achieve high-precision, multimodal, and contactless interaction functions. Attached Figure Description

[0069] Figure 1 This is a system diagram of the present invention.

[0070] Figure 2 This is a circuit diagram of the synchronous step-down converter of the present invention.

[0071] Figure 3 This is the circuit diagram of a switching regulator.

[0072] Figure 4 This is a circuit diagram of a load switch and a voltage regulator.

[0073] Figure 5 This is the circuit diagram of an oscillator.

[0074] Figure 6 This is the circuit diagram of the main controller.

[0075] Figure 7 This is the circuit diagram of the lighting controller.

[0076] Figure 8 This is the circuit diagram for the HUD control and headlight control switching module.

[0077] Figure 9This is the circuit diagram of the main controller and the lighting controller.

[0078] Figure 10 This is the circuit diagram for connecting terminal blocks J500 and J2 of the headlight driver.

[0079] Figure 11 This is the circuit diagram of the main controller's configuration circuit.

[0080] Figure 12 This is the circuit diagram of the main controller and the DVI receiver.

[0081] Figure 13 It is a circuit diagram of the filter module and the memory chip.

[0082] Figure 14 This is a circuit diagram of the LDO video connection module and connector.

[0083] Figure 15 This is a circuit diagram of an SPI protection chip and an ESD protection chip.

[0084] Figure 16 This is the circuit diagram of the jumper module.

[0085] Figure 17 This is a circuit diagram of a bridge and an SPI bus transceiver.

[0086] Figure 18 This is a terminal diagram showing the connection between the main controller and the HS bus.

[0087] Figure 19 This is the circuit diagram of the first HS bus terminal block J1A and the second HS bus terminal block J1B.

[0088] Figure 20 This is a schematic diagram of the present invention. Figure 1 (View from the front)

[0089] Figure 21 This is a schematic diagram of the present invention. Figure 2 (View from the rear)

[0090] Figure 22 for Figure 20 A diagram showing the effect after removing the sunshade and display screen.

[0091] Figure 23 This is a schematic diagram of the components of the mounting box in this invention.

[0092] Figure 24 This is a partial cross-sectional view of the display screen in this invention.

[0093] Figure 25 for Figure 21 A schematic diagram with mounting brackets.

[0094] Figure 26 This is a flowchart illustrating the present invention.

[0095] Figure 27 This is a schematic diagram of the attitude detection algorithm for key points in this invention.

[0096] Figure 28 This is a schematic diagram of the key point detection algorithm for right-hand gesture detection in this invention. Detailed Implementation

[0097] The present invention will be further described below with reference to the embodiments and accompanying drawings:

[0098] like Figures 1 to 28 As shown, an interactive marine HUD system based on binocular vision mainly consists of a base shell 200, a light shield 300, a control system 400, an input module 500, an image generation module 600, and at least one display screen 100. The display screen 100 is fixed by the base shell 200 and the light shield 300, which are positioned opposite each other. The control system 400 and the input module 500 are both mounted on the base shell 200, and the image generation module 600 is located inside the base shell 200. Both the input module 500 and the image generation module 600 are electrically connected to the control system 400. Preferably, both the base shell and the light shield are made of aluminum alloy.

[0099] The input module 500 receives information from the ship's display and control console and transmits the received information to the control system. The control system 400 processes the information received by the input module, allocates display information to each display screen according to the number of screens, and transmits the content to the corresponding image generation unit. The image generation unit converts electrical signals into images on the display screen, enabling the information to be displayed. The control system 400 uses a CPU with existing information receiving, transmitting, and processing functions. The image generation unit uses corresponding equipment for the type of display screen, and the input module uses a CPU with existing information receiving, transmitting, and simple information processing functions.

[0100] The number of displays can be set as needed. Preferably, the display screen 100 has three sides, and the left and right sides form a certain angle with the front display screen. Each display screen 100 is fixed to the bottom shell 200 by a corresponding light shield 300, so as to facilitate the operator to view different information.

[0101] Specifically, each display screen is configured as a rectangle composed of four waveguide display screens. Correspondingly, the image generation module 600 employs an optical engine, with each waveguide display screen having its own optical engine. The output light from the optical engine illuminates the corresponding waveguide display screen. By selecting a high-power optical engine, a clear display effect can be obtained even when the sea surface is brightly lit. The waveguide display screen includes a waveguide sheet 110 and organic glass layers 111 disposed on the front and rear sides of the waveguide sheet 110. This effectively protects the surface of the waveguide sheet and prevents glass breakage and injury in extreme cases. Simultaneously, the glass has a filtering effect, further ensuring display clarity.

[0102] The base shell 200 includes two bottom beams 210 arranged vertically opposite each other. On each bottom beam 210, on the left and right sides of each display screen 100, there is a mounting box 220 for mounting the image generation module 600. The front of the mounting box 220 is open, and a light-shielding plate can block the mounting box. The upper and lower ends of the mounting box 220 are mounted to the corresponding bottom beams 210. At least two mounting blocks 230 are provided inside the mounting box 220 for mounting the light-shielding plate 300. Simultaneously, through holes are provided on the mounting blocks corresponding to the optical engine, allowing the output light from the optical engine to illuminate the waveguide display screen. The overall structure is simple and lightweight, and the mounting boxes can effectively block the gap between the rear sides of adjacent display screens.

[0103] When a display screen 100 is provided, the mounting box 220 includes a main box body 221 and a cover plate 222 disposed on the side of the main box body 221, and the cover plates 222 of the two mounting boxes 220 are located on the inner side. Correspondingly, the image generation module 600 and the mounting block 230 are both mounted on the cover plate 222.

[0104] When two or more displays 100 are provided, the structure of the mounting boxes 220 located on both sides is the same as the structure of the mounting box 220 when one display 100 is provided. The mounting box 220 located in the middle includes a back plate 223 arranged in a U-shape and side cover plates 224 arranged on the left and right sides of the back plate. Correspondingly, the image generation module 600 and the mounting block 230 are both mounted on the side cover plates 224.

[0105] Each bottom beam 210 has a right-angle bend 211 at its front end to limit the display screen from the rear, and a receiving groove for accommodating the display screen is provided at the rear end of the light shield.

[0106] To enable operator interaction with the display screen, a binocular camera 700 is mounted on the base shell 200. An interactive information processing module 800, electrically connected to the binocular camera, is also housed within the base shell 200 and electrically connected to the control system. The binocular camera uses two cameras to reduce blind spots. The interactive information processing module processes the motion information captured by the binocular camera, combines it with signals provided by the input module to form a new input image generation unit, and then transmits it to the control system for processing. The interactive information processing module employs existing technologies with information processing, information receiving, and information transmission functions.

[0107] To facilitate the installation of the entire equipment within the ship's bridge, a mounting bracket 900 is also provided, such as... Figure 6 As shown. Specifically, the mounting bracket includes a vertical frame 910 connected to the bottom shell and a horizontal frame 920 connected to the top or ground of the bridge. A reinforcing rib 930 is provided between the vertical and horizontal frames. To facilitate adjustment of the HUD device's installation height, multiple mounting holes 901 are spaced vertically on the horizontal frame. To ensure support strength, both the horizontal and vertical frames have two vertical frames spaced apart on the left and right sides, with a connecting frame located at the rear of the bottom shell between the two vertical frames. Additionally, a mounting block can be provided at the rear of the bottom shell to facilitate connection between the vertical frames and the bottom shell. The mounting bracket can also employ other structures to integrate it into the display console or operating panel of the ship's bridge.

[0108] The control system 400 includes a main controller U2, whose lighting signal output terminal is connected to the lighting signal input terminal of the lighting controller U6, whose drive signal output terminal is connected to the drive signal input terminal of the headlight driver, whose display drive signal output terminal is connected to the display signal input terminal of the display driver module, and also includes a power adapter module for supplying power to various electrical devices.

[0109] The power adapter module includes a synchronous buck converter U5. The power input terminal of the synchronous buck converter U5 is connected to one end of capacitor C31, one end of capacitor C37, one end of resistor R540, one end of capacitor C41, and one end of capacitor C23. The other end of capacitor C23 is connected to one end of inductor L5 and the ship's main information output terminal. The other end of inductor L5 is connected to one end of terminal block J1 and one end of capacitor C571. The ground terminal of the synchronous buck converter U5, the other ends of capacitors C31, C37, C41, C23, and C571 are all connected to power ground. The other end of resistor R540 is connected to the enable terminal of the synchronous buck converter U5. The VCC terminal of the synchronous buck converter U5 is connected to one end of capacitor C587, and the other end of capacitor C587 is connected to power ground.

[0110] The synchronous buck converter U5BOOT terminal is connected to one end of capacitor C38. The other end of capacitor C38 is connected to the synchronous buck converter U5NC terminal and one end of inductor L2. The other end of inductor L2 is connected to one end of capacitor C26, one end of capacitor C536, one end of resistor R535, one end of capacitor C19, one end of capacitor C18, one end of resistor R20, one end of capacitor C537, the switching regulator U504VIN terminal, and the load switch U1. The VIN terminal and the VIN terminal of regulator U3, the other end of capacitor C26 and the other end of resistor R535 are all connected to the feedback terminal of synchronous buck converter U5 and one end of resistor R544. The other ends of resistor R544, capacitor C536, capacitor C19 and capacitor C18 are all connected to power ground. The other end of resistor R20 is connected to the CTRL terminal of switching regulator U504 and the PG terminal of synchronous buck converter U5. The COMP terminal of switching regulator U504 is connected to one end of resistor R517. The other end of resistor R517 is connected to the other end of capacitor C519. The other end of capacitor C519 is connected to power ground.

[0111] The SW terminal of the switching regulator U504 is connected to one end of inductor L516 and the positive terminal of diode D1. The other end of inductor L516 is connected to the VIN terminal of the switching regulator U504. The negative terminal of diode D1 is connected to one end of resistor R508, one end of capacitor C2, one end of capacitor C513, one end of resistor R505, one end of capacitor C512, and the IN and IN2 terminals of linear regulator U500. The other end of resistor R508 is connected to the feedback terminal of switching regulator U504 and one end of resistor R4. The other end of resistor R4, the ground terminal of switching regulator U504, the other end of capacitor C2, the other end of capacitor C513, the other end of capacitor C512, and the ground terminal of linear regulator U500 are all connected to the power supply ground. The output terminal and SNS terminal of linear regulator U500 are both connected to one end of resistor R500. The other end of resistor R500 is connected to one end of capacitor C516. The other end of capacitor C516 is connected to the power supply ground.

[0112] The ON terminal of load switch U1 is connected to the enable terminal of lighting controller U6 and one end of resistor R5. The other end of resistor R5 and the ground terminal of load switch U1 are connected to the power supply ground. The output terminal of load switch U1 outputs a 3.3V voltage, which is the 3.3V power supply terminal of the power adapter module, and is connected to one end of resistor R9. The other end of resistor R9 is connected to the QOD terminal of load switch U1, and the CT terminal of load switch U1 is connected to the power supply ground.

[0113] The first enable terminal of voltage regulator U3 is connected to the enable terminal of lighting controller U6 and one end of resistor R13. The second enable terminal of voltage regulator U3 is connected to the enable terminal of lighting controller U6 and one end of resistor R16. The other ends of resistor R13, resistor R16, and the ground terminal of voltage regulator U3 are connected to the power supply ground. The MODE / DATA terminal of voltage regulator U3 is connected to one end of resistor R21, and the other end of resistor R21 is connected to the power supply ground. The first output terminal of voltage regulator U3 is connected to one end of inductor L518. The other end of inductor L518 outputs a 1.8V voltage, which is the 1.8V power supply terminal for the power adapter module. The other end of inductor L518 is also connected to the feedback terminal of voltage regulator U3, one end of resistor R513, one end of capacitor C526, and capacitor C525. One end of resistor R513 is connected to one end of resistor R514. The other ends of resistor R514, capacitor C526, and capacitor C525 are all connected to the power supply ground. The second output of voltage regulator U3 is connected to one end of inductor L520. The other end of inductor L520 outputs 1.1V, which is the 1.1V power supply terminal for the power adapter module. The other end of inductor L520 is also connected to one end of capacitor C561, one end of resistor R24, one end of capacitor C559, and one end of capacitor C27. The other end of resistor R24 ​​is connected to one end of resistor R32. The other ends of resistor R32, capacitor C559, and capacitor C27 are all connected to the power supply ground. The other end of capacitor C561 is connected to the ADJ2 terminal of voltage regulator U3.

[0114] The input terminal of the main controller U2PLL_REFCLK is connected to one end of capacitor C518, one end of resistor R509, and the first terminal of oscillator Y500. The output terminal of the main controller U2PLL_REFCLK is connected to the other end of resistor R509 and one end of resistor R520. One end of resistor R520 is connected to the third terminal of oscillator Y500 and one end of capacitor C521. The other ends of capacitor C521 and capacitor C518 are connected to power ground. The main controller U2VCC3IO_COSC terminal is connected to one end of ferrite bead L519 and one end of capacitor C542. The other end of ferrite bead L519 is connected to the 3.3V power supply terminal. The main controller U2GNDIOLA_COSC terminal is connected to the other end of capacitor C542 and connected to power ground. The main controller U2VCC11AD_PLLM terminal is connected to capacitor C... One end of capacitor C533, one end of capacitor C4, and one end of ferrite bead L512 are connected to the other end of capacitor C533, the other end of capacitor C4, and one end of ferrite bead L513. The other end of ferrite bead L512 is connected to the 1.1V power supply terminal and one end of capacitor C1. The other end of capacitor C1 and the other end of ferrite bead L513 are connected to the power supply ground. The other end of capacitor U2VCC11AD_PLLD is connected to one end of capacitor C534, one end of capacitor C5, and one end of ferrite bead L515. The other end of capacitor U2GND11AD_PLLD is connected to the other end of capacitor C534, the other end of capacitor C5, and one end of ferrite bead L517. The other end of ferrite bead L515 is connected to the 1.1V power supply terminal and one end of capacitor C9. The other end of capacitor C9 and the other end of ferrite bead L517 are connected to the power supply ground.

[0115] The main controller's U2HS bus data terminal is connected to the HS bus terminal block data terminal. This embodiment also includes two HS bus terminal blocks, namely the first HS bus terminal block J1A and the second HS bus terminal block J1B, as detailed below. Figure 19 and Figure 18 As shown.

[0116] The main controller's U2PMIC_SPI_DIN terminal is connected to the lighting controller's U6SPI1_DOUT terminal. The main controller's U2PMIC_SPI_DOUT terminal is also connected to the lighting controller's U6SPI1_DIN terminal and one end of resistor R574. The other end of resistor R574 is connected to power ground. The main controller's U2PMIC_SPI_CSZ_0 terminal is connected to the lighting controller's U6SPI1_SS terminal and one end of resistor R61. The main controller's U2PMIC_SPI_CLK terminal is connected to the lighting controller's U6SPI1_CLK terminal and one end of resistor R575. The other ends of resistors R61 and R575 are connected to power ground.

[0117] The main controller's U2GPIO_00 pin is connected to one end of resistor R532. The other end of resistor R532 is connected to one end of ferrite bead FB1 and one end of resistor R512. The other end of resistor R512 is connected to power ground. The other end of ferrite bead FB1 is connected to the seventh pin of the headlight driver interface J2, which in turn connects to the headlight driver. The main controller's U2PMIC_LEDSEL_0_S pin is connected to one end of resistor R521. The other end of resistor R521 is connected to the first pin of the headlight driver interface J2. The main controller U2PMIC_LEDSEL_1_S terminal is connected to one end of resistor R12, and the other end of resistor R12 is connected to the second terminal of the headlight driver interface J2. The main controller U2PMIC_LEDSEL_2_S terminal is connected to one end of resistor R522, and the other end of resistor R522 is connected to the third terminal of the headlight driver interface J2. The main controller U2PMIC_LEDSEL_3_S terminal is connected to one end of resistor R11, and the other end of resistor R11 is connected to the fourth terminal of the headlight driver interface J2.

[0118] The main controller U2GPIO_04 is connected to one end of resistor R54 and the lighting controller U6D_EN, with the other end of resistor R54 connected to the power supply ground; the main controller U2GPIO_03 is connected to one end of resistor R569 and the lighting controller U6S_EN, with the other end of resistor R569 connected to the power supply ground; the main controller U2PMIC_AD3_POCI is connected to the lighting controller U6AD3_MISO; the main controller U2PMIC_AD3_PICO is connected to one end of resistor R41 and the lighting controller U6AD3_MOSI, with the other end of resistor R41 connected to the power supply ground; the main controller U2PMIC_AD3_SEQ_CLK is connected to one end of resistor R41 and the lighting controller U6SEQ_CLK, with the other end of resistor R41 connected to the power supply ground.

[0119] The main controller U2PMIC_WD1_S terminal is connected to one end of resistor R546, and the other end of resistor R546 is connected to the lighting controller U6WD1 terminal. The main controller U2PMIC_SEQ_STRT_S terminal is connected to one end of resistor R19, and the other end of resistor R19 is connected to the lighting controller U6WD2 terminal. The main controller U2PWM1_COMPOUT_S terminal is connected to one end of resistor R10, and the other end of resistor R10 is connected to one end of ferrite bead FB2. The other end of ferrite bead FB2 is connected to the headlight driver interface. J2, eighth terminal; the main controller U2PMIC_INTZ terminal is connected to one end of resistor R561 and the lighting controller U6INT terminal, with the other end of resistor R561 connected to the 3.3V power supply terminal; the main controller U2PMIC_PARKZ terminal is connected to one end of resistor R559 and the lighting controller U6PARK terminal, with the other end of resistor R559 connected to the power supply ground; the main controller U2RESETZ terminal is connected to one end of resistor R50 and the lighting controller U6 reset terminal, with the other end of resistor R50 connected to the power supply ground.

[0120] The lighting controller U6R_EN terminal is connected to one end of the ferrite bead L506, and the other end of the ferrite bead L506 is connected to the tenth terminal of the terminal block J500. The headlight driver is connected through the terminal block J500. The lighting controller U6G_EN terminal is connected to one end of the ferrite bead L505, and the other end of the ferrite bead L505 is connected to the eleventh terminal of the terminal block J500. The lighting controller U6B_EN terminal is connected to one end of the ferrite bead L504, and the other end of the ferrite bead L504 is connected to the twelfth terminal of the terminal block J500. The lighting controller U6PMIC_SEN1 terminal is connected to one end of the ferrite bead L509, and the other end of the ferrite bead L509 is connected to the fifth terminal of the terminal block J500. The lighting controller U6PMIC_SEN2 terminal is connected to one end of the ferrite bead L507, and the other end of the ferrite bead L507 is connected to the eighth terminal of the terminal block J500.

[0121] The lighting controller U6PMIC_CMODE terminal connects to one end of ferrite bead L508, and the other end of ferrite bead L508 connects to terminal 7 of terminal block J500. The lighting controller U6PMIC_LM3409_DRVEN terminal connects to one end of ferrite bead L510, and the other end of ferrite bead L510 connects to terminal 3 of terminal block J500. The lighting controller U6PMIC_LS_SENSE_P terminal connects to one end of ferrite bead L502, and the other end of ferrite bead L502 connects to terminal 16 of terminal block J500. The lighting controller U6P... The MIC_LS_SENSE_N terminal is connected to one end of the ferrite bead L501, and the other end of the ferrite bead L501 is connected to the seventeenth terminal of the terminal block J500. The lighting controller U6PMIC_LM3409_SYNC terminal is connected to one end of the ferrite bead L511, and the other end of the ferrite bead L511 is connected to the first terminal of the terminal block J500. The lighting controller U6PMIC_LM3409_IADJ terminal is connected to one end of the ferrite bead L500, and the other end of the ferrite bead L500 is connected to the nineteenth terminal of the terminal block J500.

[0122] It also includes a HUD control and headlight control switching module, including signal switch U10. The A terminal of signal switch U10 is connected to the other end of resistor R523. The low-level enable terminal of signal switch U10 is connected to the main controller U2GPIO_9 terminal. The B terminal of signal switch U10 is connected to the lighting controller U6PMIC_LM3409_DRVEN terminal. The VCC terminal of signal switch U10 is connected to the 3.3V power supply terminal. It also includes signal switch U9. The A terminal of signal switch U9 is connected to the lighting controller U6PMIC_COMPOUT terminal. The low-level enable terminal of signal switch U9 is connected to the main controller U2GPIO_9 terminal. The B terminal of signal switch U9 is connected to the main controller U2PWM1_COMPOUT_S terminal. The VCC terminal of signal switch U9 is connected to the 3.3V power supply terminal.

[0123] It also includes NOT gate buffer U13. The VCC terminal of NOT gate buffer U13 is connected to one end of resistor R570, the 3.3V power supply terminal, and one end of capacitor C59. The other end of resistor R570 and the A terminal of NOT gate buffer U13 are both connected to the main controller U2GPIO_9 terminal. The other end of capacitor C59 is connected to the power supply ground. The Y terminal of NOT gate buffer U13 is connected to the first input terminal of each group of AND gates of AND gate chip U14. The other input terminal of the first group of AND gate chip U14 is connected to the other end of resistor R521. The output terminal of the first group of AND gate chip U14 is connected to the lighting controller U6HUD_LEDSEL_0. The other input terminal of the second group of AND gate chip U14 is connected to the other end of resistor R521, and the output terminal of the second group of AND gate chip U14 is connected to the terminal of lighting controller U6HUD_LEDSEL_1; the other input terminal of the third group of AND gate chip U14 is connected to the other end of resistor R521, and the output terminal of the third group of AND gate chip U14 is connected to the terminal of lighting controller U6HUD_LEDSEL_2; the other input terminal of the fourth group of AND gate chip U14 is connected to the other end of resistor R521, and the output terminal of the fourth group of AND gate chip U14 is connected to the terminal of lighting controller U6HUD_LEDSEL_3.

[0124] The main controller U2JTAGRSTZ pin is connected to one end of resistor R531, and the other end of resistor R531 is connected to power ground; the main controller U2GPIO_11 pin is connected to one end of resistor R18, and the other end of resistor R18 is connected to power ground; the main controller U2GPIO_12 pin is connected to one end of resistor R533, and the other end of resistor R533 is connected to power ground; the main controller U2GPIO_10 pin is connected to one end of resistor R536, and the other end of resistor R536 is connected to power ground; the main controller U2GPIO_13 pin is connected to resistor R2... 2. Connect one end of resistor R22 to the power supply ground. Connect the main controller U2GPIO_22 to one end of resistor R548. Connect the other end of resistor R548 to the power supply ground. Connect the main controller U2GPIO_23 to one end of resistor R547. Connect the other end of resistor R547 to the power supply ground. Connect the main controller U2GPIO_24 to one end of resistor R542. Connect the other end of resistor R542 to the power supply ground. Connect the main controller U2GPIO_25 ​​to one end of resistor R550. Connect the other end of resistor R550 to the power supply ground.

[0125] The main controller U2TESTPT0 terminal is connected to one end of resistor R549, and the other end of resistor R549 is connected to the digital bus switch U510B terminal. The digital bus switch U510A terminal and VCC terminal are both connected to the 3.3V power supply terminal. The low-level enable terminal of the digital bus switch U510 is connected to one end of resistor R571, and the other end of resistor R571 is connected to the 3.3V power supply terminal. The ground terminal of the digital bus switch U510 is connected to the power supply ground.

[0126] The main controller U2CHKSUM_SEL terminal is connected to one end of resistor R552, the other end of resistor R552 is connected to the first terminal of DIP switch SW1, and the second terminal of DIP switch SW1 is connected to the 3.3V power supply terminal; the main controller U2HOST_IF_SEL terminal is connected to one end of resistor R37, the other end of resistor R37 is connected to the first terminal of DIP switch SW2, and the second terminal of DIP switch SW2 is connected to the 3.3V power supply terminal; the main controller U2HOST_SPI_MODE terminal is connected to one end of resistor R38, the other end of resistor R38 is connected to the first terminal of DIP switch SW3, and the second terminal of DIP switch SW3 is connected to the 3.3V power supply terminal; the main controller U2TESTPT5 terminal is connected to one end of resistor R556, the other end of resistor R556 is connected to the first terminal of DIP switch SW4, and the second terminal of DIP switch SW4 is connected to the 3.3V power supply terminal;

[0127] The display driver module includes a DVI receiver U501. The parallel data bus signal terminal of the main controller U2 is connected to the parallel data bus signal terminal of the DVI receiver U501. The differential signal terminal of the DVI receiver U501 is connected to the differential signal terminal of the filter module. The filtered signal output terminal of the filter module is connected to the filtered signal input terminal of the HDMI input interface J4.

[0128] Specifically: the DVI receiver U501OCK_INV terminal is connected to one end of resistor R1, and the other end of resistor R1 is connected to the 3.3V power supply terminal; the DVI receiver U501STAGZ terminal is connected to one end of resistor R502, and the other end of resistor R502 is connected to the 3.3V power supply terminal; the DVI receiver U501ST terminal is connected to one end of resistor R503, and the other end of resistor R503 is connected to the 3.3V power supply terminal; the DVI receiver U501PDZ terminal is connected to one end of resistor R501, and the other end of resistor R501 is connected to the 3.3V power supply terminal.

[0129] The first signal terminal of the parallel data bus of the main controller U2 is connected to the ninth terminal of the resistor array R3, and the eighth terminal of the resistor array R3 is connected to the first signal terminal of the parallel data bus of the DVI receiver U501; the second signal terminal of the parallel data bus of the main controller U2 is connected to the tenth terminal of the resistor array R3, and the seventh terminal of the resistor array R3 is connected to the second signal terminal of the parallel data bus of the DVI receiver U501; the third signal terminal of the parallel data bus of the main controller U2 is connected to the eleventh terminal of the resistor array R3, and the sixth terminal of the resistor array R3 is connected to the third signal terminal of the parallel data bus of the DVI receiver U501; the fourth signal terminal of the parallel data bus of the main controller U2 is connected to the twelfth terminal of the resistor array R3, and the fifth terminal of the resistor array R3 is connected to the fourth signal terminal of the parallel data bus of the DVI receiver U501; The fifth signal terminal of the parallel data bus of the main controller U2 is connected to the thirteenth terminal of the resistor array R3, and the fourth terminal of the resistor array R3 is connected to the fifth signal terminal of the parallel data bus of the DVI receiver U501; the sixth signal terminal of the parallel data bus of the main controller U2 is connected to the fourteenth terminal of the resistor array R3, and the third terminal of the resistor array R3 is connected to the sixth signal terminal of the parallel data bus of the DVI receiver U501; the seventh signal terminal of the parallel data bus of the main controller U2 is connected to the fifteenth terminal of the resistor array R3, and the second terminal of the resistor array R3 is connected to the seventh signal terminal of the parallel data bus of the DVI receiver U501; the eighth signal terminal of the parallel data bus of the main controller U2 is connected to the sixteenth terminal of the resistor array R3, and the first terminal of the resistor array R3 is connected to the eighth signal terminal of the parallel data bus of the DVI receiver U501.

[0130] The ninth signal terminal of the parallel data bus of the main controller U2 is connected to the ninth terminal of the resistor array RN2, and the first terminal of the resistor array RN2 is connected to the ninth signal terminal of the parallel data bus of the DVI receiver U501; the tenth signal terminal of the parallel data bus of the main controller U2 is connected to the tenth terminal of the resistor array RN2, and the seventh terminal of the resistor array RN2 is connected to the tenth signal terminal of the parallel data bus of the DVI receiver U501; the eleventh signal terminal of the parallel data bus of the main controller U2 is connected to the eleventh terminal of the resistor array RN2, and the sixth terminal of the resistor array RN2 is connected to the eleventh signal terminal of the parallel data bus of the DVI receiver U501; the twelfth signal terminal of the parallel data bus of the main controller U2 is connected to the twelfth terminal of the resistor array RN2, and the fifth terminal of the resistor array RN2 is connected to the twelfth signal terminal of the parallel data bus of the DVI receiver U501; the main controller... The thirteenth signal terminal of the U2 parallel data bus is connected to the thirteenth terminal of the resistor array RN2, and the fourth terminal of the resistor array RN2 is connected to the thirteenth signal terminal of the parallel data bus of the DVI receiver U501; the fourteenth signal terminal of the master controller U2 parallel data bus is connected to the fourteenth terminal of the resistor array RN2, and the third terminal of the resistor array RN2 is connected to the fourteenth signal terminal of the parallel data bus of the DVI receiver U501; the fifteenth signal terminal of the master controller U2 parallel data bus is connected to the fifteenth terminal of the resistor array RN2, and the second terminal of the resistor array RN2 is connected to the fifteenth signal terminal of the parallel data bus of the DVI receiver U501; the sixteenth signal terminal of the master controller U2 parallel data bus is connected to the sixteenth terminal of the resistor array RN2, and the first terminal of the resistor array RN2 is connected to the sixteenth signal terminal of the parallel data bus of the DVI receiver U501.

[0131] The seventeenth signal terminal of the parallel data bus of the main controller U2 is connected to the ninth terminal of the resistor array RN1, and the first terminal of the resistor array RN1 is connected to the seventeenth signal terminal of the parallel data bus of the DVI receiver U501; the eighteenth signal terminal of the parallel data bus of the main controller U2 is connected to the tenth terminal of the resistor array RN1, and the seventh terminal of the resistor array RN1 is connected to the eighteenth signal terminal of the parallel data bus of the DVI receiver U501; the nineteenth signal terminal of the parallel data bus of the main controller U2 is connected to the eleventh terminal of the resistor array RN1, and the sixth terminal of the resistor array RN1 is connected to the nineteenth signal terminal of the parallel data bus of the DVI receiver U501; the twentieth signal terminal of the parallel data bus of the main controller U2 is connected to the twelfth terminal of the resistor array RN1, and the fifth terminal of the resistor array RN1 is connected to the twentieth signal terminal of the parallel data bus of the DVI receiver U501; the main controller U2 The 21st signal terminal of the parallel data bus is connected to the 13th terminal of the resistor array RN1, and the 4th terminal of the resistor array RN1 is connected to the 21st signal terminal of the parallel data bus of the DVI receiver U501; the 22nd signal terminal of the parallel data bus of the master controller U2 is connected to the 14th terminal of the resistor array RN1, and the 3rd terminal of the resistor array RN1 is connected to the 22nd signal terminal of the parallel data bus of the DVI receiver U501; the 23rd signal terminal of the parallel data bus of the master controller U2 is connected to the 15th terminal of the resistor array RN1, and the 2nd terminal of the resistor array RN1 is connected to the 23rd signal terminal of the parallel data bus of the DVI receiver U501; the 24th signal terminal of the parallel data bus of the master controller U2 is connected to the 16th terminal of the resistor array RN1, and the 1st terminal of the resistor array RN1 is connected to the 24th signal terminal of the parallel data bus of the DVI receiver U501.

[0132] The filtering module includes four modules: the first filtering module U505B, the second filtering module U505A, the third filtering module U506B, and the fourth filtering module U506A. The positive terminal of the third channel of the differential signal of the DVI receiver U501 is connected to the AC1 terminal of the fourth filtering module U506A, the negative terminal of the third channel of the differential signal of the DVI receiver U501 is connected to the AC2 terminal of the fourth filtering module U506A, the positive terminal of the third channel of the filtered signal of the fourth filtering module U506A is connected to the J4TMDS_data_2+ terminal of the HDMI input interface, and the negative terminal of the third channel of the filtered signal of the fourth filtering module U506A is connected to the J4TMDS_data_2- terminal of the HDMI input interface.

[0133] The positive terminal of the second differential signal channel of the DVI receiver U501 is connected to the terminal of the third filter module U506BC1, the negative terminal of the second differential signal channel of the DVI receiver U501 is connected to the terminal of the third filter module U506BC2, the positive terminal of the second filter signal channel of the third filter module U506B is connected to the terminal of the HDMI input interface J4TMDS_data_1+, and the negative terminal of the second filter signal channel of the third filter module U506B is connected to the terminal of the HDMI input interface J4TMDS_data_1-.

[0134] The positive terminal of the first differential signal channel of the DVI receiver U501 is connected to the terminal of the second filter module U505AC1, the negative terminal of the first differential signal channel of the DVI receiver U501 is connected to the terminal of the second filter module U505AC2, the positive terminal of the first filtered signal channel of the second filter module U505A is connected to the terminal of the HDMI input interface J4TMDS_data_1+, and the negative terminal of the first filtered signal channel of the second filter module U505A is connected to the terminal of the HDMI input interface J4TMDS_data_1-.

[0135] The positive terminal of the differential signal clock channel of the DVI receiver U501 is connected to the first filter module U505BC1, and the negative terminal of the differential signal clock channel of the DVI receiver U501 is connected to the first filter module U505BC2. The positive terminal of the filter signal clock channel of the first filter module U505B is connected to the HDMI input interface J4TMDS_clock+, and the negative terminal of the filter signal clock channel of the first filter module U505B is connected to the HDMI input interface J4TMDS_clock+.

[0136] The HDMI input interface J4 DDC_data terminal is connected to the second input terminal of the ESD protection module U502, one end of resistor R507, and the SDA terminal of the storage module U503. The other end of resistor R507 is connected to the HDMI input interface J4+5V_power terminal. The HDMI input interface J4DDC_clock terminal is connected to the second input terminal of the ESD protection module U502, one end of resistor R518, and the SCL terminal of the storage module U503. The other end of resistor R518 and the VCC terminal of the storage module U503 are connected to the HDMI input interface J4+5V_power terminal. The third terminal of the ESD protection module U502 is connected to the power ground.

[0137] The main controller U2HOST_IRQ_S terminal is connected to one end of resistor R39. The other end of resistor R39 is connected to the NOT gate buffer U15A terminal and the SPI protection chip U17D1+. The NOT gate buffer U15VCC terminal is connected to the 3.3V power supply terminal. The NOT gate buffer U15Y terminal is connected to one end of resistor R572 and the bridge U11GPIO_16 terminal. The other end of resistor R572 is connected to the other end of inductor L2. The main controller U2HOST_I2C_SDA terminal is connected to the level converter U7A1 terminal and the first input terminal of the ESD protection chip U16. The main controller U2HOST_I2C_SCL terminal is connected to the level converter U7A2 terminal and the second input terminal of the ESD protection chip U16. The ground terminal of the ESD protection chip U16 is connected to the power supply ground.

[0138] It also includes a jumper module, which is used to switch between Cypress and SPI bus. The jumper module includes the following: the master controller U2HOST_SPI_CLK terminal is connected to the second terminal of the connector J10; the first terminal of the connector J10 is connected to one end of the resistor R582; the other end of the resistor R582 is connected to the seventh terminal of the SPI connector J15 and the SPI protection chip U512D1+ terminal; the third terminal of the connector J10 is connected to one end of the resistor R567; the other end of the resistor R567 is connected to the SPI bus transceiver U12B3 terminal.

[0139] The main controller U2HOST_SPI_CSZ terminal is connected to the second terminal of connector J12. The first terminal of connector J12 is connected to one end of resistor R581. The other end of resistor R581 is connected to the ninth terminal of SPI connector J15 and the D2- terminal of SPI protection chip U512. The third terminal of connector J12 is connected to one end of resistor R564. The other end of resistor R564 is connected to the B4 terminal of SPI bus transceiver U12.

[0140] The main controller U2HOST_SPI_PICO terminal is connected to the second terminal of connector J11. The first terminal of connector J11 is connected to one end of resistor R583 and the SPI protection chip U512D1- terminal. The other end of resistor R583 is connected to the eighth terminal of SPI connector J15. The third terminal of connector J11 is connected to one end of resistor R568. The other end of resistor R568 is connected to the SPI bus transceiver U12B1 terminal.

[0141] One end of resistor R555 at the U2HOST_SPI_POCI terminal of the main controller is connected to the second end of connector J13. The first end of connector J10 is connected to the fifth end of SPI connector J15 and the SPI protection chip U512D2+. The third end of connector J10 is connected to the SPI bus transceiver U12B2.

[0142] The VBUS terminal of bridge U11 is connected to the first terminal of USB input interface J9 and one terminal of capacitor C603. The other terminal of capacitor C603 is connected to the power ground. The USBDM terminal of bridge U11 is connected to the second terminal of USB input interface J9. The USBDP terminal of bridge U11 is connected to the third terminal of USB input interface J9.

[0143] The bridge U11GPIO_7 terminal is connected to one end of resistor R560 and the NOT gate buffer U8A terminal. The NOT gate buffer U8B terminal is connected to the master controller U2PROJ_ON terminal. The other end of resistor R560 is connected to one end of capacitor C593, the NOT gate buffer U8VCC terminal and the other end of inductor L2. The other end of capacitor C593 is connected to power ground.

[0144] The bridge U11CY_HOST_SCL terminal is connected to the level converter U7B2 terminal and one end of resistor R49. The other end of resistor R49 is connected to the other end of inductor L2. The bridge U11CY_HOST_SDA terminal is connected to the level converter U7B1 terminal and one end of resistor R48. The other end of resistor R48 is connected to the other end of inductor L2. The bridge U11CY_HOST_I2C_OE terminal is connected to the level converter U7OE terminal and one end of resistor R40. The other end of resistor R40 is connected to power ground.

[0145] A working method for an interactive marine HUD system based on binocular vision includes the following steps:

[0146] S1: HUD screen display;

[0147] S2: Binocular detection;

[0148] S2-1: Establish the system's relative reference coordinate system and the mathematical equations for the HUD display plane;

[0149] S2-1-1: Establish the system's relative reference coordinate system;

[0150] S2-1-2: Calculate the mathematical equations for the HUD display plane;

[0151] S2-1-2-1: The operator places the left index finger perpendicular to the plane of the HUD display area, with the left finger pointing towards the center of the HUD display area, and acquires images through at least two binocular cameras spaced apart on the left and right.

[0152] S2-1-2-2: Calculate the straight line where the left index finger is located. This vector is the normal vector of the HUD display area plane, denoted as h = xx, yy, zz;

[0153] S2-1-2-3: Move the left hand fingers k meters and point the left index finger to the center of the HUD display area. Acquire images through at least two binocular cameras set at left and right intervals and record the tilt angle.

[0154] S2-1-2-5: Calculate the plane mathematical equations based on the bias angle, the moving distance k, and the normal vector;

[0155] The mathematical equation for a plane is expressed as follows:

[0156]

[0157] In the formula, x 0 ,t 0 ,z 0 It is a point on the line; t is the parametric equation, and its expression is:

[0158] S2-2: Define the area to be operated on;

[0159] S2-2-1: Facial feature detection;

[0160] S2-2-1-1: Use a pose detection algorithm to detect the operator's left ear, right ear, and nose. Figure 2 The positions of points 0, 3, and 4 in the text;

[0161] S2-2-1-1-1: Real-time video capture of operators is achieved using at least two binocular cameras spaced at left and right intervals;

[0162] S2-2-1-1-2: Locate the face region in the image from each binocular camera, draw a bounding box, and crop the face region;

[0163] S2-2-1-1-3: Normalize the face regions cropped from each binocular camera to align the faces;

[0164] S2-2-1-1-4: Input the aligned face image into the trained keypoint detection model to detect facial keypoints;

[0165] S2-2-1-1-5: Extract the pixel coordinates of key points for the left ear, right ear, and nose;

[0166] S2-2-1-2: Calculate the three-dimensional spatial coordinates of the extracted key points in the relative reference coordinate system based on their pixel coordinates.

[0167] The three-dimensional spatial coordinates corresponding to the nose are x0, y0, z0;

[0168] The three-dimensional spatial coordinates corresponding to the right ear are x3, y3, z3;

[0169] The three-dimensional spatial coordinates corresponding to the left ear are x4, y4, z4;

[0170] S2-2-2: Calculate the visual direction;

[0171] S2-2-2-1: Based on the calculated three-dimensional spatial coordinates of the left ear, right ear, and nose, calculate the direction vectors from the right ear to the nose and from the left ear to the nose; the direction vector from the right ear to the nose is v. 30 =x0-x3,y0-y3,z0-z3;

[0172] The direction vector from the left ear to the nose is v 40 =x0-x4,y0-y4,z0-z4;

[0173] S2-2-2-2: Calculate the equation of the straight line in the visual direction;

[0174] S2-2-2-2-1: Calculate the direction vector v30 The model;

[0175] Calculated using the following formula:

[0176]

[0177] In the formula, ||v 30 || represents the direction vector v 30 The model;

[0178] S2-2-2-2-2: Calculate the direction vector v 40 The model;

[0179] Calculated using the following formula:

[0180]

[0181] In the formula, ||v 40 || represents the direction vector v 40 The model;

[0182] S2-2-2-2-3: The direction vector of the unnormalized angle bisector is calculated as follows:

[0183]

[0184] In the formula, v bisect The direction vector of the angle bisector;

[0185] S2-2-2-2-5: Calculate the equation of the line in the visual direction based on the angle bisector direction vector calculated in step S2-1-2-2-3;

[0186] S2-2-2-3: Determine the corresponding display area on the HUD screen based on the linear equation of the viewing direction;

[0187] S2-3: Determine the target location for the operation;

[0188] S2-3-1: Detection of key points on the left index finger;

[0189] S2-3-1-1: Real-time image acquisition of operators is achieved by using at least two binocular cameras spaced at left and right intervals;

[0190] S2-3-1-2: Perform stereo correction on all images acquired by the binocular cameras;

[0191] S2-3-1-3: Crop the left hand palm area from the stereo-corrected image;

[0192] S2-3-1-4: The cropped image of the left hand palm region is used to identify the hand joints through the hand model, and the index finger joint is indexed;

[0193] S2-3-1-5: Obtain the pixel coordinates of the index finger joint based on the indexed index finger joint information;

[0194] S2-3-1-6: Calculate the corresponding three-dimensional spatial coordinates of the index finger joint in the relative reference coordinate system based on the obtained pixel coordinates;

[0195] The three-dimensional spatial coordinates of the tip of the left index finger are x8, y8, z8;

[0196] The three-dimensional spatial coordinates of the first joint of the left index finger are x7, y7, z7;

[0197] The three-dimensional spatial coordinates of the second joint of the left index finger are x6, y6, z6;

[0198] The three-dimensional spatial coordinates of the joint between the left index finger and the palm are x5, y5, z5;

[0199] S2-3-2: Detection of the direction pointed by the left index finger;

[0200] S2-3-2-1: Based on the calculated three-dimensional spatial coordinates of the left index fingertip, first joint, second joint, and joint between the index finger and the palm, calculate the direction vector from the left index fingertip to the first joint, the direction vector from the first joint to the second joint, and the direction vector from the second joint to the palm.

[0201] The direction vector v from the tip of the left index finger to the first joint 87 = x7-x8, y7-y8, z7-z8;

[0202] The direction vector v from the first joint to the second joint 76 = x6-x7, y6-y7, z6-z7;

[0203] The direction vector v between the second joint and the palm 65 = x5-x6, y5-y6, z5-z6;

[0204] S2-3-2-2: Calculate the direction vector v 87 v 76 v 65 The model;

[0205] Calculated using the following formula:

[0206]

[0207] In the formula, ||v87|| is the direction vector v 87 The modulus, ||v76|| is the direction vector v 76 The modulus; ||v65|| is the direction vector v 65 The model;

[0208] S2-3-2-3: Calculate the unnormalized angle bisector direction vector v bisect 'as follows:

[0209]

[0210] S2-3-2-4: Calculate the equation of the straight line pointing to the left index finger based on the angle bisector direction vector calculated in step S2-3-2-3;

[0211] S2-4: Determine the location of the operation; Calculate the operation location based on the mathematical equation of the HUD display plane calculated in step S2-1 and the pointing position determined in step S2-3;

[0212] S2-5: Determine the actions to be performed;

[0213] S2-5-1: Right index fingertip detection;

[0214] S2-5-1-1: Real-time capture of the movement trajectory of the right index fingertip using at least two binocular cameras spaced at left and right intervals;

[0215] S2-5-1-2: Perform hand key point detection for each frame, continuously track and record the three-dimensional spatial coordinates x′8, y′8, z′8 of the right index fingertip in each unit of time;

[0216] S2-5-2: Detection of the movement trajectory of the right index fingertip;

[0217] S2-5-2-1: Real-time acquisition of the current position of the right index finger, and calculation of the current velocity based on its position relative to the previous moment;

[0218] S2-5-2-2: Calculate the motion type based on the displacement vector, total path length, average velocity, direction change, and curvature of the right index finger.

[0219] S2-5-2-3: Based on the real-time acquired images, draw a trajectory diagram and analyze the trajectory characteristics;

[0220] S3: Generate operation instructions based on the binocular detection results;

[0221] S4: Control the HUD screen via operation commands.

Claims

1. An interactive marine HUD working system based on binocular vision, characterized in that: The system includes at least one display screen (100) for displaying ship information. The display screen (100) is fixed by a bottom shell (200) and a light shield (300) arranged opposite to each other. The bottom shell (200) is provided with a control system (400) for realizing the display function of the display screen (100) and an input module (500) for receiving information sent by the ship's display and control console. The bottom shell (200) is provided with an image generation module (600) for converting electrical signals into images on the display screen. The input module (500) and the image generation module (600) are both electrically connected to the control system (400). The bottom shell (200) is provided with a binocular camera (700), and an interactive information processing module (800) electrically connected to the binocular camera is provided inside the bottom shell (200). The control system (400) includes a main controller (U2), whose lighting signal output terminal is connected to the lighting signal input terminal of the lighting controller (U6), whose drive signal output terminal is connected to the drive signal input terminal of the headlight driver, whose display drive signal output terminal is connected to the display signal input terminal of the display driver module, and also includes a power adapter module, which is used to supply power to each electrical device.

2. The interactive marine HUD system based on binocular vision according to claim 1, characterized in that: The display screen (100) has three sides, and the left and right sides form a certain angle with the front display screen. Each display screen (100) is fixed to the bottom shell (200) by a corresponding light shield (300). The bottom shell (200) includes two bottom beams (210) arranged opposite each other. On each bottom beam (210), there is a mounting box (220) for installing the image generation module (600) on the left and right sides of each display screen (100). The front side of the mounting box (220) is set as an opening, and the upper and lower ends of the mounting box (220) are installed with the bottom beam (210) on the corresponding side. The mounting box (220) is provided with a mounting block (230) for installing the light shield (300).

3. The interactive marine HUD system based on binocular vision according to claim 2, characterized in that: Each bottom beam (210) has a right-angle bend (211) at its front end that limits the display screen (100) from the rear. The base shell (200) is equipped with a mounting bracket (900) for mounting the entire device in the cab. The mounting bracket (900) includes a vertical frame (910) connected to the base shell and a horizontal frame (920) connected to the cab. A reinforcing rib (930) is provided between the vertical frame (910) and the horizontal frame (920). In order to facilitate the adjustment of the installation height of the HUD device, a plurality of mounting holes (901) are provided vertically and vertically at intervals on the horizontal frame (920).

4. The interactive marine HUD system based on binocular vision according to claim 1, characterized in that: The power adapter module includes a synchronous buck converter (U5). The power input terminal of the synchronous buck converter (U5) is connected to one end of capacitor C31, one end of capacitor C37, one end of resistor R540, one end of capacitor C41, and one end of capacitor C23. The other end of capacitor C23 is connected to one end of inductor L5 and the main information output terminal of the ship. The other end of inductor L5 is connected to one end of terminal block J1 and one end of capacitor C571. The ground terminal of the synchronous buck converter (U5), the other end of capacitor C31, capacitor C37, capacitor C41, capacitor C23, and capacitor C571 are all connected to the power ground. The other end of resistor R540 is connected to the enable terminal of the synchronous buck converter (U5). The VCC terminal of the synchronous buck converter (U5) is connected to one end of capacitor C587, and the other end of capacitor C587 is connected to the power ground. The BOOT terminal of the synchronous buck converter (U5) is connected to one end of capacitor C38. The other end of capacitor C38 is connected to the NC terminal of the synchronous buck converter (U5) and one end of inductor L2. The other end of inductor L2 is connected to one end of capacitor C26, one end of capacitor C536, one end of resistor R535, one end of capacitor C19, one end of capacitor C18, one end of resistor R20, one end of capacitor C537, the VIN terminal of switching regulator (U504), the VIN terminal of load switch (U1), and the VIN terminal of regulator (U3). The other end of capacitor C26 is connected to resistor R... The other end of 535 is connected to the feedback terminal of the synchronous buck converter (U5) and one end of resistor R544. The other ends of resistor R544, capacitor C536, capacitor C19, and capacitor C18 are all connected to power ground. The other end of resistor R20 is connected to the CTRL terminal of the switching regulator (U504) and the PG terminal of the synchronous buck converter (U5). The COMP terminal of the switching regulator (U504) is connected to one end of resistor R517. The other end of resistor R517 is connected to the other end of capacitor C519. The other end of capacitor C519 is connected to power ground. The SW terminal of the switching regulator (U504) is connected to one end of inductor L516 and the positive terminal of diode D1. The other end of inductor L516 is connected to the VIN terminal of the switching regulator (U504). The negative terminal of diode D1 is connected to one end of resistor R508, one end of capacitor C2, one end of capacitor C513, one end of resistor R505, one end of capacitor C512, and the IN and IN2 terminals of the linear regulator (U500). The other end of resistor R508 is connected to the switch... The feedback terminal of the voltage regulator (U504) and one end of the resistor R4, the other end of the resistor R4, the ground terminal of the switching regulator (U504), the other end of the capacitor C2, the other end of the capacitor C513, the other end of the capacitor C512, and the ground terminal of the linear regulator (U500) are all connected to the power supply ground; the output terminal and the SNS terminal of the linear regulator (U500) are both connected to one end of the resistor R500, the other end of the resistor R500 is connected to one end of the capacitor C516, and the other end of the capacitor C516 is connected to the power supply ground.

5. The interactive marine HUD system based on binocular vision according to claim 4, characterized in that: The ON terminal of the load switch (U1) is connected to the enable terminal of the lighting controller (U6) and one end of the resistor R5. The other end of the resistor R5 and the ground terminal of the load switch (U1) are connected to the power supply ground. The output terminal of the load switch (U1) outputs a 3.3V voltage, which is the 3.3V power supply terminal for the power adapter module, and is connected to one end of the resistor R9. The other end of the resistor R9 is connected to the QOD terminal of the load switch (U1). The CT terminal of the load switch (U1) is connected to the power supply ground. The first enable terminal of the voltage regulator (U3) is connected to the enable terminal of the lighting controller (U6) and one end of resistor R13. The second enable terminal of the voltage regulator (U3) is connected to the enable terminal of the lighting controller (U6) and one end of resistor R16. The other ends of resistor R13, the other ends of resistor R16, and the ground terminal of the voltage regulator (U3) are connected to the power supply ground. The MODE / DATA terminal of the voltage regulator (U3) is connected to one end of resistor R21, and the other end of resistor R21 is connected to the power supply ground. The first output terminal of the voltage regulator (U3) is connected to one end of inductor L518. The other end of inductor L518 outputs a 1.8V voltage, which is the 1.8V power supply terminal for the power adapter module. The other end of inductor L518 is also connected to the feedback terminal of the voltage regulator (U3), one end of resistor R513, and one end of capacitor C526. One end of capacitor C525 is connected to the other end of resistor R513, which is connected to one end of resistor R514. The other ends of resistor R514, capacitor C526, and capacitor C525 are all connected to the power supply ground. The second output terminal of the voltage regulator (U3) is connected to one end of inductor L520. The other end of inductor L520 outputs a 1.1V voltage, which is the 1.1V power supply terminal for the power adapter module. The other end of inductor L520 is also connected to one end of capacitor C561, one end of resistor R24, one end of capacitor C559, and one end of capacitor C27. The other end of resistor R24 ​​is connected to one end of resistor R32. The other ends of resistor R32, capacitor C559, and capacitor C27 are all connected to the power supply ground. The other end of capacitor C561 is connected to the ADJ2 terminal of voltage regulator (U3).

6. The interactive marine HUD system based on binocular vision according to claim 1, characterized in that: The input terminal of the main controller (U2) PLL_REFCLK is connected to one end of capacitor C518, one end of resistor R509, and the first terminal of oscillator Y500. The output terminal of the main controller (U2) PLL_REFCLK is connected to the other end of resistor R509 and one end of resistor R520. One end of resistor R520 is connected to the third terminal of oscillator Y500 and one end of capacitor C521. The other ends of capacitor C521 and capacitor C518 are connected to the power supply ground. The VCC3IO_COSC terminal of the main controller (U2) is connected to one end of ferrite bead L519 and one end of capacitor C542. The other end of ferrite bead L519 is connected to the 3.3V power supply terminal. The GNDIOLA_COSC terminal of the main controller (U2) is connected to the other end of capacitor C542 and connected to the power supply ground. The VCC11AD_PLLM terminal of the main controller (U2) is connected to... One end of capacitor C533, one end of capacitor C4, and one end of ferrite bead L512 are connected to the other end of capacitor C533, the other end of capacitor C4, and one end of ferrite bead L513. The other end of ferrite bead L512 is connected to the 1.1V power supply terminal and one end of capacitor C1. The other end of capacitor C1 and the other end of ferrite bead L513 are connected to power ground. The VCC11AD_PLLD terminal of the main controller (U2) is connected to one end of capacitor C534, one end of capacitor C5, and one end of ferrite bead L515. The GND11AD_PLLD terminal of the main controller (U2) is connected to the other end of capacitor C534, the other end of capacitor C5, and one end of ferrite bead L517. The other end of ferrite bead L515 is connected to the 1.1V power supply terminal and one end of capacitor C9. The other end of capacitor C9 and the other end of ferrite bead L517 are connected to power ground. The PMIC_SPI_DIN terminal of the main controller (U2) is connected to the SPI1_DOUT terminal of the lighting controller (U6). The PMIC_SPI_DOUT terminal of the main controller (U2) is connected to the SPI1_DIN terminal of the lighting controller (U6) and one end of resistor R574. The other end of resistor R574 is connected to power ground. The PMIC_SPI_CSZ_0 terminal of the main controller (U2) is connected to the SPI1_SS terminal of the lighting controller (U6) and one end of resistor R61. The PMIC_SPI_CLK terminal of the main controller (U2) is connected to the SPI1_CLK terminal of the lighting controller (U6) and one end of resistor R575. The other ends of resistor R61 and resistor R575 are connected to power ground. The main controller (U2) GPIO_00 terminal is connected to one end of resistor R532. The other end of resistor R532 is connected to one end of ferrite bead FB1 and one end of resistor R512. The other end of resistor R512 is connected to power ground. The other end of ferrite bead FB1 is connected to the seventh terminal of the headlight driver interface J2, and is connected to the headlight driver through the headlight driver interface J2. The main controller (U2) PMIC_LEDSEL_0_S terminal is connected to one end of resistor R521. The other end of resistor R521 is connected to the first terminal of the headlight driver interface J2. The main controller (U2) PMIC_LEDSEL_1_S terminal is connected to one end of resistor R12, and the other end of resistor R12 is connected to the second terminal of the headlight driver interface J2. The main controller (U2) PMIC_LEDSEL_2_S terminal is connected to one end of resistor R522, and the other end of resistor R522 is connected to the third terminal of the headlight driver interface J2. The main controller (U2) PMIC_LEDSEL_3_S terminal is connected to one end of resistor R11, and the other end of resistor R11 is connected to the fourth terminal of the headlight driver interface J2. The main controller (U2) GPIO_04 terminal is connected to one end of resistor R54 and the lighting controller (U6) D_EN terminal, with the other end of resistor R54 connected to the power supply ground; the main controller (U2) GPIO_03 terminal is connected to one end of resistor R569 and the lighting controller (U6) S_EN terminal, with the other end of resistor R569 connected to the power supply ground; the main controller (U2) PMIC_AD3_POCI terminal is connected to the lighting controller (U6) AD3_MISO terminal; the main controller (U2) PMIC_AD3_PICO terminal is connected to one end of resistor R41 and the lighting controller (U6) AD3_MOSI terminal, with the other end of resistor R41 connected to the power supply ground; the main controller (U2) PMIC_AD3_SEQ_CLK terminal is connected to one end of resistor R41 and the lighting controller (U6) SEQ_CLK terminal, with the other end of resistor R41 connected to the power supply ground; The main controller (U2) PMIC_WD1_S terminal is connected to one end of resistor R546, and the other end of resistor R546 is connected to the WD1 terminal of the lighting controller (U6). The main controller (U2) PMIC_SEQ_STRT_S terminal is connected to one end of resistor R19, and the other end of resistor R19 is connected to the WD2 terminal of the lighting controller (U6). The main controller (U2) PWM1_COMPOUT_S terminal is connected to one end of resistor R10, and the other end of resistor R10 is connected to one end of ferrite bead FB2. The other end of ferrite bead FB2 is connected to the headlight driver interface J.

2. Eighth terminal; The main controller (U2) PMIC_INTZ terminal is connected to one end of resistor R561 and the lighting controller (U6) INT terminal. The other end of resistor R561 is connected to the 3.3V power supply terminal. The main controller (U2) PMIC_PARKZ terminal is connected to one end of resistor R559 and the lighting controller (U6) PARK terminal. The other end of resistor R559 is connected to the power supply ground. The main controller (U2) RESETZ terminal is connected to one end of resistor R50 and the lighting controller (U6) reset terminal. The other end of resistor R50 is connected to the power supply ground. The lighting controller (U6) R_EN terminal is connected to one end of the ferrite bead L506, and the other end of the ferrite bead L506 is connected to the tenth terminal of the terminal block J500. The headlight driver is connected through the terminal block J500. The lighting controller (U6) G_EN terminal is connected to one end of the ferrite bead L505, and the other end of the ferrite bead L505 is connected to the eleventh terminal of the terminal block J500. The lighting controller (U6) B_EN terminal is connected to one end of the ferrite bead L504, and the other end of the ferrite bead L504 is connected to the twelfth terminal of the terminal block J500. The lighting controller (U6) PMIC_SEN1 terminal is connected to one end of the ferrite bead L509, and the other end of the ferrite bead L509 is connected to the fifth terminal of the terminal block J500. The lighting controller (U6) PMIC_SEN2 terminal is connected to one end of the ferrite bead L507, and the other end of the ferrite bead L507 is connected to the eighth terminal of the terminal block J500. The lighting controller (U6) PMIC_CMODE terminal is connected to one end of ferrite bead L508, and the other end of ferrite bead L508 is connected to the seventh terminal of terminal block J500. The lighting controller (U6) PMIC_LM3409_DRVEN terminal is connected to one end of ferrite bead L510, and the other end of ferrite bead L510 is connected to the third terminal of terminal block J500. The lighting controller (U6) PMIC_LS_SENSE_P terminal is connected to one end of ferrite bead L502, and the other end of ferrite bead L502 is connected to the sixteenth terminal of terminal block J500. The lighting controller (U6) P... The MIC_LS_SENSE_N terminal is connected to one end of the ferrite bead L501, and the other end of the ferrite bead L501 is connected to the seventeenth terminal of the terminal block J500. The lighting controller (U6) PMIC_LM3409_SYNC terminal is connected to one end of the ferrite bead L511, and the other end of the ferrite bead L511 is connected to the first terminal of the terminal block J500. The lighting controller (U6) PMIC_LM3409_IADJ terminal is connected to one end of the ferrite bead L500, and the other end of the ferrite bead L500 is connected to the nineteenth terminal of the terminal block J500.

7. The interactive marine HUD working system based on binocular vision according to claim 1, characterized in that: It also includes a HUD control and headlight control switching module, including a signal switch U10. The A terminal of the signal switch U10 is connected to the other end of the resistor R523. The low-level enable terminal of the signal switch U10 is connected to the GPIO_9 terminal of the main controller (U2). The B terminal of the signal switch U10 is connected to the PMIC_LM3409_DRVEN terminal of the lighting controller (U6). The VCC terminal of the signal switch U10 is connected to the 3.3V power supply terminal. It also includes a signal switch U9. The A terminal of the signal switch U9 is connected to the PMIC_COMPOUT terminal of the lighting controller (U6). The low-level enable terminal of the signal switch U9 is connected to the GPIO_9 terminal of the main controller (U2). The B terminal of the signal switch U9 is connected to the PWM1_COMPOUT_S terminal of the main controller (U2). The VCC terminal of the signal switch U9 is connected to the 3.3V power supply terminal. It also includes a NOT gate buffer U13, whose VCC terminal is connected to one end of resistor R570, the 3.3V power supply terminal, and one end of capacitor C59. The other end of resistor R570 and the A terminal of NOT gate buffer U13 are both connected to the GPIO_9 terminal of the main controller (U2), and the other end of capacitor C59 is connected to the power supply ground. The Y terminal of NOT gate buffer U13 is connected to the first input terminal of each group of AND gates of AND gate chip U14. The other input terminal of the first group of AND gates of AND gate chip U14 is connected to the other end of resistor R521. The first group of output terminals of AND gate chip U14 is connected to the HUD_LEDSEL of the lighting controller (U6). The second input terminal of the AND gate chip U14 is connected to the other end of the resistor R521, and the output terminal of the second group of the AND gate chip U14 is connected to the HUD_LEDSEL_1 terminal of the lighting controller (U6); the third input terminal of the AND gate chip U14 is connected to the other end of the resistor R521, and the output terminal of the third group of the AND gate chip U14 is connected to the HUD_LEDSEL_2 terminal of the lighting controller (U6); the fourth input terminal of the AND gate chip U14 is connected to the other end of the resistor R521, and the output terminal of the fourth group of the AND gate chip U14 is connected to the HUD_LEDSEL_3 terminal of the lighting controller (U6). The JTAGRSTZ terminal of the main controller (U2) is connected to one end of resistor R531, and the other end of resistor R531 is connected to power ground; the GPIO_11 terminal of the main controller (U2) is connected to one end of resistor R18, and the other end of resistor R18 is connected to power ground; the GPIO_12 terminal of the main controller (U2) is connected to one end of resistor R533, and the other end of resistor R533 is connected to power ground; the GPIO_10 terminal of the main controller (U2) is connected to one end of resistor R536, and the other end of resistor R536 is connected to power ground; the GPIO_13 terminal of the main controller (U2) is connected to resistor R... One end of resistor R22 is connected to the power supply ground. The other end of resistor R22 is connected to the main controller (U2) GPIO_22. The other end of resistor R548 is connected to the power supply ground. The other end of resistor R548 is connected to the main controller (U2) GPIO_23. The other end of resistor R547 is connected to the power supply ground. The other end of resistor R547 is connected to the power supply ground. The other end of resistor R542 is connected to the main controller (U2) GPIO_24. The other end of resistor R542 is connected to the power supply ground. The other end of resistor R550 is connected to the main controller (U2) GPIO_25. The main controller (U2) TESTPT0 terminal is connected to one end of resistor R549, and the other end of resistor R549 is connected to the digital bus switch U510B terminal. The digital bus switch U510A terminal and VCC terminal are both connected to the 3.3V power supply terminal. The low-level enable terminal of the digital bus switch U510 is connected to one end of resistor R571, and the other end of resistor R571 is connected to the 3.3V power supply terminal. The ground terminal of the digital bus switch U510 is connected to the power supply ground. The main controller (U2) CHKSUM_SEL terminal is connected to one end of resistor R552, the other end of resistor R552 is connected to the first terminal of DIP switch SW1, and the second terminal of DIP switch SW1 is connected to the 3.3V power supply terminal; the main controller (U2) HOST_IF_SEL terminal is connected to one end of resistor R37, the other end of resistor R37 is connected to the first terminal of DIP switch SW2, and the second terminal of DIP switch SW2 is connected to the 3.3V power supply terminal; the main controller (U2) HOST_SPI_MODE terminal is connected to one end of resistor R38, the other end of resistor R38 is connected to the first terminal of DIP switch SW3, and the second terminal of DIP switch SW3 is connected to the 3.3V power supply terminal; the main controller (U2) TESTPT5 terminal is connected to one end of resistor R556, the other end of resistor R556 is connected to the first terminal of DIP switch SW4, and the second terminal of DIP switch SW4 is connected to the 3.3V power supply terminal.

8. The interactive marine HUD working system based on binocular vision according to claim 1, characterized in that: The display driver module includes a DVI receiver (U501), the parallel data bus signal terminal of the main controller (U2) is connected to the parallel data bus signal terminal of the DVI receiver (U501), the differential signal terminal of the DVI receiver (U501) is connected to the differential signal terminal of the filter module, and the filter signal output terminal of the filter module is connected to the filter signal input terminal of the HDMI input interface J4. The filtering module comprises four modules: a first filtering module (U505B), a second filtering module (U505A), a third filtering module (U506B), and a fourth filtering module (U506A). The positive terminal of the third differential signal channel of the DVI receiver (U501) is connected to the C1 terminal of the fourth filtering module (U506A), the negative terminal of the third differential signal channel of the DVI receiver (U501) is connected to the C2 terminal of the fourth filtering module (U506A), the positive terminal of the third filtered signal channel of the fourth filtering module (U506A) is connected to the J4TMDS_data_2+ terminal of the HDMI input interface, and the negative terminal of the third filtered signal channel of the fourth filtering module (U506A) is connected to the J4TMDS_data_2- terminal of the HDMI input interface. The positive terminal of the second differential signal channel of the DVI receiver (U501) is connected to the C1 terminal of the third filter module (U506B), the negative terminal of the second differential signal channel of the DVI receiver (U501) is connected to the C2 terminal of the third filter module (U506B), the positive terminal of the second filter signal channel of the third filter module (U506B) is connected to the J4TMDS_data_1+ terminal of the HDMI input interface, and the negative terminal of the second filter signal channel of the third filter module (U506B) is connected to the J4TMDS_data_1- terminal of the HDMI input interface. The positive terminal of the first differential signal channel of the DVI receiver (U501) is connected to the C1 terminal of the second filter module (U505A), the negative terminal of the first differential signal channel of the DVI receiver (U501) is connected to the C2 terminal of the second filter module (U505A), the positive terminal of the first filtered signal channel of the second filter module (U505A) is connected to the J4TMDS_data_1+ terminal of the HDMI input interface, and the negative terminal of the first filtered signal channel of the second filter module (U505A) is connected to the J4TMDS_data_1- terminal of the HDMI input interface. The positive terminal of the differential signal clock channel of the DVI receiver (U501) is connected to the C1 terminal of the first filter module (U505B), the negative terminal of the differential signal clock channel of the DVI receiver (U501) is connected to the C2 terminal of the first filter module (U505B), the positive terminal of the filter signal clock channel of the first filter module (U505B) is connected to the J4TMDS_clock+ terminal of the HDMI input interface, and the negative terminal of the filter signal clock channel of the first filter module (U505B) is connected to the J4TMDS_clock+ terminal of the HDMI input interface. The HDMI input interface J4 DDC_data terminal is connected to the second input terminal of the ESD protection module U502, one end of resistor R507, and the SDA terminal of the storage module U503. The other end of resistor R507 is connected to the HDMI input interface J4+5V_power terminal. The HDMI input interface J4 DDC_clock terminal is connected to the second input terminal of the ESD protection module U502, one end of resistor R518, and the SCL terminal of the storage module U503. The other end of resistor R518 and the VCC terminal of the storage module U503 are connected to the HDMI input interface J4+5V_power terminal. The third terminal of the ESD protection module U502 is connected to the power ground. The host controller (U2) HOST_IRQ_S terminal is connected to one end of resistor R39. The other end of resistor R39 is connected to the NOT gate buffer U15A terminal and the SPI protection chip U17D1+. The NOT gate buffer U15VCC terminal is connected to the 3.3V power supply terminal. The NOT gate buffer U15Y terminal is connected to one end of resistor R572 and the bridge U11GPIO_16 terminal. The other end of resistor R572 is connected to the other end of inductor L2. The host controller (U2) HOST_I2C_SDA terminal is connected to the level converter U7A1 terminal and the first input terminal of ESD protection chip U16. The host controller (U2) HOST_I2C_SCL terminal is connected to the level converter U7A2 terminal and the second input terminal of ESD protection chip U16. The ground terminal of ESD protection chip U16 is connected to the power supply ground.

9. The interactive marine HUD working system based on binocular vision according to claim 1, characterized in that: It also includes a jumper module for switching between Cypress and SPI bus. The jumper module includes the host controller (U2) HOST_SPI_CLK terminal connected to the second terminal of connector J10, the first terminal of connector J10 connected to one end of resistor R582, the other end of resistor R582 connected to the seventh terminal of SPI connector J15 and the SPI protection chip U512D1+ terminal, the third terminal of connector J10 connected to one end of resistor R567, and the other end of resistor R567 connected to the SPI bus transceiver U12B3 terminal. The host controller (U2) HOST_SPI_CSZ terminal is connected to the second terminal of connector J12. The first terminal of connector J12 is connected to one end of resistor R581. The other end of resistor R581 is connected to the ninth terminal of SPI connector J15 and the D2- terminal of SPI protection chip U512. The third terminal of connector J12 is connected to one end of resistor R564. The other end of resistor R564 is connected to the B4 terminal of SPI bus transceiver U12. The host controller (U2) HOST_SPI_PICO terminal is connected to the second terminal of connector J11. The first terminal of connector J11 is connected to one end of resistor R583 and the SPI protection chip U512D1- terminal. The other end of resistor R583 is connected to the eighth terminal of SPI connector J15. The third terminal of connector J11 is connected to one end of resistor R568. The other end of resistor R568 is connected to the SPI bus transceiver U12B1 terminal. One end of resistor R555 of the host controller (U2) HOST_SPI_POCI terminal is connected to the second end of connector J13. The first end of connector J10 is connected to the fifth end of SPI connector J15 and the SPI protection chip U512D2+. The third end of connector J10 is connected to the SPI bus transceiver U12B2. The VBUS terminal of the bridge U11 is connected to the first terminal of the USB input interface J9 and one terminal of the capacitor C603. The other terminal of the capacitor C603 is connected to the power ground. The USBDM terminal of the bridge U11 is connected to the second terminal of the USB input interface J9. The USBDP terminal of the bridge U11 is connected to the third terminal of the USB input interface J9. The bridge U11GPIO_7 terminal is connected to one end of resistor R560 and the NOT gate buffer U8A terminal. The NOT gate buffer U8B terminal is connected to the master controller (U2)PROJ_ON terminal. The other end of resistor R560 is connected to one end of capacitor C593, the NOT gate buffer U8VCC terminal and the other end of inductor L2. The other end of capacitor C593 is connected to power ground. The bridge U11CY_HOST_SCL terminal is connected to the level converter U7B2 terminal and one end of resistor R49. The other end of resistor R49 is connected to the other end of inductor L2. The bridge U11CY_HOST_SDA terminal is connected to the level converter U7B1 terminal and one end of resistor R48. The other end of resistor R48 is connected to the other end of inductor L2. The bridge U11CY_HOST_I2C_OE terminal is connected to the level converter U7OE terminal and one end of resistor R40. The other end of resistor R40 is connected to power ground.

10. The interactive marine HUD working system based on binocular vision according to claim 1, characterized in that: It also includes the following steps: S1: HUD screen display; S2: Binocular detection; S2-1: Establish the system's relative reference coordinate system and the mathematical equations for the HUD display plane; S2-1-1: Establish the system's relative reference coordinate system; S2-1-2: Calculate the mathematical equations for the HUD display plane; S2-1-2-1: The operator places the left index finger perpendicular to the plane of the HUD display area, with the left finger pointing towards the center of the HUD display area, and acquires images through at least two binocular cameras spaced apart on the left and right. S2-1-2-2: Calculate the line containing the left index finger; S2-1-2-3: Move the left hand fingers k meters and point the left index finger to the center of the HUD display area. Acquire images through at least two binocular cameras set at left and right intervals and record the tilt angle. S2-1-2-5: Calculate the plane mathematical equations based on the bias angle, the distance moved, and the normal vector; The mathematical equation for a plane is expressed as follows: In the formula, (x 0 ,y 0 ,z 0 () is a point on the line; t is the parametric equation, which is expressed as: S2-2: Define the area to be operated on; S2-2-1: Facial feature detection; S2-2-2: Calculate the visual direction; S2-3: Determine the target location for the operation; S2-3-1: Detection of key points on the left index finger; S2-3-2: Detection of the direction pointed by the left index finger; S2-4: Determine the location of the operation; S2-5: Determine the actions to be performed; S2-5-1: Right index fingertip detection; S2-5-2: Detection of the movement trajectory of the right index fingertip; S3: Generate operation instructions based on the binocular detection results; S4: Control the HUD screen via operation commands.

Images