A marine augmented reality system and its application method

Abstract

This invention relates to the field of Integrated Bridge System (IBS) technology, specifically to a marine augmented reality system and its application method. Through the rational arrangement of display and control circuits, mounting brackets, camera devices, combined adjustment instruments, optical coupling mirrors, high-brightness displays, and reflective projection, combined with information fusion algorithms and target tracking algorithms, this invention can achieve the effect of overlaying virtual information with external targets. This allows ship operators to focus on external environmental information while simultaneously obtaining augmented digital information about the ship, thereby effectively improving their perception of the real environment and information acquisition efficiency. Furthermore, this invention not only effectively reduces the installation space requirements of navigation support equipment on the bridge's centralized control console, facilitating a less-staffed design for the console, but also provides ship operators with a comfortable and efficient centralized control interface for navigation support equipment, thus ensuring ship navigation safety.

Description

Technical Field

[0001] This invention relates to the field of integrated bridge systems (IBS) for ships, specifically to a marine augmented reality system and its application method. Background Technology

[0002] The integrated bridge system is a multi-functional system that combines navigation, steering, centralized information display, alarm monitoring, communication, and navigation management to improve safe navigation and efficient management of ships. Originating in the 1970s, this system has evolved into a core piece of ship automation equipment and is now widely used. A key feature of the integrated bridge system is information integration. It utilizes computer technology, information processing technology, automation technology, and ergonomics to centrally display navigation, propulsion, electronic charts, radar, video, and safety alarm information through display and control equipment, improving the efficiency and reliability of information acquisition for operators. As a crucial component of the integrated bridge system, the display and control equipment serves as the interaction window between the ship's crew and the ship's systems. The rationality and effectiveness of its interface design directly impact the efficiency of information acquisition for operators, thereby affecting navigation safety.

[0003] The existing integrated bridge system's display and control equipment is usually a computer, all-in-one machine, or other screen display method. This method has the following disadvantages: 1) Operators need to match the target displayed on the screen with the target in the actual external scene, which reduces the efficiency of information acquisition; 2) Operators need to pay attention to the information displayed on the screen and the actual external environment, which can easily cause operator fatigue and increase navigation risks. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to provide a marine augmented reality system and its application method, which enables ship operators to obtain augmented digital information about the ship while paying attention to external environmental information, thereby effectively improving the ship operators' perception of the real environment and information acquisition efficiency, and ensuring the safety of ship navigation.

[0005] To solve the above-mentioned technical problems, the technical solution adopted by the present invention is as follows:

[0006] I. A Marine Augmented Reality System

[0007] This invention provides a marine augmented reality system, including a display and control circuit, a mounting bracket, a camera device, a combination adjustment device, an optical coupling lens, a high-brightness display, and a reflective projection device;

[0008] The display and control circuit is used to acquire virtual navigation information of the navigation target and process and fuse the information; the camera device is used to acquire external environment information; the reflective projection device is used to reflect and amplify the digital information displayed on the high-brightness display; the mounting bracket is used to install the augmented reality system to the corresponding position of the ship's control console seat; the combined adjustment device is used to connect the optical coupling lens to the mounting bracket and adjust the angle of the optical coupling lens according to the observer's eye position.

[0009] Furthermore, the display and control circuit interacts with the ship's integrated navigation system via a network to obtain information on the bearing, distance, speed, heading, and travel time of the navigation target.

[0010] Furthermore, the display and control circuit performs information fusion and spatial coordinate transformation on the virtual information of the navigation target, generates digital information superimposed with external environmental information, and outputs it as HDMI format video information to the high-brightness display for display.

[0011] Furthermore, the optical coupling mirror is manufactured through optical correction and reflected light analysis, and a light-transmitting anti-reflective film is applied to the observer's side to reflect and converge the light emitted by the reflective projection device into the observer's eye, thereby increasing the sensory distance of digital information to the observer.

[0012] Furthermore, the reflective projection device consists of reflective, magnifying, and reflective mirrors, used to reflect, magnify, and project the digital information displayed on the high-brightness display onto the optical coupling mirror.

[0013] Furthermore, the high-brightness display includes: a liquid crystal cell assembly, a backlight assembly, a circuit assembly, and a structural assembly;

[0014] The high-brightness display is specifically an LED display, and its backlight uses pure green high-efficiency LEDs to display digital information.

[0015] Furthermore, the mounting bracket is formed from a single piece of material in one process.

[0016] II. An Application Method of a Marine Augmented Reality System

[0017] Based on the same inventive concept, the present invention also provides an application method for the marine augmented reality system described above, specifically including the following steps:

[0018] S1, interact with the ship's integrated navigation system via the network to obtain virtual navigation information of the navigation target, including the target's bearing, distance, speed, heading, and navigation time.

[0019] S2, the virtual navigation information of the navigation target is fused with the external environment information captured by the camera device through an information fusion algorithm;

[0020] S3, the virtual navigation information of the navigation target is obtained through the target tracking algorithm to determine the display position on the optical coupling mirror, so as to realize the superimposed display of virtual information and external environment information.

[0021] The target tracking algorithm includes: acquiring the azimuth, distance, and speed information of an external target relative to an observer; transforming the target coordinate information into a virtual coordinate system through spatial transformation; and thereby obtaining the display position of the navigation virtual information of the navigation target on the optical coupling mirror.

[0022] Compared with the prior art, the present invention has the following main advantages:

[0023] 1. This invention, through the rational setting of display and control circuit, mounting bracket, camera device, combined adjustment instrument, optical coupling mirror, high-brightness display and reflective projection, combined with information fusion algorithm and target tracking algorithm, can achieve the effect of superimposing virtual information with external targets, so that the commanding and navigating personnel can pay attention to the external environment information while obtaining information-enhanced digital information of the ship, thereby effectively improving the commanding and navigating personnel's perception of the real environment and information acquisition efficiency.

[0024] 2. This invention not only effectively reduces the installation space requirements of navigation support equipment for the bridge central control console, facilitating the design of the bridge central control console with fewer personnel, but also provides a comfortable and efficient centralized control interface for navigation support equipment for commanding personnel, thereby ensuring the safety of ship navigation. Attached Figure Description

[0025] Figure 1 This is a schematic diagram of the composition of a marine augmented reality system in an embodiment of the present invention;

[0026] Figure 2 This is a schematic diagram of the principle of the marine augmented reality system in an embodiment of the present invention;

[0027] Figure 3 This is a schematic diagram of the optical imaging of a marine augmented reality system in an embodiment of the present invention;

[0028] Figure 4 This is a schematic diagram illustrating the composition of the high-brightness display in an embodiment of the present invention;

[0029] Figure 5 This is a schematic diagram of the mounting bracket in an embodiment of the present invention;

[0030] Figure 6 This is a schematic diagram of the combined regulator in an embodiment of the present invention.

[0031] In the diagram: 11-Display control circuit, 12-Mounting bracket, 13-Camera device, 14-Combination regulator, 15-Optical coupler, 16-High-brightness display, 17-Reflective projection device. Detailed Implementation

[0032] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention. Furthermore, the technical features involved in the various embodiments of this invention described below can be combined with each other as long as they do not conflict with each other.

[0033] It should be noted that, depending on the implementation needs, the various steps / components described in this application can be broken down into more steps / components, or two or more steps / components or parts of the operation of steps / components can be combined into new steps / components to achieve the purpose of this invention.

[0034] Example 1: This example provides a marine augmented reality system, such as... Figure 1 As shown, it mainly includes a display and control circuit 11, a mounting bracket 12, a camera device 13, a combination adjustment device 14, an optical coupling lens 15, a high-brightness display 16, and a reflective projection device 17;

[0035] Furthermore, the display control circuit 11 is used for information acquisition, processing, and display of the system; the display control circuit is implemented by a computer, which can acquire navigation radar, AIS, video and other information through network communication, process, fuse and transform spatial coordinates to generate digital information superimposed on external targets, and output HDMI format video information to a high-brightness display for display.

[0036] Furthermore, the mounting bracket 12 and the combined adjustment device 14 are mainly used for fixing and installing the equipment. The combined adjustment device 14 can adjust the angle of the optical coupling lens according to the observer's eye position.

[0037] Furthermore, the camera device 13 is used to capture external target information and combine it with a target tracking algorithm.

[0038] like Figures 2-3 As shown, the optical coupling mirror 15 is made of glass, with a light-transmitting anti-reflective film applied to the observer's side. This device, manufactured through optical correction and reflected light analysis, can converge the reflected and projected light into the observer's eye in a manner resembling parallel lines, thus making the observer perceive electronic information from an infinite distance.

[0039] The optical coupling mirror is an anti-reflection and anti-transmission device. It can reflect the light projected by reflection while allowing external target information to pass through. It can make the observer see external information and reflect the projected digital information.

[0040] Furthermore, the reflective projection device 17 is composed of a reflective magnifying mirror, used to reflect and magnify the image of the high-brightness display onto the optical coupling mirror.

[0041] The reflective projection device can reflect and amplify the information displayed in high brightness, which can increase the sensory distance between the digital image and the observer. At the same time, it can magnify the image of the high-brightness display and project it onto the optical coupling lens.

[0042] like Figure 4 As shown, the high-brightness display mainly consists of four components: a liquid crystal cell assembly, a backlight assembly, a circuit assembly, and a structural assembly. The liquid crystal cell assembly primarily provides functions such as graphic display, liquid crystal panel protection, and low-temperature heating. The backlight assembly provides uniform and high-brightness backlight to the liquid crystal screen. The circuit assembly's main functions include backlight driving and adjustment, external communication, and low-temperature heating control. The structural assembly, mainly composed of a panel, backlight frame, back cover, and anti-loosening screws, is used to support, install, and protect the other components.

[0043] The high-brightness display uses an LED display with a backlight made of pure green high-efficiency LEDs to display digital information.

[0044] The high-brightness display uses a green single light source to increase the intensity of light reflected by the optical coupling mirror, making it easier for observers to see digital information in a bright environment.

[0045] like Figure 5 As shown, the mounting bracket is formed from a single piece of material in one process, and the three external mounting holes on the upper part of the mounting bracket are installed on the driver's seat.

[0046] like Figure 6 As shown, the combined adjustment device 14 is used to connect the optical coupling mirror 15 and the mounting bracket 12, and can adjust the position and angle of the optical coupling mirror 15 relative to the mounting bracket 12.

[0047] Example 2: Based on the same inventive concept, this example also provides an application method for the marine augmented reality system described above, specifically including the following steps:

[0048] S1, interact with the ship's integrated navigation system via the network to obtain virtual navigation information of the navigation target, including the target's bearing, distance, speed, heading, and navigation time.

[0049] S2, the virtual navigation information of the navigation target is fused with the external environment information captured by the camera device through an information fusion algorithm;

[0050] S3, the virtual navigation information of the navigation target is obtained through the target tracking algorithm to determine the display position on the optical coupling mirror, so as to realize the superimposed display of virtual information and external environment information.

[0051] The aforementioned target tracking algorithm integrates navigation radar information, AIS information, and video equipment information. By acquiring information such as the azimuth, distance, and speed of the external target relative to the observer, it transforms the target coordinate information into a virtual coordinate system through spatial transformation. This yields the display position of the virtual navigation information of the navigation target on the optical coupling mirror, thereby achieving the superimposed display of virtual information and external target information.

[0052] Furthermore, all parts of this application that are not described in detail are the same as or implemented using existing technology.

[0053] In summary:

[0054] 1. This invention, through the rational setting of display and control circuit, mounting bracket, camera device, combined adjustment instrument, optical coupling mirror, high-brightness display and reflective projection, combined with information fusion algorithm and target tracking algorithm, can achieve the effect of superimposing virtual information with external targets, so that the commanding and navigating personnel can pay attention to the external environment information while obtaining information-enhanced digital information of the ship, thereby effectively improving the commanding and navigating personnel's perception of the real environment and information acquisition efficiency.

[0055] 2. This invention not only effectively reduces the installation space requirements of navigation support equipment for the bridge central control console, facilitating the design of the bridge central control console with fewer personnel, but also provides a comfortable and efficient centralized control interface for navigation support equipment for commanding personnel, thereby ensuring the safety of ship navigation.

[0056] Those skilled in the art will readily understand that the above description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for applying a marine augmented reality system, characterized in that, The marine augmented reality system includes a display and control circuit, a mounting bracket, a camera device, a combination adjustment instrument, an optical coupling mirror, a high-brightness display, and a reflective projection device; The display and control circuit is used to acquire virtual navigation information of the navigation target and process and fuse the information; the camera device is used to acquire external environment information; the reflective projection device is used to reflect and amplify the digital information displayed on the high-brightness display; the mounting bracket is used to install the augmented reality system to the corresponding position of the ship's control console seat; the combined adjustment device is used to connect the optical coupling lens to the mounting bracket and adjust the angle of the optical coupling lens according to the observer's eye position; The application method includes the following steps: S1, interact with the ship's integrated navigation system via the network to obtain virtual navigation information of the navigation target, including the target's bearing, distance, speed, heading, and navigation time. S2, the virtual navigation information of the navigation target is fused with the external environment information captured by the camera device through an information fusion algorithm; S3, the virtual navigation information of the navigation target is obtained through the target tracking algorithm to determine the display position on the optical coupling mirror, so as to realize the superimposed display of virtual information and external environment information; The target tracking algorithm includes: acquiring the azimuth, distance, and speed information of an external target relative to an observer; transforming the target coordinate information into a virtual coordinate system through spatial transformation; and thereby obtaining the display position of the navigation virtual information of the navigation target on the optical coupling mirror.

2. The application method of a marine augmented reality system according to claim 1, characterized in that, The display and control circuit interacts with the ship's integrated navigation system via a network to obtain information on the bearing, distance, speed, heading, and travel time of the navigation target.

3. The application method of a marine augmented reality system according to claim 2, characterized in that, The display and control circuit performs information fusion and spatial coordinate transformation on the virtual information of the navigation target, generates digital information superimposed with external environment information, and outputs it as HDMI format video information to the high-brightness display for display.

4. The application method of a marine augmented reality system according to claim 1, characterized in that, The optical coupling mirror is manufactured through optical correction and reflected light analysis, and a light-transmitting anti-reflective film is applied to the observer's side to reflect and converge the light emitted by the reflective projection device into the observer's eyes, thereby increasing the sensory distance of digital information to the observer.

5. The application method of a marine augmented reality system according to claim 1, characterized in that, The reflective projection device consists of reflective, magnifying, and reflective mirrors, and is used to reflect, magnify, and project the digital information displayed on the high-brightness display onto the optical coupling mirror.

6. The application method of a marine augmented reality system according to claim 1, characterized in that, The high-brightness display includes: a liquid crystal cell assembly, a backlight assembly, a circuit assembly, and a structural assembly; The high-brightness display is specifically an LED display, and its backlight uses pure green high-efficiency LEDs to display digital information.

7. The application method of a marine augmented reality system according to claim 1, characterized in that, The mounting bracket is formed from a single piece of material in one process.

Images