A digital bearing device for a maritime command and control centre
The digital bearing device addresses the challenges of maritime navigation in complex or low-visibility environments by displaying symbols of external objects relative to the operator's position, enhancing situational awareness and improving navigation safety.
Patent Information
- Application Number
- PCT/NO2024/050246
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-13
- Filing Date
- 2024-11-12
- Publication Date
- 2025-05-22
AI Technical Summary
Maritime navigation in complex or low-visibility environments poses challenges due to decreased situational awareness, increased risk of collisions, and limitations of existing navigational tools that require operators to focus on screens rather than the physical environment.
A digital bearing device for a maritime command and control centre that displays symbols representing external objects on a line extending between the operator's position and the object, ensuring the operator's attention is guided to relevant external objects without compromising real-world situational awareness.
The digital bearing device enhances situational awareness by continuously guiding the operator's attention to external objects, reducing visual overload, and improving navigation in high-speed or low-visibility conditions, while maintaining focus on the physical environment.
Smart Images

Figure NO2024050246_22052025_PF_FP_ABST
Abstract
Description
[0001] TITLE OF THE INVENTION
[0002] A digital bearing device for a maritime command and control centre
[0003] FIELD OF THE INVENTION
[0004] In one aspect, the invention relates to a digital bearing device for a maritime command and control centre, such as the bridge of a ship. Another aspect of the invention relates to a method for assisting the operation of a maritime command and control centre.
[0005] BACKGROUND OF THE INVENTION
[0006] Maritime navigation in complex environments or poor visibility conditions poses a significant challenge for seafarers, as it can lead to decreased situational awareness and increased risk of collisions and accidents. Ensuring safety in maritime navigation is crucial, considering the far- reaching consequences of accidents, such as loss of life, environmental damage, and disruptions to economic activities.
[0007] In all maritime operations, the human will be an essential factor seeing that human error is a major cause of navigational accidents. Examples of human factors that can contribute to accidents include: a. Lack of situational awareness: Situational awareness refers to understanding and accurately predicting one's immediate environment and circumstances. Insufficient situational awareness can manifest as a poor lookout, delayed response, and misinterpreting situations. b. Inattention, fatigue, and poor concentration. c. Lack of communication: Ineffective communication between crew members, vessels, and shorebased authorities d. Poor training and procedures: Inadequate training and failure to adhere to standard procedures. e. Non-compliance with safety rules: Ignoring safety regulations, disregarding navigational parameters, and making navigation errors.
[0008] The human factor is compounded by environmental factors. For navigational errors, this is closely linked to weather conditions and visibility like heavy rain, fog, snowfall, low light settings, or light pollution at night.
[0009] There is an array of known navigational tools at the disposal of captains and operators to aid them in navigating, such as; ECDIS (Electronic Chart and Display Information System), Radar, AIS (Automatic Identification System), GNSS (Global Navigation Satellite System) and Radio (VHF call sources). However, these tools typically require the captain and operators to spend much of their time looking down at the screens of these instruments when accessing information, instead of looking out of the bridge windows. This is dangerous, especially in low-visibility conditions, during complex navigation and coordination situations, or aboard high-speed vessels. Several accidents have been caused by navigators not looking out of the bridge windows, not finding navigation objects, or misinterpreting ships as stationary objects.
[0010] A number of technologies have been proposed in the prior art to solve the problems related to the adverse effects of relying on navigational tools in poor visibility situations. Several of these proposed solutions relate to the use of augmented reality glasses. However, augmented reality glasses are not currently considered reliable enough, the long-term effects and use in low light conditions are unknown, and there is a risk of cluttering the user's view with information that can distract the user or mask real-world objects.
[0011] US2021 / 0389131A1 is an example of a prior art solution aiming to solve some of the aforementioned problems. This patent application discloses a solution where a number of screens are arranged above the windows of the bridge of a ship. The screens receive input from cameras arranged around the ship, and provide an operator with a view representing the surroundings of the ship. Furthermore, certain symbols are displayed on the screens, in order to highlight objects in the surrounding environment that may be relevant for navigation of the ship. This solution is inadequate in conditions with low visibility, as the screens will not be able to provide a view of the surroundings. An operator will not be able to identify the relative bearing or position of symbols on the screens without the images of the environment, and this solution is therefore not helpful in such conditions.
[0012] US2020 / 057488A1 is another example of a prior art solution that provides a fused image that combines image data of a scene received from an imaging system with a chart to aid in the navigation of a mobile structure. It suffers from similar setbacks as already described in relation to the other known prior art. It is therefore an objective of the invention to provide a display for a maritime control and command centre and an associated method that substantially alleviates or negates the aforementioned problems of the prior art.
[0013] SUMMARY OF THE INVENTION
[0014] In a first aspect, the present invention relates to a digital bearing device for a maritime command and control centre, wherein the digital bearing device comprises: a display unit arranged to display information regarding at least one external object on an area extending across or above at least a portion of a physical view provided by windows looking out from the maritime command and control centre; a processing unit arranged to receive information: related to at least one characteristic of at least one external object; on the position of an operator, and a relative bearing of the at least one external object in relation to the physical view; wherein the processing unit is arranged to process said information and transmit the information to the display unit, and the display unit is arranged to display said information as a symbol representing at least one characteristic of the external object at a position representing the relative bearing of the external object as viewed from the position of the operator, such that the symbol is displayed on a line extending between the operator position and the external object.
[0015] Thus, the invention, according to the first aspect, assists the operator in performing the task of operating a maritime command and control centre, such as the bridge of a ship, the control centre of an oil rig or a vessel traffic control centre by continuously guiding the operator's attention to various external objects, where the position of the objects change dynamically and are automatically detected. According to this aspect of the invention, an easily recognisable symbol is provided in close proximity to and along the physical view, thereby allowing recognition of external objects in the operator's visual focus when attention is directed at the view. The symbol is thus displayed on an area extending across or above at least a portion of a physical view provided by windows looking out from the maritime command and control centre, which may also be referred to herein as a display area. Notification of external objects that are hidden from view is also enabled by the invention, for example where an external ship is not visible due to heavy fog, or hidden by structure elements of the command and control centre (like the beams between windows).
[0016] The invention therefore solves the issues related to the operator switching between two different fields of focus. Thus, the invention, according to the first aspect, reduces visual overload and streamlines information. By guiding an operator to notice external objects in the physical view, the digital bearing device provides support in high-speed or conditions with low or challenging visibility, without compromising on the operator's attention and real-world situational awareness. Further, it provides support in complex navigational environments with many external navigation objects, including ships.
[0017] Furthermore, the present invention ensures that the guiding of an operator's attention to notice external objects will be correct in relation to any position the operator may have in the command and control centre. Thus, the invention allows for the position of the operator to be changed, whilst still maintaining full functionality of the digital bearing device. The invention also allows for a switch of operators in different positions, such that after a switch the new operator will have a fully functioning system relative to his or her position in the command and control centre.
[0018] Another advantage of the present invention is that the digital bearing device will provide the operator with a means of indicating whether there is a risk of collision with an external object. Taking the command and control centre of a ship as an example, if the position of a symbol displayed on the digital bearing device does not change, this could be an indication to the operator that said object is on a collision course with the ship.
[0019] Yet another advantage of the present invention is the ability to detect jamming or spoofing. If the digital bearing device is displaying symbols with a position that does not match an external object's relative bearing, this could be an indication to the operator that sensors and / or navigational tools providing input are being tampered with.
[0020] In embodiments of the invention, the display unit may comprise at least one of: a row of LED lights, a LED matrix, a projector and a surface for displaying projected images.
[0021] In embodiments of the invention, the display unit may comprise at least one row of LED lights. Preferably, the display unit may comprise at least two rows of LED lights. In a preferred embodiment, the display unit may comprise at least three rows of LED lights. The display unit may comprise at least one LED matrix. In embodiments where the display unit may comprise at least two rows of LED lights, at least one lower row of LED lights may be arranged to display external object arranged beneath a waterline.
[0022] In certain embodiments of the invention, the maritime command and control centre may be the control and / or coordination centre of a maritime facility. A maritime facility may herein be defined as a ship, marine stationary platform or a floating platform.
[0023] For example, the maritime command and control centre may be the bridge of a ship. For the purposes of this application, a ship may be defined to include waterborne vessels that are self- propelled and navigable. For example, this definition will include large sea-going vessels such as tankers, container ships, cruise ships, and large naval ships, but the definition is also intended to encompass smaller vessels such as tugboats, naval vessels, ferries for crossing smaller portions of water such as a lake or a fjord, as well as leisure crafts of different sizes and kinds. The definition of a ship herein may also include self-propelled vessels that are mainly stationary but are capable of being navigated, such as floating production, storage, and offloading (FPSO) units.
[0024] In other embodiments, the maritime command and control centre may be a control centre on a stationary platform, such as fixed oil platforms and vessel traffic control centres. In other embodiments, the maritime command and control centre may be a control centre for semisubmersible platforms or similar floating structures.
[0025] A maritime command and control centre may typically be defined as the room or platform, located e.g. onboard a ship, from which the maritime facility is commanded. For smaller vessels, the bridge may also be known as the wheelhouse or pilothouse. As the skilled person will be familiar with, the maritime command and control centre may typically be arranged in a position on the maritime facility that provides the captain or operator with an unobstructed view of the fore, aft, and sides of the facility and its surroundings. The command and control centre will therefore often be placed in a superstructure or raised platform on the maritime facility. However, for certain facilities, the maritime command and control centre may not be required to provide a complete full view of the facility's surroundings.
[0026] A physical view may be defined herein as a view of the surroundings of a maritime command and control centre, as seen from the command and control centre, where said view may typically be a view required to operate or coordinate operations relating to a maritime facility.
[0027] In embodiments of the first aspect of the invention, the physical view may be provided by the windows of a command and control centre providing a view from the command and control centre, for example, the windows looking out from the bridge of a ship. In these embodiments of the invention, the maritime command and control centre preferably comprises a physical view of the maritime facility and its surroundings. In certain embodiments, the physical view may only be provided by the windows looking out from the command and control centre.
[0028] In embodiments of the invention, the display unit may preferably be arranged to display information on an area extending across, above or along the entire length of windows, such that it will cover the entire horizontal length of the physical view. Thus, when in use, the display unit may continuously guide the operator's attention to certain symbols which represent external objects, that are displayed along the physical view.
[0029] In embodiments of the invention, the display unit may be physically separated from the windows displaying the physical view. In certain embodiments, the display unit may be arranged to display images and / or information. Thus, the display unit may advantageously be retrofitted or adapted to pre-existing command and control centres.
[0030] In embodiments of the invention, the display unit may be physically removed from the windows displaying the physical view. In certain of these embodiments, the display unit may be arranged as a physical strip for displaying images or information and mounted at a position between an operator and the windows for displaying the physical view. In variations of these embodiments, the display unit may be arranged to display information on an area extending across or above at least a portion of a physical view, by projecting means. This area may be arranged on the windows, or other structures of the maritime command and control centre. For example, a strip of tape may be provided on the windows in order to facilitate display from projections of the display unit. Alternatively, the display unit may project images directly on to a portion of the windows or others suitable surfaces.
[0031] The display unit may be arranged directly above the physical view. For example, in the context of a ship's bridge, the strip may be mounted at the top of the windows displaying the physical view. In other examples, typically where the size of the window is large enough to accommodate a display unit without obstructing the view, the display unit may be arranged anywhere on the vertical height of the window.
[0032] In embodiments of the invention, the display unit may encircle a specified operator position, partially or fully. Thus, the display unit may be arranged to show a relative bearing of an external object to the maritime facility, in the actual angle that the object is present relative to the operator position.
[0033] In embodiments of the invention, it may be preferable that the display unit is configured to display labels adjacent to the symbols in order to indicate the relative bearing of the external object. Thus, it may not be required for an operator to be in the specific position in order to read the relative bearing of the external object. Preferably, the display unit may be roof-mounted and encircle an operator's position, and / or the different positions that the operator may be located in.
[0034] In embodiments of the invention, the processing unit may be configured to receive and process the position of a plurality of operators and to transmit this information to the display unit, thereby allowing the display unit to switch between displaying information relative to the position of a certain operator.
[0035] In embodiments of the invention, the processing unit may be provided with and / or arranged to receive a plurality of fixed operator positions in the maritime command and control centre. Thus, the processing unit may be pre-programmed with certain fixed positions an operator may be in, thereby facilitating switching of the displayed information on the display unit to accommodate for the operator's moving position, or allowing another operator to view the information from his or her position with the relative bearings displayed correctly for the new position. Taking the bridge of a ship as an example, such positions may include a primary steering position, a secondary steering position, a mid-point between steering positions, a mid-point on the bridge, and other positions that will be familiar to the skilled person in the art.
[0036] In embodiments of the invention, the device may comprise a tracking means configured to track the position of at least one operator in the maritime command and control centre and to transmit the position to the processing unit. Such tracking means may include any of: a sensor arranged on an operator and / or sensors arranged in the command and control centre. For example, a Bluetooth, WiFi, Infrared, camera, acoustic, RFID, UWB or other known sensors for tracking a human position.
[0037] In embodiments of the invention, the display unit may comprise fixed angle markers indicating angles relative to a fixed position of the physical view. Such angle markers may assist an operator in quickly recognising the bearing of the external object, whether the operator is in the position that provides the correct relative bearing or not. For example, the angle markers may be arranged at any of: 0,45,90,135,180,225,270,315 and 360 degrees. The angle markers may be arranged on any of: the display unit, the display area, the windows, or positions in the command and control centre separate from the aforementioned such as beams or panels. In certain embodiments, the angle markers may be arranged at 6 degrees left and / or right of: 0,45,90,135,180,225,270,315 and 360 degrees
[0038] In embodiments of the invention, the display unit may be integrated into windows for displaying the physical view. In embodiments where the display unit may be an integral part of a window, it may typically be arranged as a dedicated strip on the window extending across the horizontal length of the window. This strip may be arranged in varying horizontal levels of the physical view, but once a level has been set it will be dedicated to the display unit. Thus, the strip of area on the physical view which is dedicated for the display unit will show information that the display is configured to display.
[0039] In embodiments of the invention, the processing unit may be a programmable computer.
[0040] The processing unit may be configured to receive information on the at least one external object from at least one of: a navigational tool, an emergency locator device, and a user input interface. The navigational tool may comprise at least one of an Electronic Chart and Display Information System (ECDIS), a radar, an Automatic Identification System (AIS), a Global Navigation Satellite System (GNSS), a VHF call source direction detector, a sound reception device for detecting source direction, sonars, LIDARs, cameras and any other means for sensing external objects that are relevant for navigation. The processing unit may be configured to receive manually plotted information or information from other sensors. For example, the location of a foghorn may be manually plotted into the processing unit via a user input interface.
[0041] An emergency locator device may comprise a means for detecting the transmitter or beacon for locating airplanes, vessels, and persons in distress and in need of immediate rescue.
[0042] In embodiments of the invention, a navigational tool may track at least one external object. For example, an external object may be tracked by radar. The radar may typically transmit signals to the ECDIS for display on a screen. In the context of this invention, the radar may either directly transmit signals to the processing unit or it may transmit the signals via the ECDIS and then to the processing unit. In certain embodiments, the processing unit may be configured to receive information from a plurality of navigational tools. In a preferred embodiment the processing unit may be configured to receive information from at least two navigational tools. For example, the processing unit may be configured to receive information from a radar and AIS. Other examples and additional combinations will be apparent to the skilled person in the context of the invention, such as GNSS+Radar+sonars, AIS+GNSS, and so on.
[0043] In embodiments of the invention, the processing unit may be arranged to process the received information by using a pre-installed computer program product which may be arranged to process the information into signals that are transmitted to the display unit.
[0044] The pre-installed computer program product may preferably be configured to the specific type of display unit, its characteristics and the layout of the command and control centre. Since the display unit may be tailored to the layout of a specific command and control centre, the computer program product may take account of that when processing where the display unit is to display a symbol on the display area. The pre-installed computer program product may preferably be configured to filter certain information based on distance from the maritime facility, priority of external objects in relation to their distance from the maritime facility, certain characteristics of external objects, set waypoints or other factors.
[0045] In embodiments of the invention, the processing unit is connected to a user adjustment interface for adjustment of configurations related to the display of characteristics of external objects. Typically, the processing unit may be connected to a user adjustment interface for allowing configurations to be adjusted at an interface by an operator. The user adjustment interface may also include features for adjusting display settings, such as light intensity of the display unit. The adjustable configurations may comprise at least one of: a distance to the external object, a predetermined class of object, a priority of object and a waypoint. A distance to the external object configuration may allow an operator to set a maximum distance for when objects are to be displayed by the display unit. A predetermined class of object configuration may allow only certain types of objects to be visible, for example only ships or only lighthouses, or combinations of certain classes of objects. A priority of object configuration may allow certain objects to be prioritised when displayed by the display unit, for example ships may be prioritised over lighthouses, such that if two or more such objects are on the same bearing, only the prioritised object may be displayed. A waypoint configuration may allow certain waypoints to be visible by the display unit.
[0046] The pre-installed computer program may be arranged to transmit information regarding a symbol and a mapped position of said symbol to the display unit. Typically, the display unit may comprise an integrated microcontroller for receiving such input from the processing unit and controlling the display of information.
[0047] A characteristic may be defined herein as a certain characteristic of an external object to the maritime facility which may merit a symbolic representation on a maritime chart, or which would be easily recognisable during navigation, or coordination of navigating objects around the facility. External objects may herein be defined as external physical obstacles to navigation, such as lighthouses, reefs, other ships, shallow waters, land, no-go zones, cities and landmarks. External objects representing larger areas may be represented by symbols extending across regions of the display unit.
[0048] An external physical obstacle may also include objects which would not physically impair the movement of the maritime facility, but which are necessary to track to ensure safe navigation, such as buoys, signals, markers or a man-over-board position. Such devices are known in the art as navigational aid (NAVAID) or aid to navigation (ATON).
[0049] External objects may also comprise automated surface vessels (ASV), remotely operated vessels (ROV) and unmanned autonomous vessels (UAV). These vessels may be operated from a maritime command and control centre which may be the same as onboard a ship. Alternatively, or in addition, an ASV, ROV and / or UAV may be controlled from an external location to the maritime command and control centre. Thus, the bearing, distance and other characteristics of an ASV, ROV or UAV may be displayed by the display unit.
[0050] In embodiments of the invention, the processing unit may be arranged to receive information on underwater objects such as drones, nets or submarines. Thus, the device may be advantageously used in marine operations.
[0051] In embodiments of the invention, the processing unit may be arranged to receive information on towed objects such as acoustic receivers or trawling equipment. Acoustic receivers may be used in seismic operations, and due to the long length of this towed equipment, it may be advantageous to have the positions of such equipment displayed on the display unit. Similar considerations may apply for equipment used during trawling.
[0052] In embodiments of the invention, the processing unit may be arranged to receive information on environmental conditions such as water currents, winds, and waves. Furthermore, the processing unit may be arranged to receive information on the location of a man-over-board. The position of the man-over-board may be plotted by an operator into the user input interface, or received by an emergency locator device to the processing unit. The processing unit may be arranged to process the information on the environmental conditions and the man-over-board location in order to predict where the man-over-board may be, for example after a certain period of time has passed. Thus, this information may also form the basis for a man-over-board symbol to be displayed by the display unit.
[0053] In certain embodiments, the processing unit may be provided with information on predefined search patterns, in order to process this information together with the input on the position of the man- over-board and thereby to set up search-patterns. The search patterns may be displayed by the display unit in order to guide navigation, and / or they may be used to display predictions and probabilities of the location of a man-over-board or other search object. Such search patterns may be based on IAMSAR manuals, and may include expanding square search, vector search and other search patterns known in the art.
[0054] In certain embodiments, the processing unit may be arranged to receive information directly from a tracking device located on the man-over-board, for example located on a life jacket. Thus, the processing unit may be arranged to process the information on the man-over-board location and to transmit the symbol to the display unit for displaying the symbol's relative bearing to the operator position.
[0055] These external objects and their characteristics may typically be represented on the ECDIS navigational tool. For example, the navigation lights of a ship are usually arranged such that a green light is located on the starboard side of the ship, a red light is located on the port side of the ship, one or two top lanterns, and a white light at the stern. The arrangement of navigation lights on a ship may therefore herein be defined as one type of characteristic. Other characteristics of an external object that merit a symbolic representation on a maritime chart may be a lighthouse and its lighting characteristics. Yet further characteristics may be larger objects or areas such as land or shallow water which are typically marked in maritime charts.
[0056] A characteristic may also be the AIS status of a ship, these different statuses are defined by the International Maritime Organisation.
[0057] However, the characteristics of an external object may not need be limited to a nautical characteristic as in the aforementioned examples, the characteristics of an external object may also be related to objects such as landmarks, cities, or other points of interest that are not necessarily present on a maritime chart.
[0058] In certain embodiments of the invention, the processing unit may be arranged to receive information related to a waypoint or a self-set bearing point, where this information may have been plotted to the ECDIS navigational tool. In said embodiments, the processing unit is further arranged to process information related to a waypoint and to transmit the information to the display unit for displaying it as a symbol and relative bearing to the operator position.
[0059] A relative bearing of an external object in relation to the maritime facility refers herein to the angle between an initial side and the bearing out from this initial side. The initial side, i.e. where the relative bearing of an external object would be 0 degrees, may for certain command and control centres be arbitrarily determined, or it may be predetermined based on the layout of the command and control centre. For example, a ship's forward direction and the location of an external object: in this example, an object with a relative bearing of 0 degrees would be immediately in front of the ship; an object with a relative bearing of 180 degrees would be behind.
[0060] A symbol for display by the display unit may be arranged to represent a real-world object, such that may be recognisable to an operator. The symbol may however also be a predetermined symbol on which the operator may be trained to understand represents a certain object, or other points of information that are relevant for navigation, such as a waypoint, bearing, or coordinate.
[0061] Typically, a symbol may correspond to a well-known nautical symbol used in maritime charts in cases where the external object would be represented on such a chart. These nautical symbols are set by the International Hydrographic Organization and are generally recognisable to maritime operators, for example, they may represent ships, lighthouses, and other objects of interest for navigation, including the characteristics of the object.
[0062] The symbols and their level of detail may be configured for the specific display unit. For example, dependent on the type of display unit, a displayed symbol may comprise a detailed representation of the object, or a light pattern representing the object. The detail of the displayed symbols may also be set by the configurations on the user adjustment interface.
[0063] The position of the symbol that is displayed by the display unit represents the relative bearing of the external object may be configured for the particular embodiment of the display unit, the command and control centre and the display unit configuration in a command and control centre. The display unit may be arranged to display text adjacent to the symbol, the text providing an angle to represent the relative bearing of the external object, thereby allowing this to be read from different positions in the command and control centre.
[0064] In embodiments, the display unit may be arranged to display a set of characters, adjacent to the symbol representing the external object, the set of characters displaying at least one of: a relative bearing of the external object, a relative distance to the external object, and a status of the external object. Such characters may preferably be alphanumeric characters. Typically, these embodiments may be applicable where the display unit comprises a high-resolution display unit. A relative bearing of the external object may be displayed as a number adjacent to the object, such that 0° would be directly ahead of the ships stern, 90° would be directly starboard or port, and so on. A relative distance to the external object may be represented by a number indicating in metres, kilometres, feet or any other units of distance. The status of the external object may be shown as an AIS status, which is defined by the International Maritime Organisation.
[0065] Displaying high-resolution images may be desirable as they may provide the operator with more information, thus the symbols that are displayed may be more representative of external objects, points of interest, or nautical symbols that the operator is familiar with from maritime charts. However, it may still be desirable to keep the information level of the display to a minimum, using simple symbols and characters, to avoid information overload and confusion.
[0066] In embodiments of the invention where the display unit may be arranged for displaying projected images, the display area may comprise a purpose-built projector screen arranged as a strip extending across the horizontal length of the physical view. However, the display area may also be any suitable surface for displaying symbols across a strip extending across the horizontal length of the physical view. Thus, the display area may for example be a dedicated screen, a beam, a wall, a piece of tape, and / or a window where images may be projected onto. The projector may be any suitable projector for displaying symbols, such as but not limited to; a video projector, a DLP projector, LCD projector, LED projector, CRT projector, or laser projector.
[0067] In embodiments of the invention where the display unit may be arranged for displaying images of low resolution, such as a row of LED lights, a LED matrix, or a laser projector, the processing unit will be configured to process the information into signals to be transmitted to the display unit that may be suitable for the low-resolution display unit. For example, three rows of LED lights may be sufficient to display a symbol informing on the direction of an external ship, whereby the navigational lighting of the ship, red, green, and white, and their orientation will queue the operator as to the external ship's direction. However, fewer rows of LED lights may also suffice to provide a symbol illustrating the heading of an external ship, for example by using fading lights in the aft direction of the ship. Thus, the skilled person will understand in the context of the invention that the nature of the symbols will depend on the configuration of the display unit.
[0068] In embodiments of the invention, the digital bearing device may comprise one or more display units arranged adjacent to each other to extend on the area across or above at least a portion of the physical view. In certain embodiments, the display unit may be arranged only at the same locations where there is a physical view, for example as LED rows arranged above the window of a ship's bridge. In other embodiments, the display unit may be arranged to provide a continuous display across different segments of a physical view, such that the display unit may be arranged to display symbols where there are blind spots in the physical view. For example, where an object obstructs the view from the bridge of ship, this may be typical where there are several intermittent windows on the ship of the bridge. The display unit may be arranged to provide information at a wider angle and with fewer blind spots than the windows of a command and control centre.
[0069] In embodiments of the invention, the display unit may be arranged to display at least one characteristic of the external object as a symbol comprising at least one of: a colour, a shape, a pattern of light, an intensity of light, and a frequency of light pulses. Thus, any of the characteristics of an external object may be represented and provide an operator with information. The symbol may represent a recognisable characteristic of the external object, comprising at least one of: a heading of and / or distance to the external object, a symbol or representation used on nautical charts and a predetermined symbol representing a shape, light pattern and / or light pulse frequency of the external object.
[0070] A colour may represent a specific colour of light on an external object, for example a colour used by a lighthouse or the navigation light of a ship. A shape may represent a shape of the external object or a shape of a nautical symbol used on a maritime chart. A pattern of light may for example be several colours in combination, representing the navigation lights, and thus the direction of a ship. An intensity of light may represent a distance to an external object, or for example, a gradually fading intensity along the strip may provide information on the directionality of an external object. A frequency of light pulses may represent a frequency of light pulses used on an external object, such as a lighthouse or an alarm. Colour patterns of a symbol may represent orientation or certain other characteristics, such as those used on maritime charts and in physical lights used for navigational purposes. Other coding schemes can easily be implemented as will be understood by the skilled person in the context of the invention.
[0071] In embodiments of the invention, the display unit may be configured to display a distinct symbol and / or set of characters, configured to capture the attention of the operator, for: new arising external objects, navigational aids and external objects on collision course with the maritime command and control centre. Thus, a certain colour, pulsation of light or other changes of the symbol may be displayed in order to get the attention of an operator towards such an external object. The duration of time for displaying such signals may be preset, or the operator may be required to actively acknowledge the object in order for the symbol to return to a normal state. In embodiments of the invention, the display unit may be arranged to display a symbol and / or set of characters representing a margin of error on the position of the external object.
[0072] In embodiments of the invention, the display unit may be arranged to display only one symbol in a vertical direction of the display area. Thus, the display unit may be arranged to display several symbols in a linear configuration along the display area. Limiting the number of symbols to one dimension may ensure that the symbols may be more easily recognisable and may help guide the operator to inspect the position where the symbol is located in more detail, without overloading the operator with information. However, the invention may not be limited to displaying only one symbol in the vertical direction, and in other embodiments, it may be beneficial for the display unit to display a plurality of symbols in the vertical direction. For all these embodiments, it may be advantageous for a symbol to be accompanied by adjacent text indicating the status, distance to and relative bearing of an external object.
[0073] In embodiments of the invention, the information on the external object may comprise an additional characteristic of the external object, wherein the display unit may be additionally arranged to display information on the additional characteristic of the external object.
[0074] In embodiments of the invention, the additional information may comprise the heading of the external object relative to the maritime facility. For these embodiments, the symbol may display the heading of the external object. For example, an external ship and its heading may be represented by a symbol of the navigational lighting on the ship. The orientation of the external ship may thus be shown in a symbol comprising a number of LED lights of the colours green, red and white. For higher resolution displays, the symbol may comprise a symbol of an external object with detail enough to illustrate a direction.
[0075] In embodiments of the invention, the display unit may be configured to only display said symbols and alphanumeric characters. Thus, these embodiments avoid any overload of information cluttering the display device. For example, the display unit may in these embodiments not display a live video stream of the surroundings of the maritime facility, or a digital representation aiming to fully represent the environment around the maritime facility instead focusing the operator's attention on certain external objects of relevance to navigation, coordination or monitoring of navigation.
[0076] In embodiments of the invention, the display unit may be configured to complement the physical view instead of reproducing the physical view. Thus, these embodiments may also exclude the use of cameras and additional screens reproducing full details of the surrounding environment, and instead streamline information for display to the operator with a focus on certain external objects of relevance to navigation / coordination of navigation.
[0077] A second aspect of the invention relates to a method for assisting the operation of a maritime command and control centre, wherein the method comprises the steps of: providing a display unit arranged to display information regarding at least one external object on an area extending across or above at least a portion of a physical view provided by windows looking out from the maritime command and control centre; providing a processing unit with information related to at least one characteristic of at least one external object, on the position of an operator, and a relative bearing of at least one external object in relation to the physical view; processing said information in the processing unit and transmitting said symbol and said position to the display unit; and, displaying the information as a symbol representing at least one characteristic of the external object at a position representing the relative bearing of the external object as viewed from the position of the operator, such that the symbol is displayed on a line extending between the operator position and the external object.
[0078] As will be understood, the second aspect of the invention may incorporate any embodiments of the first aspect of the invention into the method.
[0079] In embodiments of the second aspect of the invention, the method may comprise a step of adjusting a course in the maritime command and control centre. By adjusting the course, the location of an external object in relation to a ship, or simulated ship, may thereby change interactively.
[0080] In embodiments of the second aspect of the invention, the method may comprise the step of continuously receiving information from a navigational tool comprising at least one of: Electronic Chart and Display Information System, Radar, Automatic Identification System, Global Navigation Satellite System, a VHF call source direction detector, a sound reception device for detecting source direction, sonars, LIDARs, cameras and any other means for sensing external objects that are relevant for navigation.
[0081] In embodiments of the second aspect of the invention, the step of displaying the symbol may further comprise displaying at least one characteristic of the external object comprising at least one of: a colour, a shape, a pattern of light, an intensity of light and a frequency of light.
[0082] In embodiments of the second aspect of the invention, the method may comprise a step of adjusting a configuration of the processing unit related to the display of characteristics of external objects.
[0083] In a third aspect of the invention, the invention relates to a computer-implemented simulation method according to any of the aforementioned embodiments of the first and second aspect, and comprises the step of providing a simulated environment representing the view from a maritime facility on a main screen.
[0084] In a fourth aspect, the invention relates to a maritime command and control centre comprising a digital bearing device according to any of the aforementioned embodiments or aspects.
[0085] In a fifth aspect, the invention relates to a method for calibrating a digital bearing device to a maritime command and control centre according to any of the aforementioned aspects and / or embodiments, comprising: defining a position of an operator; defining a shape of a display unit; defining a display density of the display unit; calculate a relative bearing between the physical view and the external object; calculate an intersection point between the line defined by the calculated relative bearing between the position of the operator and the external object, and the shape of the display unit; calculate the distance on the display unit from an end of the display unit to the intersection point between the display unit and the relative bearing, calculate a display unit index based on display unit density and display unit distance. Thus, the configuration and calibration of the display unit may be precisely mapped out. In certain embodiments, the display unit may be tested by having it show calibration signals. Thus, the display unit symbols may be aligned with layout of the maritime command and control centre and the position of the operator. This may be particularly useful for maritime command and control centres with a longer width than length, or of irregular size. The operator may have a greater distance to certain parts of the display unit than others in certain command and control centres. The calibration may ensure that the operator sees the symbols in similar manner from the operator position, regardless of the layout of the command and control centre.
[0086] Since the maritime sector is turning towards autonomous operations, aspects of the invention may be relevant for both conventional and autonomous ships. Conventional ships are mainly operated by a human crew, while autonomous ships can vary widely in regard to human involvement.
[0087] At present, however, both conventional ships and ships with varying degrees of autonomy may require human monitoring. This monitoring can range from a bridge of a conventional ship to an onshore remote operating centre providing remote control, or supervisory control either onboard or remotely. Thus, aspects of the invention may be relevant for command and control centres comprising simulation centres or remote operating centres. According to a sixth aspect of the invention, certain embodiments may comprise a maritime facility-oriented view provided by screens arranged to display a physical view from the command and control centre. This sixth aspect may be similar to the aforementioned aspects in all regards and embodiments, apart from the physical view being a maritime facility-oriented view. For example, the screens may be configured to display CCTV footage from cameras arranged on the command and control centre. Typically, for these embodiments, the maritime facility-oriented view may be arranged such that it reproduces the layout of a physical view in a maritime command and control centre. However, the screens may additionally or alternatively be configured to display a view from the maritime facility that includes CCTV footage taken from cameras on the maritime facility that are mounted in other positions than at the command and control centre. For example, the non-physical view may display CCTV footage taken from cameras on the maritime facility that are mounted in positions providing views of the fore, aft, sides, and / or surroundings of the maritime facility.
[0088] In certain embodiments of the sixth aspect of the invention, the physical / maritime facility-oriented view may comprise a combination of windows providing a physical view and screens for displaying CCTV footage taken from cameras on the maritime facility.
[0089] In certain embodiments of the sixth aspect of the invention, the screens for displaying CCTV footage may be digital, such as an LCD, OLED, plasma, cathode ray, or any type of monitor. In other embodiments, the screens may comprise a screen for projecting an image from a projector. In certain embodiments, the screens may comprise a combination of a digital screen and a projected image onto the screen.
[0090] According to embodiments of the sixth aspect, the maritime command and control centre may be a remote operating centre or a simulation centre for simulating the command and control centre of a maritime facility. A remote operating centre may be defined as a centre for operating the maritime facility remotely, where remotely may be defined as not onboard the maritime facility. Thus, a remote operating centre may be located at a separate location, either onshore or on another maritime facility. Typically for these embodiments, the maritime facility-oriented view may be presented on a screen configured to show a CCTV image displaying a view from the maritime facility. The maritime facility-oriented view may thus comprise footage from CCTV cameras arranged on the command and control centre, typically where the command and control centre may be located on an elevated platform or superstructure of the maritime facility. Alternatively, or additionally, the maritime facility-oriented view may be provided from CCTV cameras arranged on the maritime facility to provide views of the fore, aft, and / or sides of the ship and its surroundings.
[0091] Simulation centres may typically be arranged to replicate the physical layout of a maritime command and control centre, with similar navigational tools as used on a real maritime facility and with screens displaying computer-generated graphics in the place of windows looking out from the command and control centre. Typically for these embodiments, the maritime facility-oriented view may comprise a computer-generated image simulating the view from the windows of a maritime facility, and / or from CCTV footage of cameras arranged on the maritime facility.
[0092] In embodiments of the sixth aspect, where the command and control centre is a remote operating centre or a simulation centre, a main screen may be arranged to display a maritime facility-oriented view. In embodiments, the main screen may comprise a screen for projecting an image from a projector. In certain embodiments, the main screen may comprise a combination of a digital screen and a projected image onto the screen. A main screen may comprise a plurality of screens for displaying a maritime facility-oriented view. A screen, or a plurality of screens, may be arranged in a flat formation or in a formation that represents the shape of a maritime command and control centre. For example, a main screen may comprise one or more screens arranged to encircle an operator position such that it represents a similar maritime facility-oriented view as would be present on a maritime command and control centre, such as the bridge of a ship. Thus, the relative bearing displayed in the remote operating centre or simulation centre may be displayed at a similar position as it would be in a physical maritime command and control centre, thereby emulating a real- world situation providing an improved training experience.
[0093] For embodiments of the sixth aspect, the display unit may be integrated into, or form part of, a main screen for displaying a maritime facility-oriented view, such as CCTV footage or computer generated graphics. For such embodiments, such as in a remote operating centre or a simulation centre, it may be beneficial to integrate the display unit into the main screen as it eliminates the need for a separate unit to be mounted in the command and control centre. Integrating the display unit into a main screen may thus be a cheaper option to mimic a physical unit that may be arranged on e.g. the bridge of a ship with windows providing a physical maritime facility-oriented view. In these embodiments the display unit and the main screen may form one screen, and the display unit may thus be configured to display on a display area of the main screen for displaying symbols representing external objects, their status and position.
[0094] For embodiments of the sixth aspect, the processing unit may be configured to receive information on the at least one external object from a computer unit simulating a navigational tool. The navigational tool may thus track a simulated external object or the navigational tool may be simulated itself.
[0095] In embodiments of the sixth aspect, such as a remote operating centre having a main screen representing a maritime facility-oriented view, the position of the relative bearing may not be affected by the position of the operator. Thus, for this aspect, the display unit may not be required to alter the display based on the position of the operator, as the maritime facility-oriented view may in any case be a 2D projection aligned with the display area.
[0096] In other aspects of the invention, the processing unit may be arranged to receive information related to waypoints, bearings, coordinates, and other sources of information that are not necessarily linked to external objects. The skilled person will understand that these aspects may be similar to the aforementioned aspects and the embodiments of those aspects. It will also be understood that combinations of these aspects are possible, in particular in relation to different types of information being used, where the aspects of the invention may relate to the processing and display of both information on external objects and information on waypoints, bearings, coordinates or other points of information relevant for navigation.
[0097] In the following description, numerous specific details are introduced by way of example only to provide a thorough understanding of embodiments of the claimed device and methods. One skilled in the relevant art, however, will recognize that these embodiments can be practised without one or more of the specific details, or with other components, systems, methods etc. In other instances, well-known structures or operations are not shown, or are not described in detail, to avoid obscuring aspects of the disclosed embodiments.
[0098] BRIEF DESCRIPTION OF THE DRAWINGS
[0099] The following drawings are appended to facilitate the understanding of the invention. The drawings show embodiments of the invention, which will now be described by way of example only, where:
[0100] Fig. 1 is a bird's eye view of the bridge of a ship (a bidirectional RORO ferry), illustrating the layout of various navigational tools in relation to the captain's chair and the windows providing a view from the ship.
[0101] Fig. 2 is a perspective illustration of a command and control centre, exemplified as the bridge of a ship. In this figure, the digital bearing device is exemplified with a LED display unit arranged as a strip extending in a semicircle across the top of windows looking out from the bridge.
[0102] Fig. 3A and Fig. 3B are, respectively, perspective and bird's eye view illustrations of a command and control centre exemplified as the bridge of a ship. In these figures, the digital bearing device is exemplified with a LED display unit arranged as a strip extending along the top of the windows looking out from the bridge.
[0103] Fig. 4A and Fig. 4B are, respectively, perspective and bird's eye view illustrations of a command and control centre exemplified as a remote operating centre. These figures illustrate a digital bearing device forming part of a main screen arranged to show a 220-degree ship-oriented view.
[0104] Fig. 5A and Fig. 5B are, respectively, perspective and bird's eye view illustrations of a command and control centre exemplified as a remote operating centre with main screens arranged in a flat formation.
[0105] Fig. 6A and Fig. 6B illustrate different examples of external objects and how these objects may be represented as symbols on various types of display units, LED rows and display areas.
[0106] Fig. 7 is an example of a user adjustment interface.
[0107] Fig. 8A and Fig. 8B are illustrations of a command and control centre similar to that of Fig. 3A and Fig. 3B, albeit with the operator position being shifted and thus the display unit reacting to display symbols at the correct relative bearing to the operator position. DETAILED DESCRIPTION OF THE INVENTION
[0108] In the following, embodiments of the invention will be discussed in more detail with reference to the appended drawings. It should be understood, however, that the drawings are not intended to limit the invention to the subject matter depicted in the drawings.
[0109] Fig. 1 is a schematic bird's eye view illustration of a maritime command and control centre 2 exemplified as a typical bridge 2 on board a ship. The bridge 2 is provided with floor-to-ceiling windows 4 encircling the bridge floor. The windows 4 are intermitted by panels or beams separating each window 4. In the middle of the bridge 2 is located the captain's chair from where the operation of the ship is directed. The captain's chair may also be referred to as the operator's 10 position P or location in the context of this invention. The operator 10 is herein exemplified as a captain. Thus, the captain may have a 360-degree view of the ship surroundings from the operator position P. The view from the bridge in the example of Fig. 1 is in the context of the invention referred to as the physical view 4 and is made up of physical windows 4. In the present example illustrated in the figures, the physical view is exemplified as a ship-oriented view 4. It will be understood that for other aspects and embodiments of the invention, when used for other maritime command and control centres such as onboard an oil platform or an onshore facility, the view may be referred to as a maritime facility-oriented view.
[0110] The example in Fig. 1 illustrates a ferry where the captain's chair is slidable and rotatable, with instruments and tools arranged in two directions, allowing the captain 10 to control the ferry facing in two opposing directions. Fig. 1 further illustrates that immediately adjacent to the captain's chair, various consoles, levers and control devices are located for controlling the ship. An auto-crossing display is also arranged immediately adjacent to the captain's chair, typically this display will provide key information on the ship, such as heading, propeller pitch and RPM, vessel speed etc. These devices are floor-mounted and typically within arm's reach of the captain 10.
[0111] Radar and ECDIS navigational tools 8a are seen in Fig. 1 arranged slightly radially outside of the control devices in relation to the captain's chair. These navigational tools 8a are floor mounted and typically present images on a monitor screen which is below the ship-oriented view 4. Thus, in the prior art solutions, the captain 10 will be required to shift focus from head-down when looking at the navigational tools to head-up when directing attention to the ship-oriented view.
[0112] Additional screens and tools are illustrated in Fig. 1 as being mounted or hanging from the ceiling. The screens are arranged to display CCTV footage of areas on the ship or of surroundings of the ship, which may be used whilst docking or other manoeuvres requiring high precision. A VHF radio is also shown as being mounted hanging from the ceiling. Additional features of a bridge are illustrated in Fig. 1, such as an emergency door, stairs extending down from the bridge, a mate's chair and other workstations for additional personnel. It will be understood that a maritime command and control centre 2 in the form of a simulation centre 12, or a remote operating centre 12, may have a similar layout as the physical bridge 2 shown in Fig. 1. However, for a simulation centre 12 or a remote operating centre 12, the floor-to-ceiling windows would be replaced by screens displaying a ship- oriented view 4.
[0113] Fig. 2 is a schematic illustration of the invention according to one embodiment. In this particular embodiment, the maritime command and control centre 2 is exemplified as the bridge of a ship. The bridge 2 comprises floor-to-ceiling windows for providing an operator with a ship-oriented view 4. Along the ship-oriented view 4, there is provided a display unit 3 comprising a LED assembly arranged as a strip extending in a semicircle across the top of the windows 4. In the example of Fig. 2, the windows 4 are illustrated as being mainly directed towards the bow of the ship, but also providing a view of the sides of the ship. This may be typical for larger vessels arranged to sail mainly in one direction. Accordingly, in this embodiment, the display unit 3 covers the ship-oriented view 4 where the windows are provided.
[0114] The screens of the navigational tools 8a, such as ECDIS and radar, and control devices, such as levers and consoles, are not concretely illustrated in the example of Fig. 2. However, the skilled person will understand that the screens and physical interfaces of these tools and devices may be arranged in a layout on the bridge 2 similar to that of Fig. 1 or any other standard layout that is typical for the bridge of a ship. Fig. 2 does however illustrate the navigational tools 8a in the context of their processing units, which are configured to transmit information to the processing unit 5 of the digital bearing device 1.
[0115] The user adjustment interface 9 and user input interface 8c of the digital bearing device 1 are shown in Fig. 2 as being located adjacent to the operator position P, thereby allowing ease of access. It will be understood that these interfaces 9,8c may be arranged in a layout that does not hinder access to the control devices and navigational tools 8a and that the illustration in Fig. 2 is merely indicative of the interfaces 8c, 9 being in the proximity of the operator 10.
[0116] As Fig. 2 illustrates, by the use of dashed arrows, the user adjustment interface 9 and user input interface 8c are configured to transmit information to the processing unit 5. These interfaces 8c, 9 may thus be directly connected to the processing unit 5 of the digital bearing device 1, or they may be arranged with their own processing unit capable of processing information before it is transmitted to the main processing unit 5 of the digital bearing device 1. Furthermore, a tracking means 13 is provided on the bridge to track the position P of the operator 10 and feed this information to the processing unit 5. The processing unit 5 is configured to process the information from the various sources, and a dashed arrow is illustrated to represent information being transmitted to the display unit 3, comprising a LED assembly for being displayed in the form of symbols 7 at given positions.
[0117] The display unit 3 is exemplified in Fig. 2 as comprising a LED assembly 3 consisting of an aluminium semi-circular ring consisting of two rows of LED lights. The operator 10 is positioned P in the middle of the bridge 2 facing out towards the ship-oriented view 4. In the ship-oriented view 4, several external objects 6 can be seen from the windows of the bridge. The dashed arrows extending out from the operator 10 illustrate the operator 10 looking at each external object 6. Above the windows on the ship and above the external objects 6 that are seen from the windows, the LED assembly is displaying symbols 7 representing the objects 6.
[0118] For example, the external object 6 located in the upper left corner of the window of Fig. 2 is a ship 6, represented by the symbol 7 for a ship typically used on maritime charts. The location, heading and bearing a of the external ship 6 will be detected by navigational tools 8a such as radar and ECDIS. The information from the navigational tools 8a will be transmitted to the processing unit 5 which processes the information into a symbol 7 configured for the display unit 3.
[0119] Since the display unit 3 is a two-row LED assembly 3 in the exemplary embodiment of Fig. 2, the external ship 6 will be represented by a symbol 7 comprising a pattern of LED lights. In the present case, the pattern of three LED lights in the two rows will present the operator with the information that there is a ship 6 in this relative bearing a and that it has a certain heading. The operator will thus be prompted to scan the windows 4 in that position below the LED assembly 3 to find the ship 6. If there is not enough visibility to scan the window 4, for example due to fog, the operator 10 will continuously be reminded of there being a ship 6 with a certain heading being present in that particular bearing a. The heading of the external ship 6 will be ascertainable from the symbol 7 , comprising a configuration of the three LED lights. As illustrated in Fig. 1, the symbol 7 is represented by a pattern from left to right consisting of a green light (G) on the first / bottom row, a white light (W) on the top / second row and a red light (R) on the first / bottom row. This pattern is consistent with the real- life navigational lights of a ship 6, shown heading from left to right on the image and exemplified by the small ship symbol in the windows 4.
[0120] Fig. 2 provides further examples of external objects 6 and their respective symbols 7 on the LED assembly 3.
[0121] • The bottom left object as seen on the windows 4 is a lightless beacon, represented by a symbol 7 comprising a single yellow (Y) LED light on the LED assembly 3.
[0122] • The third symbol 7 from the left displayed on the LED assembly 3 as a symbol 7 comprising blue (B), yellow (Y) and blue (B) LED lights represents a submerged rock 6, which is illustrated by the maritime symbol for such a rock on the window.
[0123] • The fourth symbol 7 from the left displayed on the LED assembly 3 as a symbol 7 6 comprising a fixed red (FR) light represents a red-lighted beacon, illustrated by the maritime symbol for such a beacon on the window 4.
[0124] • The fifth symbol 7 from the left displayed on the LED assembly 3 as a symbol 7 comprising a fixed green (FG) light represents a green-lighted beacon 6, illustrated by the maritime symbol for such a beacon on the window 4.
[0125] • The sixth symbol 7 from the left displayed on the LED assembly 3 as a symbol 7 comprising a group occulting 8 second green light (Oc(2)8s G) represents a lighthouse 6 having these light characteristics in real-life.
[0126] • The seventh symbol 7 from the left displayed on the LED assembly 3 as a symbol 7 comprising a group of fading fixed red lights (FRioo%-so%) on the first / bottom row with a white light (W) on the second / top row, represents a ships navigational lights 6 and the fading lights represents the speed it is travelling in the direction of the strongest of the lights.
[0127] The skilled person will understand, in the context of the invention, that a simulation centre 12 or a remote operating centre 12 may have a similar layout as that illustrated in Fig. 2 but where the floor- to-ceiling windows are replaced by main screens arranged to display a ship-oriented view 4, or a maritime facility-oriented view 4.
[0128] Fig. 3A and Fig. 3B are respectively, perspective and bird's eye view illustrations of a command and control centre 2 exemplified as the bridge of a ship. The bridge 2 illustrated in these figures may be smaller than that of Fig. 2, and comprises floor-to-wall windows 4 extending 360 degrees around the operator, providing a view 4 in all directions from the bridge 2. Furthermore, Fig. 3B provides a schematic illustration of the objects 6 and their position external to the ship.
[0129] In this embodiment, the display unit 3 is mounted to the top of, or above the windows providing the ship-oriented view 4. Instead of a circular ring, there are two rows of LED lights extending along the windows. Besides the different configuration of the display unit, the examples of external objects 6 and the functioning of the LED lights is similar to that as described in Fig. 2.
[0130] The relative bearing a of the fixed green (FG) lighted beacon is illustrated in Fig. 3A and Fig. 3B. As can be seen, the angle a is measured from the heading of the ship, which is being controlled in the maritime command and control centre and out to the external object 6. Thus, in the illustrated embodiment, the symbol 7 representing the lighted beacon 6 is positioned on the display unit 3 such that the relative bearing a, as seen from the position P of the operator 10, is the same as for the external object 6. It will be understood that for display units 3 of higher resolution, the angle a may be displayed on the display unit 3 such that the relative bearing a may be read from any position P on the bridge 2.
[0131] The skilled person will understand, in the context of the invention, that a simulation centre 12 or a remote operating centre 12 may have a similar layout as that illustrated in Fig. 3A but where the floor-to-ceiling windows are replaced by main screens arranged to display a ship-oriented view 4, or a maritime facility-oriented view 4. It will also be understood that for such cases, the display unit 3 may be integrated into the main screens arranged to display a ship-oriented view 4 such that symbols 7 are displayed along the top of the main screens. Typically, such main screens will have a higher resolution allowing for more detailed characteristics of objects 6 to be displayed as symbols 7.
[0132] Fig. 4A and Fig. 4B are respectively, perspective and bird's eye view illustrations of a command and control centre 2 exemplified as a remote operating centre 12. These figures illustrate a digital bearing device 1 comprising main screens arranged to show a 220-degree ship-oriented view 4. The objects 6 and symbols 7 represented in Figs. 4A and 4B are the same as for Figs. 2, 3A and 3B. The remote operating centre 12 is formed with a 220-degree ship-oriented view 4 in order to make it reminiscent of a ship bridge 2. As can be seen from the dashed arrows extending from the operator 10 to the various external objects 6, the operator 10 will recognise an object 6 on the main screens in the same relative bearing a as it would in relation to an operator 10 working on a ship.
[0133] Since the main screens in Fig. 4A and Fig. 4B only provide a two-dimensional picture, it is possible for the operator 10 to be located in any location in the command and control centre 2 without it affecting how the angle a to the external object is seen from the operator's 10 position P. Similarly, the display unit 3 will provide a symbol 7 in a position in the same relative bearing a as the external object 6, and it may not be necessary to provide additional information displaying the angle adjacent to the symbol 7.
[0134] However, it may be desirable to provide the angle a adjacent the symbol on the display unit 3 for training purposes. Typically, main screens for a remote operating centre 12 will have a higher resolution allowing for more detailed characteristics of objects 6 to be displayed as symbols 7, thereby allowing angles a to be presented, or symbols 7 with more details than that exemplified in Fig. 4A and Fig. 4B.
[0135] The skilled person will understand that a simulation centre 12 may be arranged with a similar layout as that illustrated in Fig. 4A and Fig. 4B.
[0136] Fig. 5A and Fig. 5B are respectively, perspective and bird's eye view illustrations of a command and control centre 2 exemplified as a remote operating centre 12 with main screens arranged in a flat formation. The embodiment illustrated in these figures is essentially similar to that of Fig. 4A and 4B, although it may be seen that fewer external objects 6 are visible. As illustrated in Fig. 5B, the relative bearing a of an object 6 as seen from the operator's 10 position P will be displayed with a corresponding symbol 7 on the display unit 3. Although the display unit 3 in Fig. 5A and 5B is shown with symbols 7 represented by one row of lights, it may be beneficial to include text informing of the relative bearing a to an object 6. That will allow the operator 10 to better assess the relative bearing a of an external object 6.
[0137] Fig. 6A and Fig. 6B illustrate different examples of external objects 6 and how these objects 6 may be represented as symbols 7 by various types of display units 3. Fig. 6A illustrates four different examples of symbols 7 representing ships: • The top symbol 7 is a representation of a ship 6 showing heading of the ship, as commonly used on maritime charts. This symbol 7 may typically be used for display units 3 with a high- resolution.
[0138] • The second top symbol 7 is a representation of a ship 6 showing heading of the ship 6 by three rows of LED lights as a display unit 3. The LED lights are presented in different colours to represent navigation lights, and the lights fade away in the opposing direction of the ship's heading, thereby also representing the speed of the ship 6.
[0139] • The second to bottom symbol 7 is a symbol of a ship 6 displayed by a low-resolution display unit 3. This could for example be a laser projection onto a suitable display area surface of a ship-shaped symbol.
[0140] • The bottom symbol 7 is a ship representation on a high-resolution display unit 3, for example an LCD strip. Here, the ship 6 may be represented in such detail that the type of ship 6 is recognisable.
[0141] Fig. 6B illustrates four different examples of a non-lighted beacon:
[0142] • The top symbol 7 is a symbol 7 used on maritime charts to represent a non-lighted beacon 6, and may be used for high-resolution display units.
[0143] • The second from top symbol 7 is displayed on a LED matrix as a display unit 3 comprising three rows, where two of the LED lights represent the colours of the beacon 6.
[0144] • The second to bottom symbol 7 is represented by a schematic symbol 7 of a beacon 6 along with three letters YBY characterising the colours of the beacon 6.
[0145] • The bottom symbol 7 is on a high-resolution display unit that can faithfully represent the beacon's 6 shape and colours.
[0146] It will be understood from the examples in Fig. 6A and 6B that the display unit may be configured to only show symbols or alphanumeric characters, in order to streamline the presentation of information to an operator. Alternatively, for high-resolution display, a live-video representation of the surroundings may be displayed and provided by cameras arranged on the ship.
[0147] Fig. 7 is an example of a user adjustment interface 9. Various buttons are provided: for turning the digital bearing device display on or off, resetting the display or highlighting various objects such as ships, lighthouses, shallow water or buoys. Additionally, rotary control devices are provided to adjust the display range, light intensity and setting a bearing / waypoint. Above each rotary control device, a small screen is provided in order to display the present configuration. It will be understood that additional interfaces may be provided for plotting positions and bearings, such interfaces may be in the form of a computer screen and keyboard.
[0148] Fig. 8A and Fig. 8B provides an example of a command and control centre 2 exemplified as the bridge of a ship. The command and control centre 2 is identical to that of Fig. 3A and Fig. 3B. However, it will be seen that the position P of the operator 10 has been shifted from a first position Pl to a second position P2. By studying the positions of the symbols 7 displayed on the display unit 3, in particular when comparing the birds-eye views of Fig. 8B and Fig 3B, it will be seen that the position of these symbols 7 have been shifted. The operator 10 will therefore see a symbol 7 on the display unit 3 at the correct relative bearing in relation to a corresponding external object 6.
[0149] In the preceding description, various aspects of the digital bearing device and methods according to the invention have been described with reference to the illustrative embodiments. For purposes of explanation, specific numbers, systems and configurations were set forth in order to provide a thorough understanding of the device and its workings. However, this description is not intended to be construed in a limiting sense. Various modifications and variations of the illustrative embodiment, as well as other embodiments of the device and methods, which are apparent to persons skilled in the art to which the disclosed subject matter pertains, are deemed to lie within the scope of the present invention.
Claims
CLAIMS1. A digital bearing device (1) for a maritime command and control centre (2), wherein the digital bearing device (1) comprises: a display unit (3) arranged to display information regarding at least one external object (6) on an area extending across or above at least a portion of a physical view (4) provided by windows looking out from the maritime command and control centre (2); a processing unit (5) arranged to receive information: related to at least one characteristic of at least one external object (6) ; on the position (P) of an operator (10), and a relative bearing (a) of the at least one external object (6) in relation to the physical view (4); wherein the processing unit (5) is arranged to process said information and transmit the information to the display unit (3), and the display unit (3) is arranged to display said information as a symbol (7) representing at least one characteristic of the external object (6) at a position (D) representing the relative bearing (a) of the external object (6) as viewed from the position (P) of the operator (10), such that the symbol (7) is displayed on a line extending between the operator position (P) and the external object (6).
2. The digital bearing device (1) according to claim 1, wherein the display unit (3) comprises at least a row of LED lights.
3. The digital bearing device (1) according to claim 2, wherein the display unit (3) comprises at least two rows of LED lights, wherein at least one lower row of LED lights is arranged to display external objects (6) arranged beneath a waterline.
4. The digital bearing device (1) according to any of the preceding claims, wherein the display unit (3) is configured to only display said symbols (7) and alphanumeric characters.
5. The digital bearing device (1) according to any of the preceding claims, wherein the display unit (3) is configured to complement the physical view (4) instead of reproducing the view (4).
6. The digital bearing device (1) according to any of the preceding claims, wherein the processing unit (5) is configured to receive and process the position (Px) of a plurality of operators (lOx) and to transmit to this information to the display unit (3), thereby allowing the display unit (3) to switch between displaying information relative to the position (Px) of a certain operator (lOx).
7. The digital bearing device (1) according to claim 6, wherein the processing unit (5) is provided with and / or arranged to receive a plurality of fixed operator positions (lOx) in the maritime command and control centre (2).
8. The digital bearing device (1) according to any of the preceding claims, comprising a tracking means (11) configured to track the position (Px) of the at least one operator (lOx) in the maritime command and control centre (2) and to transmit the position (Px) to the processing unit (5).
9. The digital bearing device (1) according to any of the preceding claims, wherein the display unit (3) comprises fixed angle markers indicating angles relative to a fixed position of the physical view (4).
10. The digital bearing device (1) according to any of the preceding claims, wherein the processing unit (5) is arranged to receive information on at least one external object (6) from at least one of: a navigational tool (8a), an emergency locator device and a user input interface (8c).
11. The digital bearing device (1) according to any of the preceding claims, wherein the processing unit (5) is arranged to receive information on the position of a man-over-board.
12. The digital bearing device (1) according to claim 11, wherein the processing unit (5) is arranged to receive information on environmental conditions such as water currents, winds, and waves, and to process this information together with the input on the position of the man-over-board in order to predict the position of the man-over-board.
13. The digital bearing device (1) according to claim 11 or 12, wherein the processing unit (5) is provided with information on predefined search patterns, in order to process this information together with the input on the position of the man-over-board and thereby to set up searchpatterns.
14. The digital bearing device (1) according to any of the preceding claims, wherein the processing unit (5) is arranged to receive information from a navigational tool (8a), comprising at least one of: an Electronic Chart and Display Information System, a radar, an Automatic Identification System, a Global Navigation Satellite System, a VHF call source direction detector, a sound reception device for detecting source direction, sonars, LIDARs, cameras and any other means for sensing external objects that are relevant for navigation.
15. The digital bearing device (1) according to any of the preceding claims, wherein the processing unit (5) is arranged to receive information on underwater objects such as drones, nets or submarines.
16. The digital bearing device (1) according to any of the preceding claims, wherein the processing unit (5) is arranged to receive information on towed objects such as acoustic receivers or trawling equipment.
17. The digital bearing device (1) according to any of the preceding claims, wherein the display unit (3) is arranged to display at least one characteristic of the external object (6) as a symbol (7) comprising at least one of: a colour, a shape, a pattern of light, an intensity of light and a frequency of light pulses.
18. The digital bearing device (1) according to claim 17, wherein the symbol (7) represents a recognisable characteristic of the external object (6), comprising at least one of: a heading of and / or distance to the external object (6), a symbol or representation used on nautical charts, and a predetermined symbol representing a shape, light pattern and / or light pulse frequency ofthe external object (6).
19. The digital bearing device (1) according to any claims 17-18, wherein the display unit (3) is arranged to display a set of characters, adjacent to the symbol (7) representing the external object (6), the set of characters displaying at least one of: a relative bearing of the external object, a relative distance to the external object and a status of the external object (6).
20. The digital bearing device (1) according to any claims 17-19, wherein a distinct symbol (7) and / or set of characters, configured to capture the attention of the operator (10), are displayed for: new arising external objects (6), navigational aids and external objects (6) on collision course with the maritime command and control centre.
21. The digital bearing device (1) according to any of claims 12 or 13, and any of claims 17-20, wherein the display unit (3) is arranged to display the predicted position of the man-over-board and / or the search patterns.
22. The digital bearing device (1) according to any of the preceding claims, wherein the processing unit (5) is connected to a user adjustment interface (9) for adjustment of configurations related to the display of characteristics of external objects (6).
23. The digital bearing device (1) according to claim 22, wherein the adjustable configurations comprise at least one of: a distance to the external object, a predetermined class of object, a priority of object and a waypoint.
24. A method for assisting the operation of a maritime command and control centre (2), wherein the method comprises the steps of: providing a display unit (3) arranged to display information regarding at least one external object (6) on an area extending across or above at least a portion of a physical view (4) provided by windows looking out from the maritime command and control centre (2); providing a processing unit (5) with information: related to at least one characteristic of at least one external object (6); on the position (P) of an operator (10), and and a relative bearing (a) of at least one external object (6) in relation to the physical view (4); processing said information in the processing unit (5)(7) and transmitting the information to the display unit (3); and, displaying the information as a symbol (7) representing at least one characteristic of the external object (6) at a position (D) representing the relative bearing (a) of the external object (6) as viewed from the position (P) of the operator (10), such that the symbol (7) is displayed on a line extending between the operator position (P) and the external object (6).
25. The method according to claim 24, wherein the method comprises a step of adjusting a course in the maritime command and control centre (2).
26. The method according to any of claims 24-25, wherein the method comprises the step of continuously receiving information from a navigational tool (8a) comprising at least one of: Electronic Chart and Display Information System, Radar, Automatic Identification System, Global Navigation Satellite System, a VHF call source direction detector, a sound reception device for detecting source direction, sonars, LIDARs, cameras and any other means for sensing external objects that are relevant for navigation.
27. The method according to any of claims 24-26, wherein the step of displaying the symbol (7) further comprises displaying at least one characteristic of the external object (6) comprising at least one of: a colour, a shape, a pattern of light, an intensity of light and a frequency of light.
28. The method according to any of claims 24-27, comprising a step of adjusting a configuration of the processing unit (5) related to the display of characteristics of external objects (6).
29. A method for calibrating a digital bearing device (1) to a maritime command and control centre (2) according to any of claims 1-23, comprising: defining a position (P) of an operator (10); defining a shape of a display unit (3); defining a display density of the display unit (3); calculate a relative bearing (a) between the physical view (4) and the external object (6); calculate an intersection point between the line defined by the calculated relative bearing (a) between the position (P) of the operator (10) and the external object (6), and the shape of the display unit (3); calculate the distance on the display unit (3) from an end of the display unit (3) to the intersection point between the display unit (3) and the relative bearing (a) calculate a display unit (3) index based on display unit density and display unit distance.
Citation Information
Patent Citations
Video and image chart fusion systems and methods
US20200057488A1
Method for driving the display of information on a screen banner equipping a boat wheelhouse
US20210389131A1
Navigational danger identification and feedback systems and methods
US20220326018A1