Buoy for the detection, identification and location of marine mammals.
The buoy system with hydrophone and camera, enhanced by AI, addresses detection challenges by integrating underwater and aerial data, achieving reliable and extended-range marine mammal detection and communication.
Patent Information
- Application Number
- FR2022005184
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-05-31
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2042-05-31
AI Technical Summary
Existing technologies face challenges in reliably detecting marine mammals near construction sites due to intermittent ultrasound emissions and variable water conditions, leading to potential non-detection and unreliable detection methods.
A buoy system equipped with a hydrophone for underwater sound collection and a camera for aerial photography, combined with artificial intelligence for signal processing, to enhance detection reliability and range by utilizing simultaneous underwater and aerial data acquisition.
Enables real-time, reliable detection of marine mammals over a kilometer range, independent of water transparency, with improved contrast and reduced masking effects, and supports human-dolphin communication and protection systems.
Smart Images

Figure 00000009_0000
Abstract
Description
Title of the invention: Buoy for the detection, identification and location of marine mammals.
[0001] The invention relates firstly to networks of buoys for the detection and protection of marine mammals during construction sites, in particular wind turbines, offshore or in marine parks.
[0002] The present application relates to the general field of the protection of marine mammals and more particularly the detection of these marine mammals by buoys equipped with recognition means adapted for use with artificial intelligence.
[0003] Marine mammals are subjected to noise pollution near construction sites which is harmful to their communication, the use of their "bio-sonar" for navigation, their metabolism or their reproduction.
[0004] It is therefore useful to have reliable means of detecting the presence of mammals, particularly dolphins or whales, in an area around a construction site.
[0005] To this end, the art prior to the present application knows buoys equipped with hydrophones which passively record marine sounds or ultrasounds in the frequencies known for sonar emissions and vocalizations of marine mammals in order to detect their presence.
[0006] However, since the emissions of ultrasound by marine mammals are not permanent, there is a risk of non-detection of these mammals by means of passive reception of underwater ultrasound.
[0007] The prior art thus knows buoys or beacons equipped with underwater cameras, for the purpose of improving knowledge of dolphins by associating behavior with vocalization. However, the turbidity of the water or its transparency being highly variable and less than the ultrasonic detection distance, there is no reliable means in the prior art of detecting a silent dolphin by a combination of ultrasound reception and underwater photography.
[0008] Signal processing techniques known from the prior art can nevertheless to some extent overcome the deficiencies of weak signals from hydrophones but cannot compensate for the absence of a signal.
[0009] The detection of marine mammals is therefore a difficult problem for the prior art.
[0010] In the present application, platform is understood to mean in particular: a buoy, a ship, a caisson, a computing station on land or offshore. In the context of the caisson, it may be placed at the quayside or on board a ship. Summary of the invention
[0011] In this context, the present application relates to a platform comprising a hydrophone and a camera configured for aerial photography.
[0012] In variants:
[0013] - the camera is a camera suitable for daytime operation. - the camera is a camera suitable for night operation. - the camera includes an aerial image collection device, remote from the platform and a network for communicating aerial images to the platform. - the hydrophone includes a device for collecting underwater signals, remote from the platform and a system for transmitting underwater signals to the platform.
[0014] The present application also relates to a method for obtaining a platform for the detection of marine mammals which comprises the following steps:
[0015] - place a hydrophone on a platform;
[0016] - place on the platform a camera configured for aerial photography
[0017] The present application also relates to a method for real-time detection of marine mammals in an ocean, by means of a platform, comprising a hydrophone and a camera configured for aerial photography, which comprises the following steps:
[0018] - collect sounds under an ocean surface, via the hydrophone,
[0019] - collect, simultaneously with the sounds, aerial images of the ocean surface, via camera.
[0020] The present application also relates to a variant of the method comprising the following additional step:
[0021] - implement artificial intelligence techniques to make the recognition of the presence of mammals in the area of collection of underwater sounds and aerial images, by means of a computer simultaneously supplied with data from the underwater sounds and aerial images collected.
[0022] In variants: - the calculator is placed on the platform. - the calculator is placed on a ship in communication with the platform. - the calculator is located in a computing center, located on land, in communication with the platform.
[0023] The present application also relates to a variant of the method comprising the following additional step:
[0024] - trigger a dolphin repelling device outside the danger zone, according to the hearing tolerance thresholds of marine mammals, when the presence of a marine mammal is recognized.
[0025] The present application also relates to a variant of the method comprising the following additional step:
[0026] - trigger an alert device to warn a dolphin of a dangerous area, when the presence of a marine mammal is recognized.
[0027] The present application also relates to a variant of the method comprising the following additional step:
[0028] - trigger a human-dolphin inter-species communication device, when the presence of a marine mammal is recognized.
[0029] It is understood throughout the application that a computer on land in a computing center, or on a platform fixed relative to the bottom of an ocean, can use databases and means superior to a buoy floating on the surface of an ocean and to a system on board a ship.
[0030] The criterion of the invention will be easy to implement, for a buoy comprising a hydrophone and a camera, the buoy will be placed in a basin containing sufficient water so that the buoy floats on the surface of the water in the basin: if the camera of the buoy floating on the water is bathed in the air, then we will be in the presence of the invention, if the camera of the buoy floating on the water is bathed in the water, we will be in the presence of a buoy of the prior art.
[0031] The invention will be better understood in connection with the list of figures below.
[0032] [Fig-1]: [Fig.l] represents a buoy placed on the surface of the water of an ocean and which includes a hydrophone placed on the buoy and under the surface of the water, in other words on one side of the buoy along its length and which includes a camera configured for aerial shots of the surface of the water, placed on the buoy and above the surface of the water, in other words on the other side of the buoy along its length. The buoy also includes transmission means capable of sending the collected data to a boat or a computing center, where appropriate formatted by a computer on board the buoy, in particular using artificial intelligence techniques.
[0033] The invention will also be better understood in connection with the embodiments detailed below, in connection with [Fig.l] for the numbers in parentheses or in bold.
[0034] In a first embodiment, a buoy (1) provided with a hydrophone (2) linked to the submerged or submersible part of the buoy will be equipped with a camera (3) linked to the emerged part or intended to emerge from the buoy. The camera may be structurally arranged on the buoy, as far as possible from the hydrophone, because in fact, a hydrophone is generally arranged as low as possible on the buoy and, to maximize the camera's viewing angle, it will then be useful to position it as high as possible on the buoy and therefore as far as possible from the hydrophone.
[0035] This camera can also be positioned in variants, at the end of a mast with wired transmission or wireless transmission by technology in particular “bluetooth” or “wifi”, radio, lora or satellite.
[0036] In a second embodiment, the camera may be divided between an optical imaging system placed on a flying object such as a drone or an airplane and a receiver located on the buoy to receive the images emitted by the flying object and, where appropriate, receive the results of the on-board processing carried out in the flying object itself.
[0037] In variants of these modes, the optical system of the camera, whether mechanically positioned on the buoy, connected to the buoy by wire like a kite or remoted on a flying object such as a drone or an airplane, may be equipped either with a quantum detector, using in particular photodiodes, for the visible or near infrared and daytime operation, or equipped with a thermal detector, using in particular bolometers, for the mid-infrared and nighttime operation.
[0038] In all the embodiments of the invention, the camera will be optimized for operation in the air from the point of view of its optical combination, in particular to impose a detection distance greater than the solutions using underwater shots for which the detection distance is of the order of ten meters for the clearest waters.
[0039] In the case where the buoy includes a waterline indicated on the buoy, the hydrophone and the camera will be located on either side of this waterline and directed to collect signals in directions parallel to each other.
[0040] Advantageously, the buoy may be provided with a mast at the end of which the camera will be arranged or distributed by separating its optical system from an image receiver located closer to the water to reduce the weight carried by the mast. Any means allowing observation via the camera as high as possible above the water will be useful, in particular to reduce the masking effect of the swell and to have the greatest possible detection range.
[0041] In the case where a drone or an aircraft mechanically independent of the buoy is used, it will be sufficient to provide communication of the information collected to the buoy.
[0042] In all embodiments of the invention, it is particularly suitable for marine mammals emitting sounds intermittently, because these mammals are obliged to periodically return to the surface to breathe and they are then detectable by the camera present in all embodiments of the invention.
[0043] In addition, since the acquisition of images and the acquisition of the ultrasonic signal are simultaneous, they constitute a set of coherent signals capable of being advantageously processed together by calculation means comprising signal processing for the recognition of these mammals and of accumulating this coherent information to supply a local computer at the buoy and of moderate computing power or on a ship in communication with the buoy and of average computing power or in a computing center on land and maximum computing power. Such a computer will be able, by accumulating a history of these mutually coherent signals, to more easily implement artificial intelligence techniques based on this history of better quality for the signals with respect to noise.
[0044] It is notably possible to refine the precision of the acquisition of data from the underwater or aerial channel to remove any doubt about one or other of the acquisition channels and increase the reliability of the whole.
[0045] In addition, this detection being done in real time and without influence of the transparency of the water or its turbidity, it is possible to have a detection distance greater than solutions using underwater shots. With an effective recognition section of the order of magnitude of the length of the mammal rather than its width when it moves towards the buoy and an improved contrast corresponding to that of the mammal on the surface of the sea. Detection surfaces of the order of a kilometer (1 km), out of range of cameras configured for underwater shooting.
[0046] In addition, with a sufficiently sensitive thermal camera, it will be possible to detect the breaths of mammals, warmer than their skin, to distinguish mammals from fish, such as sharks.
[0047] It is thus possible to use, without departing from the teaching of the present application, calculation means on the buoy, or on a boat in radio connection with the buoy or on a boat or an installation on land having a calculation center and servers, on land or on a fixed work platform at sea, also in communication with the buoy via a telecommunications network, to best size the calculation power and adapt to the bandwidth available for the telecommunications used for the invention.
[0048] The invention is susceptible to industrial application in the field of marine mammal detection and human-dolphin communication.
[0049] It is understood that the teaching of the present application extends to a network of buoys composed of a set of buoys of the type described above, particularly useful for monitoring a construction site located "offshore" (i.e. at sea), particularly wind turbines or located in a marine park.
[0050] It is understood that the teaching of the present application also extends to several networks of buoys of the type described above for the purpose of coordinating the protection of marine animals.
[0051] In the present application, the term “night-operation camera” means in particular a thermal camera.
[0052] In the present application, a computer supplied with underwater sounds and aerial images may also be supplied with external databases or external sensors such as the position of ships in real time (e.g.: AIS), marine mammal habitat maps, weather buoys (waves, temperature, salinity, wind, etc.) or oceanographic models.
[0053] The present application also applies to the detection of a vessel entering the monitored area either with hydrophones for vessels with running engines or with the camera when the engines are stopped or for vessels having silent means of propulsion (sail, kite wing, oar, etc.).
[0054] The present application also applies to buoys with propulsion means to position themselves in the right place depending on the nature of the site and the species to be detected, to reposition themselves when the work vessel changes construction station (e.g. driving a pile for a new wind turbine), or to follow a work vessel in motion such as an oil seismic prospecting vessel, or to carry out transects to census marine mammal populations in a given area. This propelled buoy can be remote-controlled by an operator or completely autonomous.
[0055] In the present application, a network for communicating aerial images to the buoy is understood to mean any system for transmitting raw, compressed images or the results of on-board processing such as detection of the presence of marine mammals.
[0056] The present application also applies to a buoy comprising a device for collecting underwater signals, remote from the buoy and a system for transmitting underwater signals to the buoy: other buoys, underwater drones, underwater fixed stations, etc.
[0057] In the present application, the term “human-dolphin communication system” means any device enabling communication with a marine mammal, in particular to alert it or repel it from a danger zone (in particular sound or light signals).
[0058] In all the embodiments described in the present application, it is understood that a buoy may be replaced by a platform in the sense previously defined.
[0059] It is understood, as already indicated, that equivalents within the meaning of the present application to the word "platform" include: a buoy, a ship, a caisson (placed at the quayside or on board a ship), a computing station on land or offshore.
[0060] It is thus expressly understood, within the meaning of the present application, that a platform collecting data comprising aerial images transmitted to the platform from an aircraft or aircraft and comprising ultrasonic signals transmitted to the platform via a buoy or a network of buoys, each buoy being equipped with a hydrophone or several hydrophones is within the teaching of the present application. Any spatial redistribution of the elements of the collection of these two types of data (namely optical images and ultrasonic signals) at the platform is also within the teaching of the present application.For example, it will be possible to place a hydrophone or a camera on a platform, either by placing them physically entirely on it, or by placing them in a distributed manner, on the one hand in the form of a sensitive element and a transmitter placed in a geographical area to be monitored, and on the other hand, in the form of a receiver placed physically on the platform and in communication, in particular radio or wired, with the transmitter in the area.
Claims
Claims
1. Method for the real-time detection of marine mammals in an ocean, by means of a platform comprising a hydrophone and a camera configured for aerial photography, which comprises the following steps: - collecting sounds under a surface of the ocean, via the hydrophone, - collecting, simultaneously with the sounds, aerial images of the surface of the ocean, via the camera, and - implementing artificial intelligence techniques to make reliable the recognition of the presence of mammals in the area of collection of underwater sounds and aerial images, by means of a computer simultaneously supplied with data by the underwater sounds and the aerial images collected by simultaneous image acquisition and ultrasonic signal acquisition, constituting a set of coherent signals capable of being processed together by the computer, the computer accumulating in real time a history of these mutually coherent signals,to more easily implement history-based artificial intelligence techniques and increase the reliability of the whole.
2. Method according to claim 1 in which the calculator is arranged on the platform.
3. A method according to claim 1 wherein the computer is arranged on a vessel in communication with the platform.
4. Method according to claim 1 in which the computer is arranged in a computing center, arranged on land, in communication with the platform.
5. A method according to claim 1 and comprising the further step of triggering a human-dolphin communication system.
