Ship identification method, device and storage medium

Abstract

The embodiment of the present application provides a ship identification method, device and storage medium, which relate to the field of artificial intelligence and can improve the recognition accuracy of target ships. The method includes: determining an image recognition name of a ship to be identified and a first position of the ship to be identified among the ships to be identified, wherein the first position is a physical position corresponding to the position of the ship to be identified in the image; judging whether there is ship AIS information within a target range; wherein the target range is a range whose distance from the first position is less than a first preset threshold; the ship AIS information includes the ship position and AIS generation time, the ship position is within the target range, and the absolute value of the time difference between the AIS generation time and the image capture time is less than a second preset threshold; if there is no ship AIS information within the target range, it is determined that the ship to be identified has not turned on the AIS device; if there is ship AIS information within the target range, the ship to be identified is identified according to the image recognition name and the ship AIS information.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of artificial intelligence, and in particular, to a ship identification method, device and storage medium. Background Art

[0002] With the continuous development of the maritime industry, how to identify passing ships has become the focus of ship regulatory authorities. Among them, the commonly used ship identification method is based on the automatic identification system (AIS).

[0003] In the conventional technology, the method for identifying a ship includes: the shore-based system calculates the predicted positions of the ships corresponding to the multiple AIS information at the capture time (i.e., the time when the image acquisition device captures the target ship) based on the dynamic information in the multiple latest AIS information, wherein the dynamic information in the AIS information includes: the ship's position, the ship's speed, the ship's heading, and the generation time; then, the AIS information corresponding to the predicted position closest to the first position (i.e., the position of the target ship when the image acquisition device captures the target ship) among the multiple predicted positions is determined as the AIS information of the target ship, and the shore-based system identifies the target ship based on the AIS information.

[0004] However, in the above method for identifying ships, the predicted position is determined based on the ship position, ship speed and ship heading in the AIS information, and the ship speed and ship heading are dynamically changing, so the predicted position determined by the above method has errors, so that the accuracy of the predicted position closest to the first position among multiple predicted positions is low, which further leads to low recognition accuracy of the target ship. Summary of the invention

[0005] The present application provides a ship identification method, device and storage medium, which can improve the recognition accuracy of target ships. To achieve the above purpose, the present application adopts the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a ship identification method, which is applied to a ship identification device, the method comprising: determining an image recognition name of a ship to be identified in an image of the ship to be identified and a first position of the ship to be identified, wherein the first position is a physical position corresponding to the position of the ship to be identified in the image; judging whether there is ship AIS information within a target range; wherein the target range is a range whose distance from the first position is less than a first preset threshold; the ship AIS information includes a ship position and an AIS generation time, the ship position is within the target range, and the absolute value of the time difference between the AIS generation time and the image capture time is less than a second preset threshold; if there is no ship AIS information within the target range, it is determined that the AIS device of the ship to be identified is not turned on; if there is ship AIS information within the target range, the ship to be identified is identified according to the image recognition name and the ship AIS information.

[0007] Compared with the traditional technology of determining the target AIS information based on the dynamic information in the AIS information, and identifying the ship to be identified according to the target AIS information; the embodiment of the present application is to determine the image recognition name of the ship to be identified in the image of the ship to be identified and the first position of the ship to be identified, and then, determine whether there is a ship AIS information in the target range whose distance from the ship position to the first position is less than a first preset threshold, and the absolute value of the time difference between the AIS generation time and the image capture time is less than a second preset threshold. When the ship AIS information exists, the ship to be identified is identified according to the image recognition name and the ship AIS information; in this way, the present application does not need to determine the predicted position corresponding to the ship AIS information, thereby improving the recognition efficiency of the ship to be identified. In addition, the present application identifies the ship to be identified according to the static information (image recognition name) and the ship AIS information, and does not identify the ship to be identified completely based on the dynamic information in the AIS information. In this way, the uncertainty of the dynamic information in the AIS information leads to the problem of low accuracy of the determined target AIS information, thereby improving the recognition accuracy of the target ship.

[0008] In a possible implementation, the ship AIS information includes a first ship name; the identifying the ship to be identified according to the image recognition name and the ship AIS information specifically includes: querying a ship archive according to the image recognition name; wherein the ship archive stores second ship names of multiple ships; if the archive information of the ship to be identified is queried in the ship archive, querying the ship AIS information according to the image recognition name; wherein the second ship name in the archive information of the ship to be identified matches the image recognition name; if the first target ship AIS information is not queried in the ship AIS information, it is determined that the AIS device of the ship to be identified is not turned on; wherein the first ship name in the AIS information of the first target ship matches the image recognition name; if the first target ship AIS information is queried in the ship AIS information, the ship to be identified is identified according to the first target ship AIS information.

[0009] The ship identification method provided in the embodiment of the present application identifies the ship to be identified based on the AIS information of the ship whose first ship name matches the image recognition name within the target range when there is archival information of the ship to be identified; compared with the traditional technology that determines the target AIS information by predicting the position and identifies the ship to be identified based on the target AIS information; the technical solution provided in the embodiment of the present application does not need to determine the predicted position of each ship AIS information, thereby improving the efficiency of identifying the ship to be identified.

[0010] In a possible implementation, the above-mentioned identifying the ship to be identified according to the image recognition name and the ship AIS information also includes: if the archive information of the ship to be identified is not found in the ship archive library, querying whether there is a second target ship AIS information in the ship AIS information; wherein the similarity between the first ship name and the image recognition name in the second target ship AIS information meets a preset condition; if the second target ship AIS information does not exist in the ship AIS information, it is determined that the AIS device of the ship to be identified is not turned on; if the second target ship AIS information exists in the ship ASI information, the ship to be identified is identified according to the second target ship AIS information.

[0011] Compared with the method of determining the target AIS information based on the dynamic information in the AIS information in the traditional technology, and identifying the ship to be identified according to the target AIS information; the embodiment of the present application determines the ship AIS information whose similarity between the first ship name and the image recognition name in the target range meets the preset conditions as the second target ship AIS information, and then identifies the ship to be identified according to the second target ship AIS information. That is to say, the embodiment of the present application determines the second target ship AIS information according to the static information in the ship AIS information, and the static information in the ship AIS information does not change. Therefore, the second target ship AIS information determined by the embodiment of the present application is more accurate. Furthermore, the ship identification device identifies the ship to be identified according to the second target ship AIS information, thereby improving the accuracy of identifying the ship to be identified.

[0012] In a possible implementation, the above-mentioned identifying the ship to be identified based on the image recognition name and the ship AIS information includes: predicting the predicted position of the ship corresponding to the ship AIS information at the capture time based on the ship AIS information; the capture time is the acquisition time of the image of the ship to be identified; based on the distance between the predicted position and the first position, screening out the third target ship AIS information corresponding to the predicted position whose distance is less than a third preset threshold; identifying the ship to be identified based on the image recognition name and the third target ship AIS information.

[0013] In a possible implementation, the ship AIS information includes a first ship name; the identifying the ship to be identified based on the image recognition name and the third target ship AIS information includes: querying whether there is AIS information of a fourth target ship in the third target ship AIS information, wherein the fourth target ship AIS information is the target ship AIS information whose similarity between the first ship name and the image recognition name in the third target ship AIS information meets a preset condition; and the similarity is the highest; if the fourth target ship AIS information exists in the third target ship AIS information, identifying the ship to be identified according to the fourth target ship AIS information; if the fourth target ship AIS information does not exist in the third target ship AIS information, determining that the AIS device of the ship to be identified is not turned on.

[0014] In a possible implementation, the above-mentioned identifying the ship to be identified based on the image recognition name and the third target ship AIS information also includes: if there are multiple fourth target ship AIS information in the third target ship AIS information, identifying the ship to be identified according to the fourth target ship AIS information whose predicted position is closest to the first position among the multiple fourth target ship AIS information.

[0015] Compared with the traditional technology of determining the target AIS information based on the distance between the predicted position corresponding to the ship AIS information and the first position, and identifying the ship to be identified according to the target AIS information; the embodiment of the present application determines the third target ship AIS information according to the distance between the predicted position corresponding to the ship AIS information and the first position, and then the ship identification device queries whether there is AIS information of the fourth target ship in the third target ship AIS information, wherein the fourth target ship AIS information is the target ship AIS information whose similarity between the first ship name and the image recognition name in the third target ship AIS information meets the preset condition; and the similarity is the highest. When there is a fourth target ship AIS information, the ship to be identified is directly identified according to the fourth target ship AIS information; when there are multiple fourth target ship AIS information, the ship identification device identifies the ship to be identified according to the fourth target ship AIS information whose predicted position is closest to the first position in the multiple fourth target ship AIS information; that is, the embodiment of the present application determines the fourth target ship AIS information for identifying the ship to be identified by combining the ship name matching method on the basis of the traditional technology, so that after the third target ship AIS information is determined by the dynamic information in the ship AIS information, the fourth target AIS information for identifying the ship to be identified is determined in the third target ship AIS information by the static information of the ship AIS information, thereby avoiding to a certain extent the problem of inaccurate target ship AIS information for identifying the ship to be identified determined based on the dynamic information in the ship AIS information, thereby improving the accuracy of identifying the ship to be identified.

[0016] In a second aspect, an embodiment of the present application provides a ship identification device, comprising: a determination module, a judgment module and an identification module; the determination module is used to determine the image recognition name of a ship to be identified in the image of the ship to be identified and the first position of the ship to be identified, wherein the first position is the physical position corresponding to the position of the ship to be identified in the image; the judgment module is used to determine whether there is ship AIS information within a target range; wherein the target range is a range whose distance from the first position is less than a first preset threshold; the ship AIS information includes the ship position and the AIS generation time, the ship position is within the target range, and the absolute value of the time difference between the AIS generation time and the image capture time is less than a second preset threshold; the determination module is also used to determine that the AIS device of the ship to be identified is not turned on if there is no ship AIS information within the target range; the identification module is also used to identify the ship to be identified according to the image recognition name and the ship AIS information if there is ship AIS information within the target range.

[0017] In a possible implementation, the ship identification device further includes: a query module; the query module is used to query the ship archive according to the image recognition name; wherein the ship archive stores the second ship names of multiple ships; the query module is also used to query the ship AIS information according to the image recognition name if the archive information of the ship to be identified is queried in the ship archive; wherein the second ship name in the archive information of the ship to be identified matches the image recognition name; the ship AIS information includes the first ship name; the determination module is used to determine that the ship to be identified has not turned on the AIS device if the first target ship AIS information is not queried in the ship AIS information; wherein the first ship name in the first target ship AIS information matches the image recognition name; the identification module is used to identify the ship to be identified according to the first target ship AIS information if the first target ship AIS information is queried in the ship AIS information. .

[0018] In a possible implementation, the query module is used to query whether there is a second target ship AIS information in the ship AIS information if the archive information of the ship to be identified is not found in the ship archive library; wherein the similarity between the first ship name and the image recognition name in the second target ship AIS information meets a preset condition; the determination module is used to determine that the AIS device of the ship to be identified is not turned on if the second target ship AIS information does not exist in the ship AIS information; the identification module is used to identify the ship to be identified according to the second target ship AIS information if the second target ship AIS information exists in the ship ASI information.

[0019] In a possible implementation, the ship identification device also includes: a prediction module and a screening module; the prediction module is used to predict the predicted position of the ship corresponding to the ship AIS information at the capture time based on the ship AIS information; the capture time is the acquisition time of the image of the ship to be identified; the screening module is used to filter out the third target ship AIS information corresponding to the predicted position whose distance is less than a third preset threshold based on the distance between the predicted position and the first position; the identification module is used to identify the ship to be identified based on the image recognition name and the third target ship AIS information.

[0020] In a possible implementation, the ship identification device also includes: a query module; the query module is used to query whether there is AIS information of a fourth target ship in the AIS information of the third target ship, wherein the fourth target ship AIS information is the target ship AIS information whose similarity between the first ship name and the image recognition name in the AIS information of the third target ship meets a preset condition; and the similarity is the highest; the ship AIS information includes the first ship name; the identification module is used to identify the ship to be identified according to the AIS information of the fourth target ship if there is AIS information of the fourth target ship in the AIS information of the third target ship; the determination module is used to determine that the AIS device of the ship to be identified is not turned on if there is AIS information of the fourth target ship in the AIS information of the third target ship.

[0021] In a possible implementation, the identification module is used to identify the ship to be identified according to the AIS information of the fourth target ship whose predicted position is closest to the first position among the multiple AIS information of the fourth target ship if there is multiple AIS information of the fourth target ship in the AIS information of the third target ship.

[0022] In a third aspect, an embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory is coupled to the processor; the memory is used to store computer program code, wherein the computer program code comprises computer instructions; when the computer instructions are executed by the processor, the electronic device executes the method described in the first aspect and any one of its possible implementation methods.

[0023] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, including computer instructions, which, when executed on a computing device, enables the computing device to execute the method described in the first aspect and any one of its possible implementations.

[0024] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the method described in the first aspect and any one of its possible implementations.

[0025] It should be understood that the beneficial effects achieved by the technical solutions of the second to fifth aspects of the embodiments of the present application and the corresponding possible implementation methods can be referred to the technical effects of the first aspect and its corresponding possible implementation methods mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 A schematic diagram of a ship identification system provided in an embodiment of the present application;

[0027] Figure 2 A schematic diagram of a ship identification device provided in an embodiment of the present application;

[0028] Figure 3 A schematic diagram of a ship identification method provided in an embodiment of the present application Figure 1 ;

[0029] Figure 4 A schematic diagram of a ship identification method provided in an embodiment of the present application Figure 2 ;

[0030] Figure 5 A schematic diagram of a ship identification method provided in an embodiment of the present application Figure 3 ;

[0031] Figure 6 A schematic diagram of a scenario for determining a predicted position provided in an embodiment of the present application;

[0032] Figure 7 A schematic diagram of a ship identification method provided in an embodiment of the present application Figure 4 ;

[0033] Figure 8 A schematic diagram of the structure of a ship identification device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0034] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0035] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects rather than to describe a specific order of objects. For example, the AIS information of the first target ship and the AIS information of the second target ship are used to distinguish different AIS information rather than to describe a specific order of AIS information.

[0036] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0037] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more. For example, multiple fourth target ship AIS information refers to two or more fourth target ship AIS information.

[0038] First, some concepts involved in a ship identification method, device and storage medium provided in an embodiment of the present application are explained.

[0039] AIS is composed of a shore-based (base station) and a server carrying AIS on a ship (i.e., ship service). AIS is used to send dynamic and static information of the target ship to other ships and the corresponding shore-based in the preset waters. The dynamic information of the target ship includes: ship position (i.e., longitude and latitude), ship heading, ship heading change rate, and generation time; the static information of the target ship includes: ship name, ship call sign, ship draft information, and cargo type on board; the dynamic information and static information of the target ship are called the AIS information of the target ship.

[0040] The ship identification method provided in the embodiment of the present application can be applied to Figure 1 In the ship identification system shown in the figure, the ship identification system comprises: an image acquisition device 101, a ship service 102 and a ship identification device 103.

[0041] In the ship identification system, the image acquisition device 101 includes a device or apparatus with image acquisition capability such as a common camera or an intelligent camera. The image acquisition device 101 is used to capture an image of the ship to be identified and send the image of the ship to be identified to the ship identification device 103, or the image acquisition device 101 is used to capture an image of the ship to be identified and, after identifying the image recognition name of the ship to be identified, send the image of the ship to be identified and the image recognition name to the ship identification device 103.

[0042] The ship service 102 is used to send the AIS information of the ship to the ship identification device 103 .

[0043] The ship identification device 103 identifies the ship to be identified based on the received image of the ship to be identified and the AIS information of the ship. For the specific implementation method of the ship identification device 103 identifying the ship to be identified, please refer to the method part below; wherein, the ship identification device 103 includes a server, a desktop computer or a notebook computer and other devices with processing capabilities.

[0044] It should be noted that the ship identification device 103 in the embodiment of the present application is a shore-based device or apparatus integrated with a server.

[0045] For example, Figure 2 It is a hardware schematic diagram of a ship identification device provided in an embodiment of the present application, and the ship identification device includes a processor 201, a memory 202 and a network interface 203.

[0046] The processor 201 includes one or more CPUs, which may be single-core CPUs (single-CPU) or multi-core CPUs (multi-CPU).

[0047] The memory 202 includes but is not limited to RAM, ROM, EPROM, flash memory, or optical memory.

[0048] Optionally, the processor 201 implements the ship identification method provided in the embodiment of the present application by reading instructions stored in the memory 202, or the processor 201 implements the ship identification method provided in the embodiment of the present application by internally stored instructions. In the case where the processor 201 implements the method in the above embodiment by reading instructions stored in the memory 202, the memory 202 stores instructions for implementing the ship identification method provided in the embodiment of the present application.

[0049] The network interface 203 is a wired interface (port), such as an FDDI or GE interface. Alternatively, the network interface 203 is a wireless interface. It should be understood that the network interface 203 includes a plurality of physical ports, and the network interface 203 is used to receive AIS information and images of ships to be identified.

[0050] Optionally, the ship identification device further includes a bus 204, and the processor 201, the memory 202, and the network interface 203 are usually interconnected via the bus 204, or are interconnected in other ways.

[0051] The present application embodiment provides a ship identification method, which is executed by a ship identification device, such as Figure 3 As shown, the method may include S301-S304.

[0052] S301. A ship identification device determines an image identification name of a ship to be identified and a first position of the ship to be identified in an image of the ship to be identified.

[0053] The above-mentioned image of the ship to be identified is a captured image of the ship to be identified when it is at the first position, wherein the first position is the position of the ship to be identified when the image acquisition device captures the image of the ship to be identified within the predetermined water area, that is: the first position is the physical position corresponding to the position of the ship to be identified in the image of the ship to be identified.

[0054] It should be noted that the specific implementation of the image recognition name of the ship to be recognized may be achieved through optical character recognition (OCR) technology.

[0055] It can be understood that the above-mentioned image recognition name is determined based on the image of the ship to be identified, and there are many factors that affect the quality and clarity of the image of the ship to be identified, such as the visibility of the current waters, the capturing angle of the image acquisition device, and the heading and speed of the ship to be identified; therefore, the above-mentioned image recognition name of the ship to be identified is not necessarily the real name of the ship to be identified.

[0056] The above-mentioned method of determining the first position of the ship to be identified includes: restoring the physical position corresponding to the position of the ship to be identified in the image according to a predetermined ratio based on the position of the ship to be identified in the image.

[0057] S302: The ship identification device determines whether there is ship AIS information within the target range.

[0058] In one implementation, the ship identification device stores AIS information of at least one ship, and the AIS information of the at least one ship may be sent to the ship identification device by at least one ship service.

[0059] The AIS information of each ship in the AIS information of the at least one ship includes: a first ship name, a ship position, an AIS generation time, a ship heading and a ship speed, wherein the first ship name is the name of the ship corresponding to the current AIS information; the ship position is the position of the ship when the AIS information of the ship is sent; the AIS generation time is the time when the AIS information of the ship is generated; the ship heading is the sailing direction of the ship when the AIS information of the ship is sent; and the ship speed is the sailing speed of the ship when the AIS information of the ship is generated.

[0060] The above-mentioned target range is a range whose distance from the first position is less than a first preset threshold; the ship position in the above-mentioned determined ship AIS information is within the target range, and the absolute value of the time difference between the AIS generation time in the ship AIS information and the image capture time is less than a second preset threshold.

[0061] The above S302 specifically includes: the ship identification device determines whether there is AIS information of at least one ship stored locally, in which the distance between the ship position and the first position is less than a first preset threshold, and the absolute value of the time difference between the AIS generation time and the image capture time is less than a second preset threshold.

[0062] Exemplarily, assuming that the coordinates of the first position are (35.342411, 121.639082), the first preset threshold is 1000 meters, the second preset threshold is 30 minutes, the capture time is 2021-8-8 02:10:08, and the AIS information of at least one ship is the AIS information of 5 ships, as shown in Table 1 below; then, the ship identification device determines the AIS information of ships 1 to 5 whose distance from the first position is less than or equal to 1000 meters based on the AIS information of the ships in Table 1, and the absolute value of the time difference between the AIS generation time and the image capture time is less than 30 minutes, that is, the AIS information of ships 2, ship 3 and ship 5.

[0063] Table 1

[0064] First ship name Vessel position AIS generation time Distance from first position Ship 1 (35.302517,121.657052) 2021-8-8 01:33:23 910m Boat 2 (35.339998,121.640506) 2021-8-8 02:03:08 212 meters Ship 3 (35.342712,121.629201) 2021-8-8 02:03:30 100 meters Ship 4 (35.086595,121.880281) 2021-8-8 02:03:01 30717m Ship 5 (35.346805,121.638918) 2021-8-8 02:03:13 257 meters

[0065] Optionally, if there is no ship AIS information within the target range, the ship identification device executes S303.

[0066] Optionally, if there is ship AIS information within the target range, the ship identification device executes S304.

[0067] S303: The ship identification device determines that the ship to be identified has not turned on the AIS device.

[0068] It should be noted that when there is no ship AIS information within the target range, that is, the AIS information of the ship to be identified in the image of the ship to be identified is not found, indicating that the AIS device of the ship to be identified is not turned on. By adjusting the first preset threshold and the second preset threshold, for example, increasing the first preset threshold and the second preset threshold, the misjudgment rate of not turning on the AIS device caused by the late transmission of AIS information can be reduced as much as possible.

[0069] S304: The ship identification device identifies the ship to be identified according to the image recognition name and the ship AIS information.

[0070] Compared with the traditional technology of determining the target AIS information based on the dynamic information in the AIS information, and identifying the ship to be identified according to the target AIS information; the embodiment of the present application determines the image recognition name of the ship to be identified and the first position of the ship to be identified according to the image of the ship to be identified, and then judges whether there is a ship AIS information in the target range whose distance from the ship position to the first position is less than the first preset threshold, and the absolute value of the time difference between the AIS generation time and the image capture time is less than the second preset threshold. When the ship AIS information exists, the ship to be identified is identified according to the image recognition name and the ship AIS information; in this way, the present application does not need to determine the predicted position corresponding to the ship AIS information, thereby improving the recognition efficiency of the ship to be identified. In addition, the present application identifies the ship to be identified according to the static information (image recognition name) and the ship AIS information, and does not identify the ship to be identified completely based on the dynamic information in the AIS information. In this way, the uncertainty of the dynamic information in the AIS information leads to the problem of low accuracy of the determined target AIS information, thereby improving the recognition accuracy of the target ship.

[0071] Optionally, when the ship identification device can be connected to the ship archive, Figure 3 ,like Figure 4 As shown, the above S304 specifically includes: S401-S407

[0072] S401. The ship identification device identifies the name according to the image and searches the ship archive.

[0073] The above-mentioned ship archive stores archive information of multiple ships, wherein each archive information includes static information such as the name of the second ship, the size of the ship, the power parameters of the ship, and the draft of the ship.

[0074] The specific implementation of the above S401 may be that the ship identification device searches for archive information corresponding to the second ship name that is consistent with the image recognition name in a remote or local ship archive.

[0075] It is understandable that a ship has only one file information, that is, the above query results include at most one file information.

[0076] Optionally, if the archival information of the ship to be identified is queried in the ship archive, the ship identification device executes S402; wherein, the second ship name in the archival information of the ship to be identified matches the image recognition name, for example, the second ship name is consistent with the image recognition name, or the similarity is greater than a certain threshold, such as 99.99%, which means that the accuracy of the image recognition name is high.

[0077] Optionally, if the archive information of the ship to be identified is not found in the ship archive library, the ship identification device executes S405.

[0078] S402: The ship identification device searches for the AIS information of the first target ship in the ship AIS information according to the image recognition name.

[0079] The first ship name in the above-mentioned first target ship AIS information matches the image recognition name. In this way, if the first target ship AIS information is queried in the ship AIS information, it can be considered that the first target ship AIS information is the AIS information of the ship to be identified in the image to be identified, and the two can be associated, that is, the ship to be identified is identified.

[0080] Optionally, if the first target ship AIS information is not found in the ship AIS information, the ship identification device executes S403.

[0081] Optionally, if the AIS information of the first target ship is found in the ship AIS information, the ship identification device executes S404.

[0082] S403: The ship identification device determines that the ship to be identified has not turned on the AIS device.

[0083] It should be noted that the implementation of the above S403 is similar to that of the above S303. For the specific description of S403, reference may be made to the above related description of S303, which will not be repeated here.

[0084] S404: The ship identification device identifies the ship to be identified according to the AIS information of the first target ship.

[0085] The identifying the ship to be identified according to the AIS information of the first target ship specifically includes: binding the AIS information of the first target ship with the ship to be identified, and determining the AIS information of the first target ship as the AIS information of the ship to be identified.

[0086] The ship identification method provided in the embodiment of the present application identifies the ship to be identified based on the AIS information of the ship whose first ship name matches the image recognition name within the target range when there is archival information of the ship to be identified; compared with the traditional technology that determines the target AIS information by predicting the position and identifies the ship to be identified based on the target AIS information; the technical solution provided in the embodiment of the present application does not need to determine the predicted position of each ship AIS information, thereby improving the efficiency of identifying the ship to be identified.

[0087] S405: The ship identification device queries whether there is AIS information of a second target ship in the ship AIS information.

[0088] The similarity between the first ship name in the AIS information of the second target ship and the image recognition name meets a preset condition.

[0089] It should be noted that the above preset condition may be that the similarity is greater than a preset similarity, or that the similarity is the largest of multiple similarities. The specific content of the above preset condition is not limited in the embodiment of the present application.

[0090] The above S405 specifically includes: calculating the similarity between the first ship name and the image recognition name in each ship AIS information in the ship AIS information, and then determining the ship AIS information whose similarity meets the preset condition as the second target ship AIS information.

[0091] Optionally, if the second target ship AIS information does not exist in the ship AIS information, the ship identification device executes S406.

[0092] Optionally, if the ship ASI information contains AIS information of a second target ship, the ship identification device executes S407.

[0093] S406: The ship identification device determines that the ship to be identified has not turned on the AIS device.

[0094] It should be noted that the implementation of the above S406 is similar to that of the above S303. For the specific description of S406, reference can be made to the above related description of S303, which will not be repeated here.

[0095] S407: The ship identification device identifies the ship to be identified according to the AIS information of the second target ship.

[0096] It should be noted that the implementation of the above S407 is similar to that of the above S404. For the specific description of S407, reference can be made to the above related description of S404, which will not be repeated here.

[0097] Compared with the method of determining the target AIS information based on the dynamic information in the AIS information in the traditional technology, and identifying the ship to be identified according to the target AIS information; the embodiment of the present application determines the ship AIS information whose similarity between the first ship name and the image recognition name in the target range meets the preset conditions as the second target ship AIS information, and then identifies the ship to be identified according to the second target ship AIS information. That is to say, the embodiment of the present application determines the second target ship AIS information according to the static information in the ship AIS information, and the static information in the ship AIS information does not change. Therefore, the second target ship AIS information determined by the embodiment of the present application is more accurate. Furthermore, the ship identification device identifies the ship to be identified according to the second target ship AIS information, thereby improving the accuracy of identifying the ship to be identified.

[0098] Optionally, when the ship identification device cannot be connected to the ship archive, Figure 3 ,like Figure 5As shown, the above S304 specifically includes: S501-S503.

[0099] S501. The ship identification device predicts the predicted position of the ship corresponding to the ship AIS information at the time of capturing the image based on the ship AIS information.

[0100] The above-mentioned capture time is the acquisition time of the image of the ship to be identified.

[0101] It should be noted that the above-mentioned predicted position is based on the ship's position and is moved M unit distances in the ship's heading, where M = ship's speed × (capture time - generation time).

[0102] For example, Figure 6 As shown, assuming that the AIS generation time in the ship AIS information is 2021-08-08 02:00, the ship heading is 53.13 degrees east of north, the ship speed is 60km / h, the capture time is 2021-08-08 02:10, the ship position is (2, 4), and the first position is (10, 6); the time difference between the capture time and the AIS generation time is calculated to be 1 / 6 hour, and then, the moving distance calculated based on the time difference and the ship speed is 10km, that is: the predicted position is 10km in the direction of 53.13 degrees east of the ship position, that is, (10, 10); finally, according to the coordinates of the predicted position and the coordinates of the first position, the distance between the first position and the predicted position is calculated to be 4km.

[0103] S502: The ship identification device selects AIS information of a third target ship corresponding to a predicted position whose distance is less than a third preset threshold based on the distance between the predicted position and the first position.

[0104] The third preset threshold may be equal to the first preset threshold, or may be different from the first preset threshold, which is not limited in the specific embodiment of the present application.

[0105] The above S502 specifically includes: according to the distance between the predicted position corresponding to each ship AIS information calculated in S501 and the first position, determining the ship AIS information whose distance is less than a third preset threshold as the third target ship AIS information.

[0106] S503: The ship identification device identifies the ship to be identified based on the image recognition name and the AIS information of the third target ship.

[0107] Optional, combined Figure 5 ,like Figure 7 As shown, the above S503 specifically includes: S701-S703.

[0108] S701. The ship identification device queries whether there is AIS information of a fourth target ship in the AIS information of the third target ship.

[0109] The fourth target ship AIS information is the target ship AIS information in which the similarity between the first ship name and the image recognition name in the third target ship AIS information meets a preset condition, and the similarity is the highest.

[0110] It should be noted that the specific method of querying the similarity between the first ship name and the image recognition name in the AIS information of the third target ship to meet the preset conditions is similar to the above S405. For specific description, please refer to the above description of S405, which will not be repeated here.

[0111] Optionally, if the AIS information of the third target ship exists in the AIS information of the fourth target ship, the ship identification device executes S702.

[0112] Optionally, if the AIS information of the third target ship does not include the AIS information of the fourth target ship, the ship identification device executes S703.

[0113] S702: The ship identification device identifies the ship to be identified according to the AIS information of the fourth target ship.

[0114] The above S702 specifically includes:

[0115] If there is a fourth target ship AIS information in the third target ship AIS information, the ship identification device directly identifies the ship to be identified according to the fourth target ship AIS information.

[0116] It should be noted that the method in which the ship identification device directly identifies the ship to be identified according to the AIS information of the fourth target ship is similar to the above S404. For specific description, reference may be made to the above related description of S404, which will not be repeated here.

[0117] If there are multiple fourth target ship AIS information in the third target ship AIS information, the ship identification device identifies the ship to be identified according to the fourth target ship AIS information whose predicted position is closest to the first position among the multiple fourth target ship AIS information.

[0118] S703: The ship identification device determines that the ship to be identified has not turned on the AIS device.

[0119] It should be noted that the implementation of the above S703 is similar to that of the above S303. For the specific description of S703, reference may be made to the above related description of S303, which will not be repeated here.

[0120] Compared with the traditional technology of determining the target AIS information based on the distance between the predicted position corresponding to the ship AIS information and the first position, and identifying the ship to be identified according to the target AIS information; the embodiment of the present application determines the third target ship AIS information according to the distance between the predicted position corresponding to the ship AIS information and the first position, and then the ship identification device queries whether there is AIS information of the fourth target ship in the third target ship AIS information, wherein the fourth target ship AIS information is the target ship AIS information whose similarity between the first ship name and the image recognition name in the third target ship AIS information meets the preset condition; and the similarity is the highest. When there is a fourth target ship AIS information, the ship to be identified is directly identified according to the fourth target ship AIS information; when there are multiple fourth target ship AIS information, the ship identification device identifies the ship to be identified according to the fourth target ship AIS information whose predicted position is closest to the first position in the multiple fourth target ship AIS information; that is, the embodiment of the present application determines the fourth target ship AIS information for identifying the ship to be identified by combining the ship name matching method on the basis of the traditional technology, so that after the third target ship AIS information is determined by the dynamic information in the ship AIS information, the fourth target AIS information for identifying the ship to be identified is determined in the third target ship AIS information by the static information of the ship AIS information, thereby avoiding to a certain extent the problem of inaccurate target ship AIS information for identifying the ship to be identified determined based on the dynamic information in the ship AIS information, thereby improving the accuracy of identifying the ship to be identified.

[0121] Accordingly, an embodiment of the present application provides a ship identification device, which is used to execute each step in the above-mentioned ranging method. The embodiment of the present application can divide the functional modules of the ship identification device according to the above-mentioned method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. The division of modules in the embodiment of the present application is schematic, which is only a logical functional division. There may be other division methods in actual implementation.

[0122] In the case of dividing each functional module into corresponding functional modules, Figure 8 FIG. 2 is a schematic diagram showing a possible structure of the ship identification device involved in the above embodiment. Figure 8 As shown, the ship identification device includes: a determination module 801, a judgment module 802 and an identification module 803.

[0123] The determination module 801 is used to determine the image recognition name of the ship to be identified and the first position of the ship to be identified in the image of the ship to be identified, for example, by executing step S301 in the above method embodiment.

[0124] The determination module 802 determines whether there is ship AIS information within the target range, for example, by executing step S302 in the above method embodiment.

[0125] The determination module 801 is further configured to determine that the AIS device of the ship to be identified is not turned on if there is no ship AIS information within the target range, for example, executing step S303 in the above method embodiment.

[0126] The identification module 803 is used to identify the ship to be identified according to the image recognition name and the ship AIS information, for example, executing step S304 in the above method embodiment.

[0127] Optionally, the above-mentioned ship identification device includes: a query module 804.

[0128] The query module 804 is used to search the ship archive according to the image recognition name, for example, executing step S401 in the above method embodiment.

[0129] The query module 804 is also used to query the ship AIS information according to the image recognition name if the archive information of the ship to be identified is found in the ship archive library, for example, executing step S402 in the above method embodiment.

[0130] The determination module 801 is further configured to determine that the AIS device of the ship to be identified is not turned on if the AIS information of the first target ship is not found in the ship AIS information, for example, by executing step S403 in the above method embodiment.

[0131] The identification module 803 is used to identify the ship to be identified according to the first target ship AIS information if the first target ship AIS information is found in the ship AIS information, for example, executing step S404 in the above method embodiment.

[0132] Optionally, the above-mentioned ship identification device includes: a prediction module 805 and a screening module 806 .

[0133] The prediction module 805 is used to predict the predicted position of the ship corresponding to the ship AIS information at the time of capturing the image based on the ship AIS information, for example, executing step S501 in the above method embodiment.

[0134] The screening module 806 is used to screen out the third target ship AIS information corresponding to the predicted position whose distance is less than a third preset threshold based on the distance between the predicted position and the first position, for example, executing step S502 in the above method embodiment.

[0135] The identification module 803 identifies the ship to be identified based on the image recognition name and the AIS information of the third target ship, for example, executing step S503 in the above method embodiment.

[0136] The various modules of the above-mentioned ship identification device can also be used to execute other actions in the above-mentioned method embodiment. All relevant contents of the various steps involved in the above-mentioned method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0137] Part or all of the steps in the determination module 801, the judgment module 802, the identification module 803, the query module 804, the prediction module 805 and the screening module 806 can be Figure 2 The processor 201 in the processor executes the code in the memory 202.

[0138] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instruction is loaded and executed on a computer, the process or function in accordance with the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instruction can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instruction can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) mode or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server, data center, etc. that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a magnetic disk, a magnetic tape), an optical medium (eg, a digital video disc (DVD)), or a semiconductor medium (eg, a solid state drive (SSD)).

[0139] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0140] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0141] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0142] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0143] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the traditional technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk and other media that can store program codes.

[0144] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A ship identification method, characterized in that: The method comprises: Determine an image recognition name of a ship to be identified and a first position of the ship to be identified in the image of the ship to be identified, wherein the first position is a physical position corresponding to the position of the ship to be identified in the image; Determine whether there is ship AIS information within the target range; wherein the target range is a range whose distance from the first position is less than a first preset threshold; the ship AIS information includes a ship position and an AIS generation time, the ship position is within the target range, and the absolute value of the time difference between the AIS generation time and the capture time of the image is less than a second preset threshold; If there is no ship AIS information within the target range, it is determined that the ship to be identified has not turned on the AIS device; If there is ship AIS information within the target range, query the ship archive according to the image recognition name; wherein the ship archive stores the second ship names of multiple ships; If the archive information of the ship to be identified is queried in the ship archive library, a query is performed in the ship AIS information according to the image recognition name; wherein the second ship name in the archive information of the ship to be identified matches the image recognition name; If the first target ship AIS information is not found in the ship AIS information, it is determined that the AIS device of the ship to be identified is not turned on; wherein the ship AIS information includes the first ship name; the first ship name in the first target ship AIS information matches the image recognition name; If the first target ship AIS information is found in the ship AIS information, the ship to be identified is identified according to the first target ship AIS information.

2. The method according to claim 1, characterized in that The method further comprises: If the archive information of the ship to be identified is not found in the ship archive library, then query whether there is AIS information of a second target ship in the ship AIS information; wherein the similarity between the first ship name in the AIS information of the second target ship and the image recognition name meets a preset condition; If the AIS information of the second target ship does not exist in the AIS information of the ship, it is determined that the AIS device of the ship to be identified is not turned on; If the AIS information of the second target ship exists in the AIS information of the ship, the ship to be identified is identified according to the AIS information of the second target ship.

3. A ship identification method, characterized in that: The method comprises: Determine an image recognition name of a ship to be identified and a first position of the ship to be identified in the image of the ship to be identified, wherein the first position is a physical position corresponding to the position of the ship to be identified in the image; Determine whether there is ship AIS information within the target range; wherein the target range is a range whose distance from the first position is less than a first preset threshold; the ship AIS information includes a ship position and an AIS generation time, the ship position is within the target range, and the absolute value of the time difference between the AIS generation time and the capture time of the image is less than a second preset threshold; If there is no ship AIS information within the target range, it is determined that the ship to be identified has not turned on the AIS device; If there is ship AIS information within the target range, then based on the ship AIS information, predict the predicted position of the ship corresponding to the ship AIS information at the capture time; the capture time is the acquisition time of the image of the ship to be identified; Based on the distance between the predicted position and the first position, filter out the AIS information of the third target ship corresponding to the predicted position whose distance is less than a third preset threshold; The ship to be identified is identified based on the image recognition name and the AIS information of the third target ship.

4. The method according to claim 3, characterized in that: The ship AIS information includes a first ship name; and identifying the ship to be identified based on the image recognition name and the third target ship AIS information includes: Querying whether there is AIS information of a fourth target ship in the AIS information of the third target ship, wherein the AIS information of the fourth target ship is the AIS information of the target ship for which the similarity between the first ship name in the AIS information of the third target ship and the image recognition name meets a preset condition; and the AIS information of the target ship with the highest similarity; If the AIS information of the third target ship contains the AIS information of the fourth target ship, identifying the ship to be identified according to the AIS information of the fourth target ship; If the AIS information of the fourth target ship does not exist in the AIS information of the third target ship, it is determined that the AIS device of the ship to be identified is not turned on.

5. The method according to claim 4, characterized in that The identifying the ship to be identified based on the image recognition name and the AIS information of the third target ship further includes: If there are multiple fourth target ship AIS information in the third target ship AIS information, the ship to be identified is identified according to the fourth target ship AIS information whose predicted position is closest to the first position among the multiple fourth target ship AIS information.

6. A ship identification device, characterized in that: include: Determination module, judgment module, identification module and query module; The determination module is used to determine the image recognition name of the ship to be identified and the first position of the ship to be identified in the image of the ship to be identified, wherein the first position is a physical position corresponding to the position of the ship to be identified in the image; The judging module is used to judge whether there is ship AIS information within the target range; wherein the target range is a range whose distance from the first position is less than a first preset threshold; the ship AIS information includes a ship position and an AIS generation time, the ship position is within the target range, and the absolute value of the time difference between the AIS generation time and the capture time of the image is less than a second preset threshold; The determination module is further configured to determine that the AIS device of the ship to be identified is not turned on if there is no ship AIS information within the target range; The identification module is further configured to identify the ship to be identified according to the image recognition name and the ship AIS information if there is ship AIS information within the target range; The query module is used to query a ship archive based on the image recognition name; wherein the ship archive stores the second ship names of multiple ships; The query module is further configured to query the ship AIS information according to the image recognition name if the archive information of the ship to be identified is queried in the ship archive library; wherein the second ship name in the archive information of the ship to be identified matches the image recognition name; and the ship AIS information includes the first ship name; The determination module is used to determine that the AIS device of the ship to be identified is not turned on if the first target ship AIS information is not found in the ship AIS information; wherein the first ship name in the first target ship AIS information matches the image recognition name; The identification module is used to identify the ship to be identified according to the first target ship AIS information if the first target ship AIS information is queried in the ship AIS information; The ship identification device also includes: The query module is used to query whether there is AIS information of a second target ship in the ship AIS information if the archive information of the ship to be identified is not found in the ship archive library; wherein the similarity between the first ship name in the AIS information of the second target ship and the image recognition name meets a preset condition; The determination module is configured to determine that the AIS device of the ship to be identified is not turned on if the AIS information of the second target ship does not exist in the AIS information of the ship; The identification module is configured to identify the ship to be identified according to the second target ship AIS information if the second target ship AIS information exists in the ship AIS information; The ship identification device further comprises: a prediction module and a screening module; The prediction module is used to predict the predicted position of the ship corresponding to the ship AIS information at the capture time based on the ship AIS information; the capture time is the acquisition time of the image of the ship to be identified; The screening module is used to screen out the AIS information of the third target ship corresponding to the predicted position whose distance is less than a third preset threshold based on the distance between the predicted position and the first position; The identification module is used to identify the ship to be identified based on the image recognition name and the AIS information of the third target ship; The query module is used to query whether there is AIS information of a fourth target ship in the AIS information of the third target ship, wherein the AIS information of the fourth target ship is the target ship AIS information whose similarity between the first ship name in the AIS information of the third target ship and the image recognition name meets a preset condition; and the ship AIS information has the highest similarity; and the ship AIS information includes the first ship name; The identification module is used to identify the ship to be identified according to the AIS information of the fourth target ship if the AIS information of the third target ship contains the AIS information of the fourth target ship; The determination module is configured to determine that the AIS device of the to-be-identified ship is not turned on if the AIS information of the fourth target ship does not exist in the AIS information of the third target ship; The ship identification device also includes: The identification module is used to identify the ship to be identified according to the AIS information of the fourth target ship whose predicted position is closest to the first position among the multiple AIS information of the fourth target ship if there are multiple AIS information of the fourth target ship in the AIS information of the third target ship.

7. An electronic device, characterized in that: It comprises a memory and a processor, the memory is coupled to the processor; the memory is used to store computer program code, the computer program code includes computer instructions; when the computer instructions are executed by the processor, the electronic device executes the method as described in any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on a computing device, cause the computing device to execute the method according to any one of claims 1 to 5.

Images