Onboard support method and onboard support system

Abstract

To efficiently support transfer of skills and expertise of an experienced crew member even in situations where a less experienced crew member cannot receive a direct instruction from the experienced crew member.SOLUTION: An onboard support method includes: an image acquisition step in which an onboard information processing device 1 causes an imaging device 3 to acquire, at regular intervals, target image data capturing a refrigerator 7 in a ship 6; an upload step in which the onboard information processing device 1 uploads the target image data to an outboard information processing device 9 via the Internet; a storage step in which the outboard information processing device 9 receives and stores the uploaded target image data; and a determination step in which the outboard information processing device 9 determines an estimated score about the target image data by referencing a plurality of learned comparison image data given scores indicative of the levels of refrigeration performance.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an in-ship support method and an in-ship support system used in a ship equipped with a refrigerator such as a long-range tuna ship.

Background Art

[0002] In recent years, a situation has occurred in which there is a shortage of crew members on long-range tuna ships. The operation of the main engines (e.g., diesel engines, turbine engines, electric propulsion engines, etc.) and auxiliary machines (e.g., generators, pumps, air compressors, desalination plants, heat exchangers, refrigerators, etc.) of long-range tuna ships is entrusted to the proficiency of veteran crew members, and it is required to support the work of crew members so that inexperienced crew members can acquire it in a short period of time.

[0003] Various efforts have been made to support the work of inexperienced crew members from land (see, for example, Non-Patent Document 1).

Prior Art Documents

Non-Patent Documents

[0004]

Non-Patent Document 1

[0005] Non-Patent Document 1 discloses a system for supporting the operation of crew members by transmitting control data of in-ship engines to land and sharing data with support companies and engine manufacturers on land. In this way, a control data remote management system has been introduced in some newly built ships.

Summary of the Invention

Problems to be Solved by the Invention

[0006] As a burden on crew members, the difficulty of operating the freezer, which is directly related to fish prices, is cited. It is said that the fact that long-term experience is required to properly operate the freezer is one of the reasons why prospective crew members avoid tuna longliners.

[0007] Generally, in freezer management, it is necessary to adjust the fish hold area and temperature according to changes in conditions such as the catch volume and seawater temperature. Veteran crew members adjust the control of the compressors installed in the freezer in a timely manner. Specifically, veteran crew members operate various parts such as valves to adjust the circulation volume of the refrigerant so that appropriate freezing performance can be maintained while suppressing the fuel consumption that leads to operating costs and avoiding serious failures.

[0008] In the freezers of tuna longliners, there is a current situation where veteran crew members operate the freezers by visually judging the freezing performance based not only on various numerical data related to the freezers (for example, numerical values of pressure and temperature) but also on the range of frost adhesion on the pipes through which the refrigerant circulates.

[0009] However, the conventional system disclosed in Non-Patent Document 1 has a problem that it is based only on numerical data and cannot provide appropriate support.

[0010] In order to inherit the proficiency of veteran crew members, it is necessary to understand their visual judgment thinking. However, in reality, the crew members are on shift work for engine operations, and even during a long voyage, there is a problem that inexperienced crew members cannot directly inherit the know-how regarding operations from veteran crew members on site.

[0011] The present invention has been made in view of such circumstances, and an object thereof is to provide support for efficiently inheriting the proficiency even in a situation where inexperienced crew members cannot directly receive guidance from veteran crew members.

Means for Solving the Problems

[0012] In a first aspect of the present invention, an in-ship information processing apparatus causes an imaging device to acquire target image data obtained by imaging a refrigerator in a ship at regular intervals, which is an image acquisition step; an upload step in which the in-ship information processing apparatus uploads the target image data to an out-ship information processing apparatus via the Internet; a storage step in which the out-ship information processing apparatus receives and stores the upload of the target image data; a determination step in which the out-ship information processing apparatus determines an estimated score for the target image data by referring to a plurality of learned comparison image data to which scores indicating the degree of refrigeration performance are assigned; A shipboard support method characterized by including the above is provided.

[0013] According to the first aspect of the present invention, determination can be made in the out-ship information processing apparatus. Therefore, even in a situation where a less experienced crew member cannot receive direct guidance from a veteran crew member, support can be provided to efficiently transfer their proficiency.

[0014] Further, the shipboard support method according to the first aspect of the present invention further includes a work instruction data generation step in which the out-ship information processing apparatus generates work instruction data corresponding to the target image data, a work instruction data transmission step in which the out-ship information processing apparatus transmits the work instruction data to the in-ship information processing apparatus via the Internet, an output step in which the in-ship information processing apparatus receives the work instruction data and displays and / or reproduces the work instruction data on the in-ship information processing apparatus, and has The learned comparison image data is a learning model by machine learning or deep learning for estimating the degree of refrigeration performance of the refrigerator, The work instruction data is preferably document data and / or video data and / or audio data.

[0015] According to such an aspect, even a crew member with little experience can perform work according to the output work instruction data inside the ship, so that more efficient support can be realized.

[0016] Further, the in-ship support method according to the first aspect of the present invention further includes a speed measurement step in which the out-of-ship information processing device measures line speed data of a communication line. In the work instruction data generation step, the out-of-ship information processing device extracts work instruction individual data associated with the level of the estimated score using a work instruction table in which one or more work instruction individual data are associated with each level of the score, and generates work instruction data. It is preferable that work instruction individual data having a file size corresponding to the line speed data is selected.

[0017] According to such an aspect, appropriate support can be provided without overloading the line.

[0018] Further, the in-ship support method according to the first aspect of the present invention further includes the out-of-ship information processing device a cloud server, a land information processing device connected to the cloud server via the Internet and having a determination data storage unit, an input unit, and a display unit in which the work instruction table is stored, and In the storage step, the cloud server receives and stores the target image data, when the land information processing device receives a download instruction by the input unit or at a predetermined timing, the land information processing device downloads and stores the target image data from the cloud server, In the work instruction data generation step, the work instruction data is preferably input and / or selected by the land information processing device through the input unit.

[0019] According to such an aspect, more appropriate support can be realized by combining the cloud and the land.

[0020] Further, a second aspect of the present invention provides a shipboard support system comprising: one or more imaging devices, a shipboard information processing device including an image acquisition unit configured to acquire, at regular intervals, target image data obtained by the imaging device capturing a refrigerator inside the ship, and an off-ship information processing device configured to receive and store the upload of the target image data via the Internet from the shipboard information processing device or a communication device connected to the shipboard information processing device.

[0021] According to the second aspect of the present invention, since the state inside the ship can be periodically stored outside the ship, even in a situation where a less experienced crew member cannot receive direct guidance from a veteran crew member, it is possible to efficiently provide support for passing on their proficiency.

[0022] Furthermore, in the shipboard support system according to the second aspect of the present invention, the off-ship information processing device includes a determination data storage unit storing a plurality of learned comparison image data to which scores indicating the degree of refrigeration performance are assigned, a determination unit configured to determine an estimated score for the target image data by referring to the learned comparison image data, and has 1] It is preferable that the off-ship information processing device includes one or more physical servers and / or cloud servers outside the ship.

[0023] According to such an aspect, since the determination is performed, more appropriate support can be realized.

[0024] Furthermore, the cloud server includes a storage unit configured to receive and temporarily store the target image data, and the physical server is an onshore information processing device connected to the cloud server via the Internet and including the determination data storage unit, the determination unit, an input unit, and a display unit, In the determination data storage unit, a work instruction table in which the target image data downloaded from the cloud server when a download instruction is received by the input unit or at a predetermined timing is associated with one or more work instruction individual data for each score level is stored. The onshore information processing device further A work instruction data generation unit that generates work instruction data corresponding to the target image data according to the estimated score by receiving input and / or selection by the input unit or automatic selection; A work instruction data transmission unit that transmits the work instruction data to the in-ship information processing device via the Internet; is provided with The in-ship information processing device receives the work instruction data and includes a display unit and / or an audio reproduction unit that displays and / or reproduces the work instruction data on the in-ship information processing device. The learned comparison image data is a learning model by machine learning or deep learning for estimating the degree of refrigeration performance of the refrigerator, It is preferable that the work instruction data is document data and / or video data and / or audio data.

[0025] According to such an aspect, even a crew member with little experience can work according to the output work instruction data in the ship, so that more efficient support can be realized.

Effect of the Invention

[0026] According to the present invention, even in a situation where a crew member with little experience cannot receive direct guidance from a veteran crew member, it is possible to realize support for efficiently passing on their proficiency.

[0027] Further, according to the present invention, especially for existing ships, compared with introducing a control data remote management system, the modification cost is lower, the introduction period is shorter, and the barrier to introducing the system can be reduced.

Brief Description of the Drawings

[0028]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Embodiments for Carrying Out the Invention

[0029] Hereinafter, the in-ship support method and the in-ship support system of the present invention will be specifically described with reference to the accompanying drawings using embodiments, but the present invention is not limited thereto.

[0030] The in-ship support system of the present invention is realized on a computer terminal (including in-ship servers) having a computing device such as a CPU and a storage device such as a RAM and a hard disk inside the ship, and on a computer terminal (including out-of-ship servers) having a computing device such as a CPU and a storage device such as a RAM and a hard disk outside the ship. The out-of-ship server may be realized by appropriately using SaaS (Software as a Service) or PaaS (Platform as a Service) provided by a cloud server for some or all of its functions without providing dedicated software, hardware, OS, etc. for this system. The program for realizing the in-ship support system of this embodiment is stored in the hard disk of the computer terminal (including the cloud server), and such a program is read into the RAM etc. by performing a predetermined operation, and its functions (means) are executed by the computing device, whereby a predetermined process is performed. And the information stored as the storage means used for such a process is stored in a storage device such as a RAM or a hard disk in various file storage formats such as a database or a data file, and is appropriately read out during the process to perform a predetermined process. Also, the result of the process is written out to a storage device such as a RAM or a hard disk and stored as appropriate. Each means in the present invention only has its functions logically distinguished, and may constitute the same area physically or de facto. The program for realizing the in-ship support system of this embodiment is for causing a computer to function as a system for realizing the in-ship support method of this embodiment.

Example

[0031] {Configuration} Figure 1 is an image diagram of an in-ship support system that executes Example 1 of the in-ship support method of the present invention. The in-ship support system of this example includes: (a) a photographing device 2; (i) an in-ship information processing device 1 including an image acquisition unit 13 that causes the photographing device 2 to acquire target image data obtained by photographing a refrigerator 7 inside a ship 6 at regular intervals; and (u) an out-ship information processing device 9 that receives and stores the upload of the target image data via the Internet 4 from a communication device 5 connected to the in-ship information processing device 1. In this example, the photographing device 2 is composed of photographing devices 2a, 2b, and 2c, each of which photographs the way frost 72 forms on the piping 71 of a different refrigerator 7. Also, in this example, the out-ship information processing device 9 is composed of a cloud server 91 and an on-land information processing device 92, which are connected to each other via the Internet 4. In this example, the photographing device 2 also photographs the operating state of the blower 8.

[0032] In this example, the communication device 5 is a communication terminal in the steering room 62 of the ship 6 and is operable by the ship's captain 621. Also, in this example, the in-ship information processing device 1 is a display terminal in the engine room 61 of the ship 6 and is operable by the engine room chief 611. Since the engine room 61 has an iron door and it is difficult for the Internet to penetrate, the in-ship information processing device 1 is connected to an Internet line via a communication satellite from the communication device 5 connected by an in-ship network 3 using a LAN cable. The in-ship information processing device 1 has a display unit 11 and an audio playback unit 12 as output units that output work instruction data received from the out-ship information processing device 9.

[0033] The in-ship support system that realizes the in-ship support method of this example is realized by an application program incorporated into the in-ship information processing device 1 by means such as download, and an application program incorporated on the out-ship information processing device 9 that receives data from the in-ship information processing device 1.

[0034] In this example, the photographing device 2 is three, namely, photographing devices 2a, 2b, and 2c, but this is just an example, and it may be one or a large number. It is preferable that there is one photographing device 2 for one refrigerator 7.

[0035] In this embodiment, the device for uploading target image data to the outboard information processing device 9 via the Internet is the communication device 5 connected to the inboard information processing device 1. However, the inboard information processing device 1 may be composed of one or more computers connected to each other, and may be equipped with a communication unit to the Internet within the inboard information processing device 1 and upload the target image data to the outboard information processing device 9 via the Internet.

[0036] The outboard information processing device 9 may be realized by using virtual information processing resources provided by using existing virtualization technologies, process space separation technologies, etc., such as a virtual server provided by a cloud system, either in whole or in part. Also, all or part of the functions provided by the information processing device 10 may be realized by services provided by a cloud system via an API or the like. In this embodiment, the outboard information processing device 9 is composed of a cloud server 91 and an onshore information processing device 92 which is a physical server. However, it may be only the cloud server 91, or only the onshore information processing device 92 which is one or more physical servers outside the ship, or a virtual server operating on a hypervisor or a combination thereof.

[0037] FIG. 2 is a system configuration diagram of an inboard support system that executes Example 1 of the inboard support method of the present invention. The cloud server 91 includes a storage unit 911 that receives and temporarily stores target image data. The onshore information processing device 92 is connected to the cloud server 91 via the Internet, and includes a determination data storage unit 93 in which a plurality of learned comparison image data with scores indicating the degree of refrigeration performance are stored, a determination unit 94 that determines an estimated score for the target image data by referring to the learned comparison image data, an input unit 921, a display unit 922, and a communication unit 923. The learned comparison image data is a learning model by machine learning or deep learning for estimating the degree of refrigeration performance of the refrigerator 7.

[0038] In this embodiment, the target image data stored in the determination data storage unit 93 is automatically downloaded from the cloud server 91 by the land information processing device 92 at a predetermined timing and accumulated. However, the land information processing device 92 may receive a download instruction at the input unit 921 and download and accumulate the data when it is received. Further, the cloud server 91 may automatically transmit the target image data stored in the storage unit 911 to the land information processing device 92 at a predetermined timing.

[0039] The in-ship support system of this embodiment has a configuration capable of executing an AI model creation phase and a crew support phase, which will be described later. When only the crew support phase is performed and the land information processing device 92 automatically makes determinations and instructions, the input unit 921 and the display unit 922 may not be provided in the land information processing device 92.

[0040] In this embodiment, the learned comparison image data is created in the AI model creation phase. Further, it may be automatically corrected by receiving an input of the determination result and the appropriateness of the work instruction for each output in the crew support phase.

[0041] FIG. 3 is an image diagram of the AI diagnosis of the target image data in Embodiment 1 of the in-ship support system of the present invention.

[0042] The target image data, which is an image captured by the imaging device 2, includes at least the piping 71 of the refrigerator 7, and preferably includes the operating status of the blower 8. From the target image data, the presence or absence and the degree of frosting 72 adhering to the periphery of the piping 71 of the refrigerator 7 can be known. In this embodiment, the refrigerator being blown by the blower 8 within the same image is a refrigerator different from the refrigerator within the image. In this embodiment, the piping 71 of a plurality of refrigerators 7 is simultaneously captured by different imaging devices 2. The imaging device 2 may be accompanied by various sensors such as a temperature sensor and collect data from the sensors simultaneously with imaging, and may include temperature data and the like in the target image data.

[0043] Fig. 3(a) shows that frost 72 thickly covers pipe 71. When compared with the learned comparison image data, it is in an extremely good state, and it is determined that the refrigeration efficiency is good. The estimated score for the refrigeration performance is, for example, 99.4. On the other hand, in Fig. 3(b), although frost 72 covers pipe 71, the thickness of the frost is thin. It is determined that the refrigeration efficiency is not good but within the allowable range, and the estimated score for the refrigeration performance is, for example, 62.6. Fig. 3(c) shows that frost 72 hardly covers pipe 71, and it is determined that the refrigeration efficiency is not good, and the estimated score for the refrigeration performance is, for example, 4.8. Comparison with the learned comparison image data is performed by analyzing the frosting condition through image analysis. Image analysis is also performed on whether the blower is operating or not. It is preferable that the determination data storage unit 93 stores in advance data on which refrigerator is shown in the image from which imaging device and which blower for the refrigerator is shown. When temperature data is attached from the imaging device 2, it is preferable to perform determination by comprehensively considering both the temperature data and the frosting condition.

[0044] In addition to the learned comparison image data, the determination data storage unit 93 stores the target image data downloaded from the cloud server 91 and a work instruction table in which one or a plurality of work instruction individual data are associated for each score level.

[0045] FIG. 4 is an image diagram of the work instruction table of Example 1 of the in-ship support system of the present invention. The onshore information processing device 92 has a work instruction data generation unit 95 that generates work instruction data corresponding to the target image data by automatic selection according to the estimation score. If the target image data is determined in the determination unit 94 that the estimation score is higher than a certain value (80 in this embodiment), there is no need for work in the ship, and no work instruction data is extracted. When it is determined that the estimation score is below a certain value, the work instruction data associated in the work instruction table according to the score range, that is, the work instruction individual data including the corresponding work instruction content, for example, video data and document data (PDF, text, JPEG, etc.) are extracted. As the work instruction individual data, voice data without video may be included, and the work instruction individual data extracted as the work instruction data may be plural or one. In this embodiment, the onshore information processing device 92 automatically selects the work instruction data, but it may be generated by receiving an input and / or selection by the input unit 921 according to the estimation score.

[0046] The offshore information processing device 9 may have a speed measurement means for measuring the line speed data of the communication line. The measured line speed data is uploaded together with the target image data. When generating work instruction data for extracting work instruction individual data associated with the level of the estimation score and transmitting it to the in-ship information processing device 1, the work instruction data generation unit 95 preferably selects work instruction individual data with a file size according to the line speed. That is, when the line speed is slow, it is preferable not to include video data in the work instruction individual data and only select document data with a small file size.

[0047] The onshore information processing device 92 includes a work instruction data transmission unit 96 that transmits work instruction data to the in-ship information processing device 1 via the Internet. The work instruction data transmission unit 96 of the offshore information processing device 9 transmits work instruction data to the in-ship information processing device 1 directly or via the communication device 5 by the communication unit 923 provided with data transmission and reception means.

[0048] The in-ship information processing device 1 receives work instruction data, and includes a display unit 11 and an audio playback unit 12 as output units that display images and document data of the work instruction data and play back audio and video. In this embodiment, the in-ship information processing device 1 is a display terminal, and the communication device 5 is a communication terminal that serves as the data communication unit of the in-ship information processing device 1. However, when the in-ship information processing device 1 is composed of a plurality of devices, the in-ship information processing device 1 may have a data communication unit.

[0049] When the out-ship information processing device 9 is only the cloud server 91, the determination data storage unit 93, the determination unit 94, the work instruction data generation unit 95, and the work instruction data transmission unit 96 are provided in the cloud server 91. Also, the target image data is accumulated in the determination data storage unit 93 by the cloud server 91 receiving an upload from the in-ship information processing device 1 at a predetermined timing, either directly or via the communication device 5. Further, the cloud server 91 transmits the work instruction data generated by the work instruction data generation unit 95 to the in-ship information processing device 1 or the communication device 5 at a predetermined timing.

[0050] When the out-ship information processing device 9 is only the onshore information processing device 92, the target image data is accumulated in the determination data storage unit 93 by the onshore information processing device 92 receiving an upload from the in-ship information processing device 1 at a predetermined timing, either directly or via the communication device 5.

[0051] {Processing Process} FIG. 5 is a system flowchart of Embodiment 1 of the in-ship support method of the present invention. The in-ship support method of Embodiment 1 has an AI model creation phase for creating learned comparison image data, and a crew support phase for performing determination based on the learned comparison image data, generating work instructions, and supporting in-ship work. The steps from the image acquisition step to the accumulation step are common. In the AI model creation phase, it includes a learned model creation step after the accumulation step, and in the crew support phase, which is executed with the learned comparison data accumulated in the AI model creation phase, it includes each step from the determination step to the output step after the accumulation step.

[0052] (Step10) Image acquisition step During the operation of the ship, the crew is performing the operation of starting and stopping the refrigerator. The in-ship information processing device 1 connected to the imaging device 2 and the in-ship network 3 causes the imaging device 2 to acquire the target image data obtained by photographing the piping 71 of the refrigerator 7 in the ship 6 at regular intervals with a timer or the like, and transmits it to the image acquisition unit 13 of the in-ship information processing device 1 connected via the in-ship network 3 for accumulation. During the operation of the refrigerator, frost adheres to the piping 71. However, if frost adheres to the main body or if there is not enough frost on the piping 71, the refrigerant circulation amount is inappropriate, resulting in wasteful fuel consumption, reduced refrigeration efficiency, or a cause of failure.

[0053] (Step20) Upload step Next, the in-ship information processing device 1 uploads the target image data acquired in the image acquisition step to the connected out-of-ship information processing device via the Internet at regular intervals, either directly or via the communication device 5 connected to the in-ship network 3. In this embodiment, the upload timing is performed by a timer, but it may be every time an image of one or more target image data is acquired.

[0054] (Step30) Accumulation step Next, the out-of-ship information processing device 9 receives and accumulates the upload of the target image data. In this embodiment, it is accumulated in the cloud server 91 that constitutes the out-of-ship information processing device 9. Further, in this embodiment, the out-of-ship information processing device 9 downloads the target image data from the cloud server 91 to the onshore information processing device 92 that constitutes the out-of-ship information processing device 9 for accumulation. In this embodiment, the download is performed at a predetermined timing, but it may be downloaded when a download instruction is received by the input unit 921.

[0055] (Step31) Trained model creation step In the AI model creation phase, next, the onshore information processing device 92 creates an image database with the accumulated target image data. For each piece of target image data, the input unit 921 receives a score input from an onshore work instructor, assigns a score indicating the degree of refrigeration performance to each piece of target image data to form teacher data, and stores it in the determination data storage unit 93 as learned comparison image data for determination. In this embodiment, the determination data storage unit 93 is within the onshore information processing device 92. However, when the determination is made by the cloud server 91 instead of the onshore information processing device 92 in the crew support phase, the onshore information processing device 92 stores the learned comparison image data in the determination data storage unit 93 on the cloud server 91. The AI model creation phase completes the processing in this step. It is desirable that the onshore work instructor be a veteran crew member or a refrigeration machine manufacturer's employee. Even if there are not multiple veteran crew members on each ship, it is possible to monitor multiple ships from the shore. This enables new or mid-level crew members who monitor the engine room on an alternating duty basis with the ship's chief engineer on board the ship to work without anxiety.

[0056] (Step40) Judgment step In the crew support phase, after the accumulation step, it proceeds to the judgment step. FIG. 6 is a processing flowchart from the judgment step to the output step of Embodiment 1 of the in-ship support method of the present invention. The offshore information processing device 9 determines the estimated score for the target image data by referring to a plurality of learned comparison image data with scores indicating the degree of refrigeration performance stored in the determination data storage unit 93 in the determination unit 94.

[0057] (Step50) Work instruction data generation step Next, when the estimated score does not meet the predetermined conditions, the outboard information processing device 9 generates work instruction data corresponding to the target image data. The outboard information processing device 9 extracts the work instruction individual data associated with the level of the estimated score using a work instruction table in which one or more work instruction individual data are associated with each level of the score, and generates work instruction data. For example, in the case of FIG. 3(a) where the estimated score is determined to be 99.4, as shown in the example of the work instruction table shown in FIG. 4, since the condition that the score is greater than 80 is satisfied and there is no associated work instruction data, the process is completed. In the case of FIG. 3(b) where the estimated score is determined to be 62.6, in the example of FIG. 4, the outboard information processing device 9 selects the video with the file name BM001, the document BD001, and the text BT001 as the work instruction individual data, and generates it as the work instruction data to be transmitted to the inboard information processing device 1. In this embodiment, the work instruction data is automatically selected by the onshore information processing device 92, but it may also receive input and selection by the input unit 921, and add or change the input or selected work instruction individual data to the work instruction data.

[0058] (Step60) Work Instruction Data Transmission Step Next, the outboard information processing device 9 transmits the work instruction data to the inboard information processing device 1 via the Internet, either directly or through the communication device 5.

[0059] (Step70) Output Step The inboard information processing device 1 receives the work instruction data transmitted from the outboard information processing device 9 and outputs the work instruction data to the output unit of the inboard information processing device 1. As an output method, the document or image of the work instruction data is displayed on the display unit 11 which is the output unit, the voice is played back by the voice playback unit 12, and the video file is played back. Even if the crew member has little experience, based on the displayed and played-back work instruction data, the crew member can operate the refrigerator or perform the device confirmation work.

[0060] {Effect} According to the in-ship support method and in-ship support system of this embodiment, the state inside the ship can be periodically accumulated outside the ship, and determination can be made in the out-of-ship information processing device. Therefore, even in a situation where a novice crew member cannot receive direct guidance from a veteran crew member, support can be provided to efficiently inherit their proficiency. Also, even a novice crew member can perform work according to the output work instruction data, so that support can be realized more efficiently. Further, a more appropriate support can be realized by combining the cloud and onshore.

[0061] In addition, especially for existing ships, compared with introducing a control data remote management system, the modification cost is lower, the introduction period is shorter, and the barrier to introducing the system can be reduced.

[0062] {Modification example} Selection according to line speed In this embodiment, it is further desirable to select work instruction data according to the line speed. FIG. 7 is a processing flow diagram from the determination step to the output step of a modification example of Embodiment 1 of the in-ship support method of the present invention.

[0063] (Step51) Speed measurement step The out-of-ship information processing device 9 measures and acquires the line speed data of the communication line in the work instruction data generation step.

[0064] (Step52) Work instruction data limitation step The out-of-ship information processing device 9 further creates work instruction data to be transmitted to the in-ship information processing device 9 by selecting work instruction individual data with a file size corresponding to the line speed data from the work instruction individual data associated according to the score level in the work instruction data generation step. For example, if the line situation is bad, video data is deleted to generate work instruction data.

[0065] In this modification example, as shown in FIG. 7, the outboard information processing device 9 determines whether data transmission is necessary or not at the time of generating work instruction data in the work instruction data generation unit 95. In determining whether data transmission is necessary or not, if the work can be handled by the in-ship work manual, it is determined that data transmission is not required, and if the work cannot be handled, it is determined that data transmission is necessary. When the work can be handled by the in-ship work manual, it is further determined whether the work can be performed using the electronic manual stored in the in-ship information processing device 1. If it is determined that the work cannot be performed using the electronic manual, it is considered necessary to refer to the paper manual installed in the ship for work, and as one of the individual work instruction data, the text of the page number information of the page of the work manual is included in the work instruction data transmitted to the in-ship information processing device 1. When it is determined that the work can be performed using the electronic manual, the image data of the QR code (registered trademark) information of the corresponding page is included in the work instruction data transmitted to the in-ship information processing device 1.

[0066] When it is determined that the work cannot be handled by the in-ship work manual, it is further determined whether a video file can be transmitted from the measured line speed data. If the line speed is fast enough and the video file can be transmitted, the video file is included in the work instruction data transmitted to the in-ship information processing device 1. In that case, other work document files or text files may also be included in the work instruction data. If the line speed is slow and it is difficult to transmit the video file, work document files or text files without video are used as the work instruction data.

[0067] According to the in-ship support method and the in-ship support system of this modification example, since the transmitted data is changed according to the line situation, it is possible to prevent the time lag until the work instruction data reaches the crew members, and if the line situation is good, the work instruction content can be delivered to the crew members in an easy-to-understand video. Therefore, appropriate support can be provided without overloading the line.

Example

[0068] {Configuration} FIG. 8 is a system configuration diagram of an in-ship support system that executes Example 2 of the in-ship support method of the present invention. In the crew support phase of the in-ship support system of this example, the off-ship information processing device 9 is only the cloud server 91. In this example, the determination data storage unit 93, the determination unit 94, the work instruction data generation unit 95, and the work instruction data transmission unit 96 are in the cloud server 91. The learned comparison image data is stored in the determination data storage unit 93 in the cloud server 91. Other configurations are the same as those in Example 1 in principle.

[0069] {Processing Process} FIG. 9 is a system flowchart of Example 2 of the in-ship support method of the present invention. In the AI model creation phase, the learned comparison image data is uploaded to the cloud server. Also, in the crew support phase, in the accumulation step, the off-ship information processing device 9 accumulates the target image data in the cloud server 91, and for the work instruction data, it is automatically transmitted from the cloud server 91 to the in-ship information processing device 1 at a predetermined timing. Other steps are the same as those in Example 1 in principle.

[0070] {Effect} According to the in-ship support method and in-ship support system of this example, even in a situation where inexperienced crew members cannot receive direct guidance from veteran crew members, it is possible to efficiently provide support for passing on their proficiency. Since automatic determination and instruction are performed by the cloud server in the crew support phase, there is no need for an onshore physical server or an instructor for input.

Example

[0071] {Configuration} In this example, there is no work instruction data generation unit 95, but other configurations are the same as those in Example 1 in principle.

[0072] {Processing Process} FIG. 10 is a system flowchart of Example 3 of the in-ship support method of the present invention. In the in-ship support method of this example, the AI model creation phase is the same as in Example 1. Regarding the crew support phase, in the work instruction data generation step, the off-ship information processing device 9 displays the estimated score determined by the determination unit 94 on the display unit 922, and the input unit 921 receives the input and selection of work instruction data. In the work instruction data transmission step, the input unit 921 receives a transmission instruction, and based on the transmission instruction, the communication unit 923 transmits the work instruction data input or selected by the input unit 921 to the in-ship information processing device 1. The other steps are the same as in Example 1 in principle.

[0073] {Effect} According to the in-ship support method and the in-ship support system of this example, even in a situation where a novice crew member cannot receive direct guidance from a veteran crew member, it is possible to efficiently provide support for passing on their proficiency. When the operation of the refrigerator is required, although manual transmission of operation instructions requires manpower, since the score is automatically determined, the burden on the onshore work instructor is reduced.

Explanation of Signs

[0074] 1 In-ship information processing device 11 Display unit 12 Voice playback unit 13 Image acquisition unit 2 Photographing device 3 In-ship network 4 Internet 5 Communication device 6 Ship 61 Engine room 611 Chief engineer 62 Steering room 621 Captain 7 Refrigerator 71 Pipe 72 Frost 8 Blower 9 Off-ship information processing device 91 Cloud server 911 Storage unit 92 Onshore information processing device 921 Input section 922 Display section 923 Communication section 93 Determination data storage section 94 Determination section 95 Work instruction data generation section 96 Work instruction data transmission section

Claims

1. An in-ship information processing device causes an imaging device to acquire target image data obtained by imaging a refrigerator in a ship at regular intervals; an upload step in which the in-ship information processing device uploads the target image data to an out-ship information processing device via the Internet; a storage step in which the out-ship information processing device receives and stores the upload of the target image data; a determination step in which the out-ship information processing device determines an estimated score for the target image data by referring to a plurality of learned comparison image data to which scores indicating the degree of refrigeration performance are assigned; An in-ship support method characterized by including the above.

2. Furthermore, a work instruction data generation step in which the out-ship information processing device generates work instruction data corresponding to the target image data; a work instruction data transmission step in which the out-ship information processing device transmits the work instruction data to the in-ship information processing device via the Internet; an output step in which the in-ship information processing device receives the work instruction data and displays and / or reproduces the work instruction data on the in-ship information processing device; having the learned comparison image data is a learning model by machine learning or deep learning for estimating the degree of refrigeration performance of the refrigerator, The in-ship support method according to claim 1, wherein the work instruction data is document data and / or video data and / or audio data.

3. Furthermore, the out-ship information processing device includes a speed measurement step of measuring line speed data of a communication line, In the work instruction data generation step, the out-ship information processing device extracts work instruction individual data associated with the level of the estimated score using a work instruction table in which one or a plurality of work instruction individual data are associated for each score level, and generates work instruction data, and selects work instruction individual data having a file size corresponding to the line speed data. The in-ship support method according to claim 2, characterized in that

4. The out-ship information processing device includes a cloud server, a land information processing device connected to the cloud server via the Internet and having a determination data storage unit, an input unit, and a display unit in which the work instruction table is stored, equipped with In the storage step, the cloud server receives and stores the target image data, When the onshore information processing device receives a download instruction by the input unit or at a predetermined timing, it downloads and stores the target image data from the cloud server. In the work instruction data generation step, The work instruction data is input and / or selected by the onshore information processing device through the input unit. The in-ship support method according to claim 2 is characterized by this.

5. One or more imaging devices, An in-ship information processing device including an image acquisition unit that causes the imaging device to acquire target image data obtained by imaging a refrigerator in a ship at regular intervals, An in-ship support system comprising: an out-ship information processing device that receives and stores the upload of the target image data via the Internet from the in-ship information processing device or a communication device connected to the in-ship information processing device.

6. The out-ship information processing device, A determination data storage unit storing a plurality of learned comparison image data with scores indicating the degree of refrigeration performance, A determination unit that determines an estimated score for the target image data by referring to the learned comparison image data, having, The out-ship information processing device includes one or more physical servers and / or cloud servers outside the ship. The in-ship support system according to claim 5 is characterized by this.

7. The cloud server includes a storage unit that receives and temporarily stores the target image data, The physical server is an onshore information processing device connected to the cloud server via the Internet and including the determination data storage unit, the determination unit, an input unit, and a display unit. In the determination data storage unit, a work instruction table in which the target image data downloaded from the cloud server when a download instruction is received by the input unit or at a predetermined timing is associated with one or more work instruction individual data for each score level is stored. The onshore information processing device further includes, A work instruction data generation unit that generates work instruction data corresponding to the target image data according to the estimated score by receiving input and / or selection by the input unit or automatic selection, A work instruction data transmission unit that transmits the work instruction data to the in-ship information processing device via the Internet, comprising. The in-ship information processing device receives the work instruction data, and includes a display unit and / or an audio playback unit that display and / or play back the work instruction data in the in-ship information processing device. The learned comparison image data is a learning model by machine learning or deep learning for estimating the degree of refrigeration performance of the refrigerator. The in-ship support system according to claim 6, wherein the work instruction data is document data and / or video data and / or audio data.

Images