Plotting support system, ship, plotting support method, and plotting support program

Abstract

To provide a plot support system, a ship, a plot support method, and a plot support program that improve work efficiency and alleviate parallel work of a user.SOLUTION: A report support system 1 includes voice input units 51, 52, and 53 to which a user inputs a report on an event that has occurred in a ship by voice and which output the report as voice data, a voice recognition unit 10 that acquires the voice data from the voice input units 51, 52, and 53, converts the voice data into text data, and outputs the text data, a recommendation generation unit 20 that acquires the text data from the voice recognition unit 10 and outputs candidates for a symbol based on a table in which the event and the symbol are associated with each other and the text data, and a display unit 31 that acquires the candidates for the symbol from the recommendation generation unit 20 and displays the candidates.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a plotting support system, a vessel, a plotting support method, and a plotting support program. [Background technology]

[0002] On a ship, when an event requiring a response occurs, a plotter plots the situation of the event and the progress of emergency measures on a ship's chart in real time, and uses this as the basis for formulating emergency measures. The plotter receives reports of the situation and the details of emergency measures from personnel on board, and plots them on the ship's chart. For example, Patent Document 1 discloses a fire alarm support system that determines signs of a fire based on sensor information obtained from a fire alarm system before a fire alarm is issued, and quickly collects, processes, and displays various information needed to observe the fire. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 11-144165 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the invention of Patent Document 1 displays information based on sensor information, and does not consider displaying information based on verbal reports from users. Currently, plotters are required to process multiple verbal reports simultaneously, which is a cumbersome process and can lead to information leaks and errors.

[0005] The present disclosure has been made in consideration of these circumstances, and aims to provide a plot support system, a ship, a plot support method, and a plot support program that improve work efficiency and reduce the user's parallel work. [Means for solving the problem]

[0006] In order to solve the above problems, the plotting support system, ship, plotting support method, and plotting support program of the present disclosure employ the following means. The plotting support system of the present disclosure comprises a voice input unit that allows a user to input a report on an event that has occurred on a ship by voice and outputs the report as voice data; a voice recognition unit that acquires the voice data from the voice input unit, converts it into text data, and outputs it; a recommendation generation unit that acquires the text data from the voice recognition unit and outputs candidate symbols based on a table that associates the event with a symbol and the text data; and a display unit that acquires the candidate symbols from the recommendation generation unit and displays them.

[0007] The vessel of the present disclosure is equipped with the aforementioned plotting support system.

[0008] The plotting assistance method disclosed herein is executed by a computer and includes a voice input process in which a user inputs a report on an event that occurred on a ship by voice and outputs the input voice as voice data; a voice recognition process in which the voice data is acquired, converted into text data, and output; a recommendation generation process in which the text data is acquired and candidate symbols are output based on a table that associates the event with a symbol and the text data; and an output process in which the candidate symbols are acquired and displayed.

[0009] The plotting support program of the present disclosure causes a computer to execute the plotting support method described above. [Effects of the Invention]

[0010] According to the present disclosure, the series of tasks from converting audio information into symbols can be automated, reducing the user's parallel work of plotting events that occur and are reported continuously, thereby improving the user's work efficiency. [Brief explanation of the drawings]

[0011] [Figure 1]FIG. 1 is a schematic diagram of a plotting assistance system according to some embodiments of the present disclosure. [Figure 2] FIG. 1 is a diagram illustrating an example of a hardware configuration of a plotting support system according to some embodiments of the present disclosure. [Figure 3] FIG. 2 illustrates a control flow of a plotting assistance system in some embodiments of the present disclosure. [Figure 4] FIG. 1 illustrates a table of a plotting assistance system in some embodiments of the present disclosure. [Figure 5] FIG. 1 illustrates an example of a symbol in accordance with some embodiments of the present disclosure. [Figure 6] FIG. 1 illustrates a boat diagram of a plotting assistance system in some embodiments of the present disclosure. [Figure 7] FIG. 10 illustrates a pop-up of a plotting assistance system in some embodiments of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, an embodiment of a plotting support system, a ship, a plotting support method, and a plotting support program according to the present disclosure will be described with reference to the drawings. FIG. 1 is a schematic diagram of a plotting assistance system according to some embodiments of the present disclosure. As shown in FIG. 1, the plotting support system 1 includes a voice recognition server (voice recognition unit) 10, a recommendation generation server (recommendation generation unit) 20, a display unit 31, an in-house network 40, and voice input units 51, 52, and 53.

[0013] The voice input units 51, 52, and 53 are used to input the contents of an oral report by voice when a user reports an event that has occurred on the ship to a plotting officer in the command compartment 30. Specifically, the voice input units 51, 52, and 53 are devices such as a smartphone or an onboard telephone.

[0014] The local network 40 is a network for communication installed on board the ship. The local network 40 transmits and receives analog data such as voice data 11 and digital data such as text data 12. The local network 40 is equipped with a telephone exchange 41, and voices input from voice input units 51, 52, and 53 are output and transmitted as voice data 11 to the voice recognition server 10 and display unit 31.

[0015] The speech recognition server 10 performs speech recognition on the speech data 11 input from the speech input units 51, 52, and 53, converts it into text data 12, and outputs it. The text data 12 generated by the speech recognition server 10 is output and transmitted to the recommendation generation server 20 and the display unit 31 via the local area network 40.

[0016] The recommendation generation server 20 analyzes the text data 12 input from the speech recognition server 10 and outputs symbol candidates as plot recommendation data 21 based on the text data 12 and a table that associates pre-registered events with symbols. The plot recommendation data 21 generated by the recommendation generation server 20 is output and transmitted to the display unit 31 via the local network 40. In addition to symbols, the plot recommendation data 21 may also include the location (position) where the event is occurring and the corresponding position on a hull diagram. A hull diagram 60, described below, is a map showing an overview of a ship, for example, a diagram showing the facilities and equipment on board the ship when viewed from above. The plot recommendation data 21 may also include the names and job titles of personnel related to the event in the event situation.

[0017] A display unit 31 installed in the command section 30 displays voice data 11 input through voice input units 51, 52, and 53, text data 12 converted by the voice recognition server 10, and plot recommendation data 21 generated by the recommendation generation server 20. The display unit 31 is, for example, a console.

[0018] FIG. 2 is a diagram illustrating an example of a hardware configuration of a plotting support system according to some embodiments of the present disclosure. 2, the speech recognition server 10 and the recommendation generation server 20 of the plotting support system 1 are computer systems that include, for example, a CPU (Central Processing Unit: processor) 1100, a secondary storage device (ROM, Secondary storage: memory) 1200, a main storage device (RAM, Main Memory) 1300, a hard disk drive (HDD) 1400 as a large-capacity storage device, and a communication unit 1500 for connecting to a network or the like. Note that a solid-state drive (SSD) may also be used as the large-capacity storage device. These units are connected via a bus 1800.

[0019] The CPU 1100 controls the entire speech recognition server 10 or the recommendation generation server 20 using, for example, an operating system (OS) stored in a secondary storage device 1200 connected via a bus 1800, and executes various processes by executing various programs stored in the secondary storage device 1200. One or more CPUs 1100 may be provided, and may implement processes in cooperation with each other.

[0020] The main memory device 1300 is composed of writable memory such as cache memory, RAM (Random Access Memory), etc., and is used as a working area for reading out programs executed by the CPU 1100 and writing data processed by the programs.

[0021] The secondary storage device 1200 is a non-transitory computer-readable storage medium. Examples of the secondary storage device 1200 include a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, and a semiconductor memory. Examples of the secondary storage device 1200 include a read-only memory (ROM), a hard disk drive (HDD), and a solid-state drive (SSD) flash memory. The secondary storage device 1200 stores, for example, an operating system (OS) for controlling the entire information processing device, such as Windows (registered trademark), iOS (registered trademark), or Android (registered trademark), a basic input / output system (BIOS), various device drivers for operating peripheral devices, various application software, and various data and files. The secondary storage device 1200 also stores programs for implementing various processes and various data required for implementing the various processes. A plurality of secondary storage devices 1200 may be provided, and the above-described programs and data may be stored separately in each secondary storage device 1200.

[0022] The speech recognition server 10 and the recommendation generation server 20 may also include an input unit such as a keyboard or a mouse, a display unit such as a liquid crystal display for displaying data, etc. They may also include a notification unit such as a speaker that includes a display unit and outputs a lamp, sound, especially an alarm sound.

[0023] A series of processes for realizing the functions of the speech recognition server 10 and the recommendation generation server 20 is stored in the secondary storage device 1200 or the like in the form of a program, for example, and the CPU (processor) 1100 reads this program into the main storage device 1300 and executes information processing and arithmetic processing to realize various functions. Note that the program may be pre-installed in the secondary storage device 1200, provided in a state stored in another non-transitory computer-readable storage medium, or distributed via wired or wireless communication means. Examples of non-transitory computer-readable storage media include magnetic disks, magneto-optical disks, CD-ROMs, DVD-ROMs, and semiconductor memories.

[0024] 3 is a diagram showing a control flow of a plotting support system in some embodiments of the present disclosure. In the embodiment of the present disclosure, a series of processes from an oral report in the event of a fire occurring in an office of a ship to plotting on a ship diagram 60 will be described. Note that in the present disclosure, the occurrence of a fire in an office is one example, and other events may also be used.

[0025] When the user recognizes that a fire has broken out in an office on board the ship, in step S301 the user uses the voice input unit 52 to call the plotting officer in the command compartment 30. Using the voice input unit 52, the user makes an oral report to the plotting officer by saying, "Fire has broken out in the office." It is desirable that the terms used in the user's speech conform to predetermined terminology rules. Language processing may be performed to resolve ambiguity in the terms. The voice data 11 of the user's oral report is sent to the voice recognition server 10 in parallel with the display unit 31 of the plotting officer via the telephone exchange 41 of the local area network 40.

[0026] Next, in step S302, the speech recognition server 10 converts the speech data 11 into text data 12, "Fire in the office." The converted text data 12 is sent to the display unit 31 via the local network 40 (transition to S303), and also to the recommendation generation server 20 (transition to S304).

[0027] In step S303, the display unit 31 displays the text data 12 "Fire breaks out in the office" on the screen.

[0028] Meanwhile, in step S304, the recommendation generation server 20 extracts text data 12 corresponding to the situation of the event and the location of the event from the text data 12 of "Fire breaks out in the office." A table associating events with symbols is collated based on the text data 12 of "Fire breaks out in the office."

[0029] FIG. 4 is a diagram illustrating a table of a plotting assistance system according to some embodiments of the present disclosure. As shown in FIG. 4, the table associates a pronunciation dictionary with a plot control. The pronunciation dictionary associates pronunciations with their spellings and registers them as a dictionary. The plot control associates the word category (category) of a term registered in the pronunciation dictionary with a section number if the word category is a section (place of occurrence). Furthermore, if the word category is an event or a person's name, the plot control associates a symbol with an operation for that symbol. In the present disclosure, two types of symbols and operations can be registered for one word, but one type or three or more types may also be registered.

[0030] The item "operation" in the table of FIG. 4 is set to "ADD," "REMOVE," and "BUFF." "ADD (section, symbol, symbol...)" means, for example, adding a symbol to a section. "REMOVE(compartment, symbol, symbol...)" means, for example, to remove a symbol from a compartment. "BUFF (section, symbol, type)" means, for example, temporarily storing a symbol in the buffer area of ​​a section. Here, "type" indicates information such as personnel name, job title, and material name. These "types" may have further classified tables. The number of these arguments is not limited to the above, and it is sufficient that one or more arguments are set.

[0031] In the case of the text data 12 of the present disclosure, "Office Fire", the word "office" is matched with the word category "section" and section number "2F03". Also, the word "fire" is matched with the word category "event", symbol 1 "F01", and operation 1 "ADD". In other words, the matching result with the table of the text data 12, "(2F03)(F01,ADD)", is output.

[0032] 3, the recommendation generation server 20 generates symbol candidates. Based on the matching result, the recommendation generation server 20 outputs plot recommendation data 21 such as "ADD (2F03, F01)," i.e., "add symbol F01 to section 2F03."

[0033] FIG. 5 is a diagram illustrating an example of a symbol according to some embodiments of the present disclosure. As shown in FIG. 5, the symbols displayed on the ship diagram 60 are associated with numbers corresponding to the symbols in the table shown in FIG. 4 and with the meanings of the symbols. The symbols displayed on the ship diagram 60 correspond to events and have shapes that allow the user to intuitively understand the content when they see it.

[0034] Furthermore, if the display unit 31 is capable of displaying in color, the display may be differentiated by color. For example, red or reddish colors may be used for events related to fire or temperature rise, such as a fire, and blue or blued colors may be used for events related to water or cooling, such as flooding, water spraying, or bulkhead cooling.

[0035] Furthermore, the number corresponding to the symbol may include additional information. For example, the number corresponding to the symbol for "pipe system damage" is "P01**." Numbers or letters are used in place of the "**." As shown in FIG. 4, "PW" indicates "fresh water," and "FW" indicates "fire extinguishing seawater." When the symbol for "pipe system damage" is displayed, additional information such as "fresh water" or "fire extinguishing seawater" may also be displayed near the symbol.

[0036] In step S305 of Figure 3, the recommendation generation server 20 generates a symbol corresponding to "fire outbreak" (see Figure 5) from the matching result "(2F03)(F01,ADD)" corresponding to the text data 12 for "fire outbreak in office," and outputs it to the display unit 31 via the in-house network 40 so that it is displayed at a position corresponding to the office on the ship diagram 60.

[0037] FIG. 6 is a diagram illustrating a boat diagram of a plotting assistance system in some embodiments of the present disclosure. As shown in FIG. 6, a ship diagram 60 is a map showing an outline of a ship, and shows, for example, the various facilities and equipment on board the ship when viewed from above.

[0038] The ship diagram 60 shows the boundaries of each compartment, and also displays symbols for the equipment and the events that have occurred. For example, the symbols corresponding to the events shown in Figure 5 are a fire plot 61, a flooding plot 62, a team leader plot 63, a piping failure plot 64, a water spray plot 65, and a bulkhead cooling plot 66. The piping failure plot 64 is displayed with a symbol associated with the number "P01PW" that corresponds to the symbol in the table shown in Figure 4, and additional information, with "fresh water" displayed near the symbol for "piping failure."

[0039] In step S306 of Fig. 3, the display unit 31 flashes a symbol corresponding to "fire" (see Fig. 5) in the position (section) corresponding to the office on the ship diagram 60. By flashing the symbol, the plotting staff can recognize that a new symbol has been plotted and can also recognize that the flashing symbol is not confirmed information.

[0040] In step S307, the plotter touches the blinking symbol. If the display unit 31 is not a touch panel as an input means but is a display that does not accept touch input, the symbol is selected using an input device (input means) such as a mouse click or keyboard input.

[0041] In step S308, the display unit 31 displays a pop-up asking whether or not to adopt the symbol candidate. FIG. 7 is a diagram illustrating a pop-up of a plotting assistance system according to some embodiments of the present disclosure.

[0042] As shown in Figure 7, the display unit 31 displays on a pop-up screen the text data 12 "Fire in the office" generated by the speech recognition server 10 through speech recognition of the speech data 11, and the plot recommendation data 21 (plot position and plot symbol) generated by the recommendation generation server 20.

[0043] The plotter checks the symbol flashing on the ship diagram 60 and the information displayed on the pop-up screen, and if the symbol candidate and its display position are acceptable, touches (presses) the "Accept" button. In this case, the process proceeds to step S309.

[0044] On the other hand, if the symbol candidate and its display position are not acceptable, the "Reject" button is touched (pressed), in which case the process proceeds to step S310.

[0045] If the plotter is unable to determine whether or not to accept the proposal based solely on the text information displayed on the pop-up screen, he or she can touch (press) the "Audio" button and check the audio data 11 spoken by the user using the audio input unit 52 as supplementary information.

[0046] When the "Adopt" button is touched (pressed) in step S308, the symbol that was flashing on the ship shape diagram 60 is considered to be confirmed, and the symbol is changed to a constantly lit display (confirmed display), and becomes confirmed information (S309).

[0047] On the other hand, if the "Reject" button is touched (pressed) in step S308, the symbol that was flashing on the ship diagram 60 is deemed to have been rejected and is deleted from the section (S310).

[0048] Furthermore, if the text data 12 is "machine room watering stopped," the word category "section" and section number "2D01" are matched with the word "machine room." Furthermore, the word category "event," symbol 1 "W01," and operation 1 "REMOVE" are matched with the word "watering stopped." In other words, the matching result "(2D01)(W01, REMOVE)" with the table of the text data 12 is output.

[0049] In this case, the symbol corresponding to "water sprinkler" (see Figure 5), which is already displayed in the position corresponding to the machinery room on the ship diagram 60, is made to flash. When the plotter touches the flashing symbol, a pop-up appears asking whether or not to delete the symbol, and when the "Delete" button is touched, the symbol that was flashing on the ship diagram 60 is deleted, as it is considered to have been deleted.

[0050] Furthermore, if the text data 12 is "Rear aisle NM team leader arrives," the word segment "section" and the section number "2F02" are matched with the word "rear aisle." Furthermore, the word segment "person's name," symbol 1 "CR01," and operation 1 "BUFF(CREW[])" are matched with the word "NM team leader." Furthermore, the word segment "event," symbol 1 "CREW[]," and operation 1 "ADD" are matched with the word "arrival." In other words, the matching result of the text data 12 with the table, "(2F02)(CR01,BUFF(CREW[]))(CREW[],ADD)," is output.

[0051] In this case, the symbol corresponding to the "NM Team Leader" (see Figure 5), which is temporarily stored in the buffer area, is displayed in a flashing manner in the position corresponding to the rear aisle on the ship diagram 60. When the plotter touches the flashing symbol, a pop-up appears asking whether or not to adopt the symbol. When the "Adopt" button is touched, the symbol that was flashing on the ship diagram 60 is considered to have been confirmed, and the symbol is changed to a constantly lit display, becoming the confirmed information.

[0052] <Additional Notes> The plotting support system, ship, plotting support method, and plotting support program described in the above-described embodiments can be understood, for example, as follows.

[0053] A plotting support system (1) of a first aspect of the present disclosure includes a voice input unit (51, 52, 53) that allows a user to input a report on an event occurring on a ship by voice and outputs the report as voice data (11); a voice recognition unit (10) that acquires the voice data from the voice input unit, converts it into text data (12), and outputs it; a recommendation generation unit (20) that acquires the text data from the voice recognition unit and outputs candidate symbols based on a table that associates the event with a symbol and the text data; and a display unit (31) that acquires the candidate symbols from the recommendation generation unit and displays them.

[0054] The system automates the entire process of converting voice information into symbols by outputting candidate symbols based on reports of events occurring on board a ship, thereby reducing the parallel work required by users to plot events that occur and are reported consecutively, thereby improving user work efficiency.

[0055] In the plotting support system of the second aspect of the present disclosure, in the first aspect, the audio data may include the status of an event that occurred on the ship and the location where the event occurred.

[0056] Since the voice data includes the location of the event that occurred on the ship in addition to the situation of the event, the user can obtain detailed text data and symbol candidates for the event that occurred.

[0057] In the plotting support system of the third aspect of the present disclosure, in the second aspect, the table may have data that respectively associates the situation of the event with a symbol, and the location of the event with a position on a ship diagram (60), and the recommendation generation unit may extract information on the situation of the event and the location of the event from the text data, and based on the table, output candidate symbols corresponding to the situation of the event at the position on the ship diagram corresponding to the extracted location of the event.

[0058] Users can recognize the situation of an incident that occurred on a ship along with the location of the incident, and can obtain complex information in an easy-to-understand manner.

[0059] In a fourth aspect of the plotting support system of the present disclosure, in any one of the first to third aspects, the display unit may acquire the text data from the voice input unit and display the text data in association with the symbol candidates.

[0060] By displaying the symbol candidates in association with the text data, the user can check the consistency between the text data and the symbol candidates, and can avoid the need to convert voice data into text.

[0061] In the plotting support system of the fifth aspect of the present disclosure, in the first to fourth aspects, the display unit may be provided with an input means, display the symbol candidates, and when the symbol candidate is adopted via the input means, switch the display of the symbol to a confirmed display.

[0062] The accuracy of the plotting work can be improved because the user checks whether the symbol candidates are appropriate and then confirms the display of the symbol if he / she decides to adopt it.

[0063] A vessel according to a sixth aspect of the present disclosure includes the plotting support system according to any one of the first to fifth aspects.

[0064] A plotting assistance method according to a seventh aspect of the present disclosure is executed by a computer and includes a voice input process in which a user inputs a report on an event occurring on a ship by voice and outputs the input voice as voice data; a voice recognition process in which the voice data is acquired, converted into text data, and output; a recommendation generation process in which the text data is acquired and candidate symbols are output based on a table that associates the event with a symbol and the text data; and an output process in which the candidate symbols are acquired and displayed.

[0065] A plotting support program according to an eighth aspect of the present disclosure causes a computer to execute the plotting support method according to the seventh aspect.

[0066] The plotting support system, ship, plotting support method, and plotting support program of the present disclosure have been described above using embodiments, but the technical scope of the present disclosure is not limited to the scope described in the above embodiments. For example, the display unit 31 displays the text data 12 converted from the audio data 11. In this case, the recommendation generation server 20 may highlight the extracted text by highlighting it or by displaying it in bold. [Explanation of symbols]

[0067] 1. Plot Support System 10. Speech recognition unit (speech recognition server) 11 Audio data 12 Text Data 20 Recommendation generation unit (recommendation generation server) 21 Plot Recommendation Data 30 Command Section 31 Display section 40 In-house network 41 Telephone exchange 51, 52, 53 Audio input section 60 Ship shape diagram 61 Fire Plot 62 Flooded plots 63 Squad Leader Plot 64 Pipeline Failure Plot 65 Watering Plot 66 Bulkhead Cooling Plot 1100 CPU 1200 Secondary storage 1300 Main storage 1500 Communications Department 1800 Bus

Claims

1. a voice input unit that allows a user to input a report on an event that has occurred on the ship by voice and outputs the report as voice data; a voice recognition unit that acquires the voice data from the voice input unit, converts the voice data into text data, and outputs the text data; a recommendation generation unit that acquires the text data from the speech recognition unit, and outputs candidates for the symbols based on a table that associates the events with symbols and the text data; a display unit that acquires the symbol candidates from the recommendation generation unit and displays them; A plot support system comprising:

2. The plotting support system according to claim 1 , wherein the audio data includes a situation of an event that occurred on the vessel and a location where the event occurred.

3. The table has data that respectively associates the status of the event with a symbol, and the location of the event with a position on a ship diagram, The plotting support system according to claim 2, wherein the recommendation generation unit extracts information on the situation of the event and the location where the event occurred from the text data, and outputs, based on the table, candidate symbols corresponding to the situation of the event at positions on the ship diagram corresponding to the extracted locations where the event occurred.

4. The plotting support system according to claim 1 , wherein the display unit acquires the text data from the voice recognition unit, and displays the text data in association with the symbol candidates.

5. the display unit includes an input means, 2. The plotting support system according to claim 1, wherein the symbol candidates are displayed, and when the symbol candidate is adopted via the input means, the display of the symbol is switched to a confirmed display.

6. A vessel comprising the plotting support system of claim 1.

7. The user can enter a report of an incident that occurred on board the vessel by voice, a voice input step of outputting the input voice as voice data; a speech recognition step of acquiring the speech data, converting it into text data, and outputting the text data; a recommendation generating step of acquiring the text data and outputting symbol candidates based on a table associating the events with symbols and the text data; an output step of acquiring and displaying the symbol candidates; A computer-implemented plotting assistance method comprising:

8. A plotting support program for causing a computer to execute the plotting support method according to claim 7.

Images