Electronic device and method for outputting vessel education content as three-dimensional image

Abstract

Provided are an electronic device and method for outputting vessel education content according to one embodiment of the present invention, wherein the electronic device may comprise a display, a sensor module for sensing a user input, and a processor configured to: when an execution request of an application for outputting vessel education content is received, control the display to display a basic screen on a 360-degree 3D image of a predetermined type of vessel; when the user input indicates a transparency setting of the 3D image, apply transparency of a value corresponding to the user input to the 3D image; control the display to display a plurality of preset viewpoints on the image to which the transparency is applied; as the user input indicates selection of a first viewpoint among the plurality of viewpoints, control the display to enlarge and display a portion of the 3D image corresponding to a first structure related to the first viewpoint; generate a first storyboard including a first description related to the first structure; and convert the first description into data in a designated form and output the data to the outside. Various other embodiments may be possible.

Description

Electronic device and method for outputting ship training content as a three-dimensional image

[0001] The present invention relates to an electronic device and method for outputting ship training content as a three-dimensional image.

[0002] In general, ship-related personnel perform various maintenance, structural inspections, and maintenance during the ship's entry, departure, and anchoring stages, so they must continuously learn about ship design and structure.

[0003] Meanwhile, since ships are manufactured in units ranging from a few tons to hundreds of thousands of tons (or more), it may be physically or time-consuming for ship-related personnel to visit the ship in person each time and learn the overall design / structure of the ship in detail.

[0004] Accordingly, the present invention aims to provide an electronic device and method for learning the design / structure of a ship based on virtual reality, identifying and displaying viewpoints according to a user's viewpoint or a selected point, learning a previously generated storyboard to create a new storyboard for the viewpoints, and outputting ship education content of the generated storyboard using voice or a chatbot.

[0005] In order to solve the above-described problem, an electronic device for outputting ship education content according to an embodiment of the present invention may include a display, a sensor module for detecting a user's input, and a processor for controlling the display to display a basic screen on a 360-degree 3D image of a pre-designated type of ship when an execution request for an application for outputting ship education content is received, applying transparency of a value corresponding to the user's input to the 3D image when the user's input indicates a transparency setting of the 3D image, controlling the display to display a plurality of pre-designated viewpoints on the image to which the transparency is applied, controlling the display to enlarge and display a portion corresponding to a first structure related to the first viewpoint in the 3D image when the user's input indicates a selection of a first viewpoint among the plurality of viewpoints, generating a first storyboard including a first description related to the first structure, and converting the first description into data of a designated form and outputting the same to the outside.

[0006] According to an embodiment of the present invention, a method for outputting ship education content in an electronic device may include, when an execution request for an application for outputting ship education content is received, an operation of displaying a basic screen on a 360-degree 3D image of a pre-specified type of ship; an operation of applying transparency of a value corresponding to the user's input to the 3D image when the user's input indicates a transparency setting of the 3D image, and displaying a plurality of pre-specified viewpoints on the image to which the transparency is applied; an operation of displaying a portion corresponding to a first structure related to the first viewpoint in the 3D image by enlarging it when the user's input indicates selection of a first viewpoint from among the plurality of viewpoints; and an operation of generating a first storyboard including a first description related to the first structure, converting the first description into data of a specified form, and outputting the same to the outside.

[0007] The electronic device and method for outputting ship education content as a three-dimensional image according to the present invention have the effect of enabling one to conveniently learn about the design and specific structure of a ship anytime and anywhere using an electronic device without having to visit the ship in person.

[0008] In addition, the present invention has the effect of enabling learning for multiple viewpoints with a single storyboard without the need to check multiple storyboards for multiple viewpoints by learning storyboards for multiple viewpoints to derive common keywords or associations and using the derived information to create and output a new storyboard.

[0009] In addition, the present invention has the effect of enabling users to comfortably and friendly learn ship education content by outputting a chatbot and setting an avatar to make it user-friendly and outputting ship education content through the avatar of the chatbot.

[0010] The effects of the present invention are not limited thereto, and various effects will be described in detail below with reference to each embodiment.

[0011] FIG. 1 is a drawing illustrating an electronic device and a screen configuration displayed on the electronic device according to one embodiment of the present invention.

[0012] FIG. 2 is a block diagram illustrating an electronic device configuration according to one embodiment of the present invention.

[0013] FIG. 3 is a diagram illustrating the basic screen configuration of a ship training application according to one embodiment of the present invention.

[0014] FIG. 4 is a drawing illustrating a side view of a ship displayed on a basic screen of a ship training application according to one embodiment of the present invention.

[0015] FIG. 5 is a drawing illustrating a display of a ship with transparency set on the main screen of a ship training application according to one embodiment of the present invention.

[0016] FIG. 6 is a drawing illustrating a display of a ship with transparency set on the main screen of a ship training application according to one embodiment of the present invention.

[0017] FIG. 7 is a diagram illustrating a screen configuration of a ship training application in which ship scenarios and viewpoints are displayed in ship training content according to one embodiment of the present invention.

[0018] FIG. 8 is a diagram illustrating a screen configuration that displays a storyboard of a related structure when a specific viewpoint is selected in a ship training application according to one embodiment of the present invention.

[0019] FIG. 9 is a diagram illustrating a screen configuration for outputting ship training content using a chatbot in a ship training application according to one embodiment of the present invention.

[0020] FIG. 10 is a drawing illustrating a screen configuration of a structure selection menu for selecting a specific structure displayed in a ship training application according to one embodiment of the present invention.

[0021] FIG. 11 is a flowchart illustrating an operation of outputting ship training content in an electronic device according to one embodiment of the present invention.

[0022] The technology described below is susceptible to various modifications and embodiments. Specific embodiments are illustrated in the drawings and described in detail. However, it should be understood that all modifications, equivalents, and alternatives fall within the spirit and scope of the technology described below.

[0023] Terms such as first, second, A, B, etc. may be used to describe various components, but these components are not limited by these terms and are only used to distinguish one component from another. For example, without departing from the scope of the technology described below, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. The term and / or includes a combination of multiple related described items or any of multiple related described items. For example, 'A and / or B' may be interpreted to mean 'at least one of A or B'. Additionally, ' / ' may be interpreted as 'and' or 'or'.

[0024] In the present specification, the singular expressions should be understood to include the plural expressions unless the context clearly dictates otherwise, and the term "comprises" and the like should be understood to mean the presence of a feature, number, step, operation, component, part, or combination thereof, but not to exclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0025] Before going into a detailed description of the drawings, it should be made clear that the division of components in this specification is merely a division based on the main function of each component. In other words, two or more components described below may be combined into a single component, or a single component may be further subdivided into two or more components with more detailed functions. In addition to its own main function, each component described below may additionally perform some or all of the functions of other components, and of course, some of the main functions of each component may be exclusively performed by other components.

[0026] Additionally, in performing a method or method of operation, each process constituting the method may occur in a different order than the stated order, unless the context clearly indicates a specific order. That is, each process may occur in the same order as the stated order, may be performed substantially simultaneously, or may be performed in the opposite order.

[0027] A vessel according to one embodiment of the present invention can be divided into a bow section, an engine room, a central section, and a stern section, and of course, can be further divided according to various other criteria.

[0028] According to one embodiment of the present invention, a ship training application can output ship training content for a pre-specified type of ship upon execution. For example, the ship training application may include functions for displaying images of specific ships according to transparency, zooming in / out on specific structures, or providing descriptions of specific viewpoints or structures.

[0029] Ship training content according to one embodiment of the present invention may include information related to the ship, such as the structure, exterior appearance, and location of the internal structure of the ship.

[0030] FIG. 1 is a drawing illustrating an electronic device and a screen configuration displayed on the electronic device according to one embodiment of the present invention.

[0031] Referring to FIG. 1, the electronic device (101) may be a head mounted display (HMD) device worn on the face in the form of glasses. For example, the electronic device (101) may output a 3D (three dimensional) screen (200) based on VR (virtual reality) / AR (augmented reality).

[0032] According to one embodiment of the present invention, the electronic device (101) displays ship training content on the 3D screen (200), provides a navigation function through the 3D screen (200), and can display the structure of the interior of the ship by setting the transparency to high or low. In addition, the electronic device (101) can communicate with an external control device (102) to display the control device (102), and control the display of the ship training content according to the movement of the control device (102).

[0033] According to one embodiment of the present invention, the 3D screen (200) is a 360-degree image generated in the shape of a sphere, and depending on the movement of the electronic device (101), an image of a certain area around a point (hereinafter, a view point) viewed by the display (120) of the electronic device (101) among the entire area of ​​the 360-degree image can be displayed through the display (120).

[0034] According to one embodiment of the present invention, the viewpoint may be automatically set to a point that the user is looking at based on the movement of the user wearing the electronic device (101), or a specific viewpoint may be set based on the user's selection when pre-designated viewpoints are displayed in the ship training application.

[0035] FIG. 2 is a block diagram illustrating an electronic device configuration according to one embodiment of the present invention.

[0036] Referring to FIG. 2, the electronic device (101) may include a processor (110), a display (120), a communication module (130), a sensor module (140), and a memory (150).

[0037] According to one embodiment of the present invention, the processor (110) can control the operation of the overall electronic device (101) to display and control ship training content.

[0038] According to one embodiment of the present invention, the processor (110) can learn ship training content based on artificial intelligence (AI). For example, the processor (110) can learn scenarios (or storyboards) for each viewpoint or structure selected by the user, derive correlations between the scenarios, and generate new scenarios for multiple viewpoints or structures.

[0039] According to one embodiment of the present invention, the display (120) can output ship training content implemented as a 360-degree image as image data. In addition, the electronic device (101) can further include various input / output devices (e.g., speakers, microphones, vibration sensors) (not shown) to output ship training content as various types of data (e.g., voice data, vibration data).

[0040] According to one embodiment of the present invention, the communication module (130) can communicate with various external control devices (102) and external servers through various wireless communications (e.g., short-range communication, cellular network). For example, the control device (102) may be various electronic devices such as a joystick, a mouse, a keyboard, etc. for selecting a function of ship training content displayed on the display (120) and controlling the display, a device such as a (Bluetooth) speaker for outputting ship training content as voice data, or a device such as a microphone for receiving voice data.

[0041] According to one embodiment of the present invention, although the control device (102) has been described as being connected to the electronic device (101) through a communication connection from outside the electronic device (101), it may be configured to be included in the electronic device (101) as an internal component of the electronic device (101).

[0042] According to one embodiment of the present invention, the communication module (130) can communicate with an external server to receive information on a new ship type or ship training content or receive update information related to previously stored ship training content.

[0043] According to one embodiment of the present invention, the sensor module (140) may include various sensors for detecting user movement or gesture input, such as a touch sensor, an (actual) velocity sensor, a gesture sensor, and a proximity sensor. For example, the sensor module (140) may be included in the display (120) or disposed adjacent to the display (120) to detect a gesture input (e.g., touch, gesture, tap, drag) input from the user.

[0044] According to one embodiment of the present invention, the memory (150) can store ship training content. For example, the ship training content may be stored according to ship type (e.g., cruise ship or cargo ship) and may include the structure of the ship and scenarios for each structure, depending on the ship type. Furthermore, previously stored ship training content may be updated or modified and stored based on updates received from outside sources.

[0045] According to one embodiment of the present invention, the processor (110) can control the display (120) so that the display of the ship training content is controlled according to input from the control device (102) or the sensor module (150) received from the outside through the communication module (130).

[0046] FIG. 3 is a diagram illustrating the basic screen configuration of a ship training application according to one embodiment of the present invention.

[0047] Referring to FIG. 3, when a ship education application is executed in an electronic device (101), a basic screen (300) may be displayed. For example, the basic screen (300) may display a transparency setting button (310) for setting the transparency of an image of a ship (301) displayed in the basic screen (300), a viewpoint button (320) for indicating a viewpoint in an area of ​​the ship (301) displayed in the basic screen (300), a structure selection button (330) for selecting a specific structure of the ship, a drawing button (340) for outputting a drawing for the selected specific viewpoint or structure, a scenario button (350) for outputting a description of the specific structure, and an end button (360) for terminating execution of the ship education application.

[0048] According to one embodiment of the present invention, the image of the ship (301) is an image showing the actual appearance of a ship corresponding to a specified type (e.g., cruise) or model name, and may be changed to an image of a ship corresponding to various types or specific model names according to the user's settings.

[0049] According to one embodiment of the present invention, when a user's gesture input (e.g., drag) is detected through the sensor module (140), the electronic device (101) can control the ship (301) to be displayed by rotating, enlarging / reducing, or moving in response to the movement direction, speed, or distance of the detected gesture input.

[0050] FIG. 4 is a drawing illustrating a side view of a ship displayed on a basic screen of a ship training application according to one embodiment of the present invention.

[0051] Referring to FIG. 4, the electronic device (101) can display a side image of a ship (301) through the main screen (300) of the ship training application.

[0052] According to one embodiment of the present invention, the structure of a ship (301) viewed from the side can be divided into a bow section (331), an engine room (332), a center section (333), and a stern section (334). For example, the structure selection button (330) of the basic screen (300) includes detailed buttons corresponding to each structure, and when a specific detailed button is selected by the user, the electronic device (101) can display the structure corresponding to the detailed button and enlarge the structure.

[0053] According to one embodiment of the present invention, the viewpoint button (320) of the basic screen (300) may include a viewpoint display button (321) for displaying preset viewpoints in a specific area of ​​a ship (301) currently displayed on the basic screen (300) and a viewpoint removal button (322) for preventing the displayed viewpoints from being displayed.

[0054] FIG. 5 is a drawing illustrating a display of a ship with transparency set on the main screen of a ship training application according to one embodiment of the present invention.

[0055] Referring to FIG. 5, when the transparency setting button (310) is selected through the main screen (300) of the ship training application, the electronic device (101) can display the image of the ship (301) with the specified transparency applied.

[0056] According to one embodiment of the present invention, the transparency setting button (310) may include a minimum transparency button (311) that displays the image as an original image with low transparency (e.g., 0 to 10%), a medium transparency button (312) that displays the image in a semi-transparent state with medium transparency (e.g., 30 to 50%), and a maximum transparency button (313) that displays the image in a fully transparent state with high transparency (e.g., 80 to 100%).

[0057] According to one embodiment of the present invention, when a ship (301) is displayed in a semi-transparent state as in the basic screen (300) illustrated in FIG. 4, if the minimum transparency button (311) is selected, the image of the original ship (301) set to 0% transparency may be converted and displayed.

[0058] FIG. 6 is a drawing illustrating a display of a ship with transparency set on the main screen of a ship training application according to one embodiment of the present invention.

[0059] Referring to FIG. 6, when the intermediate transparency button (312) is selected on the main screen (300) of the ship education application, the electronic device (101) can control the image of the ship (301) to be displayed with a predetermined transparency (e.g., 40%) set. Accordingly, the ship (301) can be displayed through the ship education application so that the existing brown structure is displayed in a semi-transparent state, allowing the internal structure to be visible.

[0060] FIG. 7 is a diagram illustrating a screen configuration of a ship training application in which ship scenarios and viewpoints are displayed in ship training content according to one embodiment of the present invention.

[0061] Referring to FIG. 7, when a specific structure is selected through a ship training application in an electronic device (101), and the viewpoint display button (321) and the drawing button (340) are selected, a first drawing (3310) related to the selected structure and a preset viewpoint (3311) in the structure shown in the first drawing (3310) can be displayed on the basic screen (300) in a new window.

[0062] According to one embodiment of the present invention, when a user selects a viewpoint (3311) shown in the first drawing (3310), the electronic device (101) can display an animation moving to a structure of a ship (301) corresponding to the selected viewpoint (3311) and ship education content related to the moved structure.

[0063] FIG. 8 is a diagram illustrating a screen configuration that displays a storyboard of a related structure when a specific viewpoint is selected in a ship training application according to one embodiment of the present invention.

[0064] Referring to FIG. 8, when the bow section (331) button among the structure selection buttons (330) of the basic screen (300) is selected while the first drawing (3310) is displayed through the ship education application, the electronic device (101) can control the display (120) to display a storyboard (3310) including information on the bow section (331). For example, the electronic device (101) can further display images of the corresponding structure taken from various angles on the storyboard (3310), a description of the images, and a voice description button (3312) for outputting the description in voice. The information on the bow section (331) included in the storyboard (3310) can include a drawing, related image data, or text data for description.

[0065] According to one embodiment of the present invention, when the voice description button (3312) is selected through the ship education application, the electronic device (101) can output the ship education content included in the storyboard (3310) as voice data. For example, the electronic device (101) can convert the description related to the ship education content into voice data and output it through an internal input / output device (e.g., a speaker) or an external control device (e.g., a Bluetooth speaker).

[0066] According to one embodiment of the present invention, the electronic device (101) may display the base screen (300) by overlapping it with the storyboard (3310) in order to select another structure, set transparency, or output a description while the storyboard (3310) is being displayed. For example, the electronic device (101) may control the base screen (300) to be displayed by overlapping it with the screen of the ship training application currently being displayed when a preset input (e.g., double tap, drag) is received.

[0067] According to one embodiment of the present invention, in an electronic device (101), when a specific button (e.g., minimum transparency button (311)) of the basic screen (300) is selected while the basic screen (300) is displayed overlappingly on the screen of a ship training application, the image of the ship (301) can be changed and displayed according to the setting corresponding to the selected button (e.g., setting transparency to minimum (e.g., 0 to 10%)).

[0068] According to one embodiment of the present invention, the electronic device (101) can output ship training content for at least two storyboards. For example, if it is confirmed that the first drawing (3310) includes at least two viewpoints or other viewpoints related to the first drawing (3310) are confirmed, the electronic device (101) can merge storyboards for the confirmed viewpoints based on AI.

[0069] According to one embodiment of the present invention, if the electronic device (101) confirms that the confirmed viewpoints are the 'forecastle deck' and the 'forecastle deck plate' of the bow section (310) of the ship (301), respectively, the electronic device (101) can perform AI learning on the storyboards of each of the 'forecastle deck' and the 'forecastle deck plate' to derive common keywords and correlations. For example, the electronic device (101) can confirm the common keyword as the 'fore end construction of the bow section (310)' structure as the derived result, and confirm that it is installed on the upper part of the forecastle deck as a correlation.

[0070] According to one embodiment of the present invention, when viewpoints for the 'forecastle deck' and the 'forecastle deck plate' are selected, the electronic device (101) may generate and output a new storyboard based on the derived common keywords and associations instead of outputting a storyboard for each structure. For example, the newly generated storyboard may include, as ship education content for the 'forecastle deck' and the 'forecastle deck plate', the following content: "These are structures installed on the forecastle deck of the bow (310) structure, and among these, related equipment of the 'forecastle deck' includes a windlass, a mooring winch, etc., and the lower main compartment is composed of a bosun store, a painting store, and a rope store. In addition, the 'forecastle deck plate' is installed on the upper part of the 'forecastle deck' described above, and a device for reinforcing the lower part of the equipment is further installed for safe operation."

[0071] According to one embodiment of the present invention, the electronic device (101) has been described as generating a storyboard for a plurality of viewpoints based on common keywords and relationships between viewpoints, but may further include various information for describing relationships between viewpoints, such as navigation information describing paths between viewpoints, and information indicating commonalities / differences in materials or structures.

[0072] FIG. 9 is a diagram illustrating a screen configuration for outputting ship training content using a chatbot in a ship training application according to one embodiment of the present invention.

[0073] Referring to FIG. 9, the electronic device (101) displays a basic screen (300) through a ship training application, and when a scenario button (350) of the basic screen (300) is selected, the ship training chatbot (901) can be controlled to be displayed on the basic screen (300).

[0074] According to one embodiment of the present invention, the ship training chatbot (901) may be in the form of an avatar, wearing a sailor, captain, or other designated attire, and various settings related to the avatar, such as the size, attire, race, accent, or language of the avatar, may be changed according to the user's settings.

[0075] According to one embodiment of the present invention, the electronic device (101) can display a second drawing (910) describing a specific viewpoint or structure according to the user's selection on the main screen (300). Thereafter, when the user selects the scenario button (350) on the main screen (300), the electronic device (101) can control the ship training chatbot (901) to be displayed parallel to the second drawing (910).

[0076] According to one embodiment of the present invention, when a ship education chatbot (901) is displayed on an electronic device (101), an explanation of ship education content (e.g., the second drawing (910)) displayed adjacent to the ship education chatbot (901) can be output as voice data. At the same time, the electronic device (101) can control the mouth shape and hand movements of the ship education chatbot (901) to move and display in correspondence with the output voice data, as if the ship education chatbot (901) is speaking the explanation.

[0077] According to one embodiment of the present invention, while the ship training chatbot (901) is displayed, the electronic device (101) can confirm a user's gesture input to the ship training chatbot (901). Thereafter, the electronic device (101) can set the display of the ship training chatbot (901) by enlarging / reducing the size of the ship training chatbot (901) or rotating the ship training chatbot (901) in response to the gesture input.

[0078] FIG. 10 is a drawing illustrating a screen configuration of a structure selection menu for selecting a specific structure displayed in a ship training application according to one embodiment of the present invention.

[0079] Referring to FIG. 10, the electronic device (101) can display a structure selection menu (1000) when a pre-designated input (e.g., scroll) is input while the basic screen (300) is displayed. Thereafter, when the structure selection menu (1000) is selected, a scene selection menu (1010) and a detailed structure selection menu (1020) can be displayed on the basic screen (300).

[0080] According to one embodiment of the present invention, the scene selection menu (1010) may display a menu (1011) for selecting a background and a list (1012) of scenes of specific detailed structures of a ship (301) (e.g., deck type, cabin, stacks, etc.). The backgrounds selectable through the menu (1011) may include open ocean, icebergs, archipelago, etc., and may further include items for selecting various backgrounds.

[0081] According to one embodiment of the present invention, each item of the list (1012) is displayed with a button (1012a) for setting the material, and when the button (1012a) is selected, a list (1012b) of items that can be set as materials for the corresponding item can be displayed.

[0082] FIG. 11 is a flowchart illustrating an operation of outputting ship training content in an electronic device according to one embodiment of the present invention.

[0083] Referring to FIG. 11, in operation S210, when an execution request of an application for outputting ship training content is received, the electronic device (101) can control the display (120) to display a basic screen (300) on a 360-degree 3D image of a pre-specified type of ship.

[0084] According to one embodiment of the present invention, a transparency setting button (310) for setting the transparency, a structure selection button (330) for selecting a specific structure of the ship, a viewpoint button (320) for displaying the plurality of viewpoints on the currently displayed screen, and a scenario button (350) for outputting a description of the selected structure may be displayed on the basic screen (300).

[0085] According to one embodiment of the present invention, the transparency setting button (310) further includes buttons (311-313) for setting the transparency of the 3D image to a minimum value, an intermediate value, or a maximum value, and the electronic device (101) can control the 3D image to be displayed with the transparency set for the selected button applied when a specific button of the transparency setting button (310) is selected.

[0086] In operation S220, if the user's input indicates a transparency setting of the 3D image, the electronic device (101) can apply transparency of a value corresponding to the user's input to the 3D image and control the display (120) so that a plurality of preset viewpoints are displayed on the image to which the transparency is applied.

[0087] According to one embodiment of the present invention, the user's gesture input or movement input can be detected through the sensor module (140) of the electronic device (101) or received from an external control device (102).

[0088] In operation S230, the electronic device (101) can control the display (120) so that a portion corresponding to the first structure related to the first viewpoint among the 3D image is enlarged and displayed as the user's input indicates selection of the first viewpoint among the plurality of viewpoints.

[0089] According to one embodiment of the present invention, the electronic device (101) can display at least one second viewpoint located within a certain distance from the first viewpoint when the viewpoint button (320) is selected, and learn the first storyboard and the second storyboard for the at least one second viewpoint based on AI.

[0090] According to one embodiment of the present invention, the electronic device (101) can learn based on the AI ​​to derive common keywords and associations between the first and second viewpoints, and based on the derived results, can generate and externally output a third storyboard for the first and second viewpoints.

[0091] According to one embodiment of the present invention, the third ship education content included in the third storyboard may include information indicating common keywords and relationships between the derived first and second viewpoints, and may include information describing a location or path between the first viewpoint and the second viewpoint.

[0092] In operation S240, the electronic device (101) can generate a first storyboard including a first description related to the first structure, convert the first description into data of a specified format, and output it externally.

[0093] According to one embodiment of the present invention, when the scenario button (350) is selected while the third storyboard is being output, the electronic device (101) can display the ship education chatbot (901) and set the display of the avatar of the ship education chatbot (901) to correspond to the third ship education content included in the third storyboard and output it.

[0094] According to one embodiment of the present invention, when the electronic device (101) receives a user's gesture input for the ship training chatbot (901), the electronic device can display the ship training chatbot by enlarging, reducing, or rotating it in response to the received gesture input.

[0095] Embodiments of the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof. In the case of hardware implementation, an embodiment of the present invention may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, etc.

[0096] In addition, in the case of implementation by firmware or software, one embodiment of the present invention may be implemented in the form of a module, procedure, function, etc. that performs the functions or operations described above, and may be recorded on a recording medium that can be read by various computer means. Here, the recording medium may include program commands, data files, data structures, etc., alone or in combination. The program commands recorded on the recording medium may be those specially designed and configured for the present invention, or may be those known and usable by those skilled in the art of computer software. For example, the recording medium includes magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs (Compact Disk Read Only Memory) and DVDs (Digital Video Disk), magneto-optical media such as floptical disks, and hardware devices specially configured to store and perform program commands such as ROMs, RAMs, and flash memories. Examples of program instructions may include not only machine language code, such as that generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

[0097] Additionally, the device or terminal according to the present invention may be driven by commands that cause one or more processors to perform the functions and processes described above. For example, such commands may include interpreted commands, such as script commands such as JavaScript or ECMAScript commands, executable code, or other commands stored on a computer-readable medium. Furthermore, the device according to the present invention may be implemented in a distributed manner across a network, such as a server farm, or may be implemented on a single computer device.

[0098] In addition, a computer program (also known as a program, software, software application, script, or code) mounted on a device according to the present invention and executing a method according to the present invention may be written in any form of a programming language, including a compiled or interpreted language, a priori or procedural language, and may be deployed in any form, including a standalone program, module, component, subroutine, or other unit suitable for use in a computer environment. A computer program does not necessarily correspond to a file in a file system. A program may be stored in a single file provided to a requested program, in multiple interacting files (e.g., a file storing one or more modules, subprograms, or portions of code), or in part of a file containing other programs or data (e.g., one or more scripts stored in a markup language document). A computer program may be deployed to be executed on a single computer or on multiple computers located at a single site or distributed across multiple sites and interconnected by a communications network.

[0099] For convenience of explanation, each drawing has been described separately. However, it is also possible to design a new embodiment by combining the embodiments described in each drawing. Furthermore, the present invention is not limited to the configuration and method of the embodiments described above. Rather, the embodiments described above may be selectively combined in whole or in part to allow for various modifications.

[0100] In addition, although the preferred embodiments have been illustrated and described above, the present specification is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present specification pertains without departing from the gist claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present specification.

Claims

1. In an electronic device that outputs ship training content, display; A sensor module that detects user input; and When a request to execute an application for outputting ship training content is received, the display is controlled so that the basic screen is displayed on a 360-degree 3D image of a pre-specified type of ship, If the user's input indicates a transparency setting of the 3D image, the transparency of a value corresponding to the user's input is applied to the 3D image, and the display is controlled so that a plurality of preset viewpoints are displayed on the image to which the transparency is applied. When the user's input indicates selection of a first viewpoint among the plurality of viewpoints, the display is controlled so that a portion corresponding to the first structure related to the first viewpoint among the 3D image is enlarged and displayed. An electronic device comprising a processor that generates a first storyboard including a first description related to the first structure, and converts the first description into data of a specified format and outputs it externally.

2. In paragraph 1, The above processor, An electronic device that confirms the user's gesture input or movement input detected through the sensor module or the input received from an external control device as the user's input.

3. In paragraph 1, The above processor, An electronic device that controls the display so that a transparency setting button for setting the transparency, a structure selection button for selecting a specific structure of the ship, a viewpoint button for displaying the plurality of viewpoints on the currently displayed screen, and a scenario button for outputting a description of the selected structure are displayed on the basic screen.

4. In paragraph 3, The above transparency setting button further includes buttons for setting the transparency of the 3D image to a minimum, medium, or maximum value. The above processor, An electronic device that controls the display so that when a specific button of the above transparency setting buttons is selected, the transparency set for the selected button is applied and displayed on the 3D image.

5. In paragraph 3, The above processor, When the above viewpoint button is selected, at least one second viewpoint located within a certain distance from the first viewpoint is displayed, An electronic device that learns the first storyboard and the second storyboard for the at least one second viewpoint based on AI.

6. In paragraph 5, The above processor, By learning based on the above AI, common keywords and correlations between the first and second viewpoints are derived, An electronic device that generates and externally outputs a third storyboard for the first and second viewpoints based on the above-described results.

7. In paragraph 6, The third ship training content included in the above third storyboard is: Includes information indicating common keywords and correlations between the first and second viewpoints derived above, An electronic device comprising information describing a location or path between the first viewpoint and the second viewpoint.

8. In paragraph 6, The above processor, When the scenario button is selected while the third storyboard is output, the display is controlled so that the ship training chatbot is displayed. An electronic device that sets and outputs the display of the avatar of the ship education chatbot in response to the third ship education content included in the third storyboard.

9. In paragraph 8, The above processor, An electronic device that controls the display so that the ship education chatbot is displayed in an enlarged, reduced, or rotated manner in response to the received gesture input by the user when the user's gesture input for the ship education chatbot is received through the sensor module.

10. A method for outputting ship training content from an electronic device, When a request to execute an application for outputting ship training content is received, an action to display a basic screen on a 360-degree 3D image of a pre-specified type of ship; An operation of detecting a user's input, and, if the user's input indicates a transparency setting of the 3D image, applying a transparency of a value corresponding to the user's input to the 3D image, and displaying a plurality of preset viewpoints on the image to which the transparency is applied; An operation of enlarging and displaying a portion of the 3D image corresponding to the first structure related to the first viewpoint, as the user's input indicates selection of the first viewpoint among the plurality of viewpoints; and A method for outputting ship training content, comprising: generating a first storyboard including a first description related to the first structure, and converting the first description into data of a specified format and outputting it externally.

11. In paragraph 10, A method for outputting ship training content, further comprising: an operation of confirming the detected user's gesture input or movement input or input received from an external control device as the user's input.

12. In paragraph 10, A method for outputting ship training content, further comprising: an operation of displaying, on the basic screen, a transparency setting button for setting the transparency, a structure selection button for selecting a specific structure of the ship, a viewpoint button for displaying the plurality of viewpoints on the currently displayed screen, and a scenario button for outputting a description of the selected structure.

13. In paragraph 12, The above transparency setting button further includes buttons for setting the transparency of the 3D image to a minimum, medium, or maximum value. A method for outputting ship training content, further comprising: an operation for controlling, when a specific button of the above transparency setting buttons is selected, the transparency set for the selected button to be applied and displayed on the 3D image.

14. In paragraph 12, An action of displaying at least one second viewpoint located within a certain distance from the first viewpoint when the viewpoint button is selected; and A method for outputting ship training content, further comprising: an operation of learning the first storyboard and the second storyboard for the at least one second viewpoint based on AI; 15. In paragraph 14, An operation of learning based on the above AI to derive common keywords and associations between the first and second viewpoints; and A method for outputting ship training content, further comprising: generating and externally outputting a third storyboard for the first and second viewpoints based on the above-described results.

16. In paragraph 15, The third ship training content included in the above third storyboard is: Includes information indicating common keywords and correlations between the first and second viewpoints derived above, A method for outputting ship training content, comprising information describing a location or path between the first viewpoint and the second viewpoint.

17. In paragraph 15, When the above scenario button is selected while the above third storyboard is being output, an action is taken to display the ship training chatbot; and A method for outputting ship training content, further comprising: an action of setting the display of the avatar of the ship training chatbot to correspond to the third ship training content included in the third storyboard and outputting it; 18. In paragraph 17, A method for outputting ship training content, further comprising: when receiving a user's gesture input for the ship training chatbot, an action of displaying the ship training chatbot by enlarging, reducing, or rotating the ship training chatbot in response to the received gesture input.

Images