Method and system for displaying auxiliary information of ship equipment in virtual environment
By assigning unique identification codes to the ship equipment model and establishing corresponding relationships, the problem of users in the virtual environment is difficult to obtain equipment auxiliary information, and rapid and accurate information acquisition is achieved, which improves training and maintenance efficiency.
Patent Information
- Application Number
- CN202411948632.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-27
- Publication Date
- 2025-05-27
AI Technical Summary
In a virtual environment, it is difficult for users to quickly obtain detailed auxiliary information of marine equipment, especially when there are a large number of equipment, auxiliary information is easily lost or does not match user needs.
By assigning a unique identification code to each device model and establishing a correspondence between the field name, auxiliary information and identification code of the database storage device, the user can query the corresponding auxiliary information through the identification code of the target device model and display it on the display interface.
It enables users to quickly and conveniently obtain detailed auxiliary information of target equipment in a virtual environment, improves training and maintenance efficiency, and ensures the accuracy and completeness of auxiliary information.
Smart Images
Figure CN120047275A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of virtual simulation, and more particularly, to a method and system for displaying attached information of ship equipment in a virtual environment. Background Art
[0002] Modern ship equipment is a complex mega-system project. A ship consists of tens of thousands of assemblies, equipment, systems, etc. Its complexity and professional diversity pose certain challenges to the ship acceptance training. The method of using virtual simulation technology for user training is becoming more and more widespread.
[0003] Currently, the research and development design of large ship equipment generally adopts three-dimensional design. A virtual ship model is constructed using the model in the construction design stage of the ship equipment to introduce the equipment to users and conduct operation and maintenance training, which is a relatively common method. Users usually require detailed information about the equipment in the virtual environment. In the objective state of a large number of equipment, it is difficult for relevant personnel to master the detailed information of all equipment. Moreover, during the cross-platform model processing and data transmission, the attached information of the equipment model is usually lost or the attached information provided by the original construction design does not match the user's needs. In addition, even if the developers organize the attached information, it is difficult for users to quickly and conveniently obtain the detailed information of the target equipment in the virtual ship model environment.
[0004] Therefore, how to propose a display method that can help users quickly master the attached information of target equipment in a virtual environment has become an urgent technical problem to be solved. Summary of the Invention
[0005] In view of this, the present invention provides a display method that can help users quickly master the attached information of target equipment in a virtual environment.
[0006] Specifically, the present invention is implemented through the following technical solutions:
[0007] According to a first aspect of the present invention, there is provided a method for displaying attached information of ship equipment in a virtual environment, including constructing corresponding equipment models according to the types of ship equipment, and assigning a unique identification code to each equipment model; establishing a database, in which the field names, attached information of each ship equipment, and the corresponding relationship between the field names and the identification codes are pre-stored; obtaining the target equipment model to be queried, and determining the corresponding identification code according to the target equipment model; determining the corresponding field name from the database according to the identification code corresponding to the target equipment model and the corresponding relationship; determining the attached information corresponding to the target equipment model according to the corresponding field name; creating a display interface, obtaining the user's line of sight direction, and adjusting the position of the display interface according to the user's line of sight direction so that the display interface faces the user's line of sight direction; and sending the attached information corresponding to the target equipment model to the display interface for display.
[0008] In some embodiments, the step of sending the affiliated information corresponding to the target device model to the display interface for display includes: taking the virtual camera center as the origin, the optical axis direction of the virtual camera as the Z-axis, the horizontal right direction of the imaging image as the X-axis, and the vertical upward direction of the imaging image as the Y-axis to establish a virtual camera coordinate system; obtaining the target position point of the target device model, using the target position point as the center point, determining the size of the grid according to a predefined rule to generate a quadrilateral grid, where the quadrilateral grid includes the affiliated information corresponding to the target device model; obtaining the initial parameter information of the quadrilateral grid and performing conversion to obtain conversion parameter information, generating the conversion parameter information of the quadrilateral grid in the virtual camera coordinate system so that the length direction of the quadrilateral grid is parallel to the X-axis direction of the virtual camera coordinate system and the width direction of the quadrilateral grid is parallel to the Y-axis direction; based on the conversion parameter information generated in the virtual camera coordinate system, displaying the affiliated information corresponding to the target device model on the display interface.
[0009] In some embodiments, the initial parameter information of the quadrilateral grid includes the center position of the quadrilateral grid, the direction vector of the quadrilateral grid along the X-axis, the direction vector of the quadrilateral grid along the Y-axis, the offset of the initial coordinate point of the quadrilateral grid on the X-axis, the offset of the initial coordinate point of the quadrilateral grid on the Y-axis, the size of the quadrilateral grid on the X-axis, and the size of the quadrilateral grid on the Y-axis.
[0010] In some embodiments, the step of displaying the affiliated information corresponding to the target device model on the display interface includes: obtaining the predefined category for displaying the affiliated information in the display interface; extracting the affiliated information of the corresponding category from the affiliated information corresponding to the target device model according to the predefined category; and displaying the affiliated information of the corresponding category in the display interface.
[0011] In some embodiments, the affiliated information includes at least one of the system information to which the ship equipment belongs, the cabin information, the equipment name information, the equipment model information, and the equipment area information.
[0012] In some embodiments, the affiliated information further includes predefined information.
[0013] According to a second aspect of the present invention, there is provided a display system for the accessory information of ship equipment in a virtual environment, including: a construction module, configured to construct a corresponding equipment model according to the ship equipment type, and assign a unique identification code to each equipment model; the construction module is further configured to establish a database, in which the field names, accessory information of each ship equipment, and the corresponding relationship between the field names and the identification codes are pre-stored; an acquisition module, configured to acquire a target equipment model to be queried, and determine the corresponding identification code according to the target equipment model; a determination module, configured to determine the corresponding field name from the database according to the identification code corresponding to the target equipment model and the corresponding relationship; the determination module is further configured to determine the accessory information corresponding to the target equipment model according to the corresponding field name; the construction module is further configured to create a display interface, acquire the line-of-sight direction of the user, and adjust the position of the display interface according to the line-of-sight direction of the user, so that the display interface faces the line-of-sight direction of the user; a display module, configured to send the accessory information corresponding to the target equipment model to the display interface for display.
[0014] In some embodiments, the display module is specifically configured to: take the center of the virtual camera as the origin, the optical axis direction of the virtual camera as the Z-axis, the horizontal direction of the imaging image as the X-axis, and the vertical direction of the imaging image as the Y-axis to establish a virtual camera coordinate system; acquire the target position point of the target equipment model, use the target position point as the center point, determine the size of the grid according to a predefined rule, generate a quadrilateral grid, and the quadrilateral grid includes the accessory information corresponding to the target equipment model; acquire the initial parameter information of the quadrilateral grid and perform conversion to obtain conversion parameter information, and generate the conversion parameter information of the quadrilateral grid in the virtual camera coordinate system, so that the length direction of the quadrilateral grid is parallel to the X-axis direction of the virtual camera coordinate system, and the width direction of the quadrilateral grid is parallel to the Y-axis direction; based on the conversion parameter information generated in the virtual camera coordinate system, display the accessory information corresponding to the target equipment model on the display interface.
[0015] According to a third aspect of the present invention, there is provided an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, it implements the steps of the method for displaying the accessory information of ship equipment in a virtual environment in the first aspect or any possible implementation manner of the first aspect.
[0016] According to a fourth aspect of the present invention, there is provided a storage medium, on which a computer program is stored. When the program is executed by a processor, it implements the steps of the method for displaying the accessory information of ship equipment in a virtual environment in the first aspect or any possible implementation manner of the first aspect.
[0017] The technical solution provided by the present invention brings at least the following beneficial effects: By defining the unique encoding of the device model and comparing it with the corresponding field names in the created database, the attached information under the corresponding field names is visualized, helping users quickly master the attached information of the target device ship to be queried in the virtual environment. In this way, it helps users such as trainees and maintenance personnel to conveniently master the attached information such as the system to which the device belongs, the device name, and the model, facilitating the equipment maintenance personnel to quickly seek remote support and improving the training and maintenance efficiency. At the same time, for any attached information of the ship equipment that the user wants to understand, it can be better presented to the user for viewing on the display interface to enhance the viewing effect of the user. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The accompanying drawings herein are incorporated into and constitute a part of this specification, showing embodiments consistent with the present invention and, together with the specification, are used to explain the principles of the present invention.
[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or related technologies. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.
[0020] Figure 1 It is one of the flow diagrams of the method for displaying the attached information of ship equipment in a virtual environment provided by an embodiment of the present invention.
[0021] Figure 2 It is another flow diagram of the method for displaying the attached information of ship equipment in a virtual environment provided by an embodiment of the present invention.
[0022] Figure 3 It is yet another flow diagram of the method for displaying the attached information of ship equipment in a virtual environment provided by an embodiment of the present invention.
[0023] Figure 4 It is a schematic diagram of the encoding method of the device model identification code provided by an embodiment of the present invention.
[0024] Figure 5 It is a schematic diagram of the ship equipment attached information database provided by an embodiment of the present invention.
[0025] Figure 6 It is a schematic diagram of the virtual camera space coordinate system provided by an embodiment of the present invention.
[0026] Figure 7 It is a schematic diagram of the visualization of the attached information provided by an embodiment of the present invention.
[0027] Figure 8It is a block diagram of a display system for the attached information of ship equipment in a virtual environment provided by an embodiment of the present invention.
[0028] Figure 9 It is a block diagram of an electronic device provided by an embodiment of the present invention.
[0029] Among them, Figure 8 and Figure 9 The corresponding relationship between the reference numerals and the component names in is:
[0030] 1 Display system for the attached information of ship equipment in a virtual environment, 12 Construction module, 14 Acquisition module, 16 Determination module, 18 Display module, 2 Electronic device, 20 Memory, 22 Processor. Specific implementation manners
[0031] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some but not all of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.
[0032] See Figure 1 , an embodiment of the present invention provides a method for displaying the attached information of ship equipment in a virtual environment. The display method may include the following steps:
[0033] S102. Construct a corresponding equipment model according to the ship equipment type, and assign a unique identification code to each equipment model.
[0034] S104. Establish a database, which pre-stores the field names, attached information of each ship equipment, and the corresponding relationship between the field names and the identification codes.
[0035] S106. Obtain the target equipment model to be queried, and determine the corresponding identification code according to the target equipment model.
[0036] S108. Determine the corresponding field name from the database according to the identification code corresponding to the target equipment model and the corresponding relationship.
[0037] S110. Determine the attached information corresponding to the target equipment model according to the corresponding field name.
[0038] S112. Create a display interface, obtain the line-of-sight direction of the user, and adjust the position of the display interface according to the line-of-sight direction of the user so that the display interface faces the line-of-sight direction of the user.
[0039] S114. Send the affiliated information corresponding to the target device model to the display interface for display.
[0040] According to a method for displaying affiliated information of ship equipment in a virtual environment provided by the present invention, the ship as a whole is divided into various types of ship equipment. For example, the ship is divided into navigation equipment, power equipment, communication equipment, loading and unloading equipment, safety equipment, etc. according to functions. Of course, the ship can also be divided in other ways. Corresponding equipment models are constructed for the divided ship equipment. The equipment models can accurately reproduce the characteristics of the equipment such as shape, size, and color, enabling users to more intuitively understand the appearance of the equipment. A unique identification code is assigned to each equipment model. The manifestation form of the identification code can be a number. For example, it is named in the way of classification number, secondary sub-classification number, separator, and serial number. Then a database is constructed, and the field names, affiliated information of each ship equipment, and the corresponding relationship between the field names and the identification codes are pre-stored in the database. Each identification code has a corresponding field name. That is, after determining the identification code of the target device model to be queried, the corresponding field name can be found in the database, and thus the affiliated information under this field name can be found. This affiliated information is also the affiliated information corresponding to the target device model to be queried. The affiliated information corresponding to the target device model is sent to the display interface for display. The eye movement tracking technology can be used to obtain the user's line of sight direction. By detecting and analyzing the eye movement trajectory, the user's visual focus is obtained, and the position of the display interface is adjusted to always face the user's line of sight direction for the user to view conveniently. The method for displaying affiliated information of ship equipment in a virtual environment provided by the present invention helps users quickly master the affiliated information of the target device ship to be queried in the virtual environment by defining the unique code of the equipment model and comparing it with the corresponding field names in the created database, visualizing the affiliated information under the corresponding field names. This helps users such as trainees and maintenance personnel conveniently master affiliated information such as the system to which the equipment belongs, the equipment name, and the model, facilitating the equipment maintenance personnel to quickly seek remote support and improving the training and maintenance efficiency.
[0041] In some embodiments, as Figure 2 shown, step S114, sending the affiliated information corresponding to the target device model to the display interface for display, includes:
[0042] S202. Establish a virtual camera coordinate system with the center of the virtual camera as the origin, the optical axis direction of the virtual camera as the Z-axis, the horizontal right direction of the imaging image as the X-axis, and the vertical upward direction of the imaging image as the Y-axis.
[0043] S204. Obtain the target position point of the target device model. Using the target position point as the center point, determine the size of the grid according to a predefined rule to generate a quadrilateral grid, and the quadrilateral grid includes the affiliated information corresponding to the target device model.
[0044] S206. Obtain the initial parameter information of the quadrilateral grid and perform conversion to obtain the conversion parameter information. Generate the conversion parameter information of the quadrilateral grid in the virtual camera coordinate system so that the length direction of the quadrilateral grid is parallel to the X-axis direction of the virtual camera coordinate system, and the width direction of the quadrilateral grid is parallel to the Y-axis direction.
[0045] S208. Based on the conversion parameter information generated in the virtual camera coordinate system, display the affiliated information corresponding to the target device model on the display interface.
[0046] In this embodiment, a camera space coordinate system is defined for the virtual camera. The Z-axis faces the front of the camera, that is, the optical axis direction of the virtual camera. The Y-axis faces upward, and the X-axis faces rightward. That is, the vertical upward direction of the imaging image is the Y-axis direction, and the horizontal rightward direction of the imaging image is the X-axis direction. When it is necessary to obtain the affiliated information corresponding to the target device model, a quadrilateral grid will be generated at the corresponding position of the target device model. The target position point can be the center point or the center of gravity point of the target device model, or it can also be the target position point determined by the target device model receiving the user's query instruction. The predefined rule defines the length and width sizes of the quadrilateral grid. By obtaining the initial parameter information of the quadrilateral grid and performing conversion, conversion parameter information is generated in the virtual camera coordinate system, so that the length direction of the quadrilateral grid is parallel to the X-axis direction of the virtual camera coordinate system, and the width direction is parallel to the Y-axis direction. Thus, the quadrilateral grids in different directions and positions are unified under the virtual camera coordinate system, and the affiliated information corresponding to the target device model is displayed in the quadrilateral grid. In this application, the affiliated information dashboard can automatically adapt to the user's perspective. For the affiliated information of any ship equipment that the user wants to know, it can be better presented to the user for viewing in the virtual camera, so that the imaging is always directly facing the user's line of sight, so as to improve the user's viewing effect and help the user quickly master the affiliated information of the target device in the immersive environment.
[0047] In some embodiments, the initial parameter information of the quadrilateral grid includes the center position of the quadrilateral grid, the direction vector of the quadrilateral grid along the X-axis, the direction vector of the quadrilateral grid along the Y-axis, the offset of the initial coordinate point of the quadrilateral grid on the X-axis, the offset of the initial coordinate point of the quadrilateral grid on the Y-axis, the size of the quadrilateral grid on the X-axis, and the size of the quadrilateral grid on the Y-axis.
[0048] In this embodiment, by generating transformation parameter information of a quadrilateral grid with a length and width parallel to the X-axis and Y-axis respectively in the virtual camera coordinate system, the following formula can be specifically used for calculation:
[0049] newPosition = centerPosition + vecUp × oldPosition.x × Size.x + vecRight × oldPosition.y × Size.y;
[0050] Where: newPosition is the position after the transformation of the quadrilateral grid (transformation parameter information), centerPosition: the central position of the quadrilateral grid, vecUp: the vector of the quadrilateral grid along the X-axis direction, vecRight: the vector of the quadrilateral grid along the Y-axis direction, oldPosition.x: the offset of the initial coordinate point of the quadrilateral grid on the X-axis, oldPosition.y: the offset of the initial coordinate point of the quadrilateral grid on the Y-axis, Size.x: the size of the quadrilateral grid on the X-axis, Size.y: the size of the quadrilateral grid on the Y-axis.
[0051] Through the above calculation, the new coordinates (transformation parameter information) of the quadrilateral grid can be obtained, so as to generate the corresponding new coordinates of the quadrilateral grid in the virtual camera coordinate system using the initial coordinates (initial parameter information) of the quadrilateral grid. For any attached information of the ship equipment that the user wants to know, it can be better presented to the user in the virtual camera for viewing, so as to improve the viewing effect of the user and help the user quickly master the attached information of the target equipment in the immersive environment.
[0052] In some embodiments, the step of displaying the attached information corresponding to the target equipment model on the display interface includes: obtaining a predefined category for displaying the attached information in the display interface; extracting the attached information of the corresponding category from the attached information corresponding to the target equipment model; and displaying the attached information of the corresponding category in the display interface.
[0053] In this embodiment, by defining categories of the attached information to be displayed on the display interface, such as engineering equipment number (unique model number), system number, system name, etc., in this way, corresponding attached information can be generated on the display interface according to the actual needs of the user, without presenting all the attached information of the target ship equipment to the user, thereby further improving the viewing effect of the user on the attached information and enabling the user to more accurately understand the attached information of the target ship equipment.
[0054] In some embodiments, the attached information includes at least one of ship equipment belonging system information, cabin information, equipment name information, equipment model information, and equipment area information.
[0055] In some embodiments, the attached information further includes predefined information.
[0056] In this embodiment, the attached information further includes predefined information. The attached information such as the system information to which the ship equipment belongs, the cabin information, the equipment name information, the equipment model information, and the equipment area information can be extracted programmatically through the model design platform, while the predefined information is the content not available in the original model design platform, such as information about equipment manufacturers, technical support, etc. These predefined information need to be added according to the actual needs of users to ensure the diversification of the attached information of the target ship equipment viewed subsequently and to fully understand the detailed information of the target equipment.
[0057] As Figure 3 shown, an embodiment of the present invention provides a method for displaying attached information of ship equipment in a virtual environment, and the method may include the following steps:
[0058] S302. Select a model.
[0059] S304. Obtain the unique code of the model.
[0060] S306. Extract information from the model design platform or manually expand entries and content.
[0061] S308. Establish a database.
[0062] S310. Query the corresponding attached information in the database using the unique code of the model.
[0063] S312. Write the attached information into a quadrilateral mesh.
[0064] S314. Display the attached information.
[0065] In the present invention, by defining the unique code of the model, comparing it with the corresponding code in the created attached information database, visualizing the attached information under the corresponding code, and expanding the attached information entries and content as needed; in a three-dimensional immersive environment, the attached information dashboard can automatically adapt to the user's perspective to help the user quickly master the attached information of the target equipment in the immersive environment.
[0066] The present invention provides the following technical methods:
[0067] Step 1: Define the model number and attached information
[0068] The simulation model is the most important geometric element for building a virtual prototype ship. In the process of developing a virtual prototype ship, the simulation model is usually referenced as a resource. Creating a structure tree for the simulation model facilitates its management. For the equipment models with the largest number and types, a unique code is assigned to them. At the same time, a database is created, with the unique code as the corresponding field name, and the attached information, such as the system, cabin, equipment name, model, etc., is mounted. The relevant attached information can be extracted programmatically through the model design platform, or it can be manually added according to user needs to expand the content that the original model design platform does not have, such as equipment manufacturers, technical support and other information.
[0069] Step 2: Visualize the additional information
[0070] On the basis of step 1, first define a camera space coordinate system for the camera object, and define the Z axis to be directly in front of the camera object. In the virtual simulation program, monitor the mouse or interactive device. When the mouse double-clicks the device model (you can also define other events such as mouse plus shortcut keys), a quadrilateral grid with a length and width parallel to the X axis and Y axis is generated in the X-axis and Y-axis coordinate systems of the camera space. At the same time, according to the unique code of the device model selected by the mouse, compare the field name in the database created in step 1, write the attached information under the corresponding field name into the quadrilateral grid, and complete the visualization of the device attached information in the virtual prototype ship system.
[0071] For ease of understanding, the camera object, camera object space coordinate system, and world space coordinate system mentioned above are interpreted as follows:
[0072] 1. Camera object: A virtual camera in the three-dimensional space of virtual reality software is usually treated as a physical object, with attributes and states added to it, or its movement driven by a script. The virtual scene illuminated by the camera object is the scene presented to the user, and the position of the camera object is the position of the user in the virtual environment.
[0073] 2. Camera object space coordinate system: The camera object space coordinate system is a coordinate system centered on the virtual camera. Usually the position of the camera object is the origin, and the camera object line of sight direction is the Z axis. The X axis and Y axis correspond to the right-hand coordinate system, and its coordinate origin and coordinate axis direction change with the movement and rotation of the camera object.
[0074] 3. World space coordinate system: The world space coordinate system is the coordinate system of the entire virtual scene or world. It is a fixed reference coordinate system that does not change with the movement and rotation of the camera object. In this solution, the world space coordinate system is used to determine the virtual camera coordinate system.
[0075] The beneficial effects of the present invention are:
[0076] A method for visualizing the attached information of equipment in a ship virtual simulation environment is provided to assist users in quickly grasping the detailed information of target equipment in a complex virtual environment. It helps users such as training participants and maintenance personnel to conveniently master the attached information such as the system to which the equipment belongs, the equipment name, and the model, facilitating equipment maintenance personnel to conveniently seek remote support and improving training and maintenance efficiency.
[0077] Modern ship equipment is a complex large-scale system project. A ship consists of tens of thousands of assemblies, equipment, systems, etc. Its complexity and professional diversity pose certain challenges to the acceptance training of equipment. The method of using virtual simulation technology for user training is becoming more and more widespread. At present, the research and development design of large ship equipment generally adopts three-dimensional design. Using the model in the construction design stage of ship equipment to build a virtual prototype ship to introduce the equipment to users and carry out operation and maintenance training is a relatively common method. Users usually require to understand the detailed information of the equipment in the virtual environment. Under the objective state of a large number of equipment, it is difficult for relevant personnel to master the detailed information of all equipment. Moreover, in the process of cross-platform model processing and data transmission, the attached information of the equipment model is usually lost or the attached information provided by the original construction design does not match the user's needs. In addition, even if the developers organize the attached information, it is difficult for users to quickly and conveniently obtain the detailed information of the target equipment in the virtual prototype ship environment. Therefore, a method for visualizing the attached information of equipment in a ship virtual simulation environment is needed to help users conveniently and quickly retrieve and view the attached information of the target equipment in the virtual environment.
[0078] The method for visualizing the attached information of equipment in a ship virtual simulation environment provided by this application is specifically implemented as follows:
[0079] 1) Define the unique model number
[0080] Create empty nodes according to ship specialties under the model resource node tree. Among them, the equipment type node is named Equip (equipment), and all equipment models are mounted under the Equip node. For the convenience of retrieving the attached information of the model and tracing the model modification, number and name all equipment. The numbering method of the equipment model is as Figure 4 shown, and it is named in the way of classification number, secondary sub-classification number, separator and sequence number.
[0081] 2) Create an attached information database
[0082] Create a database with the unique model number as the key field name. As Figure 5 shown, organize the attached information related to the corresponding equipment into the corresponding items. According to actual needs, entries and corresponding information can be added or deleted in the database.
[0083] 3) Define the camera space coordinate system and coordinate transformation
[0084] AsFigure 6 As shown, a camera space coordinate system is defined for the camera object, with the Z-axis facing directly in front of the camera, the Y-axis facing upward, and the X-axis facing rightward. The mouse events (or other interaction devices such as interactive gamepads) are monitored. When the model is double-clicked with the mouse, a quadrilateral mesh is generated. The coordinate transformation of the quadrilateral directly refers to the virtual camera coordinate system, and the mesh size is defined. The center position of the generated quadrilateral mesh is the position where the mouse clicks on the model, and its position remains unchanged. In the actual application process, users generally do not look at the screen obliquely in the virtual scene (that is, the human line of sight generally does not rotate along the z-axis), so only the offsets of the quadrilateral mesh in the X and Y directions need to be adjusted. When the quadrilateral mesh is generated, it may be facing the virtual camera (the user), or it may not be facing the user. And the user is moving in the virtual scene. After the user moves, the original quadrilateral mesh is no longer facing the user, and the user may not be able to see the relevant device attachment information. Therefore, coordinate transformation needs to be performed on the quadrilateral mesh so that it can always be displayed in the virtual camera, facilitating the user's viewing. The formula for generating a quadrilateral mesh with its length and width parallel to the X-axis and Y-axis respectively in the X and Y coordinate systems of the camera space is:
[0085] newPosition = centerPosition + vecUp × oldPosition.x × Size.x + vecRight × oldPosition.y × Size.y;
[0086] For easy understanding, the variables in the formula are explained as follows:
[0087] centerPosition: The center position of the quadrilateral, vecUp: The upward direction vector of the quadrilateral, vecRight: The right direction vector of the quadrilateral, oldPosition.x: The offset of the initial coordinate point on the x-axis, oldPosition.y: The offset of the initial coordinate point on the y-axis, Size.x: The size of the quadrilateral on the x-axis, which remains unchanged, Size.y: The size of the quadrilateral on the y-axis, which remains unchanged.
[0088] In the virtual environment, all models or objects have an initial coordinate relative to the world coordinate system, and these coordinates are all directional, so that the initial parameter information of the generated quadrilateral mesh can be determined according to the world coordinate system.
[0089] 4) Unique code retrieval
[0090] Define the categories of the attached information to be written into the quadrilateral grid, such as engineering equipment number (unique model number), system number, system name, etc. After the mouse (or other interaction device) clicks on the model, obtain the name of the model node, that is, the unique model code. According to the obtained unique code, retrieve and capture the corresponding attached information in the database and write it into the quadrilateral grid. The specific implementation process is as Figure 3 shown, and the actual project application is as Figure 7 shown.
[0091] Based on the same inventive concept, as Figure 8 shown, an embodiment of the present invention also provides a display system 1 for attached information of ship equipment in a virtual environment, including: a construction module 12, configured to construct a corresponding equipment model according to the ship equipment type and assign a unique identification code to each equipment model; the construction module 12 is further configured to establish a database, in which the field names, attached information of each ship equipment and the corresponding relationship between the field names and the identification codes are pre-stored; an acquisition module 14, configured to acquire a target equipment model to be queried and determine the corresponding identification code according to the target equipment model; a determination module 16, configured to determine the corresponding field name from the database according to the identification code corresponding to the target equipment model and the corresponding relationship; the determination module 16 is further configured to determine the attached information corresponding to the target equipment model according to the corresponding field name; the construction module 12 is further configured to create a display interface, acquire the line-of-sight direction of the user, and adjust the position of the display interface according to the line-of-sight direction of the user so that the display interface faces the line-of-sight direction of the user; a display module 18, configured to send the attached information corresponding to the target equipment model to the display interface for display.
[0092] The implementation processes of the functions and roles of each module in the above system are specifically described in the implementation processes of the corresponding steps in the above method, and will not be elaborated here.
[0093] In some embodiments, the display module 18 is specifically configured to: take the center of the virtual camera as the origin, the optical axis direction of the virtual camera as the Z axis, the horizontal direction of the imaging image as the X axis, and the vertical direction of the imaging image as the Y axis to establish a virtual camera coordinate system; acquire the target position point of the target equipment model, use the target position point as the center point, determine the size of the grid according to a predefined rule, generate a quadrilateral grid, and the quadrilateral grid includes the attached information corresponding to the target equipment model; acquire the initial parameter information of the quadrilateral grid and perform conversion to obtain conversion parameter information, generate the conversion parameter information of the quadrilateral grid in the virtual camera coordinate system so that the length direction of the quadrilateral grid is parallel to the X axis direction of the virtual camera coordinate system, and the width direction of the quadrilateral grid is parallel to the Y axis direction; based on the conversion parameter information generated in the virtual camera coordinate system, display the attached information corresponding to the target equipment model on the display interface.
[0094] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to the partial descriptions of the method embodiments. The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the present invention. Those of ordinary skill in the art can understand and implement it without creative efforts.
[0095] Based on the same inventive concept, refer to Figure 9 , an embodiment of the present invention further provides an electronic device 2, including a memory 20 (such as a non-volatile memory), a processor 22, and a computer program stored on the memory 20 and executable on the processor 22. When the processor 22 executes the program, it implements the steps of the method for displaying the attached information of ship equipment in a virtual environment in any possible implementation manner, which is equivalent to the display system 1 of the attached information of ship equipment in a virtual environment as described above. Of course, this processor can also be used to process other data or operations. The electronic device 2 can be a device such as a PC, a server, or a terminal.
[0096] The electronic device 2 generally may further include: a memory, a network interface, and an internal bus. In addition to these components, other hardware may also be included, which will not be elaborated here.
[0097] It should be noted that the above electronic device 2 can be implemented by software. As a logically meaningful device, it is formed by the processor 22 of the electronic device 2 where it is located reading the computer program instructions stored in the non-volatile memory 20 into the memory for running.
[0098] Based on the same inventive concept, an embodiment of the present invention further provides a storage medium, on which a computer program is stored. When the program is executed by a processor, it implements the steps of the method for displaying the attached information of ship equipment in a virtual environment in any possible implementation manner.
[0099] Optionally, the storage medium can be a non-temporary computer-readable storage medium. For example, the non-temporary computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.
[0100] Based on the same inventive concept, an embodiment of the present invention further provides a computer program product, including a computer program. When the program is executed by a processor, it implements the steps of the method for displaying the attached information of ship equipment in a virtual environment in any possible implementation manner.
[0101] In an embodiment according to the present invention, the terms "first", "second", "third" are only used for descriptive purposes and should not be construed as indicating or implying relative importance; the term "plural" refers to two or more, unless otherwise clearly defined. Terms such as "mounted", "connected", "coupled", "fixed" and the like should be construed broadly. For example, "connected" can be a fixed connection, a detachable connection, or an integral connection; "coupled" can be a direct connection or an indirect connection through an intermediate medium. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments according to the present invention can be understood according to specific circumstances.
[0102] In addition, although the operations are depicted in a particular order, this should be understood to require that the operations be performed in the particular order shown or in a sequential order, or that all illustrated operations be performed to achieve the desired result. In certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although a number of specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present invention. Certain features described in the context of separate embodiments may also be implemented in combination in a single implementation. Conversely, the various features described in the context of a single implementation may also be implemented separately or in any suitable subcombination in multiple implementations.
[0103] Although the subject matter has been described in language specific to structural features and / or methodological acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms for implementing the claims.
[0104] The above are only preferred embodiments according to the embodiments of the present invention and are not used to limit the embodiments according to the present invention. For those skilled in the art, various changes and modifications can be made according to the embodiments of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments according to the present invention shall be included within the protection scope of the embodiments according to the present invention.
Claims
1. A method for displaying auxiliary information of ship equipment in a virtual environment, characterized in that: include: Constructing corresponding equipment models according to the types of ship equipment, and assigning a unique identification code to each of the equipment models; Establishing a database, wherein the database pre-stores the field name, the auxiliary information and the corresponding relationship between the field name and the identification code of each of the ship equipment; Obtaining a target device model to be queried, and determining a corresponding identification code according to the target device model; Determining the corresponding field name from the database according to the identification code corresponding to the target device model and the corresponding relationship; Determine the auxiliary information corresponding to the target device model according to the corresponding field name; Creating a display interface, obtaining a user's sight direction, and adjusting a position of the display interface according to the user's sight direction so that the display interface faces the user's sight direction; The auxiliary information corresponding to the target device model is sent to the display interface for display.
2. The method for displaying ship equipment auxiliary information in a virtual environment according to claim 1, characterized in that: The step of sending the auxiliary information corresponding to the target device model to the display interface for display includes: With the center of the virtual camera as the origin, the optical axis direction of the virtual camera as the Z axis, the horizontal right direction of the image as the X axis, and the vertical upward direction of the image as the Y axis, a virtual camera coordinate system is established; Acquire a target position point of the target device model, use the target position point as a center point, determine a size of a grid according to a predefined rule, and generate a quadrilateral grid, wherein the quadrilateral grid includes the auxiliary information corresponding to the target device model; Acquire initial parameter information of the quadrilateral mesh and convert it to obtain conversion parameter information, and generate the conversion parameter information of the quadrilateral mesh in the virtual camera coordinate system so that the length direction of the quadrilateral mesh is parallel to the X-axis direction of the virtual camera coordinate system, and the width direction of the quadrilateral mesh is parallel to the Y-axis direction; Based on the conversion parameter information generated in the virtual camera coordinate system, the auxiliary information corresponding to the target device model is displayed on the display interface.
3. The method for displaying ship equipment auxiliary information in a virtual environment according to claim 2, characterized in that: The initial parameter information of the quadrilateral mesh includes the center position of the quadrilateral mesh, the direction vector of the quadrilateral mesh along the X-axis, the direction vector of the quadrilateral mesh along the Y-axis, the offset of the initial coordinate point of the quadrilateral mesh on the X-axis, the offset of the initial coordinate point of the quadrilateral mesh on the Y-axis, the size of the quadrilateral mesh on the X-axis, and the size of the quadrilateral mesh on the Y-axis.
4. The method for displaying ship equipment auxiliary information in a virtual environment according to claim 2, characterized in that: The step of displaying the auxiliary information corresponding to the target device model on the display interface includes: Obtaining a predefined category for displaying auxiliary information in the display interface; Extracting the corresponding category of auxiliary information from the auxiliary information corresponding to the target device model according to the predefined category; The auxiliary information of the corresponding category is displayed in the display interface.
5. The method for displaying ship equipment auxiliary information in a virtual environment according to any one of claims 1 to 4, characterized in that: The auxiliary information includes at least one of the system information of the ship equipment, cabin information, equipment name information, equipment model information and equipment area information.
6. The method for displaying ship equipment auxiliary information in a virtual environment according to claim 5, characterized in that: The auxiliary information also includes predefined information.
7. A display system (1) for ship equipment auxiliary information in a virtual environment, characterized in that: include: A construction module (12) is used to construct a corresponding equipment model according to the type of ship equipment, and to assign a unique identification code to each of the equipment models; The construction module (12) is also used to establish a database, in which the field name, auxiliary information and the corresponding relationship between the field name and the identification code of each of the ship equipment are pre-stored; An acquisition module (14) is used to acquire a target device model to be queried and determine a corresponding identification code according to the target device model; A determination module (16), configured to determine the corresponding field name from the database according to the identification code corresponding to the target device model and the corresponding relationship; The determination module (16) is further used to determine the auxiliary information corresponding to the target device model according to the corresponding field name; The construction module (12) is further used to create a display interface, obtain the user's line of sight direction, and adjust the position of the display interface according to the user's line of sight direction so that the display interface faces the user's line of sight direction; A display module (18) is used to send the auxiliary information corresponding to the target device model to the display interface for display.
8. The display system (1) for ship equipment auxiliary information in a virtual environment according to claim 7, characterized in that: The display module (18) is specifically used for: A virtual camera coordinate system is established with the center of the virtual camera as the origin, the optical axis direction of the virtual camera as the Z axis, the horizontal direction of the image as the X axis, and the vertical direction of the image as the Y axis; Acquire a target position point of the target device model, use the target position point as a center point, determine a size of a grid according to a predefined rule, and generate a quadrilateral grid, wherein the quadrilateral grid includes the auxiliary information corresponding to the target device model; Acquire initial parameter information of the quadrilateral mesh and convert it to obtain conversion parameter information, and generate the conversion parameter information of the quadrilateral mesh in the virtual camera coordinate system so that the length direction of the quadrilateral mesh is parallel to the X-axis direction of the virtual camera coordinate system, and the width direction of the quadrilateral mesh is parallel to the Y-axis direction; Based on the conversion parameter information generated in the virtual camera coordinate system, the auxiliary information corresponding to the target device model is displayed on the display interface.
9. An electronic device (2), comprising a memory (20), a processor (22), and a computer program stored in the memory (20) and executable on the processor (22), characterized in that: When the processor (22) executes the computer program, the steps of the method for displaying the auxiliary information of ship equipment in a virtual environment according to any one of claims 1 to 6 are implemented.
10. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method for displaying the auxiliary information of ship equipment in a virtual environment according to any one of claims 1 to 6 are implemented.