Ship perspective projection positioning, device, product, computer equipment and storage medium

Abstract

The application discloses a ship perspective projection positioning device, product, computer equipment and storage medium. The application establishes a virtual-real fusion space to eliminate the cabin debugging visual field and information gap. In the process of debugging the equipment in the cabin of the ship, a virtual window is used to assist in viewing the real-time three-dimensional observation of the working medium flow, the state of other space operations and the positions of other personnel, and it is not necessary to convert the two-dimensional electronic manual into a three-dimensional space with the same scale space. The XR extended reality device task debugging sequence information is synchronized through the shipboard local area network, the multi-person collaborative debugging operation is synchronized, the working medium flow rendering effect is updated according to the synchronization state, the debugging personnel can quickly complete the debugging task positioning and collaborative sequence operation, the complex cabin system debugging efficiency is greatly improved, the cross-cabin equipment debugging period is shortened, the workload of the debugging personnel in space confirmation and step confirmation is reduced, the ship delivery quality is ensured, and the ship delivery period is shortened.

Description

Technical Field

[0001] This application relates to the field of metaverse technology, and in particular to a ship perspective projection positioning device, computer program product, computer equipment and storage medium. Background Technology

[0002] Augmented Reality (AR) technology uses optoelectronic display technology, interactive technology, multiple sensor technology, and computer graphics and multimedia technology to integrate a computer-generated virtual environment with the user's surrounding real environment, making the user believe, through sensory effects, that the virtual environment is a component of their surrounding real environment.

[0003] Ship operation support systems, such as ballast water regulation systems, power distribution systems, hydraulic systems, and air conditioning systems, include pipelines and regulating valves for conveying working media such as water, electricity, hydraulics, and gas. In large, high-value-added medium and large ships with large volume and tonnage, these systems' pipelines, regulating valves, and reading instruments are intricately interwoven, located in compartments on different levels with large spacing. Some operating systems also need to retain redundant operation, unit operation, and low-power operation modes and capabilities.

[0004] Traditional commissioning of operating systems on large and medium-sized ships involves multiple engineers scattered across various compartments, coordinating operational progress and instrument information via walkie-talkies. This approach suffers from problems such as dispersed operations, unclear personnel location information, untimely information matching, and difficulty in aligning work sequences, impacting commissioning and delivery efficiency. Although marine electronic navigation maps are available to assist commissioning personnel in locating compartment layouts and floor levels, these maps are presented in 2D, making it difficult to intuitively represent the locations and statuses of other personnel and commissioning points. Furthermore, the continuity status of the working fluid within the corresponding pipelines of each compartment is also difficult to obtain and view directly from within the compartment. Summary of the Invention

[0005] The purpose of this invention is to provide a ship perspective projection positioning device, computer program product, computer equipment and storage medium to solve the problems of multi-point decentralized operation in the debugging of existing medium and large ship operation systems, unclear personnel location information, untimely information matching and difficulty in aligning operation sequences, so as to improve the efficiency of ship operation system debugging before leaving the factory and shorten the delivery cycle.

[0006] To achieve the above objectives, the present invention provides the following technical solution:

[0007] On the one hand, a method for positioning a ship using perspective projection is provided, the method comprising:

[0008] Obtain a 3D structural distribution diagram of the cabins of a ship using an XR extended reality device. The 3D structural distribution diagram includes cabin models, the location of each cabin model, the number of each cabin model, the equipment models and working fluid flow models within each cabin model.

[0009] The location of each XR extended reality device is obtained, the serial number of each XR extended reality device is identified, the serial number of each XR extended reality device is marked on the corresponding cabin model in the cabin three-dimensional structure distribution map, and the location of the cabin model, the number of the cabin model and the serial number of the XR extended reality device are associated.

[0010] When the first XR extended reality device issues a command to obtain the location of the second XR extended reality device, the serial numbers of the cabin models where the first XR extended reality device and the second XR extended reality device are located are obtained according to the serial numbers of the first XR extended reality device and the second XR extended reality device.

[0011] Draw virtual windows on the walls or obstacles of the cabin where the first XR extended reality device is located;

[0012] The virtual window displays the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device.

[0013] In one embodiment, the ship perspective projection positioning method further includes:

[0014] All XR extended reality devices are configured to share the position in the cabin stereoscopic structure distribution map, and the transparently rendered cabin stereoscopic structure distribution map is displayed in a virtual window in each XR extended reality device.

[0015] The position of the XR extended reality device in the cabin's three-dimensional structure distribution map is updated in real time.

[0016] In one embodiment, the ship perspective projection positioning method further includes:

[0017] Set up the wearer information and task information for each XR extended reality device;

[0018] When the third XR extended reality device selects the serial number of the XR extended reality device or the wearer's information for display, the serial number of the XR extended reality device or the number of the cabin model corresponding to the wearer's information is retrieved accordingly.

[0019] When the task information is selected, the serial numbers of all XR extended reality devices that execute the task information are obtained, and the number of the cabin model corresponding to the serial number of the XR extended reality device is retrieved accordingly.

[0020] Based on the number of the cabin model, determine the target XR extended reality device within the cabin model corresponding to the number of the cabin model, obtain the virtual viewpoint and virtual view cone of the target XR extended reality device relative to the third XR extended reality device, and display the equipment model and working fluid flow model within the cabin model corresponding to the number of the cabin model, as well as the position of the target XR extended reality device.

[0021] In one embodiment, obtaining the location of each XR extended reality device and identifying the serial number of each XR extended reality device includes:

[0022] Obtain the numbers of the positioning sensors installed in each compartment of the ship, and label the corresponding compartment model in the three-dimensional structure distribution diagram of the compartment with the number of each positioning sensor.

[0023] When the positioning sensor detects the infrared passive positioning sensor mark of the XR extended reality device, it identifies the graphic serial number of the infrared passive positioning sensor mark and uses the graphic serial number of the infrared passive positioning sensor mark as the serial number of the XR extended reality device.

[0024] In one embodiment, the ship perspective projection positioning method further includes:

[0025] The display image in the virtual window is generated by adjusting the viewing cone distance and XR projection imaging resolution parameters of the virtual viewing cone.

[0026] In one embodiment, drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located includes:

[0027] A virtual window is projected onto the wall or obstacle of the cabin where the first XR extended reality device is located using a virtual camera, and a model of a person wearing the second XR extended reality device is displayed in the virtual window.

[0028] In one embodiment, drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located further includes:

[0029] A virtual view frustum of the second XR extended reality device relative to the first XR extended reality device is generated in the virtual window based on the view frustum distance and XR projection imaging resolution parameters.

[0030] The virtual viewpoint of the second XR Extended Reality device relative to the first XR Extended Reality device in the virtual window is calculated and generated from the real-time perceived six-DOF spatial position parameters of the camera of the XR Extended Reality device;

[0031] The second XR extended reality device displays the image in the virtual window based on the virtual viewpoint and virtual cone of the first XR extended reality device.

[0032] In one embodiment, displaying the device model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device, in the virtual window includes:

[0033] Obtain the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the position of the second XR extended reality device within the cabin model; render the personnel model wearing the second XR extended reality device; and form a target projection image by combining the equipment model, the working fluid flow model, and the personnel model.

[0034] Based on the virtual viewpoint and the virtual cone, the projected image of the target is transformed by perspective projection to obtain the image displayed in the virtual window.

[0035] On the other hand, a ship perspective projection positioning device is provided, the device comprising:

[0036] The ship model building module is used to obtain a three-dimensional structural distribution map of the cabins of a ship using an XR extended reality device. The three-dimensional structural distribution map of the cabins includes cabin models, the location of each cabin model, the number of each cabin model, the equipment model and the working fluid flow model within each cabin model.

[0037] The wearable device positioning module is used to obtain the location of each XR extended reality device, identify the serial number of each XR extended reality device, mark the serial number of each XR extended reality device on the corresponding cabin model in the cabin three-dimensional structure distribution map, and associate the location of the cabin model, the number of the cabin model, and the serial number of the XR extended reality device.

[0038] The positioning perspective location module is used to, in response to the command issued by the first XR extended reality device to obtain the location of the second XR extended reality device, obtain the number of the cabin model where the first XR extended reality device and the second XR extended reality device are located based on the serial numbers of the first XR extended reality device and the second XR extended reality device;

[0039] The virtual window management module is used to draw virtual windows on the walls or obstacles of the cabin where the first XR extended reality device is located;

[0040] The perspective projection image display module is used to display the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device, in the virtual window.

[0041] In another aspect, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to perform the following steps:

[0042] Obtain a 3D structural distribution diagram of the cabins of a ship using an XR extended reality device. The 3D structural distribution diagram includes cabin models, the location of each cabin model, the number of each cabin model, the equipment models and working fluid flow models within each cabin model.

[0043] The location of each XR extended reality device is obtained, the serial number of each XR extended reality device is identified, the serial number of each XR extended reality device is marked on the corresponding cabin model in the cabin three-dimensional structure distribution map, and the location of the cabin model, the number of the cabin model and the serial number of the XR extended reality device are associated.

[0044] When the first XR extended reality device issues a command to obtain the location of the second XR extended reality device, the serial numbers of the cabin models where the first XR extended reality device and the second XR extended reality device are located are obtained according to the serial numbers of the first XR extended reality device and the second XR extended reality device.

[0045] Draw virtual windows on the walls or obstacles of the cabin where the first XR extended reality device is located;

[0046] The virtual window displays the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device.

[0047] On the other hand, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:

[0048] Obtain a 3D structural distribution diagram of the cabins of a ship using an XR extended reality device. The 3D structural distribution diagram includes cabin models, the location of each cabin model, the number of each cabin model, the equipment models and working fluid flow models within each cabin model.

[0049] The location of each XR extended reality device is obtained, the serial number of each XR extended reality device is identified, the serial number of each XR extended reality device is marked on the corresponding cabin model in the cabin three-dimensional structure distribution map, and the location of the cabin model, the number of the cabin model and the serial number of the XR extended reality device are associated.

[0050] When the first XR extended reality device issues a command to obtain the location of the second XR extended reality device, the serial numbers of the cabin models where the first XR extended reality device and the second XR extended reality device are located are obtained according to the serial numbers of the first XR extended reality device and the second XR extended reality device.

[0051] Draw virtual windows on the walls or obstacles of the cabin where the first XR extended reality device is located;

[0052] The virtual window displays the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device.

[0053] In another aspect, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, performs the following steps:

[0054] Obtain a 3D structural distribution diagram of the cabins of a ship using an XR extended reality device. The 3D structural distribution diagram includes cabin models, the location of each cabin model, the number of each cabin model, the equipment models and working fluid flow models within each cabin model.

[0055] The location of each XR extended reality device is obtained, the serial number of each XR extended reality device is identified, the serial number of each XR extended reality device is marked on the corresponding cabin model in the cabin three-dimensional structure distribution map, and the location of the cabin model, the number of the cabin model and the serial number of the XR extended reality device are associated.

[0056] When the first XR extended reality device issues a command to obtain the location of the second XR extended reality device, the serial numbers of the cabin models where the first XR extended reality device and the second XR extended reality device are located are obtained according to the serial numbers of the first XR extended reality device and the second XR extended reality device.

[0057] Draw virtual windows on the walls or obstacles of the cabin where the first XR extended reality device is located;

[0058] The virtual window displays the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device.

[0059] The aforementioned ship perspective projection positioning method, device, computer program product, computer equipment, and storage medium eliminate visual and informational barriers during ship cabin commissioning by establishing a virtual-real fusion space. During equipment commissioning in ship cabins, virtual windows assist in viewing real-time 3D observations of the working fluid flow, other spatial operation statuses, and the positions of other personnel, eliminating the need for conversion from 2D electronic manuals to 3D space of the same scale. Shipborne local area networks are used to synchronize XR extended reality equipment task commissioning sequence information, enabling synchronized multi-person collaborative commissioning operations. The working fluid flow rendering effect is updated based on the synchronization status, allowing commissioning personnel to quickly complete commissioning task positioning and collaborative sequence operations. This significantly improves the commissioning efficiency of complex ship cabin systems, shortens the commissioning cycle of cross-cabin equipment, reduces the workload of commissioning personnel in spatial and step confirmation, ensures ship delivery quality, and shortens the ship delivery cycle. Attached Figure Description

[0060] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0061] Figure 1 This is an application environment diagram of the ship perspective projection positioning method in one embodiment of this application;

[0062] Figure 2 This is a flowchart illustrating a ship perspective projection positioning method in one embodiment of this application;

[0063] Figure 3 This is a perspective projection diagram of a virtual window in a ship's cabin in one embodiment of this application;

[0064] Figure 4 This is a schematic diagram of a synchronization communication clock for multi-person collaborative debugging operation information in one embodiment of this application;

[0065] Figure 5 This is a structural block diagram of a ship perspective projection positioning device in one embodiment of this application;

[0066] Figure 6 This is an internal structural diagram of a computer device in one embodiment of this application. Detailed Implementation

[0067] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0068] like Figure 1As shown, in cabin 101, commissioner 1 wears an XR extended reality device 100, and in cabin 2, commissioner 2 wears an XR extended reality device 100. The two cabins are separated by a steel plate wall and are not visible to each other within the actual field of view. A virtual window 103 is displayed on the steel plate wall of the cabin, and a projected image is displayed on the virtual window 103. The projected image is a model 105 of the example device 104 in cabin 2 and a model 106 of the person wearing the XR extended reality device 100 in cabin 2.

[0069] Two XR augmented reality devices identify the location of infrared passive positioning sensor markers. By identifying the graphic serial number of the infrared passive positioning sensor marker, the location of the marker's compartment within the ship, its compartment number, and mission information are obtained. The location of the two XR augmented reality devices, the personnel wearing them, and the information about their work compartments are synchronized via the ship's local area network.

[0070] After completing the virtual-real fusion debugging and shared space calibration, Debugger 1 and Debugger 2 can respectively set the virtual window view cone distance value to be greater than the sum of the total distances of the first and second compartments, and start the cabin perspective auxiliary debugging model. At this time, the XR extended reality device generates virtual windows 103 for Debugger 1 and Debugger 2 according to the device position. The two debuggers can observe each other's position, the contents of each other's compartments, the shared pipelines of the two compartments, and the 3D rendering of the working fluid flow of the equipment through the virtual windows 103 displayed on their respective XR extended reality devices.

[0071] After completing the debugging operations for the corresponding cabin equipment on their respective work orders, Debugger 1 and Debugger 2 use gestures and voice interaction to check the task completion status in the collaborative debugging task software on the XR extended reality devices. Multiple XR extended reality devices refresh and synchronize debugging results and rendered content to the cloud edge computer via the ship's local area network.

[0072] This application provides a ship perspective projection positioning method, which includes three methods for joint debugging of ship cabin equipment in an extended reality environment: virtual-real fusion debugging shared space calibration, cabin perspective auxiliary viewing, and multi-person collaborative debugging operation synchronization.

[0073] The virtual-real fusion debugging space calibration step involves identifying the position of the infrared passive positioning sensor marker by using an XR extended reality device worn by the debugging personnel; obtaining the position of the cabin containing the marker, the cabin number, and the mission information within the ship by identifying the graphic serial number of the infrared passive positioning sensor marker; and synchronizing the position of the activated XR extended reality device, the personnel wearing it, and the information of the working cabin through the ship's local area network.

[0074] Multiple equipment commissioning personnel, wearing XR extended reality devices, associate their locations and work tasks with the identification codes of each compartment, automatically establishing a shared virtual-real fusion commissioning space and eliminating visual and informational barriers during shipboard commissioning. This invention combines real-time data collection from multiple sensors on AR terminal devices with computer vision algorithms, virtual-real fusion visualization technology, and gesture and voice interaction technology to provide shipboard system commissioning personnel with a 3D representation of the commissioning location and tasks within the shipboard compartment. This enables commissioning personnel to quickly complete task positioning and collaborative sequence operations, significantly improving the efficiency of commissioning complex shipboard systems, shortening the commissioning cycle for cross-compartment equipment, reducing the workload of spatial and procedural confirmation for commissioning personnel, ensuring ship delivery quality, and shortening the ship delivery cycle.

[0075] In one embodiment, such as Figure 2 As shown, a method for positioning a ship using perspective projection is provided, including the following steps:

[0076] Step S1: Obtain a 3D structural distribution diagram of the cabins of the ship using an XR extended reality device. The 3D structural distribution diagram includes cabin models, the location of each cabin model, the number of each cabin model, the equipment model and the working fluid flow model within each cabin model.

[0077] Step S2: Obtain the location of each XR extended reality device, identify the serial number of each XR extended reality device, mark the serial number of each XR extended reality device on the corresponding cabin model in the cabin three-dimensional structure distribution map, and associate the location of the cabin model, the number of the cabin model, and the serial number of the XR extended reality device.

[0078] Step S3: In response to the command issued by the first XR extended reality device to obtain the location of the second XR extended reality device, obtain the number of the cabin model where the first XR extended reality device and the second XR extended reality device are located according to the serial numbers of the first XR extended reality device and the second XR extended reality device;

[0079] Step S4: Draw a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located;

[0080] Step S5: Display the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device, in the virtual window.

[0081] In this embodiment, the ship perspective projection positioning method further includes:

[0082] All XR extended reality devices are configured to share the position in the cabin stereoscopic structure distribution map, and the transparently rendered cabin stereoscopic structure distribution map is displayed in a virtual window in each XR extended reality device.

[0083] The position of the XR extended reality device in the cabin's three-dimensional structure distribution map is updated in real time.

[0084] In this embodiment, the ship perspective projection positioning method further includes:

[0085] Set up the wearer information and task information for each XR extended reality device;

[0086] When the third XR extended reality device selects the serial number of the XR extended reality device or the wearer's information for display, the serial number of the XR extended reality device or the number of the cabin model corresponding to the wearer's information is retrieved accordingly.

[0087] When the task information is selected, the serial numbers of all XR extended reality devices that execute the task information are obtained, and the number of the cabin model corresponding to the serial number of the XR extended reality device is retrieved accordingly.

[0088] Based on the number of the cabin model, determine the target XR extended reality device within the cabin model corresponding to the number of the cabin model, obtain the virtual viewpoint and virtual view cone of the target XR extended reality device relative to the third XR extended reality device, and display the equipment model and working fluid flow model within the cabin model corresponding to the number of the cabin model, as well as the position of the target XR extended reality device.

[0089] In this embodiment, obtaining the location of each XR extended reality device and identifying the serial number of each XR extended reality device includes:

[0090] Obtain the numbers of the positioning sensors installed in each compartment of the ship, and label the corresponding compartment model in the three-dimensional structure distribution diagram of the compartment with the number of each positioning sensor.

[0091] When the positioning sensor detects the infrared passive positioning sensor mark of the XR extended reality device, it identifies the graphic serial number of the infrared passive positioning sensor mark and uses the graphic serial number of the infrared passive positioning sensor mark as the serial number of the XR extended reality device.

[0092] Furthermore, the infrared passive positioning sensor marker refers to a passive infrared generating element with a prototype or square layout. The XR extended reality device collects the element layout pattern through an infrared sensor and determines the marker serial number based on the pattern recognition result.

[0093] In this embodiment, the ship perspective projection positioning method further includes:

[0094] The display image in the virtual window is generated by adjusting the viewing cone distance and XR projection imaging resolution parameters of the virtual viewing cone.

[0095] In this embodiment, drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located includes:

[0096] A virtual window is projected onto the wall or obstacle of the cabin where the first XR extended reality device is located using a virtual camera, and a model of a person wearing the second XR extended reality device is displayed in the virtual window.

[0097] In this embodiment, drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located further includes:

[0098] A virtual view frustum of the second XR extended reality device relative to the first XR extended reality device is generated in the virtual window based on the view frustum distance and XR projection imaging resolution parameters.

[0099] The virtual viewpoint of the second XR Extended Reality device relative to the first XR Extended Reality device in the virtual window is calculated and generated from the real-time perceived six-DOF spatial position parameters of the camera of the XR Extended Reality device;

[0100] The second XR extended reality device displays the image in the virtual window based on the virtual viewpoint and virtual cone of the first XR extended reality device.

[0101] Please see Figure 3 In this embodiment, displaying the device model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device, in the virtual window includes:

[0102] Obtain the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the position of the second XR extended reality device within the cabin model; render the personnel model wearing the second XR extended reality device; and form a target projection image by combining the equipment model, the working fluid flow model, and the personnel model.

[0103] Based on the virtual viewpoint and the virtual cone, the projected image of the target is transformed by perspective projection to obtain the image displayed in the virtual window.

[0104] Please see Figure 4 In use, different XR extended reality devices can be positioned and displayed using ship perspective projection based on work order status signals. Figure 4 Device 1 in the diagram represents the first XR extended reality device, and device 2 represents the second XR extended reality device.

[0105] The multi-person collaborative debugging operation synchronization method uses WebRTC and Socket services to collect the sequence operation completion information of the infrared positioning board corresponding to the cabin and equipment personnel and send it to the XR extended reality device client software, and refreshes and updates it according to a 30ms real-time clock.

[0106] The steps for refreshing and updating information include:

[0107] Step 1. The system clock triggers a refresh operation every 30ms.

[0108] Step 2. Each time Device 1 (the first XR Extended Reality device) and Device 2 (the second XR Extended Reality device) refresh, the system clock sends a request to Device 1 and Device 2 to collect their work order status signals.

[0109] Step 3. Upon receiving the socket request status signal, devices 1 and 2 respectively return their work order status signals to the system clock.

[0110] Step 4. The system clock merges the work order status signals of device 1 and device 2.

[0111] Step 5. The merged signals are passed to the rendering engine, which calculates the image to be rendered based on these signals.

[0112] Step 6. The rendering engine distributes the calculated image to devices 1 and 2 for display.

[0113] In the aforementioned ship perspective projection positioning method, by establishing a virtual-real fusion space, the visual field and information barriers during ship cabin commissioning are eliminated. During the commissioning of equipment in ship cabins, virtual windows are used to assist in viewing the real-time three-dimensional observation of the working fluid flow, the operational status of other spaces, and the positions of other personnel, eliminating the need for conversion from two-dimensional electronic manuals to three-dimensional space of the same scale. The shipborne local area network is used to synchronize XR extended reality equipment task commissioning sequence information, enabling synchronized multi-person collaborative commissioning operations. The working fluid flow rendering effect is updated according to the synchronization status, allowing commissioning personnel to quickly complete commissioning task positioning and collaborative sequence operations. This significantly improves the commissioning efficiency of complex ship cabin systems, shortens the commissioning cycle of cross-cabin equipment, reduces the workload of commissioning personnel in spatial confirmation and step confirmation, ensures ship delivery quality, and shortens the ship delivery cycle.

[0114] In one embodiment, such as Figure 5 As shown, a ship perspective projection positioning device 10 is provided, including: a ship model construction module 1, a wearable device positioning module 2, a positioning perspective position module 3, a virtual window management module 4, and a perspective projection image display module 5.

[0115] The ship model building module 1 is used to obtain a three-dimensional structural distribution diagram of the cabins of a ship using an XR extended reality device. The three-dimensional structural distribution diagram includes cabin models, the location of each cabin model, the number of each cabin model, the equipment model and the working fluid flow model within each cabin model.

[0116] The wearable device positioning module 2 is used to obtain the location of each XR extended reality device, identify the serial number of each XR extended reality device, mark the serial number of each XR extended reality device on the corresponding cabin model in the cabin three-dimensional structure distribution map, and associate the location of the cabin model, the number of the cabin model, and the serial number of the XR extended reality device.

[0117] The positioning perspective location module 3 is used to obtain the number of the cabin model where the first XR Extended Reality device and the second XR Extended Reality device are located based on the serial numbers of the first XR Extended Reality device and the second XR Extended Reality device when the first XR Extended Reality device issues a command to obtain the location of the second XR Extended Reality device.

[0118] The virtual window management module 4 is used to draw virtual windows on the walls or obstacles of the cabin where the first XR extended reality device is located.

[0119] The perspective projection image display module 5 is used to display the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device, in the virtual window.

[0120] like Figure 5 As shown, the ship perspective projection positioning device 10 also includes a location sharing module 6.

[0121] The location sharing module 6 is used for:

[0122] All XR extended reality devices are configured to share the position in the cabin stereoscopic structure distribution map, and the transparently rendered cabin stereoscopic structure distribution map is displayed in a virtual window in each XR extended reality device.

[0123] The position of the XR extended reality device in the cabin's three-dimensional structure distribution map is updated in real time.

[0124] like Figure 5 As shown, the ship perspective projection positioning device 10 also includes a search and positioning module 7.

[0125] The search and location module 7 is used for:

[0126] Set up the wearer information and task information for each XR extended reality device;

[0127] When the third XR extended reality device selects the serial number of the XR extended reality device or the wearer's information for display, the serial number of the XR extended reality device or the number of the cabin model corresponding to the wearer's information is retrieved accordingly.

[0128] When the task information is selected, the serial numbers of all XR extended reality devices that execute the task information are obtained, and the number of the cabin model corresponding to the serial number of the XR extended reality device is retrieved accordingly.

[0129] Based on the number of the cabin model, determine the target XR extended reality device within the cabin model corresponding to the number of the cabin model, obtain the virtual viewpoint and virtual view cone of the target XR extended reality device relative to the third XR extended reality device, and display the equipment model and working fluid flow model within the cabin model corresponding to the number of the cabin model, as well as the position of the target XR extended reality device.

[0130] In this embodiment, obtaining the location of each XR extended reality device and identifying the serial number of each XR extended reality device includes:

[0131] Obtain the numbers of the positioning sensors installed in each compartment of the ship, and label the corresponding compartment model in the three-dimensional structure distribution diagram of the compartment with the number of each positioning sensor.

[0132] When the positioning sensor detects the infrared passive positioning sensor mark of the XR extended reality device, it identifies the graphic serial number of the infrared passive positioning sensor mark and uses the graphic serial number of the infrared passive positioning sensor mark as the serial number of the XR extended reality device.

[0133] like Figure 5 As shown, the ship perspective projection positioning device 10 also includes a cone adjustment module 8.

[0134] The frustum adjustment module 8 is used to: adjust the frustum distance and XR projection imaging resolution parameters of the virtual frustum to generate the display image in the virtual window.

[0135] In this embodiment, drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located includes:

[0136] A virtual window is projected onto the wall or obstacle of the cabin where the first XR extended reality device is located using a virtual camera, and a model of a person wearing the second XR extended reality device is displayed in the virtual window.

[0137] In this embodiment, drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located further includes:

[0138] A virtual view frustum of the second XR extended reality device relative to the first XR extended reality device is generated in the virtual window based on the view frustum distance and XR projection imaging resolution parameters.

[0139] The virtual viewpoint of the second XR Extended Reality device relative to the first XR Extended Reality device in the virtual window is calculated and generated from the real-time perceived six-DOF spatial position parameters of the camera of the XR Extended Reality device;

[0140] The second XR extended reality device displays the image in the virtual window based on the virtual viewpoint and virtual cone of the first XR extended reality device.

[0141] In this embodiment, displaying the device model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device, in the virtual window includes:

[0142] Obtain the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the position of the second XR extended reality device within the cabin model; render the personnel model wearing the second XR extended reality device; and form a target projection image by combining the equipment model, the working fluid flow model, and the personnel model.

[0143] Based on the virtual viewpoint and the virtual cone, the projected image of the target is transformed by perspective projection to obtain the image displayed in the virtual window.

[0144] The aforementioned ship perspective projection positioning device eliminates visual and informational barriers during cabin commissioning by establishing a virtual-real fusion space. During equipment commissioning in ship cabins, virtual windows assist in real-time 3D observation of the working fluid flow, other spatial operation status, and other personnel positions, eliminating the need for conversion from 2D electronic manuals to a 3D space of the same scale. Shipborne local area networks are used to synchronize XR extended reality equipment task commissioning sequence information, enabling synchronized multi-person collaborative commissioning operations. The working fluid flow rendering effect is updated based on the synchronization status, allowing commissioning personnel to quickly complete commissioning task positioning and collaborative sequence operations. This significantly improves the commissioning efficiency of complex cabin systems, shortens the commissioning cycle of cross-cabin equipment, reduces the workload of space and step confirmation for commissioning personnel, ensures ship delivery quality, and shortens the ship delivery cycle.

[0145] Specific limitations regarding the ship perspective projection positioning device can be found in the limitations of the ship perspective projection positioning method described above, and will not be repeated here. Each module in the aforementioned ship perspective projection positioning device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in or independent of the processor in a computer device in hardware form, or stored in the memory of a computer device in software form, so that the processor can call and execute the corresponding operations of each module.

[0146] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:

[0147] Obtain a 3D structural distribution diagram of the cabins of a ship using an XR extended reality device. The 3D structural distribution diagram includes cabin models, the location of each cabin model, the number of each cabin model, the equipment models and working fluid flow models within each cabin model.

[0148] The location of each XR extended reality device is obtained, the serial number of each XR extended reality device is identified, the serial number of each XR extended reality device is marked on the corresponding cabin model in the cabin three-dimensional structure distribution map, and the location of the cabin model, the number of the cabin model and the serial number of the XR extended reality device are associated.

[0149] When the first XR extended reality device issues a command to obtain the location of the second XR extended reality device, the serial numbers of the cabin models where the first XR extended reality device and the second XR extended reality device are located are obtained according to the serial numbers of the first XR extended reality device and the second XR extended reality device.

[0150] Draw virtual windows on the walls or obstacles of the cabin where the first XR extended reality device is located;

[0151] The virtual window displays the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device.

[0152] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0153] The ship perspective projection positioning method also includes:

[0154] All XR extended reality devices are configured to share the position in the cabin stereoscopic structure distribution map, and the transparently rendered cabin stereoscopic structure distribution map is displayed in a virtual window in each XR extended reality device.

[0155] The position of the XR extended reality device in the cabin's three-dimensional structure distribution map is updated in real time.

[0156] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0157] The ship perspective projection positioning method also includes:

[0158] Set up the wearer information and task information for each XR extended reality device;

[0159] When the third XR extended reality device selects the serial number of the XR extended reality device or the wearer's information for display, the serial number of the XR extended reality device or the number of the cabin model corresponding to the wearer's information is retrieved accordingly.

[0160] When the task information is selected, the serial numbers of all XR extended reality devices that execute the task information are obtained, and the number of the cabin model corresponding to the serial number of the XR extended reality device is retrieved accordingly.

[0161] Based on the number of the cabin model, determine the target XR extended reality device within the cabin model corresponding to the number of the cabin model, obtain the virtual viewpoint and virtual view cone of the target XR extended reality device relative to the third XR extended reality device, and display the equipment model and working fluid flow model within the cabin model corresponding to the number of the cabin model, as well as the position of the target XR extended reality device.

[0162] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0163] The steps of obtaining the location of each XR extended reality device and identifying the serial number of each XR extended reality device include:

[0164] Obtain the numbers of the positioning sensors installed in each compartment of the ship, and label the corresponding compartment model in the three-dimensional structure distribution diagram of the compartment with the number of each positioning sensor.

[0165] When the positioning sensor detects the infrared passive positioning sensor mark of the XR extended reality device, it identifies the graphic serial number of the infrared passive positioning sensor mark and uses the graphic serial number of the infrared passive positioning sensor mark as the serial number of the XR extended reality device.

[0166] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0167] The ship perspective projection positioning method also includes:

[0168] The display image in the virtual window is generated by adjusting the viewing cone distance and XR projection imaging resolution parameters of the virtual viewing cone.

[0169] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0170] The step of drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located includes:

[0171] A virtual window is projected onto the wall or obstacle of the cabin where the first XR extended reality device is located using a virtual camera, and a model of a person wearing the second XR extended reality device is displayed in the virtual window.

[0172] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0173] The step of drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located also includes:

[0174] A virtual view frustum of the second XR extended reality device relative to the first XR extended reality device is generated in the virtual window based on the view frustum distance and XR projection imaging resolution parameters.

[0175] The virtual viewpoint of the second XR Extended Reality device relative to the first XR Extended Reality device in the virtual window is calculated and generated from the real-time perceived six-DOF spatial position parameters of the camera of the XR Extended Reality device;

[0176] The second XR extended reality device displays the image in the virtual window based on the virtual viewpoint and virtual cone of the first XR extended reality device.

[0177] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0178] The description of displaying the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device, in the virtual window includes:

[0179] Obtain the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the position of the second XR extended reality device within the cabin model; render the personnel model wearing the second XR extended reality device; and form a target projection image by combining the equipment model, the working fluid flow model, and the personnel model.

[0180] Based on the virtual viewpoint and the virtual cone, the projected image of the target is transformed by perspective projection to obtain the image displayed in the virtual window.

[0181] For specific limitations on the steps implemented when a computer program is executed by a processor, please refer to the limitations on the method of ship perspective projection positioning mentioned above, which will not be repeated here.

[0182] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 6 As shown, the computer device includes a processor, memory, network interface, and database connected via a system bus. The processor provides computational and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system, computer programs, and the database. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The database stores ship perspective projection positioning data. The network interface communicates with external terminals via a network connection. When the computer program is executed by the processor, it implements a ship perspective projection positioning method.

[0183] Those skilled in the art will understand that Figure 6 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0184] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to perform the following steps:

[0185] Obtain a 3D structural distribution diagram of the cabins of a ship using an XR extended reality device. The 3D structural distribution diagram includes cabin models, the location of each cabin model, the number of each cabin model, the equipment models and working fluid flow models within each cabin model.

[0186] The location of each XR extended reality device is obtained, the serial number of each XR extended reality device is identified, the serial number of each XR extended reality device is marked on the corresponding cabin model in the cabin three-dimensional structure distribution map, and the location of the cabin model, the number of the cabin model and the serial number of the XR extended reality device are associated.

[0187] When the first XR extended reality device issues a command to obtain the location of the second XR extended reality device, the serial numbers of the cabin models where the first XR extended reality device and the second XR extended reality device are located are obtained according to the serial numbers of the first XR extended reality device and the second XR extended reality device.

[0188] Draw virtual windows on the walls or obstacles of the cabin where the first XR extended reality device is located;

[0189] The virtual window displays the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device.

[0190] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0191] The ship perspective projection positioning method also includes:

[0192] All XR extended reality devices are configured to share the position in the cabin stereoscopic structure distribution map, and the transparently rendered cabin stereoscopic structure distribution map is displayed in a virtual window in each XR extended reality device.

[0193] The position of the XR extended reality device in the cabin's three-dimensional structure distribution map is updated in real time.

[0194] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0195] The ship perspective projection positioning method also includes:

[0196] Set up the wearer information and task information for each XR extended reality device;

[0197] When the third XR extended reality device selects the serial number of the XR extended reality device or the wearer's information for display, the serial number of the XR extended reality device or the number of the cabin model corresponding to the wearer's information is retrieved accordingly.

[0198] When the task information is selected, the serial numbers of all XR extended reality devices that execute the task information are obtained, and the number of the cabin model corresponding to the serial number of the XR extended reality device is retrieved accordingly.

[0199] Based on the number of the cabin model, determine the target XR extended reality device within the cabin model corresponding to the number of the cabin model, obtain the virtual viewpoint and virtual view cone of the target XR extended reality device relative to the third XR extended reality device, and display the equipment model and working fluid flow model within the cabin model corresponding to the number of the cabin model, as well as the position of the target XR extended reality device.

[0200] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0201] The steps of obtaining the location of each XR extended reality device and identifying the serial number of each XR extended reality device include:

[0202] Obtain the numbers of the positioning sensors installed in each compartment of the ship, and label the corresponding compartment model in the three-dimensional structure distribution diagram of the compartment with the number of each positioning sensor.

[0203] When the positioning sensor detects the infrared passive positioning sensor mark of the XR extended reality device, it identifies the graphic serial number of the infrared passive positioning sensor mark and uses the graphic serial number of the infrared passive positioning sensor mark as the serial number of the XR extended reality device.

[0204] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0205] The ship perspective projection positioning method also includes:

[0206] The display image in the virtual window is generated by adjusting the viewing cone distance and XR projection imaging resolution parameters of the virtual viewing cone.

[0207] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0208] The step of drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located includes:

[0209] A virtual window is projected onto the wall or obstacle of the cabin where the first XR extended reality device is located using a virtual camera, and a model of a person wearing the second XR extended reality device is displayed in the virtual window.

[0210] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0211] The step of drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located also includes:

[0212] A virtual view frustum of the second XR extended reality device relative to the first XR extended reality device is generated in the virtual window based on the view frustum distance and XR projection imaging resolution parameters.

[0213] The virtual viewpoint of the second XR Extended Reality device relative to the first XR Extended Reality device in the virtual window is calculated and generated from the real-time perceived six-DOF spatial position parameters of the camera of the XR Extended Reality device;

[0214] The second XR extended reality device displays the image in the virtual window based on the virtual viewpoint and virtual cone of the first XR extended reality device.

[0215] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0216] The description of displaying the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device, in the virtual window includes:

[0217] Obtain the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the position of the second XR extended reality device within the cabin model; render the personnel model wearing the second XR extended reality device; and form a target projection image by combining the equipment model, the working fluid flow model, and the personnel model.

[0218] Based on the virtual viewpoint and the virtual cone, the projected image of the target is transformed by perspective projection to obtain the image displayed in the virtual window.

[0219] For specific limitations on the steps implemented by the processor when executing a computer program, please refer to the limitations on the method of ship perspective projection positioning mentioned above, which will not be repeated here.

[0220] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0221] Obtain a 3D structural distribution diagram of the cabins of a ship using an XR extended reality device. The 3D structural distribution diagram includes cabin models, the location of each cabin model, the number of each cabin model, the equipment models and working fluid flow models within each cabin model.

[0222] The location of each XR extended reality device is obtained, the serial number of each XR extended reality device is identified, the serial number of each XR extended reality device is marked on the corresponding cabin model in the cabin three-dimensional structure distribution map, and the location of the cabin model, the number of the cabin model and the serial number of the XR extended reality device are associated.

[0223] When the first XR extended reality device issues a command to obtain the location of the second XR extended reality device, the serial numbers of the cabin models where the first XR extended reality device and the second XR extended reality device are located are obtained according to the serial numbers of the first XR extended reality device and the second XR extended reality device.

[0224] Draw virtual windows on the walls or obstacles of the cabin where the first XR extended reality device is located;

[0225] The virtual window displays the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device.

[0226] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0227] The ship perspective projection positioning method also includes:

[0228] All XR extended reality devices are configured to share the position in the cabin stereoscopic structure distribution map, and the transparently rendered cabin stereoscopic structure distribution map is displayed in a virtual window in each XR extended reality device.

[0229] The position of the XR extended reality device in the cabin's three-dimensional structure distribution map is updated in real time.

[0230] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0231] The ship perspective projection positioning method also includes:

[0232] Set up the wearer information and task information for each XR extended reality device;

[0233] When the third XR extended reality device selects the serial number of the XR extended reality device or the wearer's information for display, the serial number of the XR extended reality device or the number of the cabin model corresponding to the wearer's information is retrieved accordingly.

[0234] When the task information is selected, the serial numbers of all XR extended reality devices that execute the task information are obtained, and the number of the cabin model corresponding to the serial number of the XR extended reality device is retrieved accordingly.

[0235] Based on the number of the cabin model, determine the target XR extended reality device within the cabin model corresponding to the number of the cabin model, obtain the virtual viewpoint and virtual view cone of the target XR extended reality device relative to the third XR extended reality device, and display the equipment model and working fluid flow model within the cabin model corresponding to the number of the cabin model, as well as the position of the target XR extended reality device.

[0236] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0237] The steps of obtaining the location of each XR extended reality device and identifying the serial number of each XR extended reality device include:

[0238] Obtain the numbers of the positioning sensors installed in each compartment of the ship, and label the corresponding compartment model in the three-dimensional structure distribution diagram of the compartment with the number of each positioning sensor.

[0239] When the positioning sensor detects the infrared passive positioning sensor mark of the XR extended reality device, it identifies the graphic serial number of the infrared passive positioning sensor mark and uses the graphic serial number of the infrared passive positioning sensor mark as the serial number of the XR extended reality device.

[0240] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0241] The ship perspective projection positioning method also includes:

[0242] The display image in the virtual window is generated by adjusting the viewing cone distance and XR projection imaging resolution parameters of the virtual viewing cone.

[0243] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0244] The step of drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located includes:

[0245] A virtual window is projected onto the wall or obstacle of the cabin where the first XR extended reality device is located using a virtual camera, and a model of a person wearing the second XR extended reality device is displayed in the virtual window.

[0246] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0247] The step of drawing a virtual window on the wall or obstacle of the cabin where the first XR extended reality device is located also includes:

[0248] A virtual view frustum of the second XR extended reality device relative to the first XR extended reality device is generated in the virtual window based on the view frustum distance and XR projection imaging resolution parameters.

[0249] The virtual viewpoint of the second XR Extended Reality device relative to the first XR Extended Reality device in the virtual window is calculated and generated from the real-time perceived six-DOF spatial position parameters of the camera of the XR Extended Reality device;

[0250] The second XR extended reality device displays the image in the virtual window based on the virtual viewpoint and virtual cone of the first XR extended reality device.

[0251] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0252] The description of displaying the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the location of the second XR extended reality device, in the virtual window includes:

[0253] Obtain the equipment model and working fluid flow model within the cabin model where the second XR extended reality device is located, as well as the position of the second XR extended reality device within the cabin model; render the personnel model wearing the second XR extended reality device; and form a target projection image by combining the equipment model, the working fluid flow model, and the personnel model.

[0254] Based on the virtual viewpoint and the virtual cone, the projected image of the target is transformed by perspective projection to obtain the image displayed in the virtual window.

[0255] For specific limitations on the steps implemented when a computer program is executed by a processor, please refer to the limitations on the method of ship perspective projection positioning mentioned above, which will not be repeated here.

[0256] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0257] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0258] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A method of ship perspective projection positioning, characterized by, The method comprises the following steps: obtaining a cabin stereoscopic structure distribution diagram of a ship using an XR extended reality device, wherein the cabin stereoscopic structure distribution diagram comprises cabin models, positions of the cabin models, numbers of the cabin models, equipment models in the cabin models, and working medium flow models; obtaining the positions of each XR extended reality device, identifying the serial numbers of each XR extended reality device, marking the serial numbers of each XR extended reality device on the corresponding cabin model in the cabin stereoscopic structure distribution diagram, and associating the positions of the cabin models, the numbers of the cabin models, and the serial numbers of the XR extended reality devices; in response to a first XR extended reality device issuing a command to obtain the position of a second XR extended reality device, obtaining the numbers of the cabin models in which the first XR extended reality device and the second XR extended reality device are located according to the serial numbers of the first XR extended reality device and the second XR extended reality device; drawing a virtual window at the wall or obstacle of the cabin in which the first XR extended reality device is located; displaying the equipment models and working medium flow models in the cabin model in which the second XR extended reality device is located and the position of the second XR extended reality device in the virtual window.

2. The ship perspective projection positioning method as claimed in claim 1, characterized in that, Further comprising: setting the positions of all XR extended reality devices in the cabin stereoscopic structure distribution diagram to be shared, and displaying the cabin stereoscopic structure distribution diagram rendered in transparency in the virtual window of each XR extended reality device; updating the positions of the XR extended reality devices in the cabin stereoscopic structure distribution diagram in real time.

3. The ship perspective projection positioning method as claimed in claim 1, characterized in that, Further comprising: setting the information of the corresponding wearer and the task information of each XR extended reality device; when it is obtained that a third XR extended reality device selects the serial number of the XR extended reality device or the information of the wearer for display, the corresponding cabin model number in which the XR extended reality device or the wearer corresponds to is called up; when it is obtained that the task information is selected, the serial numbers of all XR extended reality devices that execute the task information are obtained, and the corresponding cabin model number in which the XR extended reality device corresponds to is called up; determining the target XR extended reality device in the cabin model corresponding to the cabin model number according to the cabin model number, obtaining the virtual viewpoint and virtual cone of the target XR extended reality device relative to the third XR extended reality device, and displaying the equipment models and working medium flow models in the cabin model corresponding to the cabin model number and the position of the target XR extended reality device.

4. The ship perspective projection positioning method as claimed in claim 1, characterized in that, The method further comprises the following steps: obtaining the numbers of positioning sensors arranged in each cabin in the ship, and marking the numbers of each positioning sensor on the corresponding cabin model in the cabin stereoscopic structure distribution diagram; when the positioning sensor identifies an infrared passive positioning sensor marker plate of the XR extended reality device, identifying the graphic serial number of the infrared passive positioning sensor marker plate, and taking the graphic serial number of the infrared passive positioning sensor marker plate as the serial number of the XR extended reality device.

5. The ship perspective projection positioning method as claimed in claim 3, characterized in that, Also comprising: Adjusting the frustum distance and XR projection imaging resolution parameters of the virtual frustum to generate a display image in the virtual window.

6. The ship perspective projection positioning method as claimed in claim 1, characterized in that, The virtual window drawn at the wall or obstacle of the cabin where the first XR extended reality device is located comprises: Through a virtual camera projection mode, a virtual window is drawn at the wall or obstacle of the cabin where the first XR extended reality device is located, and a personnel model wearing the second XR extended reality device is displayed in the virtual window.

7. The ship perspective projection positioning method as claimed in claim 1, characterized in that, The virtual window drawn at the wall or obstacle of the cabin where the first XR extended reality device is located further comprises: The virtual frustum of the second XR extended reality device relative to the first XR extended reality device in the virtual window is generated by the frustum distance and XR projection imaging resolution parameters; The virtual viewpoint of the second XR extended reality device relative to the first XR extended reality device in the virtual window is calculated and generated by the six-degree-of-freedom spatial position parameters of the camera of the XR extended reality device perceived in real time; According to the virtual viewpoint and virtual frustum of the second XR extended reality device relative to the first XR extended reality device, a picture is displayed in the virtual window.

8. The ship perspective projection positioning method as claimed in claim 3, characterized in that, The device model and working medium flow model in the cabin model where the second XR extended reality device is located and the position of the second XR extended reality device in the virtual window are displayed, which comprises: Obtaining the device model and working medium flow model in the cabin model where the second XR extended reality device is located and the position of the second XR extended reality device in the cabin model, rendering a personnel model wearing the second XR extended reality device, and forming a target projection image of the device model, the working medium flow model and the personnel model; Based on the virtual viewpoint and the virtual frustum, the target projection image is obtained through perspective projection transformation to display an image in the virtual window.

9. A ship perspective projection positioning device, characterized by The device comprises: A ship model construction module for obtaining a cabin three-dimensional structure distribution map of a ship using an XR extended reality device, wherein the cabin three-dimensional structure distribution map comprises cabin models, positions of the cabin models, numbers of the cabin models, device models and working medium flow models in the cabin models; A wearing device positioning module for obtaining the position of each XR extended reality device, identifying the serial number of each XR extended reality device, labeling the serial number of each XR extended reality device in the corresponding cabin model in the cabin three-dimensional structure distribution map, and associating the position of the cabin model, the number of the cabin model and the serial number of the XR extended reality device; A perspective position positioning module for obtaining the numbers of the cabin models where the first XR extended reality device and the second XR extended reality device are located according to the serial numbers of the first XR extended reality device and the second XR extended reality device in response to the first XR extended reality device issuing a command to obtain the position of the second XR extended reality device; A virtual window management module for drawing a virtual window at the wall or obstacle of the cabin where the first XR extended reality device is located; perspective projection image display module configured to display, in the virtual window, a device model and a working fluid flow model within a cabin model in which the second XR extended reality device is located and a position of the second XR extended reality device.

10. A computer program product comprising a computer program, characterized in that, The computer program, which is executed by a processor, implements the steps of the method according to any one of claims 1 to 8.

11. A computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor, when executing the computer program, implements the steps of the method according to any one of claims 1 to 8.

12. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program, which is executed by a processor, implements the steps of the method according to any one of claims 1 to 8. The computer program, which is executed by a processor, implements the steps of the method according to any one of claims 1 to 8.

Images