Multi-person collaborative cabin pushing operation auxiliary decision-making system, simulation device, equipment and medium

Abstract

The invention provides a multi-person collaborative cabin pushing operation auxiliary decision-making system, a simulation device, equipment and a medium, belongs to the technical field of ship construction virtual simulation management, solves the problem that a multi-person cabin pushing simulation verification site, visibility and a collaborative state are limited, supports elimination of various space interferences and verification of reasonability of a process route, and improves the simulation efficiency. Cooperative cabin pushing is trained, the reasonability of cabin pushing is evaluated, field operation construction is instructed and explained through three-dimensional operation, constructors can quickly and visually understand responsibilities of operation stations and comprehensively understand various influence factors of an operation field, and potential operation risks existing in the construction process are avoided.

Description

Technical Field

[0001] The present application belongs to the technical field of virtual simulation management of shipbuilding, and specifically relates to a multi-person collaborative cabin pushing operation auxiliary decision-making system and simulation device, electronic equipment and computer-readable storage medium. Background Art

[0002] The construction of large cruise ships is a complex and comprehensive system engineering project, with cumbersome process and complex construction environment. The operation process involves various types of lifting equipment, large tooling, and auxiliary equipment. On-site construction requires the collaboration of multiple types of work, multiple positions, and multiple teams. As a complex and comprehensive system, cabin pushing must be completed by a multi-person team, which involves path planning, personnel communication, collaborative cabin pushing, dryness detection and other steps. At present, due to the lack of multi-person collaborative interactive virtual simulation means for modular cabin pushing process, it is impossible to carry out multi-person collaborative operation and process verification research for cabin pushing operation site, which restricts the construction efficiency of large cruise ships.

[0003] In order to solve the problems of frequent spatial interference and poor process rationality in the prefabricated cabin pushing operation of large cruise ships, this paper constructs a multi-person collaborative cabin pushing operation decision-making support system and simulation device based on VR technology, combined with the needs of prefabricated cabin transfer, cabin pushing route planning and cabin pushing collaborative process simulation, using 3D digital modeling, multi-person collaborative interactive virtual simulation and other technologies. It can not only realize the simulation interactive verification of multi-person collaborative cabin pushing operation, support the elimination of various spatial interferences, verify the rationality of process routes, train collaborative cabin pushing and evaluate the rationality of cabin pushing, but also is an effective auxiliary means to improve the actual efficiency of cabin pushing. Summary of the invention

[0004] The purpose of this application is to provide a multi-person collaborative cabin pushing operation auxiliary decision-making system and simulation device, equipment and medium, which solves the problems of limited site, visibility and collaborative status of multi-person cabin pushing simulation verification. Through three-dimensional operation guidance instructions for on-site operation construction, construction personnel can quickly and intuitively understand the responsibilities of the work station, comprehensively understand various influencing factors on the work site, and avoid potential operation risks in the construction process.

[0005] To achieve the above objectives, this application provides the following solutions: The present application provides a multi-person collaborative push-carriage operation auxiliary decision-making system, comprising: The data model management module is used to build a virtual scene of modular cabin pushing that is consistent with the operation site environment based on the pushing operation process and process guidance documents, and manage the process data, operation environment, personnel and equipment information to provide basic data for the data model to build the modular cabin pushing model; A VR interactive simulation module is used to process the actual parameters of the virtual scene and the actual cabin, equipment data information, environmental data information, operation process data, and initial data in the process guidance file to obtain a VR interactive system between the real cabin pushing operation scene and the virtual scene; The cabin pushing operation simulation module is used to set the modular cabin pushing process and route based on the multi-person collaborative interaction simulation between multiple workstations during the cabin pushing process and the rationality evaluation of the cabin pushing process, visualize the cabin pushing process, perform collision checks on the cabin and construction resources on the cabin pushing route, and generate a cabin pushing process simulation optimization report; The three-dimensional operation guidance module for the push-tank is used to evaluate the entire engineering operation content after the push-tank simulation interactive operation is completed, select elements for the evaluation plan, select the evaluation method after the element selection is completed, and display the generated evaluation report plan in the form of a report.

[0006] Furthermore, the data model management module includes a model management module, a process data management module, a work scene management module and a personnel and equipment management module; The model management module is used to import models, manage model lists and edit models for cabins, hull assembly and construction resource settings involved in the modeled cabin hoisting process of an ocean-going passenger ship; The process data management module is used to manage the modular cabin pushing process information, shipyard pushing related basic data and shipyard pushing process specification rules, and provide data support for the pushing process planning and working time statistics; The operation scene management module is used to obtain the actual parameters of the real cabin, equipment data information, environmental data information, operation process data, and initial data in the process guidance file, process the actual parameters of the real cabin, create a modular cabin three-dimensional model, equipment three-dimensional model, and operator three-dimensional model, and define the association relationship between various simulation objects according to the cabin pushing operation process and process guidance file, and build a modular cabin pushing operation virtual scene; The personnel and equipment management module is used to establish and call the operation personnel model and equipment model with the push cabin operation personnel and equipment as the objects, and to construct a virtual environment for the push cabin simulation operation.

[0007] Furthermore, the operation scene management module includes a scene model rendering module; the scene model rendering module is used to select materials and color textures that match real products and equipment in the material library, use material mapping to fill materials for objects of the initially constructed three-dimensional model, and perform environmental lighting baking settings, and export the three-dimensional model after mapping rendering.

[0008] Furthermore, the operation scenario management module includes a simulation model association information determination module; the simulation model association information determination module forms a flow logic model of the modular cabin pushing process and a 3D operation expression model within the operation steps according to the modular cabin pushing process based on process modeling combined with the process node attributes of the modular cabin pushing process, the expression of dependency relationships between process nodes, the attributes within the process / process steps, and the 3D operation expression method, and creates a 3D digital model of the modular cabin pushing process.

[0009] Furthermore, the VR interaction simulation module includes a VR device integration module, a somatosensory interaction simulation module, a multi-person collaborative network communication module, and a multi-person collaborative interaction simulation module; The VR device integration module is used to perform read and write operations on the simulation computer, touch screen, VR helmet set, tracker and base station bracket equipment based on the communication protocol to realize data collection, transmission and storage; The somatosensory interaction simulation module is used to obtain somatosensory feedback data of the push cabin operators, and collect the limb interaction information of the push cabin operators through a 3D position tracker, an immersive head-mounted virtual reality display, an interactive handle and gloves; The multi-person collaborative network communication module is used to realize the communication network between the server and the simulation client based on the server-client architecture, and realize the multi-person online interaction function between multiple workstations; The multi-person collaborative interaction simulation module is used to simulate collaborative interaction between modular cabin pushing operators and collaborative interaction between cabin pushing operators and on-site commanders during collaborative cabin pushing operations.

[0010] Furthermore, the cabin pushing operation simulation module includes a cabin pushing personnel and equipment definition module, a cabin pushing route definition module, a cabin pushing process rationality evaluation module, and a cabin pushing operation process simulation optimization module; The cabin pushing personnel and equipment definition module is used to define cabin pushing equipment and cabin pushing collaborative operation personnel according to each cabin pushing process flow, and select and modify the cabin pushing process flow according to the cabin pushing process model; The cabin pushing route definition module is used to plan the cabin pushing route for the modular cabins at each process stage based on the cabin pushing route drawing, and select and modify the cabin pushing route according to the completed cabin structure drawing and the interference collision risk of the construction resources; The said cabin pushing process rationality assessment module is used to assess the rationality of the selection of the cabin pushing process method and route through interactive simulation of the operation process according to the set cabin pushing process personnel, equipment and cabin pushing route, so as to form a cabin pushing process; The cabin pushing operation process simulation optimization module is used to set the modular cabin pushing process flow, visualize the cabin pushing process, perform collision checks on the cabin and construction resources on the cabin pushing route, generate a cabin pushing process simulation optimization report and a cabin pushing process rationality evaluation report, and perform comparative verification.

[0011] Furthermore, the cabin pushing operation process simulation optimization module is also used to record the cabin pushing process animation in the form of animation recording, and by recording the coordinate points of the cabin pushing process, it is possible to play back the animation and view the animation content from various angles.

[0012] Furthermore, the three-dimensional cabin pushing operation guidance module is also used to record the simulation process during the modular cabin pushing simulation by setting the first perspective, the third perspective, and multiple virtual camera perspectives. After the simulation is completed, a multi-perspective modular cabin hoisting simulation video is output to form a three-dimensional process instruction book for hoisting the modular cabin into the cabin.

[0013] Furthermore, the three-dimensional cabin pushing operation guidance module is also used to select evaluation factors of cabin pushing in the cabin pushing record, and the evaluation factors include engineering quantity, engineering cycle and tool and equipment resource allocation status.

[0014] Furthermore, the three-dimensional cabin pushing operation guidance module is also used to set an evaluation method for calculating the cabin pushing efficiency, calculate the weight of the elements, obtain the proportion of each element, and obtain the evaluation result through the proportion calculation result.

[0015] The present application also provides a multi-person collaborative interaction simulation device for pushing a cabin, which interacts with the multi-person collaborative cabin pushing operation auxiliary decision-making system, and the multi-person collaborative interaction simulation device for pushing a cabin includes a 3D position tracker, an immersive head-mounted virtual reality display, an interactive handle and gloves; the 3D position tracker is used to collect the somatosensory information of the cabin pushing operator, and collect the position, movement and interaction information of the hoisting operator; the 3D position tracker includes a tracking module and a positioning module; wherein the tracking module is fixedly installed at the human-computer interaction virtual simulation space site, and the positioning module is fixed on the body of the simulation participant by hand-held or worn means, and is used to send body signals of the simulation participant to the simulation computer, and at the same time transmit visual feedback information to the helmet worn by the simulation participant through computer simulation, and the position tracking information is analyzed to realize somatosensory interaction.

[0016] The present application also provides an electronic device, which includes: a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and when the computer program is executed by the processor, the steps of the push cabin operation simulation operation method described above are implemented.

[0017] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for simulating the operation of the push-carrier operation described above are implemented.

[0018] Beneficial effects of the present application: The present application constructs a 3D digital model of the cabin pushing process based on VR technology, forming auxiliary methods such as somatosensory interactive simulation, multi-person collaborative interactive simulation, process path planning, collaborative pushing, dryness detection and three-dimensional process guidance, etc., to support on-site operators to observe the status of the simulation object during the operation process from different perspectives, fully understand the overall process flow and the operating specifications of the corresponding workstations, discover the deficiencies and risks of the process during the shipbuilding operation, timely adjust and improve the operation process, improve the feasibility of the process, and reduce construction risks. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 The framework diagram of the multi-person collaborative cabin pushing operation auxiliary decision-making system provided for this application; Figure 2 Functional flow chart of the multi-person collaborative push-carriage operation auxiliary decision-making system provided for this application; Figure 3 A schematic diagram of the spatial layout of the somatosensory interaction module provided in this application; Figure 4 A schematic diagram of the configuration process of the somatosensory interaction module provided in this application; Figure 5 A schematic diagram of the simulation optimization process of the push-carriage process provided for this application; Figure 6 Schematic diagram of the rationality assessment process of the push-cart process provided for this application; Figure 7 An internal structural diagram of the computer device provided for this application. DETAILED DESCRIPTION

[0020] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0021] The present application is further described below with reference to specific examples and drawings. Example 1

[0022] like Figure 1As shown, Example 1 of the present application provides a multi-person collaborative cabin pushing operation auxiliary decision-making system 10, and the multi-person collaborative cabin pushing operation auxiliary decision-making system 10 includes: a data model management module 1, a VR interactive simulation module 2, a cabin pushing operation simulation module 3, and a cabin pushing three-dimensional operation guidance module 4.

[0023] Among them, the data model management module 1 is used for model information, process data, operating environment, personnel and equipment information management, providing a data basis for building a modular cabin lifting model, including model management, process data management, operating scene management and personnel and equipment management.

[0024] The VR interactive simulation module 2 is used to construct a virtual environment for simulating the push-cabin operation, integrating VR helmets, trackers, locators and other equipment, and based on the communication protocol, realizes the collection and storage of somatosensory interactive information and multi-person collaborative network communication, providing a hardware and software integration environment for the simulation of the push-cabin operation process.

[0025] The cabin pushing operation simulation module 3 is used to visualize the cabin pushing process, and based on the VR interactive simulation module 2, performs process path planning and interference collision inspection, records the cabin pushing operation process, and generates a cabin pushing process simulation optimization report.

[0026] The three-dimensional cabin pushing operation guidance module 4 is used to evaluate the entire cabin pushing operation content, set evaluation factors and methods based on the interactive simulation records of the cabin pushing operation simulation module 3, and form analysis reports to promote process improvement and process optimization.

[0027] like Figure 3 As shown, the spatial layout diagram of the somatosensory interaction module mainly includes a 3D position tracker, an immersive head-mounted virtual reality display, and an interactive handle; The 3D position tracker includes a tracking module and a positioning module, which are used to collect the somatosensory information of the push cabin operators and the position, movement and interaction information of the hoisting operators; Furthermore, the tracker is installed at the site of the human-computer interaction virtual simulation space to obtain the location information of personnel and equipment in real time; Furthermore, the locator is fixed on the body of the simulation participant by hand-held or worn, and is used to send body signals of the simulation participant to the simulation computer. At the same time, the visual feedback information is transmitted to the helmet worn by the simulation participant through computer simulation, and the function of somatosensory interaction is realized by the system analyzing the position tracking information.

[0028] The immersive head-mounted virtual reality display realizes the function of somatosensory interaction through the system's analysis of limb information.

[0029] The interactive handle is associated by infrared tracking and positioning to realize the input of the operator's body signal to the simulation computer.

[0030] like Figure 4 As shown, this example illustrates the configuration process of the somatosensory interaction module, which mainly includes steps S1-S8.

[0031] S1: Check the computer configuration compliance. Before installing the configuration, first check whether the simulation host configuration can meet the performance requirements.

[0032] S2: Install the device driver. After the first connection to the VR device, calibrate the device through the client, including the headset, handle controller, base station, and other trackable devices such as ViVE Trakcer.

[0033] S3: Build the position tracker bracket, and clear enough space for activities. The minimum required space is 2m*1.5m.

[0034] Furthermore, when installing the base stations, it is important to note that the two base stations installed at a high altitude can "see" most of the activity space, and there is no obstruction between them. The two base stations need to be placed separately, and there should be no objects blocking their view of each other.

[0035] S4: Install the VR helmet display, connect the headset to the host through the power adapter. Special note: the connection cable between the headset and the host, and the connection cable between the display and the host must be plugged into the same graphics card slot. The indicator light of the headset device is red for abnormality and green for normal.

[0036] S5: Bind Tracke, helmet, and handle. The head-mounted device and handle are used as the main interactive instruments. Use the client software to initialize the position. Turn on the head-mounted device and handle switches. Follow the step prompts to locate. If there is a deviation or dissatisfaction with the positioning, you can repeat the positioning. Place the helmet and two handle controllers within the visual range of the two locators.

[0037] S6: Position the monitor. Within the visible range of the locator, point the controller towards the computer display, and then keep pressing the button on the back to complete the monitor positioning.

[0038] S7: Locate the ground: Place the two handle controllers within the visible range of the locator, click the "Calibrate Ground" button on the computer screen, and wait for the system to calibrate.

[0039] S8: Measure the activity space: Use a handle controller, walk a few steps and press the button on the back of the controller. If there is a vibration, it means that the point is within the visible range of the locator and the drawing is valid; if not, it means that it is invalid. Repeat the drawing point by point until the required activity space is finally drawn.

[0040] like Figure 5 As shown, an embodiment of the present application provides a method for simulating and optimizing a push-carrier process, comprising the following steps S51-S56.

[0041] S51: Construction of logical model of push-carrier process flow: call Figure 1 The data model management module 1 provides process data (including basic information such as tank pushing process information, shipyard tank pushing process specification rules, etc.), defines the tank pushing equipment and tank pushing collaborative operation personnel.

[0042] S52: 3D digital model creation, call Figure 1 The operation scene in the operation scene provides the push cabin operation scene, through Figure 2 S2 in the paper combines the process node attributes of the cabin pushing process, the expression of the dependency relationship between the process nodes, the attributes within the process / process steps, and the 3D operation expression method to form a process flow logic model for modeling the modular cabin pushing process and a 3D operation expression model within the operation steps, and create a 3D digital model of the modular cabin pushing process.

[0043] S53: Design of the process flow of pushing the cabin, based on the pushing cabin route drawing, with the help of the process engine, the logic model of S51 is used to define the pushing cabin route in the digital model of S52; S54: Pushing cabin route collision check: According to the process path display, the pushing cabin role will perform collaborative pushing cabin simulation operation interaction in the operation area according to the task prompt. Figure 3 and Figure 4 In the multi-person simulation interaction module, users wear VR display devices and interactive gloves on their hands. Users approach and touch the modular cabin in the scene, push the pressure sensor, and push the cabin to the designated location. During the collaborative cabin pushing operation by multiple users, the role of the quality assurance department pays attention to the collision problem of the entire model when implementing the cabin pushing operation, and prompts the role user of the cabin pushing department to avoid collision in real time. When interference collision problems occur, the cabin pushing user will change the position of the key points of the path and switch to autonomous path planning.

[0044] S55: Visual display of the push-cart process, through Figure 1 The push cabin operation simulation module 3 can realize the functions of playing back animation and viewing from various angles.

[0045] By viewing the animation of the pushing process, determine whether the process is optimal. If it is optimal, proceed to S56. If not, repeat steps S53 to S55.

[0046] S56: Output simulation optimization report.

[0047] like Figure 6 As shown, an embodiment of the present application provides a method for evaluating the rationality of a cabin pushing process, including the following steps S61-S65.

[0048] S61: Construction of the logic model of the push-carrier process flow, calling Figure 1 The data model management module 1 provides process data (including basic information such as tank pushing process information, shipyard tank pushing process specification rules, etc.), defines the tank pushing equipment and tank pushing collaborative operation personnel.

[0049] S62: Selection of process parameters for pushing the cabin, including engineering quantity, engineering cycle and tool and equipment resource ratio.

[0050] S63: Determine whether the definition of the personnel and equipment of the pusher cabin meets the requirements; if so, proceed to step S64; if not, repeat step S62.

[0051] S64: Determine the rationality of the cabin pushing route, and the design department role will perform path planning. The user needs to use the handle trigger to emit rays and click the "Process Path Planning" button. The interface will display the cabin pushing route. The design department role user can select the pop-up route planning and set the process path. At the same time, the cabin pushing operation can be performed according to the path prompts.

[0052] The rationality of the push cabin route is determined. If it meets the requirements, proceed to step S65; if it does not meet the requirements, repeat step S62.

[0053] S65: Output the rationality assessment report of the push tank. Example 2

[0054] Embodiment 2 of the present application includes all the technical features of Embodiment 1.

[0055] like Figure 1 As shown, Example 2 of the present application provides a multi-person collaborative cabin pushing operation decision-making assistance system 10, and the multi-person collaborative cabin pushing operation decision-making assistance system 10 includes: a data model management module 1, a VR interactive simulation module 2, a cabin pushing operation simulation module 3, and a cabin pushing three-dimensional operation guidance module 4.

[0056] Data model management module 1 is used to build a virtual scene of modular cabin pushing that is consistent with the operation site environment based on the cabin pushing operation process and process guidance documents, and manage process data, operation environment, personnel and equipment information to provide data model basic data for building a modular cabin pushing model; VR interactive simulation module 2, used to process the actual parameters of the virtual scene and the real cabin, equipment data information, environmental data information, operation process data, and initial data in the process guidance file to obtain a VR interactive system between the real push cabin operation scene and the virtual scene; The cabin pushing operation simulation module 3 is used to set the modular cabin pushing process and route based on the multi-person collaborative interaction simulation between multiple workstations during the cabin pushing process and the rationality evaluation requirements of the cabin pushing process, visualize the cabin pushing process, perform collision checks on the cabin and construction resources on the cabin pushing route, and generate a cabin pushing process simulation optimization report; The three-dimensional operation guidance module 4 of the push cabin is used to evaluate the entire engineering operation content after the push cabin simulation interactive operation is completed, select elements for the evaluation plan, select the evaluation method after the element selection is completed, and display the generated evaluation report plan in the form of a report.

[0057] Furthermore, the data model management module 1 includes a model management module, a process data management module, a work scene management module and a personnel and equipment management module; The model management module is used to import models, manage model lists and edit models for cabins, hull assembly and construction resource settings involved in the modeled cabin hoisting process of an ocean-going passenger ship; The process data management module is used to manage the modular cabin pushing process information, shipyard pushing related basic data and shipyard pushing process specification rules, and provide data support for the pushing process planning and working time statistics; The operation scene management module is used to obtain the actual parameters of the real cabin, equipment data information, environmental data information, operation process data, and initial data in the process guidance file, process the actual parameters of the real cabin, create a modular cabin three-dimensional model, equipment three-dimensional model, and operator three-dimensional model, and define the association relationship between various simulation objects according to the cabin pushing operation process and process guidance file, and build a modular cabin pushing operation virtual scene; The personnel and equipment management module is used to establish and call the operation personnel model and equipment model with the push cabin operation personnel and equipment as the objects, and to construct a virtual environment for the push cabin simulation operation.

[0058] Furthermore, the operation scene management module includes a scene model rendering module; the scene model rendering module is used to select materials and color textures that match real products and equipment in the material library, use material mapping to fill materials for objects of the initially constructed three-dimensional model, and perform environmental lighting baking settings, and export the three-dimensional model after mapping rendering.

[0059] The initially constructed 3D model only has the cabin's exterior outline and simple homogeneous material mapping, and the surface and interior have no texture effects corresponding to the material. In order to improve the model's visualization and realism, scene rendering is performed, and the material and color texture closest to the real product and equipment are selected in the material library. The material mapping function is used to fill the object with material, and then the ambient lighting baking settings are performed. Finally, the model with mapping rendering is imported into the system.

[0060] Furthermore, the operation scenario management module includes a simulation model association information determination module; the simulation model association information determination module forms a flow logic model of the modular cabin pushing process and a 3D operation expression model within the operation steps according to the modular cabin pushing process based on process modeling combined with the process node attributes of the modular cabin pushing process, the expression of dependency relationships between process nodes, the attributes within the process / process steps, and the 3D operation expression method, and creates a 3D digital model of the modular cabin pushing process.

[0061] Among them, according to the characteristics of the modular cabin pushing process, based on the process modeling technology, combined with the process node attributes of the pushing process, the expression of dependency relationships between process nodes, the attributes within the process / process steps and the 3D operation expression method, a process flow logic model for modeling the modular cabin pushing process and a 3D operation expression model within the operation steps are formed to create a 3D digital model of the modular cabin pushing process.

[0062] Furthermore, the VR interaction simulation module 2 includes a VR device integration module, a somatosensory interaction simulation module, a multi-person collaborative network communication module, and a multi-person collaborative interaction simulation module; The VR device integration module is used to perform read and write operations on the simulation computer, touch screen, VR helmet set, tracker and base station bracket equipment based on the communication protocol to realize data collection, transmission and storage; The somatosensory interaction simulation module is used to obtain somatosensory feedback data of the push cabin operators, and collect the limb interaction information of the push cabin operators through a 3D position tracker, an immersive head-mounted virtual reality display, an interactive handle and gloves; The multi-person collaborative network communication module is used to realize the communication network between the server and the simulation client based on the server-client architecture, and realize the multi-person online interaction function between multiple workstations; The multi-person collaborative interaction simulation module is used to simulate collaborative interaction between modular cabin pushing operators and collaborative interaction between cabin pushing operators and on-site commanders during collaborative cabin pushing operations.

[0063] Furthermore, the cabin pushing operation simulation module 3 includes a cabin pushing personnel and equipment definition module, a cabin pushing route definition module, a cabin pushing process rationality evaluation module, and a cabin pushing operation process simulation optimization module; The cabin pushing personnel and equipment definition module is used to define cabin pushing equipment and cabin pushing collaborative operation personnel according to each cabin pushing process flow, and select and modify the cabin pushing process flow according to the cabin pushing process model; The cabin pushing route definition module is used to plan the cabin pushing route for the modular cabins at each process stage based on the cabin pushing route drawing, and select and modify the cabin pushing route according to the completed cabin structure drawing and the interference collision risk of the construction resources; The said cabin pushing process rationality assessment module is used to assess the rationality of the selection of the cabin pushing process method and route through interactive simulation of the operation process according to the set cabin pushing process personnel, equipment and cabin pushing route, so as to form a cabin pushing process; The cabin pushing operation process simulation optimization module is used to set the modular cabin pushing process flow, visualize the cabin pushing process, perform collision checks on the cabin and construction resources on the cabin pushing route, generate a cabin pushing process simulation optimization report and a cabin pushing process rationality evaluation report, and perform comparative verification.

[0064] Furthermore, the cabin pushing operation process simulation optimization module is also used to record the cabin pushing process animation in the form of animation recording, and by recording the coordinate points of the cabin pushing process, it is possible to play back the animation and view the animation content from various angles.

[0065] The multi-person collaborative interaction simulation realizes the collaborative interaction between modular cabin pushing operators and the collaborative interaction between cabin pushing operators and on-site commanders during the collaborative cabin pushing operation.

[0066] The cabin pushing operation simulation module 3: based on the multi-person collaborative interaction simulation and cabin pushing route simulation requirements between multiple workstations during the cabin pushing process, a modular cabin pushing process flow is set up, the cabin pushing process is visualized, collision checks are performed on the cabin and construction resources on the cabin pushing route, and a cabin pushing process simulation optimization report is generated to improve the cabin pushing operation efficiency and reduce rework caused by unreasonable cabin pushing plans. It mainly includes cabin pushing personnel and equipment definition, cabin pushing route definition, cabin pushing process rationality evaluation, and cabin pushing operation process simulation optimization.

[0067] The definition of cabin pushing personnel and equipment: for each cabin pushing process flow, cabin pushing equipment and cabin pushing collaborative workers are defined to facilitate designers to select and modify the cabin pushing process flow according to the cabin pushing process model.

[0068] The cabin pushing route definition is as follows: based on the cabin pushing route drawing, the cabin pushing route is defined for the modular cabins at each process stage, so that the designers can select and modify the cabin pushing route according to the completed cabin structure drawing and the interference and collision problems of other construction resources.

[0069] Furthermore, the cabin push route definition includes process path planning. The process path planning is performed by the design department role. The user needs to use the handle trigger to emit rays and click the "Process Path Planning" button. The interface will display the cabin push operation route. The design department role user can select the pop-up route planning and set the process path. At the same time, the cabin push operation can be performed according to the path prompts.

[0070] The simulation optimization of the cabin pushing operation process: setting a modular cabin pushing process flow, visually displaying the cabin pushing process, performing collision checks on the cabin and construction resources on the cabin pushing route, and generating a cabin pushing process simulation optimization report and a cabin pushing process rationality evaluation report for comparative verification.

[0071] Furthermore, the simulation optimization of the cabin pushing operation process includes collaborative cabin pushing operation simulation. According to the process path display, the cabin pushing role will interact with the collaborative cabin pushing simulation operation in the operation area according to the task prompts. The user wears a VR display device and interactive gloves on both hands. The user approaches the modular cabin in the scene and touches it, pushes the pressure sensor, and pushes the cabin to the designated location.

[0072] Furthermore, the simulation optimization of the cabin pushing operation process includes the interference check effect. In order to avoid the risk of equipment collision during the user's collaborative cabin pushing operation, an interference check hazard display panel is added. At the same time, as a role in the quality assurance department, the user needs to pay attention to the entire model collision problem when implementing the cabin pushing operation, and in reality, the cabin pushing department role user is prompted in real time to avoid collision. When an interference collision problem occurs, the cabin pushing user will change the position of the key points of the path and switch to autonomous path planning.

[0073] Furthermore, the simulation optimization of the push-cabin operation process includes recording the push-cabin process, and recording the entire operation process in the form of animation recording. By recording the coordinate points of the push-cabin process, the function of replaying the animation and viewing it from various angles can be realized. To perform the animation recording operation, click the completion button in the upper right corner of the interface, and the recorded animation content will be directly saved and displayed in the resource box.

[0074] Furthermore, the three-dimensional cabin pushing operation guidance module 4 is also used to record the simulation process during the modular cabin pushing simulation by setting the first perspective, the third perspective, and multiple virtual camera perspectives. After the simulation is completed, a multi-perspective modular cabin hoisting simulation video is output to form a three-dimensional process instruction book for hoisting the modular cabin into the cabin.

[0075] Furthermore, the three-dimensional cabin pushing operation guidance module 4 is also used to select evaluation factors of cabin pushing in the cabin pushing record, and the evaluation factors include engineering quantity, engineering cycle and tool equipment resource allocation status.

[0076] Furthermore, the three-dimensional cabin pushing operation guidance module 4 is also used to set an evaluation method for calculating the cabin pushing efficiency, calculate the weight of the elements, obtain the proportion of each element, and obtain the evaluation result through the proportion calculation result.

[0077] The present application also provides a multi-person collaborative interaction simulation device for pushing a cabin, which interacts with the multi-person collaborative cabin pushing operation auxiliary decision-making system, and the multi-person collaborative interaction simulation device for pushing a cabin includes a 3D position tracker, an immersive head-mounted virtual reality display, an interactive handle and gloves; the 3D position tracker is used to collect the somatosensory information of the cabin pushing operator, and collect the position, movement and interaction information of the hoisting operator; the 3D position tracker includes a tracking module and a positioning module; wherein the tracking module is fixedly installed at the human-computer interaction virtual simulation space site, and the positioning module is fixed on the body of the simulation participant by hand-held or worn means, and is used to send body signals of the simulation participant to the simulation computer, and at the same time transmit visual feedback information to the helmet worn by the simulation participant through computer simulation, and the position tracking information is analyzed to realize somatosensory interaction.

[0078] Furthermore, the tracking module is installed at the site of the human-computer interaction virtual simulation space to obtain the location information of personnel and equipment in real time; Furthermore, the positioning module is fixed on the body of the simulation participant by hand-held or worn, and is used to send body signals of the simulation participant to the simulation computer. At the same time, the visual feedback information is transmitted to the helmet worn by the simulation participant through computer simulation, and the function of somatosensory interaction is realized by the system analyzing the position tracking information.

[0079] The immersive head-mounted virtual reality display realizes the function of somatosensory interaction through the system's analysis of limb information; The interactive handle is associated by infrared tracking and positioning to realize the input of the operator's body signal to the simulation computer.

[0080] The present application also provides an electronic device, which includes: a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and when the computer program is executed by the processor, the steps of the push cabin operation simulation operation method described above are implemented.

[0081] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 7As shown. The computer device includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store the simulation operation data of the push cabin operation. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for simulating the operation of the push cabin operation is implemented.

[0082] Those skilled in the art will understand that Figure 7 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0083] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for simulating the operation of the push-carrier operation described above are implemented.

[0084] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0085] Beneficial effects of the present application: The present application constructs a 3D digital model of the cabin pushing process based on VR technology, forming auxiliary methods such as somatosensory interactive simulation, multi-person collaborative interactive simulation, process path planning, collaborative pushing, dryness detection and three-dimensional process guidance, etc., to support on-site operators to observe the status of the simulation object during the operation process from different perspectives, fully understand the overall process flow and the operating specifications of the corresponding workstations, discover the deficiencies and risks of the process during the shipbuilding operation, timely adjust and improve the operation process, improve the feasibility of the process, and reduce construction risks.

Claims

1. A multi-person collaborative push-carriage operation decision-making support system, characterized in that: include: The data model management module is used to build a virtual scene of modular cabin pushing that is consistent with the operation site environment based on the pushing operation process and process guidance documents, and manage the process data, operation environment, personnel and equipment information to provide basic data for the data model to build the modular cabin pushing model; A VR interactive simulation module is used to process the actual parameters of the virtual scene and the actual cabin, equipment data information, environmental data information, operation process data, and initial data in the process guidance file to obtain a VR interactive system between the real cabin pushing operation scene and the virtual scene; The cabin pushing operation simulation module is used to set the modular cabin pushing process and route based on the multi-person collaborative interaction simulation between multiple workstations during the cabin pushing process and the rationality evaluation of the cabin pushing process, visualize the cabin pushing process, perform collision checks on the cabin and construction resources on the cabin pushing route, and generate a cabin pushing process simulation optimization report; The three-dimensional operation guidance module for the push-tank is used to evaluate the entire engineering operation content after the push-tank simulation interactive operation is completed, select elements for the evaluation plan, select the evaluation method after the element selection is completed, and display the generated evaluation report plan in the form of a report.

2. The multi-person collaborative push-carriage operation auxiliary decision-making system according to claim 1 is characterized in that: The data model management module includes a model management module, a process data management module, a work scene management module and a personnel and equipment management module; The model management module is used to import models, manage model lists and edit models for cabins, hull assembly and construction resource settings involved in the modeled cabin hoisting process of an ocean-going passenger ship; The process data management module is used to manage the modular cabin pushing process information, shipyard pushing related basic data and shipyard pushing process specification rules, and provide data support for the pushing process planning and working time statistics; The operation scene management module is used to obtain the actual parameters of the real cabin, equipment data information, environmental data information, operation process data, and initial data in the process guidance file, process the actual parameters of the real cabin, create a modular cabin three-dimensional model, equipment three-dimensional model, and operator three-dimensional model, and define the association relationship between various simulation objects according to the cabin pushing operation process and process guidance file, and build a modular cabin pushing operation virtual scene; The personnel and equipment management module is used to establish and call the operation personnel model and equipment model with the push cabin operation personnel and equipment as the objects, and to construct a virtual environment for the push cabin simulation operation.

3. The multi-person collaborative push-carriage operation auxiliary decision-making system according to claim 2 is characterized in that: The operation scene management module includes a scene model rendering module; the scene model rendering module is used to select materials and color textures that match real products and equipment in the material library, use material mapping to fill materials for objects of the initially constructed three-dimensional model, perform ambient lighting baking settings, and export the three-dimensional model after mapping rendering.

4. The multi-person collaborative push-carriage operation auxiliary decision-making system according to claim 2 is characterized in that: The operation scenario management module includes a simulation model association information determination module; the simulation model association information determination module forms a modular cabin pushing process logic model and a 3D operation expression model within the operation steps according to the modular cabin pushing process based on process modeling combined with the process node attributes of the modular cabin pushing process, the expression of dependency relationships between process nodes, the attributes within the process / process steps, and the 3D operation expression method, and creates a 3D digital model of the modular cabin pushing process.

5. The multi-person collaborative push-carriage operation auxiliary decision-making system according to claim 1 is characterized in that: The VR interactive simulation module includes a VR device integration module, a somatosensory interactive simulation module, a multi-person collaborative network communication module, and a multi-person collaborative interactive simulation module; The VR device integration module is used to perform read and write operations on the simulation computer, touch screen, VR helmet set, tracker and base station bracket equipment based on the communication protocol to realize data collection, transmission and storage; The somatosensory interaction simulation module is used to obtain somatosensory feedback data of the push cabin operators, and collect the limb interaction information of the push cabin operators through a 3D position tracker, an immersive head-mounted virtual reality display, an interactive handle and gloves; The multi-person collaborative network communication module is used to realize the communication network between the server and the simulation client based on the server-client architecture, and realize the multi-person online interaction function between multiple workstations; The multi-person collaborative interaction simulation module is used to simulate collaborative interaction between modular cabin pushing operators and collaborative interaction between cabin pushing operators and on-site commanders during collaborative cabin pushing operations.

6. The multi-person collaborative push-carriage operation auxiliary decision-making system according to claim 1 is characterized in that: The cabin pushing operation simulation module includes a cabin pushing personnel and equipment definition module, a cabin pushing route definition module, a cabin pushing process rationality evaluation module and a cabin pushing operation process simulation optimization module; The cabin pushing personnel and equipment definition module is used to define cabin pushing equipment and cabin pushing collaborative operation personnel according to each cabin pushing process flow, and select and modify the cabin pushing process flow according to the cabin pushing process model; The cabin pushing route definition module is used to plan the cabin pushing route for the modular cabins at each process stage based on the cabin pushing route drawing, and select and modify the cabin pushing route according to the completed cabin structure drawing and the interference collision risk of the construction resources; The said cabin pushing process rationality assessment module is used to assess the rationality of the selection of the cabin pushing process method and route through interactive simulation of the operation process according to the set cabin pushing process personnel, equipment and cabin pushing route, so as to form a cabin pushing process; The cabin pushing operation process simulation optimization module is used to set the modular cabin pushing process flow, visualize the cabin pushing process, perform collision checks on the cabin and construction resources on the cabin pushing route, generate a cabin pushing process simulation optimization report and a cabin pushing process rationality evaluation report, and perform comparative verification.

7. The multi-person collaborative push-carriage operation auxiliary decision-making system according to claim 6 is characterized in that: The cabin pushing operation process simulation optimization module is also used to record the cabin pushing process animation in the form of animation recording. By recording the coordinate points of the cabin pushing process, the animation can be played back and the animation content can be viewed from various angles.

8. The multi-person collaborative push-carriage operation auxiliary decision-making system according to claim 1 is characterized in that: The three-dimensional cabin pushing operation guidance module is also used to record the simulation process during the modular cabin pushing simulation by setting the first perspective, the third perspective, and multiple virtual camera perspectives. After the simulation is completed, a multi-perspective modular cabin hoisting simulation video is output to form a three-dimensional process guidance book for the modular cabin hoisting into the cabin.

9. The multi-person collaborative push-carriage operation auxiliary decision-making system according to claim 1 is characterized in that: The three-dimensional cabin pushing operation guidance module is also used to select evaluation factors of cabin pushing in the cabin pushing record, and the evaluation factors include engineering quantity, engineering cycle and tool equipment resource allocation status.

10. The multi-person collaborative push-carriage operation auxiliary decision-making system according to claim 1 is characterized in that: The three-dimensional cabin pushing operation guidance module is also used to set an evaluation method for calculating the cabin pushing efficiency, calculate the weight of the elements, obtain the proportion of each element, and obtain the evaluation result through the proportion calculation result.

11. A multi-person collaborative interaction simulation device for a push cabin, characterized in that: Interacting with the multi-person collaborative cabin pushing operation auxiliary decision-making system, the cabin pushing multi-person collaborative interaction simulation device includes a 3D position tracker, an immersive head-mounted virtual reality display, an interactive handle and gloves; the 3D position tracker is used to collect the somatosensory information of the cabin pushing operator, and collect the position, movement and interaction information of the hoisting operator; the 3D position tracker includes a tracking module and a positioning module; wherein the tracking module is fixedly installed at the human-computer interaction virtual simulation space site, and the positioning module is fixed on the body of the simulation participant by hand-held or worn means, and is used to send body signals of the simulation participant to the simulation computer, and at the same time transmit visual feedback information to the helmet worn by the simulation participant through computer simulation, and the position tracking information analysis realizes somatosensory interaction.

12. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the steps of the method for simulating the operation of a push-carrier operation as described in any one of claims 1 to 10 are implemented.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method for simulating the operation of a push-carrier operation as described in any one of claims 1 to 10 are implemented.

Images