A digital twin multi-end collaborative scene building method and device, equipment and storage medium

Abstract

The application discloses a digital twin multi-end collaborative scene building method and device, equipment and a storage medium, the method comprises the following steps: obtaining target scene editing data transmitted by a target client, the target scene editing data is scene editing data generated by the target client in response to user editing operations in a digital twin scene editor according to a current scene model; generating target component model data based on the scene editing data through a plurality of building process processors; transmitting the target component model data to each client; and integrating the target component model data into a corresponding scene through a local digital twin scene editor in each client. As can be seen, multiple clients can collaboratively edit through the digital twin scene editor, realizing multi-person collaborative work. After the component model data edited by a single person is processed by the server, other people can view the scene building effect in real time, thereby shortening the delivery cycle, reducing the cost, and improving the overall quality of the project.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of digital twinning, more particularly, to a digital twinning multi-end collaborative scene building method and device, equipment and storage medium. BACKGROUND

[0002] Under the current digital development wave, digital twinning technology is widely used in many fields, from industrial manufacturing to urban planning, by building a virtual scene highly simulating the real world, providing strong support for decision making, process optimization, etc.

[0003] Currently, the building work mainly relies on building engineers to import various resources such as models, materials, animations, etc. into the scene building editor one by one, and then complete the whole process work from model import, scene design, data access to scene release alone. This serial operation mode greatly limits the project advancement efficiency. The whole scene building cycle completely depends on the work progress of a single engineer, and cannot form a parallel collaborative work mode. Once the engineer encounters a problem or the progress is delayed at a certain link, the whole project cycle will be forced to be extended.

[0004] Due to the whole process being led by one person, there is a lack of multi-perspective examination and collaborative review, and the overall quality of the project cannot be effectively guaranteed. There may be problems such as inconsistent style and poor data connection between different links, which leads to the final delivery result not being able to fully meet the customer's needs, affecting the project benefit and market competitiveness.

[0005] Therefore, how to design a new digital twinning scene building mode, break the serial operation limitation, realize multi-person collaborative operation, shorten the delivery cycle, reduce the cost, and improve the overall quality of the project is a problem that needs attention. SUMMARY

[0006] In view of the above problems, the present application provides a digital twinning multi-end collaborative scene building method, device, equipment and storage medium to break the serial operation limitation, realize multi-person collaborative operation, shorten the delivery cycle, reduce the cost, and improve the overall quality of the project.

[0007] In order to achieve the above purpose, the specific scheme is as follows:

[0008] A digital twinning multi-end collaborative scene building method applied to the service end of a digital twinning scene building system, the digital twinning scene building system further includes a plurality of client ends, each of the client ends includes a digital twinning scene editor, each of the digital twinning scene editors is connected with the service end, and the service end includes a plurality of building process processors.

[0009] The method comprises:

[0010] obtaining target scene editing data transmitted by a target client, the target scene editing data being scene editing data generated by the target client in response to a user editing a current scene model in the digital twin scene editor;

[0011] generating target component model data based on the scene editing data by a plurality of the build process processors;

[0012] transmitting the target component model data to each of the clients, each of the clients integrating the target component model data into a corresponding scene through a local digital twin scene editor.

[0013] Optionally, the digital twin scene building system further comprises a first queue and a storage module.

[0014] After the generating of the component model data based on the scene editing data by the plurality of the build process processors, the method further comprises:

[0015] When a preset number of other component model data is stored in the storage module, transmitting the target component model data to the first queue, the first queue being configured to respond to a request of storing the target component model data in the storage module, and transmitting the target component model data into the storage module according to an order of the target component model data entering the first queue.

[0016] Optionally, the plurality of build process processors comprise a model processor, a material processor, a component processor, a parameter processor, an event processor and a position processor.

[0017] The generating of the target component model data based on the scene editing data by the plurality of the build process processors comprises:

[0018] processing the target scene editing data according to a processing order of the plurality of the build process processors to generate the target component model data, wherein the model processor and the material processor are located at a first position of the processing order, the component processor is located at a second position of the processing order, the parameter processor is located at a third position of the processing order, the event processor is located at a fourth position of the processing order, and the position processor is located at a last position of the processing order.

[0019] Optionally, the server further comprises a database, the database comprising a parameter configuration table and a component model position table, the parameter configuration table being configured to store parameters in the target scene editing data verified by the parameter processor, and the component model position table being configured to store position information of the target component model data.

[0020] Optionally, the plurality of construction process processors comprises a position processor.

[0021] The method further comprises:

[0022] Before generating the target component model data, if other scene editing data transmitted by other clients is received, determining, by the position processor, whether the scene position information of the target scene editing data conflicts with the scene position information of the other scene editing data;

[0023] If so, sending prompt information of position conflict to the other clients.

[0024] A scene construction method for digital twin multi-end collaboration, applied to a target client of a digital twin scene construction system, the digital twin scene construction system further comprising a server and a plurality of clients, each of the clients comprising a digital twin scene editor, each of the digital twin scene editors being connected to the server, and the server comprising a plurality of construction process processors.

[0025] The method comprises:

[0026] In response to an operation of a user editing a current scene model in the digital twin scene editor of the target client, generating target scene editing data;

[0027] Receiving target component model data returned by the server, the target component model data being generated by the server based on the target scene editing data through a plurality of construction process processors;

[0028] Integrating the target component model data into a corresponding scene through the digital twin scene editor of the target client, and integrating the target component model data into a corresponding scene through the digital twin scene editor of each of the other clients.

[0029] A scene construction apparatus for digital twin multi-end collaboration, applied to a server of a digital twin scene construction system, the digital twin scene construction system further comprising a plurality of clients, each of the clients comprising a digital twin scene editor, each of the digital twin scene editors being connected to the server, and the server comprising a plurality of construction process processors.

[0030] The apparatus comprises:

[0031] A scene editing data acquisition unit, configured to acquire target scene editing data transmitted by a target client, the target scene editing data being scene editing data generated by the target client in response to an operation of a user editing a current scene model in the digital twin scene editor;

[0032] The component model data generation unit is configured to generate target component model data based on the scene editing data by using the plurality of construction process processors.

[0033] The component model data sending unit is configured to transmit the target component model data to each of the clients, and each of the clients is configured to integrate the target component model data into a corresponding scene by using the local digital twin scene editor.

[0034] Optionally, the digital twin scene construction system further comprises a first queue and a storage module.

[0035] The apparatus further comprises:

[0036] The queue storage unit is configured to transmit the target component model data to the first queue when a preset number of other component model data is stored in the storage module based on the target component model data, and the first queue is configured to respond to a request for storing the target component model data in the storage module, and transmit the target component model data into the storage module according to an order in which the target component model data enters the first queue.

[0037] Optionally, the plurality of construction process processors comprise a model processor, a material processor, a component processor, a parameter processor, an event processor, and a position processor.

[0038] The component model data generation unit comprises:

[0039] The sequential generation unit is configured to process the target scene editing data according to a processing order of the plurality of construction process processors to generate target component model data, wherein the model processor and the material processor are located at the first position of the processing order, the component processor is located at the second position of the processing order, the parameter processor is located at the third position of the processing order, the event processor is located at the fourth position of the processing order, and the position processor is located at the last position of the processing order.

[0040] Optionally, the server further comprises a database, and the database comprises a parameter configuration table and a component model position table, the parameter configuration table is configured to store parameters in the target scene editing data that are verified by the parameter processor, and the component model position table is configured to store position information of the target component model data.

[0041] Optionally, the plurality of construction process processors comprise a position processor.

[0042] The apparatus further comprises:

[0043] The position conflict judgment unit is configured to, before the target component model data is generated, if other scene editing data transmitted by other clients is received, judge, by the position processor, whether the scene position information of the target scene editing data conflicts with the scene position information of the other scene editing data, and if so, execute the conflict information prompting unit.

[0044] The conflict information prompting unit is configured to send prompt information of the position conflict to the other clients.

[0045] A digital twin multi-terminal collaborative scene building device is applied to a target client of a digital twin scene building system, the digital twin scene building system further includes a server and a plurality of clients, each of the clients includes a digital twin scene editor, each of the digital twin scene editors is connected with the server, and the server includes a plurality of building process processors.

[0046] The device includes:

[0047] The scene editing data generation unit is configured to generate target scene editing data in response to an operation of a user editing a current scene model in the digital twin scene editor of the target client.

[0048] The component model data receiving unit is configured to receive target component model data returned by the server, the target component model data being generated by the server based on the target scene editing data through a plurality of building process processors.

[0049] The scene integration unit is configured to integrate the target component model data into a corresponding scene through the digital twin scene editor of the target client, and other clients integrate the target component model data into corresponding scenes through the digital twin scene editors of the clients.

[0050] A digital twin multi-terminal collaborative scene building device includes a memory and a processor.

[0051] The memory is configured to store a program.

[0052] The processor is configured to execute the program to implement each step of the digital twin multi-terminal collaborative scene building method.

[0053] A storage medium has a computer program stored thereon, the computer program being executed by a processor to implement each step of the digital twin multi-terminal collaborative scene building method.

[0054] By the technical scheme, the target scene editing data transmitted by the target client is acquired, the target scene editing data is scene editing data generated by the target client in response to an operation of editing a current scene model in a digital twin scene editor by a user, further, the target component model data is generated by the plurality of construction process processors based on the scene editing data, and the target component model data is transmitted to each client, and each client integrates the target component model data into a corresponding scene through the local digital twin scene editor. As can be seen, multiple clients can collaboratively edit through the digital twin scene editor to realize multi-person collaborative work, and the component model data edited by a single person can be viewed in real time by others after being processed by the server, thereby shortening the delivery cycle, reducing the cost, and improving the overall quality of the project. BRIEF DESCRIPTION OF DRAWINGS

[0055] Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The detailed description is made with reference to the accompanying drawings.

[0056] Figure 1 A system architecture diagram of a digital twin scene construction system provided by an embodiment of the present application;

[0057] Figure 2 A process schematic diagram of the server implementing digital twin multi-end collaborative scene construction provided by an embodiment of the present application;

[0058] Figure 3 A technical implementation schematic diagram of a digital twin scene construction system provided by an embodiment of the present application;

[0059] Figure 4 A process schematic diagram of the target client implementing digital twin multi-end collaborative scene construction provided by an embodiment of the present application;

[0060] Figure 5 An apparatus structure schematic diagram of the server implementing digital twin multi-end collaborative scene construction provided by an embodiment of the present application;

[0061] Figure 6 An apparatus structure schematic diagram of the target client implementing digital twin multi-end collaborative scene construction provided by an embodiment of the present application;

[0062] Figure 7 A structure schematic diagram of an apparatus for implementing digital twin multi-end collaborative scene construction provided by an embodiment of the present application. DETAILED DESCRIPTION

[0063] With reference to the drawings and the embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0064] Figure 1 An optional system architecture for implementing the digital twin multi-end collaboration scenario construction provided by the embodiments of the present application is shown in FIG. 1, which can include: Figure 1

[0065] a plurality of clients, a server, a first queue, a storage module, and a database.

[0066] The server can be composed of a plurality of servers, which can share the data processing pressure with each other. For example, when distributing component model data to all clients, a plurality of servers can be used to perform the distribution.

[0067] The server can include a plurality of construction process processors. These construction process processors can process a plurality of scenario editing data provided by the clients in parallel. For any construction process processor, when receiving two or more pieces of scenario editing data to be processed, the processing can be performed according to the order in which the scenario editing data is received by the server.

[0068] As shown in FIG. 2, these construction process processors can be model processors, material processors, component processors, parameter processors, and event processors. Figure 1

[0069] The plurality of clients are connected to the server, and the specific connection mode can be through a websocket long connection. The websocket is a network communication protocol, and after the client and the server are connected through the websocket long connection, real-time bidirectional communication between the client and the server can be guaranteed.

[0070] Further, the server can be connected to the storage module and the database through the first queue.

[0071] Specifically, the first queue can be an asynchronous peak-shaving queue, which can solve the server failure caused by processing a large amount of data at a time through asynchronous queuing. The storage module can be a Ceph storage, which is used to store model files, material files, media files, etc. The database can be a mysql database, which is used to store relational structured data such as user information and parameter configuration information.

[0072] ​​Furthermore, each client can include a digital twin scene editor, in which users can create or edit scene components or model components to obtain scene editing data.

[0073] like Figure 2 As shown, the digital twin scene editors of client A and client B communicate with the server via a long connection using the WebSocket protocol. The client transmits scene editing data to the server, and the server's setup process processor processes the scene editing data to obtain component model data. The component model data can be stored in the storage module through the first queue. At the same time, the component model data can be transmitted to the digital twin scene editors of each client via the WebSocket protocol, and the digital twin scene editors integrate the component model data into the corresponding scene.

[0074] Furthermore, Figure 3 This illustration shows a flowchart of a method for building a multi-terminal collaborative scenario for digital twins provided in an embodiment of this application. (Refer to...) Figure 2 The process may include:

[0075] Step S110: Obtain the target scene editing data transmitted by the target client. The target scene editing data is the scene editing data generated by the target client in response to the user's editing operation in the digital twin scene editor based on the current scene model.

[0076] Specifically, users can edit components or models in the digital twin scene editor according to their editing needs for the current scene model. The digital twin scene editor then responds to the user's editing operations by generating scene editing data.

[0077] For example, client A has the following requirement: to edit the model added in the digital twin scene editor:

[0078] **Operation Procedures**:

[0079] Upload the model file (robotic arm.obj) and the corresponding material file (metal material.png).

[0080] Set the initial position of the robotic arm to `(x=10, y=5, z=0)`.

[0081] Configure operating parameters: speed = 50%, rotation angle = 90°.

[0082] **Data Submission**

[0083] The digital twin scene editor can then generate the following data:

[0084]

[0085] It can be understood that the scheme supports multi-user collaborative building, so that other clients can also edit the scene components without waiting while the user edits the scene components on the target client, realizing multi-person collaborative scene building.

[0086] In step S120, the target component model data is generated based on the scene editing data by the plurality of building process processors.

[0087] Specifically, for file types such as models, materials, pictures, audio and video files, they can be processed into file addresses, and for component, parameter, configuration, data, event and other data, they can be processed into JSON data.

[0088] In step S130, the target component model data is transmitted to each client, and each client integrates the target component model data into the corresponding scene through the local digital twin scene editor.

[0089] It can be understood that since the digital twin scene editor of each client is in real-time communication with the server, the target component model data is automatically transmitted to each client after being processed on the server, and all clients can see the scene building effect promoted by the target client in real time, thereby improving the scene building efficiency.

[0090] The digital twin multi-end collaborative scene building method provided in the embodiment, by obtaining the target scene editing data transmitted by the target client, the target scene editing data is the scene editing data generated by the target client in response to the user's operation of editing the current scene model in the digital twin scene editor, further, the target component model data is generated based on the scene editing data by the plurality of building process processors, and the target component model data is transmitted to each client, and each client integrates the target component model data into the corresponding scene through the local digital twin scene editor. As can be seen, multiple clients can collaboratively edit through the digital twin scene editor, realizing multi-person collaborative work, and the component model data edited by a single person can be viewed in real time by others after being processed by the server, thereby shortening the delivery cycle, reducing the cost, and improving the overall quality of the project.

[0091] Considering that the server stores the updated scene model data in the storage module, the data is in large batches, and batch processing at one time may cause server failure, in some embodiments of the present application, after the component model data is generated based on the scene editing data by the plurality of building process processors, the target component model data is transmitted to the first queue when more than a preset number of other component model data is stored in the storage module.

[0092] The first queue is used to respond to the request of storing the target component model data into the storage module, and the target component model data is transmitted into the storage module according to the order of the target component model data entering the first queue. The preset number can represent the number of component model data of the upper limit of the queue load.

[0093] For example, a plurality of clients upload respective scene editing data A1, A2, …, A n to the server, and the server processes A1, A2, …, A n in parallel to obtain a plurality of component model data B1, B2, …, B n in sequence, and transmits the component model data to the first queue in the order. Since the number n of component model data exceeds the preset number n*, the first queue transmits the component model data into the storage module according to the order of the n component model data entering the first queue.

[0094] It can be understood that the first queue can solve the server failure that may be caused by processing a large amount of data at a time through asynchronous queuing.

[0095] In some embodiments of the present application, the process of generating target component model data based on scene editing data through a plurality of build process processors is introduced, wherein the scene editing data can include a mechanical arm model file, a supporting material file, and configuration parameters. Specifically, the mechanical arm model file is “mechanical arm.obj”, the supporting material file is “metal material.png”, the configuration parameters are “speed = 50%, rotation angle = 90°”, and the initial position of the mechanical arm can be set as “x = 10, y = 5, z = 0”. The process can include:

[0096] According to the processing order of the plurality of build process processors, the target scene editing data is processed to generate target component model data.

[0097] Among them, the model processor and the material processor can be located at the first position of the processing order. The component processor can be located at the second position of the processing order. The parameter processor can be located at the third position of the processing order. The event processor can be located at the fourth position of the processing order. The position processor can be located at the last position of the processing order.

[0098] Among them, the processing process of the plurality of build process processors can include:

[0099] S1, the model processor checks the model format based on the robot arm model file, generates a robot arm model ID, stores the robot arm model file to the Ceph storage module to obtain a storage file first address, and transmits the robot arm model ID and the storage file first address to the component processor. At the same time, the material processor generates a matching material ID based on the matching material file, stores the matching material file to the storage module to obtain a storage file second address, and transmits the matching material ID and the storage file second address to the component processor.

[0100] For example, after the user submits data on the client side, the server can obtain the following data packet format:

[0101]

[0102] In the model processor, the model format is checked, and a unique ID such as `model_001` is generated. The file is uploaded to the Ceph storage, and the file address such as `ceph: / / models / model_001.obj` is returned. The model ID and the storage address are output and transmitted to the component processor.

[0103] In the material processor, the material file is checked, and a unique ID such as `texture_001` is generated. The file is uploaded to the Ceph storage, and the file address such as `ceph: / / textures / texture_001.png` is returned. The material ID and the storage address are output and transmitted to the component processor.

[0104] S2, the component processor obtains the robot arm model file from the storage file first address and the matching material file from the storage file second address based on the robot arm model ID and the matching material ID, binds the robot arm model file and the matching material file based on the robot arm model ID and the matching material ID, converts the configuration parameters into standardized JSON format data, and transmits the component metadata and the standardized JSON format data to the parameter processor.

[0105] For example, in the component processor, the model and the material are bound to generate component metadata, and the parameter configuration is converted into standardized JSON format:

[0106]

[0107] The component metadata is output and transmitted to the parameter processor and the location processor.

[0108] S3, the parameter processor checks the standardized JSON format data, and after the checking is completed, stores the standardized JSON format data in the target table of the database.

[0109] Specifically, the database of the server can include a parameter configuration table, which can be used to store parameters in the target scene editing data that are checked by the parameter processor.

[0110] For example, in the parameter processor, the parameter is checked for legality, such as a speed range of 0-100% and an angle range of 360°, and the parameter is stored in the `component_params` table of the database. The parameter checking result is output, and the event processor is notified to trigger an update event.

[0111] S4, the event processor triggers a scene update event based on the target table of the storage module and the database, and obtains component model data.

[0112] S5, the position processor converts the coordinate parameters of the component model data into a coordinate system in the scene, and generates a position update instruction.

[0113] For example, in the position processor, the coordinates can be converted into a scene coordinate system, such as a world coordinate system or a local coordinate system, and then a position update instruction can be generated, such as:

[0114]

[0115] The position instruction is output and can be further pushed to the first queue.

[0116] Further, the database of the server can include a component model position table for storing position information of the component model data.

[0117] It can be understood that after receiving the position instruction, the first queue asynchronously writes the position information of the component model data into the `component_positions` table of the database in order to ensure data persistence.

[0118] Considering that in the process of multi-person collaborative construction, there can be multiple users editing component model data at the same position in the scene, resulting in component / model editing position conflicts, based on this, the digital twin multi-end collaborative scene construction method provided by the present application further includes:

[0119] Before generating the target component model data, if other scene editing data transmitted by other clients is received, the position processor is used to determine whether the scene position information of the target scene editing data conflicts with the scene position information of the other scene editing data, if so, a position conflict prompt information is sent to the other client, otherwise the other scene editing data is normally processed.

[0120] It can be understood that other scene editing data transmitted by other clients is received before the target component model data is generated, which can represent that the target scene editing data and the other scene editing data are transmitted to the server within a certain period of time, and then it can be considered that multiple clients edit the same position in the scene at the same time. This case can be judged as repeated editing of components / models, which will cause component / model editing position conflict. Therefore, the server can send a position conflict prompt information to other clients corresponding to the received other scene editing data.

[0121] In addition, if other scene editing data transmitted by other clients is received after the target component model data is generated, and the scene position information of the target scene editing data conflicts with the scene position information of the other scene editing data, in this case, the server can not send a position conflict prompt information to the other clients. It can be understood that the server synchronizes the target component model data to all clients in real time after the target component model data is generated, so each user can view the updated scene. If other scene editing data transmitted by other clients is received at this time, and the scene position information of the other scene editing data is the same as that of the target scene editing data, it can be considered that the other clients update the operation based on the current scene model, and the server can not need to send a position conflict prompt information to the other clients. The other scene editing data can be processed normally, and after the other scene editing data is processed to obtain other component model data, the target component model data in the current scene model can be overwritten.

[0122] Next, the scene building method of digital twin multi-end collaboration is introduced from the perspective of the target client, as shown in FIG. 8. Figure 4 As shown in FIG. 8, the process of the target client implementing the scene building of digital twin multi-end collaboration can include:

[0123] Step S210, in response to the operation of the user editing according to the current scene model in the digital twin scene editor of the target client, target scene editing data is generated.

[0124] Specifically, while the user edits the scene components on the target client, other clients do not need to wait and can also edit the scene components, realizing multi-person collaborative scene building.

[0125] Step S220, target component model data returned by the server is received, and the target component model data is generated by the server based on the target scene editing data through the plurality of building process processors.

[0126] Specifically, after the target client transmits the scene editing data to the server, the server can distribute the scene editing data to the corresponding building process processors for processing, and after the position processor completes the processing, the target component model data can be obtained.

[0127] Step S230, integrating the target component model data into the corresponding scene through the digital twin scene editor of the target client, and integrating the target component model data into the corresponding scene through the local digital twin scene editor of each other client.

[0128] It can be understood that since the digital twin scene editor of each other client is in real-time communication with the server, the component model data is automatically transmitted to each client after being generated in the server, and the target client and each other client can see the scene building effect promoted by the target client in real time, thereby improving the scene building efficiency.

[0129] The digital twin multi-end collaborative scene building method provided in the embodiment generates target scene editing data in response to the operation of the user editing according to the current scene model in the digital twin scene editor of the target client, receives the target component model data returned by the server, and the target component model data is generated by the server based on the target scene editing data through a plurality of building process processors. Further, the target component model data is integrated into the corresponding scene through the digital twin scene editor of the target client, and the target component model data is integrated into the corresponding scene through the local digital twin scene editor of each other client. As can be seen, after the scene editing of the target client, the other clients can work collaboratively, and each person can view the scene building effect in real time after adding the edited scene model to the server, thereby shortening the delivery cycle, reducing the cost, and improving the overall quality of the project.

[0130] The device for implementing the digital twin multi-end collaborative scene building provided in the embodiment of the application is described below, and the device for implementing the digital twin multi-end collaborative scene building described below can be correspondingly referred to the method for implementing the digital twin multi-end collaborative scene building described above.

[0131] Referring to Figure 5 , Figure 5 The device structure diagram of the server for implementing the digital twin multi-end collaborative scene building disclosed in the embodiment of the application is shown.

[0132] As Figure 5 shown, the device can include:

[0133] The scene editing data acquisition unit 11 is configured to acquire the target scene editing data transmitted by the target client, wherein the target scene editing data is the scene editing data generated by the target client in response to the operation of the user editing according to the current scene model in the digital twin scene editor;

[0134] The component model data generation unit 12 is configured to generate target component model data based on the scene editing data by using a plurality of construction process processors.

[0135] The component model data sending unit 13 is configured to transmit the target component model data to each of the clients, and each of the clients integrates the target component model data into a corresponding scene by using a local digital twin scene editor.

[0136] Optionally, the digital twin scene construction system further comprises a first queue and a storage module.

[0137] The apparatus further comprises:

[0138] The queue storage unit is configured to, after the component model data is generated based on the scene editing data by using the plurality of construction process processors, transmit the target component model data to the first queue when a preset number of other component model data is stored in the storage module, and the first queue is configured to, in response to a request for storing the target component model data in the storage module, transmit the target component model data into the storage module according to an order in which the target component model data enters the first queue.

[0139] Optionally, the plurality of construction process processors comprise a model processor, a material processor, a component processor, a parameter processor, an event processor, and a position processor.

[0140] The component model data generation unit comprises:

[0141] The sequential generation unit is configured to process the target scene editing data according to a processing order of the plurality of construction process processors to generate target component model data, wherein the model processor and the material processor are located at a first position of the processing order, the component processor is located at a second position of the processing order, the parameter processor is located at a third position of the processing order, the event processor is located at a fourth position of the processing order, and the position processor is located at a last position of the processing order.

[0142] Optionally, the server further comprises a database, and the database comprises a parameter configuration table and a component model position table, the parameter configuration table is configured to store parameters in the target scene editing data that are verified by the parameter processor, and the component model position table is configured to store position information of the target component model data.

[0143] Optionally, the plurality of construction process processors comprise a position processor.

[0144] The apparatus further comprises:

[0145] The position conflict judgment unit is configured to, before the target component model data is generated, if other scene editing data transmitted by other clients is received, judge, by the position processor, whether the scene position information of the target scene editing data conflicts with the scene position information of the other scene editing data, and if so, execute the conflict information prompting unit;

[0146] The conflict information prompting unit is configured to send prompt information of the position conflict to the other clients.

[0147] Referring to Figure 6 , Figure 6 An apparatus structure schematic diagram of a target client implementing digital twin multi-end collaborative scene building is disclosed in the embodiments of the present application.

[0148] As Figure 6 indicated, the apparatus can include:

[0149] The scene editing data generation unit 21 is configured to generate target scene editing data in response to an operation of a user editing a current scene model in a digital twin scene editor of a target client.

[0150] The component model data receiving unit 22 is configured to receive target component model data returned by a server, the target component model data being generated by the server based on the target scene editing data through a plurality of building process processors.

[0151] The scene integration unit 23 is configured to integrate the target component model data into a corresponding scene through the digital twin scene editor of the target client, and integrate the target component model data into a corresponding scene through the digital twin scene editor of the other client.

[0152] The digital twin multi-end collaborative scene building apparatus provided by the embodiments of the present application can be applied to a digital twin multi-end collaborative scene building device. The digital twin multi-end collaborative scene building device can be a server or a client. Figure 7 A hardware structure block diagram of the digital twin multi-end collaborative scene building device is shown, referring to Figure 7 , the hardware structure of the digital twin multi-end collaborative scene building device can include at least one processor 1, at least one communication interface 2, at least one memory 3 and at least one communication bus 4.

[0153] In the embodiments of the present application, the number of the processor 1, the communication interface 2, the memory 3 and the communication bus 4 is at least one, and the processor 1, the communication interface 2 and the memory 3 complete communication with each other through the communication bus 4.

[0154] The processor 1 can be a central processing unit CPU, or an application specific integrated circuit ASIC, or one or more integrated circuits configured to implement embodiments of the present application, etc.

[0155] The memory 3 can include a high-speed RAM memory, and can also include a non-volatile memory, such as at least one disk memory, etc.

[0156] The memory stores a program, and the processor can invoke the program stored in the memory, and the program is used to implement each processing flow in the scenario building scheme of the digital twin multi-end collaboration for the server, or implement each processing flow in the scenario building scheme of the digital twin multi-end collaboration for the client.

[0157] The embodiments of the present application also provide a storage medium which can store a program suitable for the processor to execute, and the program is used to implement each processing flow in the scenario building scheme of the digital twin multi-end collaboration for the server, or implement each processing flow in the scenario building scheme of the digital twin multi-end collaboration for the client.

[0158] Finally, it should be noted that in this document, the relationship terms such as first and second are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations. Moreover, the terms "include", "contain" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or equipment including a series of elements not only includes those elements, but also includes other elements not explicitly listed or inherent to such process, method, article or equipment. Without more limitations, the element defined by the statement "including a" does not exclude the presence of other identical elements in the process, method, article or equipment including the element.

[0159] The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the difference from other embodiments. The various embodiments can be combined as needed, and the same and similar parts refer to each other.

[0160] The foregoing description of the disclosed embodiments enables a person skilled in the art to make or use the application. Modifications of these embodiments will occur to persons of skill in the art, and that the generic principles defined herein can be applied to other embodiments without departing from the spirit or scope of the application. Therefore, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for scene building of digital twin multi-end collaboration, characterized in that, The application relates to a server applied to a digital twin scene building system, wherein the digital twin scene building system further comprises a plurality of clients, each of the clients comprises a digital twin scene editor, each of the digital twin scene editors is connected with the server, and the server comprises a plurality of building process processors. The method comprises: obtaining target scene editing data transmitted by a target client, wherein the target scene editing data is scene editing data generated by the target client in response to user editing operations in the digital twin scene editor according to a current scene model; generating target component model data based on the scene editing data through a plurality of building process processors; transmitting the target component model data to each of the clients, and each of the clients integrates the target component model data into a corresponding scene through the local digital twin scene editor; the plurality of building process processors comprise a model processor, a material processor, a component processor, a parameter processor, an event processor and a position processor; the method comprises: processing the target scene editing data according to a processing sequence of the plurality of building process processors to generate target component model data, wherein the model processor and the material processor are located at the first position of the processing sequence, the component processor is located at the second position of the processing sequence, the parameter processor is located at the third position of the processing sequence, the event processor is located at the fourth position of the processing sequence, and the position processor is located at the last position of the processing sequence; the scene editing data comprises a mechanical arm model file, a matching material file and configuration parameters; the model processor is used for generating a mechanical arm model ID based on the mechanical arm model file, storing the mechanical arm model file into a Ceph storage module to obtain a storage file first address, and transmitting the mechanical arm model ID and the storage file first address to the component processor; the material processor is used for generating a matching material ID based on the matching material file, storing the matching material file into the Ceph storage module to obtain a storage file second address, and transmitting the matching material ID and the storage file second address to the component processor; the component processor is used for obtaining the mechanical arm model file from the storage file first address and the matching material file from the storage file second address based on the mechanical arm model ID and the matching material ID, binding the mechanical arm model file and the matching material file to generate component metadata, converting the configuration parameters into standardized JSON format data, and transmitting the component metadata and the standardized JSON format data to the parameter processor; the parameter processor is used for checking the standardized JSON format data, and storing the standardized JSON format data in a target table of a database after the checking is completed. The event processor is configured to trigger a scene update event based on the Ceph storage module and a target table of the database, and obtain scene structure data containing the scene editing data.

2. The method of claim 1, wherein, The digital twin scene building system further comprises a first queue and a storage module. After the component model data is generated based on the scene editing data by the plurality of building process processors, the method further comprises: When a preset number of other component model data is stored in the storage module, the target component model data is transmitted to the first queue, and the first queue is configured to respond to a request for storing the target component model data in the storage module, and transmit the target component model data into the storage module according to an order in which the target component model data enters the first queue.

3. The method of claim 1, wherein, The server further comprises a database, and the database comprises a parameter configuration table and a component model position table, the parameter configuration table is configured to store parameters in the target scene editing data that are verified by the parameter processor, and the component model position table is configured to store position information of the target component model data.

4. The method of claim 1, wherein, The plurality of building process processors comprises a position processor. The method further comprises: Before the target component model data is generated, if other scene editing data transmitted by other clients is received, the position processor is used to determine whether scene position information of the target scene editing data conflicts with scene position information of the other scene editing data. If so, prompt information of the position conflict is sent to the other clients.

5. A digital twin multi-end collaboration scene building method, characterized in that, A target client applied to a digital twin scene building system, the digital twin scene building system further comprises a server and a plurality of clients, each of the clients comprises a digital twin scene editor, each of the digital twin scene editors is connected with the server, and the server comprises a plurality of building process processors. The method comprises: In response to an operation of a user editing a current scene model in the digital twin scene editor of the target client, target scene editing data is generated; Target component model data returned by the server is received, the target component model data is generated by the server based on the target scene editing data through the plurality of building process processors; The target component model data is integrated into a corresponding scene by the digital twin scene editor of the target client, and the target component model data is integrated into a corresponding scene by the digital twin scene editor of other clients; The plurality of building process processors comprises a model processor, a material processor, a component processor, a parameter processor, an event processor, and a position processor; The process in which the server generates target component model data based on the scene editing data through the plurality of building process processors comprises: The server processes the target scene editing data in a processing order of the plurality of building process processors to generate target component model data, wherein the model processor and the material processor are located at the first position of the processing order, the component processor is located at the second position of the processing order, the parameter processor is located at the third position of the processing order, the event processor is located at the fourth position of the processing order, and the position processor is located at the last position of the processing order; The scene editing data includes a mechanical arm model file, a matching material file, and configuration parameters. The model processor is configured to generate a mechanical arm model ID based on the mechanical arm model file, store the mechanical arm model file in a Ceph storage module to obtain a storage file first address, and transmit the mechanical arm model ID and the storage file first address to the component processor. The material processor is configured to generate a matching material ID based on the matching material file, store the matching material file in the Ceph storage module to obtain a storage file second address, and transmit the matching material ID and the storage file second address to the component processor. The component processor is configured to obtain the mechanical arm model file from the storage file first address and the matching material file from the storage file second address based on the mechanical arm model ID and the matching material ID, bind the mechanical arm model file and the matching material file to generate component metadata, convert the configuration parameters into standardized JSON format data, and transmit the component metadata and the standardized JSON format data to the parameter processor. The parameter processor is configured to verify the standardized JSON format data and, after verification is completed, store the standardized JSON format data in a target table of a database. The event processor is configured to trigger a scene update event based on the Ceph storage module and the target table of the database to obtain scene structure data containing the scene editing data.

6. A digital twin multi-end coordination scene building device, characterized in that, The service end applied to the digital twin scene building system of claim 1, the digital twin scene building system further comprises a plurality of clients, each of the clients comprises a digital twin scene editor, each of the digital twin scene editors is connected with the service end, and the service end comprises a plurality of building process processors. The device comprises: A scene editing data acquisition unit configured to acquire target scene editing data transmitted by a target client, the target scene editing data being scene editing data generated by the target client in response to a user editing operation on a current scene model in the digital twin scene editor; A component model data generation unit configured to generate target component model data based on the scene editing data through a plurality of building process processors. The component model data sending unit is configured to transmit the target component model data to each of the clients, and each of the clients integrates the target component model data into a corresponding scene through the local digital twin scene editor.

7. A digital twin multi-end collaboration scene building device, characterized in that, The target client applied to the digital twin scene building system of claim 5 further comprises a server and a plurality of clients, each of the clients comprises a digital twin scene editor, each of the digital twin scene editors is connected with the server, and the server comprises a plurality of building process processors. The device comprises: The scene editing data generating unit is configured to generate target scene editing data in response to the operation of the user editing the current scene model in the digital twin scene editor of the target client. The component model data receiving unit is configured to receive target component model data returned by the server, wherein the target component model data is generated by the server based on the target scene editing data through a plurality of building process processors. The scene integrating unit is configured to integrate the target component model data into a corresponding scene through the digital twin scene editor of the target client, and other clients integrate the target component model data into corresponding scenes through the local digital twin scene editor.

8. A digital twin multi-end collaboration scenario building device, characterized in that, The memory is configured to store a program. The processor is configured to execute the program to implement each step of the digital twin multi-end collaborative scene building method of any one of claims 1-5. The computer program is executed by the processor to implement each step of the digital twin multi-end collaborative scene building method of any one of claims 1-5.

9. A storage medium having stored thereon a computer program, characterized in that ​

Images