Mixing station virtual scene construction method and management system

Abstract

The invention provides a mixing station virtual scene construction method and a mixing station virtual scene management system. The method specifically comprises the steps of collecting mixing station scene information, identifying key semantic points of the scene information, generating a mixing station virtual environment source code, configuring a code file in a mixing station virtual scene background, creating a static model of the mixing station virtual scene, creating a dynamic model of the mixing station virtual scene, and completing construction of the mixing station virtual scene. According to the invention, parameterization and modularization rapid construction of the virtual scene of the mixing station is realized, the real operation scene of the mixing station is simulated, the test cost and the labor cost are effectively reduced, verification optimization and decision strategy making of a main vehicle algorithm under the scene of the mixing station are supported, and thus the resource utilization efficiency and the production benefit are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of batching plant simulation, and particularly to a method for constructing a virtual scene of a batching plant and a management system. Background Art

[0002] With the rapid development of artificial intelligence and Internet of Things technologies, virtual scene development technology is gradually penetrating into various industries, showing unprecedented application potential. Especially in the management and operation of batching plants, this trend is particularly obvious. Some batching plants have successfully introduced Internet of Things technology, combined with computer graphics and artificial intelligence technologies, to build an intelligent system for refined management, realizing unmanned and automated conveying of bulk materials. This innovation not only greatly improves work efficiency but also significantly reduces labor costs and safety risks.

[0003] The development of virtual scenes of batching plants currently mainly relies on digital twin technology to create virtual models corresponding to physical sites, combines three-dimensional modeling technology to highly accurately restore site layouts and equipment, integrates real-time data of each subsystem through data fusion technology, and uses virtual reality technology to provide immersive virtual experiences. These technical solutions jointly build an intuitive and visual virtual platform, thereby realizing real-time monitoring, data analysis, and linkage control of equipment status.

[0004] Although the technologies currently used in the development of virtual scenes of batching plants bring many conveniences, there are also some disadvantages. Each batching plant has its unique requirements and operation processes, and virtual scene solutions need to be customized individually, lacking standardization. Many technical achievements developed for specific projects are difficult to be reused in other projects, resulting in high project costs and extended project development cycles. Summary of the Invention

[0005] In view of the above-mentioned disadvantages of the existing technologies, the present invention provides a method for constructing a virtual scene of a batching plant and a management system. By collecting descriptive information of the batching plant scene, identifying key semantic points, and based on a virtual scene code template, automatic virtual scene construction is carried out for objects such as the actual layout of the batching plant (mixing main machine system, control system, material conveying system, material weighing system, material storage system), material conveying activity areas, and environmental information.

[0006] To achieve the above object, the technical solution adopted by the present invention is as follows: The present invention provides a method for constructing a virtual scene of a batching plant, including: Collecting scene information of the batching plant; Identifying key semantic points of the scene information; Identify the key parameters of each object based on the key semantic points, modify the parameter code driver files of each object, and combine them to generate the source code of the virtual mixing plant scene; Based on the source code of the virtual mixing plant scene, parse the scene objects and key parameters, and retrieve the code files of the virtual scene components; Driven by the code files of the virtual scene components, mobilize the static model template to create the static model of the virtual mixing plant scene; Driven by the code files of the virtual scene components, mobilize the dynamic model template to create the dynamic model of the virtual mixing plant scene; Based on the static model and dynamic model of the virtual mixing plant scene, perform an initial operation to complete the construction of the virtual mixing plant scene.

[0007] Preferably, the scene information of the mixing plant includes: the overall basic introduction of the mixing plant, the main body layout information, the main vehicle activity area information, the main vehicle information, the static and dynamic obstacle information, the equipment information, the environmental information, and the material information; The main body layout information includes the information of the mixing main machine, the feeding belt conveyor, the cement silo barrel, the screw conveyor, the cement metering device, the water and admixture metering device, the transition storage bin, the admixture supply device, the gas circuit device, the water source supply device, and the electrical control room in the mixing plant area; The main vehicle activity area information refers to the activity area of the loader, including the parking area, the bunker, the hopper, the road traffic settings along the way, and the transfer and dispatching center; The main vehicle information includes the main vehicle model and the main vehicle physical model; The static and dynamic obstacle information includes pedestrians, vehicles, and stone obstacles; The equipment information includes the loader and the sensors arranged in the main vehicle activity area; The environmental information includes meteorological information and surface coverage information; The material information includes the materials that the loader can load.

[0008] Preferably, the key semantic points for identifying the scene information include: For the main body layout of the mixing plant, it is necessary to identify the name of the mixing plant, the three-dimensional coordinates of the positions of the devices in each area of the mixing plant main body, the length, width, and height dimensions, the diameter dimensions, the quantity, and the spatial front orientation; In the active area of the main vehicle, for the parking area, it is necessary to identify the position coordinates, length and width dimensions, and the number of parking spaces; for the silo, it is necessary to identify the position coordinates, the number of silos, the length, width, and height dimensions of the silo, the thickness of the silo, and the type of silo; for the hopper, it is necessary to identify the position coordinates, the number of hoppers, the length, width, and height dimensions of the hopper, the thickness of the silo, and the type of hopper; in the road traffic settings of the route, it is necessary to identify the types of roads - cement roads, asphalt roads, stone slab roads, and gravel roads, traffic settings identify three-color signal lights, two-color signal lights, and arrow signal lights, and traffic warning signs identify indicative signs and guiding signs; for the transfer and dispatching center, it is necessary to identify the position coordinates, the length and width dimensions of the area, and the orientation; For the main vehicle information, it is necessary to identify the main vehicle model and the drive signal for the main vehicle operation; For the static and dynamic obstacle information, it is necessary to identify the number of pedestrians, pedestrian paths, pedestrian running speeds, the number of vehicles, vehicle paths, vehicle running speeds, the number of stones, and the position coordinates of the stones; For the equipment information, it is necessary to identify the sensor model, sensor physical properties, sensor sensing range, sensor sensing method, sensor sensitivity, the number of sensors, and the sensor arrangement position; For the environmental information, it is necessary to identify the temperature, cloud, rain, snow, and wind levels, light, the types and areas of surface green plants; For the material information, it is necessary to identify the types of materials for loading and transportation and the material dimensions; For the retaining wall, it is necessary to identify the position, number, length, width, height, and thickness of the retaining wall; After identifying the key semantic points, a standardized electronic file is formed in a certain file format.

[0009] Preferably, the static model for creating the virtual scene of the mixing plant includes: Driven by the code file of the virtual scene constituent elements, based on the scene element module already constructed in the mixing plant, the static model template is mobilized to create a static model for displaying the virtual scene of the mixing plant, including: the main area of the mixing plant, static vehicles, stones, silos, hoppers, road traffic settings, transfer and dispatching locations, static obstacles, auxiliary vehicles, sensors, and retaining walls.

[0010] Preferably, the dynamic model for creating the virtual scene of the mixing plant includes: Driven by the code file of the virtual scene constituent elements, based on the scene element module already constructed in the mixing plant, the dynamic model template is mobilized to create a dynamic model for displaying the virtual scene of the mixing plant, and the key parameters of the dynamic model are obtained, including: the main vehicle, dynamic obstacles, weather, and materials. Among them, the key parameters of the main vehicle include the initial position and initial attitude parameters of the main vehicle; the key parameters of the dynamic obstacles include the initial position, running path, and running parameters; the key parameters of the weather include the environmental temperature, cloud density, rain density, snow density, and wind level; the key parameters of the materials include particle size, density, friction coefficient, and elastic coefficient.

[0011] Preferably, the constituent elements of the mixing plant virtual scene include the mixing plant main area, parking area, stockpile area, unloading area, driving road, transfer and dispatching area, main vehicle, NPC resources, sensor resources, environmental climate, and materials; Among them, the mixing plant main area includes a mixing main machine system, a control system, a material conveying system, a material weighing system, and a material storage system; The parking area refers to the parking position of the main vehicle when it is not working; The stockpile area refers to the silos of the mixing plant; The unloading area refers to the hoppers of the mixing plant; The driving road refers to the access roads and traffic settings within the main vehicle activity area; The main vehicle refers to the vehicle that performs tasks in the scene; NPC resources refer to non-active and non-dominant roles, including static obstacles, dynamic obstacles, and auxiliary vehicles; Sensor resources include lidar, cameras, millimeter waves, and inertial measurement units; The environmental climate refers to environmental temperature, cloud density, rain density, snow density, and wind level; Materials refer to the raw materials used for the materials produced by the mixing plant and can be transported and loaded.

[0012] The present invention also provides a mixing plant virtual scene construction management system, including: A user management module for user role assignment, login permission management, and user basic information management; A scene information collection module for collecting the scene information of the mixing plant; A code generation module for identifying and extracting objects and key parameters based on the collected scene information, and generating the source code of the mixing plant virtual scene parameters; A code parsing module for parsing the source code of the mixing plant virtual scene parameters and retrieving the code files of the virtual scene constituent elements; A scene object module for constructing the element modules required for the mixing plant virtual scene; Static model templates and dynamic model templates, A virtual scene construction module, which is driven by the code files of the virtual scene constituent elements, based on the scene element modules already constructed for the mixing plant, invokes the static model templates to create a static model for displaying the mixing plant virtual scene; and is driven by the code files of the virtual scene constituent elements, based on the scene element modules already constructed for the mixing plant, invokes the dynamic model templates to create a dynamic model for displaying the mixing plant virtual scene, and obtains the key parameters of the dynamic model; and based on the static model and dynamic model of the mixing plant virtual scene, initializes and runs to complete the construction of the mixing plant virtual scene.

[0013] Preferably, the user management module is specifically configured to create user roles, assign user roles, manage user permissions, modify user information and user login passwords.

[0014] Preferably, the scenario information collection module is specifically configured to enter information, modify information, upload and download information, store information, clean information, standardize information, verify information, update information, and visualize information.

[0015] Preferably, the code generation module includes automatically reading scenario information, invoking parameter-driven templates, generating parameter-driven codes, metadata management, template customization, one-click generation, multi-language support, and code testing; The automatically reading scenario information is used to identify and read scenario objects and key parameters according to the scenario information data provided by the scenario information collection module; The invoking parameter-driven module is used to automatically invoke parameter-driven templates after completing the identification and reading of key parameters; The generating parameter-driven codes is used to automatically generate parameter-driven codes for scenario modeling from parameter-driven templates; The metadata management is used to provide visualization tools; The template customization is used to provide code templates for generating scenario objects, including blank templates and default scenario object templates; The one-click generation is used to automatically generate parameter-driven codes; The multi-language support is used to support multiple programming languages and development frameworks; The code testing is used to run the generated parameter-driven codes, detect whether they can run normally, whether there are errors, and modify relevant object templates.

[0016] Preferably, the code parsing module is specifically configured to parse codes, optimize codes, add code comments, support cross-platform, and store parsed codes.

[0017] Preferably, the scenario object module includes a scenario resource module, a main vehicle resource module, an NPC resource module, a sensor module, a material resource module, and an environment rendering module; The described scenario resource module includes a mixing main machine, a feeding belt conveyor, a cement silo barrel, a screw conveyor, a cement metering device, a water and admixture metering device, a transition storage bin, an admixture supply device, a gas circuit device, a water source supply device, and an electrical control room; the main vehicle resource module includes vehicle equipment used for transporting materials within the mixing plant; the NPC resource module includes static and dynamic obstacles that appear within the mixing plant; the sensor module includes sensors installed and used within the active area of the main vehicle; the material resource module includes sand and gravel; the environmental rendering module includes light, wind, rain, snow, and clouds; All types of modules in the described scenario object module exist independently and can be added, deleted, and modified according to actual requirements.

[0018] The beneficial effects brought by the technical solution of the present invention are as follows: The present invention provides a method for constructing a virtual scenario of a mixing plant, which realizes the parametric and modular rapid construction of the virtual scenario of the mixing plant, enables the overall layout and equipment configuration of the mixing plant to be quickly presented, realizes the modular rapid construction of the virtual scenario, and significantly improves the development efficiency and flexibility of the virtual scenario. The virtual scenario constructed based on the method of the present invention can simulate the real operation scenario of the main vehicle within the mixing plant, monitor the status of the main vehicle equipment in real time, optimize the production, management, and maintenance of the mixing plant, improve production efficiency, and support three-dimensional visualization management and intelligent decision-making.

[0019] The present invention provides a virtual scenario management system for a mixing plant. This system provides a solid foundation for the real-time monitoring and intuitive display of the material transportation process in the mixing plant, and helps the intelligent upgrade of loaders and the optimal allocation of equipment resources in the mixing plant; in this management system, the scenario information collection module effectively manages the original scenario information, classifies and organizes it, and outputs a standardized file to support the generation of parameter codes; the code generation module automatically generates the codes required for driving the virtual scenario parameters, reducing the development cost and time; through this module, the virtual scenario can be conveniently adjusted and optimized, improving the flexibility and scalability of the system; the code parsing module, based on automatically reading the parameter-driven code, parses and automatically generates the code in the required environment. The code is independently stored and supports cross-platform parsing, improving the development efficiency; the scenario object module defines various objects in the virtual scenario, such as equipment, materials, personnel, etc., making the scenario more real and rich, and enabling the setting and management of the attributes, behaviors, etc. of the objects in the scenario, improving the interactivity and operability of the system. At the same time, each object module is independently stored, facilitating the upgrade and expansion of the system. Description of the Drawings

[0020] Figure 1 It is a schematic diagram of the method for constructing a virtual scenario of a mixing plant provided by an embodiment of the present invention; Figure 2Schematic diagram of the mixing plant virtual scene management system provided by the embodiment of the present invention; Figure 3 Schematic diagram of the constituent elements of the mixing plant virtual scene provided by the embodiment of the present invention. Detailed implementation manners

[0021] To make the objectives, technical solutions and advantages of the present invention clearer and more understandable, the present invention will be further described in detail below in conjunction with the implementation manners and the accompanying drawings. Herein, the illustrative implementation manners of the present invention and their descriptions are used to explain the present invention, but do not limit the present invention.

[0022] Herein, it also needs to be noted that in order to avoid obscuring the present invention due to unnecessary details, only the structures and / or processing steps closely related to the solution of the present invention are shown in the drawings, while other details less related to the present invention are omitted.

[0023] It should be emphasized that the term "including / comprising" when used herein refers to the presence of features, elements, steps or components, but does not exclude the presence or addition of one or more other features, elements, steps or components.

[0024] Herein, it also needs to be noted that if not otherwise specified, the term "connection" herein can refer not only to direct connection, but also to indirect connection with an intermediate.

[0025] It should be emphasized here that the step labels mentioned hereinafter do not limit the sequence of the steps. Instead, it should be understood that the steps can be executed in the sequence mentioned in the embodiments, or different from the sequence in the embodiments, or several steps can be executed simultaneously.

[0026] The first embodiment of the present invention provides a method for constructing a mixing plant virtual scene. Refer to Figure 1 , including the following steps: Step 1: Collect the scene information of the mixing plant; collect the scene information of the mixing plant from the user, mainly involving the actual layout of the mixing plant (mixing main machine system, control system, material conveying system, material weighing system, material storage system), the information of the main vehicle activity area, the information of the main vehicle, the static and dynamic obstacle information (pedestrians, vehicles, stones, etc.), the equipment information, the environmental information and the material information; Step 2: Identify the key semantic points of the scene information; according to the collected scene information, identify and classify the key semantic points from the discrete information, and form a standardized file in a certain format; Step 3: Generate the source code of the mixing plant virtual scene; based on the code generation template, read the scene information, identify the key parameters, modify the parameter code driver files of each object, and generate the source code of the mixing plant virtual scene parameters; Step 4: Retrieve the virtual scene code file of the batching plant; based on the source code of the virtual scene of the batching plant, after parsing, identify the scene objects and key parameters, and retrieve the modular script file of the batching plant model. Step 5: Create a static model of the virtual scene of the batching plant; based on the built basic model modules of the batching plant, driven by the code file, mobilize the static model template to construct the static model of the virtual scene of the batching plant. Step 6: Create a dynamic model of the virtual scene of the batching plant; based on the key dynamic semantic points, identify information such as the spawning points of the main vehicle, initial attitude parameters, and the spawning points, running parameters, and running paths of dynamic obstacles, and mobilize the dynamic model template to construct the static model of the virtual scene of the batching plant. Step 7: Complete the construction of the virtual scene of the batching plant; based on the static model and dynamic model of the virtual scene of the batching plant, perform an initial run to complete the construction of the virtual scene of the batching plant.

[0027] It should be noted that for the constituent elements of the virtual scene of the batching plant, see Figure 3 , including the main area of the batching plant, parking area, material pile area, unloading area, driving road, transfer and dispatching area, main vehicle, NPC resources, sensor resources, environmental climate, materials; Among them, the main area of the batching plant includes a mixing mainframe system, a control system, a material conveying system, a material weighing system, and a material storage system, and involves non-movable devices such as a mixing mainframe, a feeding belt conveyor, a cement silo barrel, a screw conveyor, a cement metering device, a water and admixture metering device, a transition storage bin, an admixture supply device, a gas circuit device, a water source supply device, and an electrical control room. The parking area mainly refers to the parking position of the main vehicle when it is not working. The material pile area refers to the batching plant's silo. The unloading area refers to the batching plant's hopper. The transfer and dispatching area is set up when carrying out fleet cooperation to efficiently and reasonably dispatch engineering vehicles. The driving road mainly refers to the passing roads and traffic settings within the main vehicle's activity area. The main vehicle refers to the vehicle that mainly performs tasks in the scene, such as loaders of various models. NPC resources mainly refer to non-active and non-dominant roles, including static obstacles, dynamic obstacles, and auxiliary vehicles. Sensor resources mainly include lidar, cameras, millimeter waves, inertial measurement units, etc. The environmental climate mainly refers to environmental temperature, cloud density, rain density, snow density, and wind level. Materials mainly refer to the raw materials used for the materials produced by the batching plant and can be transported and loaded, such as stones, sand, etc.

[0028] In the embodiment of the present invention, the scene information of the mixing station is collected. Generally, the scene information of the mixing station is collected by various methods such as field investigation records, reference to relevant documents and design drawings, and user surveys. Then, the information is integrated and processed to form a standardized format file on the computer and mobile terminals. The scene information mainly involves the overall basic introduction of the mixing station, the main layout information, the main vehicle activity area information, the main vehicle information, the static and dynamic obstacle information, the equipment information, the environmental information and the material information. Among them, the main layout of the mixing station mainly obtains the mixing station area - the mixing main machine, the feeding belt conveyor, the cement silo, the screw conveyor, the cement meter The main vehicle information mainly includes the information of the metering device, water and admixture metering device, transition storage silo, admixture supply device, gas circuit device, water supply device and electrical control room; the main vehicle activity area information mainly refers to the activity area of ​​the loader, including the parking area, silo, hopper, road traffic settings and transfer dispatch center, etc.; the main vehicle information includes the main vehicle model and the main vehicle physical model; the static and dynamic obstacle information mainly refers to obstacles such as pedestrians, vehicles, stones, etc.; the equipment information mainly refers to the sensors arranged in the loader and main vehicle activity area; the environmental information mainly refers to the meteorological information and surface coverage; the object of the material information is the material that the loader can load; In the embodiment of the present invention, the key semantic points of the scene information are identified, generally object recognition, scene type recognition (such as concrete mixing plant, asphalt mixing plant, stabilized soil mixing plant, etc.), object spatial relationship recognition, object action and behavior recognition and key parameter recognition are performed.

[0029] For each scene information of the mixing station, the key semantic points are identified as follows: The main layout of the mixing station mainly identifies the name of the mixing station, the three-dimensional coordinates of the location of the equipment in each area of ​​the mixing station, the length, width and height dimensions, diameter dimensions, quantity and spatial front orientation, etc., specifically involving the mixing main machine, feeding belt conveyor, cement silo, screw conveyor, cement metering device, water and admixture metering device, transition storage silo, admixture supply device, gas circuit device, water source supply device and electrical control room and other devices; The main vehicle activity area includes parking areas, silos, hoppers, road traffic settings and transfer dispatch centers; the parking area needs to identify parameters such as location coordinates, length and width, and number of parking spaces; the silo needs to identify location coordinates, number of silos, length, width and height, thickness and type of silo; the hopper needs to identify location coordinates, number of hoppers, length, width and height, thickness and type of hopper; the road traffic settings need to identify road types - cement roads, asphalt roads, stone roads, gravel roads, etc., the traffic settings need to identify three-color traffic lights, two-color traffic lights, arrow traffic lights, and traffic warning signs need to identify indication signs and road signs; the transfer dispatch center needs to identify location coordinates, length and width of the area and direction; The main vehicle information needs to identify the main vehicle model and the driving signal of the main vehicle operation; The static and dynamic obstacle information needs to identify the number of pedestrians, pedestrian paths, pedestrian running speeds, the number of vehicles, vehicle paths, vehicle running speeds, the number of stones, and the position coordinates of the stones; The device information needs to identify the sensor model, sensor physical properties, sensor sensing range, sensor sensing method, sensor sensitivity, the number of sensors, and the sensor arrangement positions; The environmental information needs to identify the temperature, cloud, rain, snow, and wind levels, lighting, types and areas of surface green plants; The material information needs to identify the types and sizes of the materials loaded and transported, such as sand and gravel; The retaining walls need to identify the positions, numbers, lengths, widths, heights, and thicknesses of the retaining walls; After identifying the key semantic points, a standardized electronic file is formed in a certain file format.

[0030] In the embodiment of the present invention, a source code file for generating the virtual scene parameters of the mixing plant is generated, including: Based on the standardized electronic file formed by the key semantic points of the scene information, the collected scene information is read, the key parameters of each object are identified in a fixed format, the parameter code driver files of each object are modified, and a source code file for the overall parameters of the virtual scene of the mixing plant is generated by combination.

[0031] In the embodiment of the present invention, the code file of the virtual scene of the mixing plant is retrieved, including: According to the source code file of the virtual scene parameters of the mixing plant, the functions and relationships of the modules, functions, and variables in the code are analyzed and understood in sequence, the scene objects and scene parameters are accurately parsed, and the code file of the mixing plant model of the constituent elements of the virtual scene is retrieved on the server.

[0032] In the embodiment of the present invention, a static model of the virtual scene of the mixing plant is created, including: Driven by the code file of the constituent elements of the virtual scene, based on the scene element module already constructed in the mixing plant, the static model for displaying the virtual scene of the mixing plant is retrieved and created, specifically including: the main area of the mixing plant (mixing main machine, feeding belt conveyor, cement silo barrel, screw conveyor, cement metering device, water and admixture metering device, transition storage bin, admixture supply device, gas circuit device, water source supply device, electrical control room, etc.), static vehicles, stones, storage bins, hoppers, road traffic settings, transfer and dispatching locations, static obstacles, auxiliary vehicles, sensors, retaining walls; among which, the main area of the mixing plant is subject to fuzzy recognition and only schematic modeling is required.

[0033] In the embodiment of the present invention, a dynamic model of the virtual scene of the mixing plant is created, including: Driven by the code file of the virtual scene composition elements, based on the scene element module already built in the mixing plant, retrieve and create a dynamic model for displaying the virtual scene of the mixing plant, and obtain the key parameters of the dynamic model. The dynamic model specifically includes: the main vehicle (such as a loader), dynamic obstacles, weather, and materials. Among them, the key parameters of the main vehicle include the initial position of the main vehicle and the initial attitude parameters (boom angle, bucket angle, steering angle); the key parameters of the dynamic obstacles include the initial position, running path, and running parameters (azimuth, speed, acceleration); the key parameters of the weather include the environmental temperature, cloud density, rain density, snow density, and wind level; the key parameters of the materials include particle size, density, friction coefficient, and elastic coefficient. There are two implementation methods for the key parameters of the dynamic model. One is to drive by parameter code, and the other is for the user to select the dynamic model on the operation interface and specify the key parameters of the dynamic model.

[0034] In the embodiment of the present invention, the construction of the virtual scene of the mixing plant is completed, including: Based on the creation of the static model and dynamic model of the virtual scene, the construction of the virtual scene of the mixing plant is completed; based on this virtual scene, combined with the main vehicle performance model, the main vehicle management strategy simulation and optimization can be carried out, the equipment status can be monitored in real time for fault diagnosis, a digital twin intelligent mixing plant can be constructed, the production, management and maintenance of the mixing plant can be optimized, the production efficiency can be improved, and support can be provided for management decision-making.

[0035] The second embodiment of the present invention provides a management system for constructing a virtual scene of a mixing plant. Refer to Figure 2 , which is composed of a user management module, a scene information collection module, a code generation module, a code parsing module, and a scene object module.

[0036] The user management module mainly realizes user role assignment, login permission management, and user basic information management; The scene information collection module records the scene information of the mixing plant using document files (such as txt, xls, etc.) to ensure the integrity, effectiveness, and standardization of the collected information; The code generation module mainly accurately identifies and extracts objects and key parameters based on rich scene information, including key elements such as scene changes and logical control of the dynamic model, and generates the source code of the virtual scene parameters of the mixing plant; The code parsing module mainly analyzes and understands the source code of the virtual scene parameters of the mixing plant; The scene object module contains the modules required for constructing the virtual scene of the mixing plant, including a scene resource module, a main vehicle resource module, an NPC resource module, a sensor module, a material resource module, a road traffic module, and an environmental rendering module.

[0037] It should be noted that the server, terminal computer or intelligent mobile terminal is the operating platform of the virtual scene management system according to the embodiments of the present invention, which is convenient for staff in the batching plant, virtual scene design and development personnel, algorithm testing personnel, system management personnel, etc. to manage and design and develop user information, scene information, scene creation, and algorithm verification.

[0038] In the embodiments of the present invention, the user management module includes user role creation, user role assignment, user permission management, user information and user login password modification, mainly for staff, design and development personnel, scene creation and use personnel, and platform administrators. Different permissions are assigned according to different roles to ensure the security of platform information storage and the reasonable use of module functions. User role creation is used to enter basic user information, including user name, company, phone number, password and other information; user role assignment is confirmed by the platform administrator; user permission management mainly sets the application permissions of each module of the system. For different personnel, different display and application interfaces are set to prevent information leakage and ensure the reasonable and safe use of each module; the modification of the user login password is executed by the user personally, and the reset of the user login password is executed by the platform administrator. The reset password is the initial password set by the system.

[0039] In the embodiments of the present invention, the scene information collection module includes functions such as information entry, information modification, information upload and download, information storage, information cleaning, information standardization, information verification, information update, and information visualization; information cleaning is responsible for removing duplicate information, formatting data or information, information proofreading, information update and other processing work; information storage is responsible for storing the processed data in the corresponding database and providing a query interface; information standardization is to classify scattered information according to virtual scene-related objects, sort out the hierarchical structure of the information by establishing tables and other types, select the output format, and call relevant scripts or programs to generate a standardized file according to the output format; information verification means that after the standardized file is generated, the generated file is opened to check the correctness of the information and modify and save it; information update is to adjust or re-enter the information, generate and replace the existing standardized file again; information visualization is responsible for presenting the scene information in the form of charts to help users better understand and obtain data.

[0040] In the embodiments of the present invention, the code generation module has functions of automatically reading scene information, invoking parameter-driven templates, generating parameter-driven codes, metadata management, template customization, one-click generation, multi-language support, and code testing. Among them, the function of automatically reading scene information is responsible for quickly identifying and reading scene objects and key parameters according to the information data provided by the scene information acquisition module. The automatic reading process effectively reduces manual intervention, reduces the possibility of human errors, and improves the efficiency of code generation. The function of invoking parameter-driven templates is responsible for automatically invoking parameter-driven templates after the information identification and reading are completed, shortening the development cycle. The function of generating parameter-driven codes is responsible for automatically generating parameter-driven codes for scene modeling from templates. The metadata management is responsible for providing a visualization tool, enabling developers to intuitively view the code content of scene objects and storing metadata. The template customization is responsible for providing code templates for generating scene objects, including blank templates and default scene object templates, allowing developers to customize according to requirements, improving the flexibility and applicability of code generation templates, and meeting different project requirements. The one-click generation is responsible for automatically generating parameter-driven codes. The multi-language support is responsible for supporting multiple programming languages and development frameworks to meet programming requirements in different scenarios. The code testing is responsible for running the generated parameter-driven codes, detecting whether they can run normally, whether there are errors, and modifying relevant object templates. The parameter-driven templates of each scene object are stored independently. When the scene object or key parameters change, only the corresponding templates need to be updated, without large-scale modification of the entire code generation template. This design makes the system highly flexible and scalable, and can easily cope with new scenarios and new requirements that may appear in the future.

[0041] In the embodiments of the present invention, the code parsing module has functions of code parsing, code optimization, code annotation, cross-platform support, and storing parsed codes. Among them, the code parsing is responsible for analyzing, understanding, and converting parameter-driven codes into codes that can be recognized by scene creation software, generating codes for creating the object and parameters in the scene creation software, and driving to the scene object module to retrieve and load relevant scene objects by this code. At the same time, this code is classified and managed for convenient update or expansion. The code optimization is responsible for optimizing the codes during the code parsing process to improve the execution efficiency and readability of the codes. The code annotation annotates the parsed codes and generates a document for storage, explaining the parameter meanings of the codes, reducing the understanding and communication costs of developers. The cross-platform support means that the code parsing module is applicable to various scene object software for code parsing in different environments. The storing of parsed codes is responsible for saving the generated code parsing files for convenient repeated viewing or use during the subsequent scene object creation process.

[0042] In the embodiment of the present invention, the scene object module includes a scene resource module, a host vehicle resource module, an NPC resource module, a sensor module, a material resource module, and an environment rendering module; the scene resource module includes the component devices of a mixing station such as a mixing main machine, a feeding belt conveyor, a cement silo barrel, a screw conveyor, a cement metering device, a water and admixture metering device, a transition storage bin, an admixture supply device, a gas circuit device, a water source supply device, and an electrical control room; the host vehicle resource module mainly refers to the vehicle equipment used for transporting materials in the mixing station, such as a loader; the NPC resource module refers to the static obstacles (static vehicles, stones, etc.) and dynamic obstacles (pedestrians, dynamic vehicles, etc.) that appear in the mixing station; the sensor module refers to the sensors installed and used in the active area of the host vehicle, including lidar, cameras, millimeter waves, inertial measurement units, etc.; the material resource module includes sand, gravel, etc.; the environment rendering module includes light, wind, rain, snow, clouds, etc. Each type of module in the scene object module exists independently, and modules can be added, deleted, and modified according to actual needs, facilitating the upgrade and expansion of the system; at the same time, the scene object module can be created by code calling, or can be created based on the interface by the user operating to drag and drop module objects and set parameters.

[0043] The above are only the preferred embodiments of the present invention. It should be noted that for those of ordinary skill in the art in this technical field, without departing from the technical principle of the present invention, several improvements and deformations can still be made, and these improvements and deformations should also be regarded as the protection scope of the present invention.

Claims

1. A method for constructing a virtual scene of a mixing station, characterized in that: include: Collect scene information of mixing station; Identifying key semantic points of the scene information; Based on the key semantic points, key parameters of each object are identified, parameter code driver files of each object are modified, and the source code of the mixing plant virtual scene is generated by combining them; Based on the mixing plant virtual scene source code, the scene objects and key parameters are parsed, and the code files of the virtual scene constituent elements are retrieved; Driven by the code files of the elements of the virtual scene, the static model template is mobilized to create a static model of the mixing plant virtual scene; Driven by the code files of the elements of the virtual scene, the dynamic model template is mobilized to create a dynamic model of the mixing plant virtual scene; Based on the static model and dynamic model of the virtual scene of the mixing station, the initial operation is completed to complete the construction of the virtual scene of the mixing station.

2. A method for constructing a virtual scene of a mixing plant according to claim 1, characterized in that: The scene information of the mixing station includes: an overall basic introduction of the mixing station, main layout information, main vehicle activity area information, main vehicle information, static and dynamic obstacle information, equipment information, environmental information and material information; The main layout information includes the information of the main mixer, feeding belt conveyor, cement silo, screw conveyor, cement metering device, water and admixture metering device, transition storage silo, admixture supply device, gas circuit device, water supply device and electrical control room in the mixing station area; The main vehicle activity area information refers to the activity area of ​​the loader, including the parking area, silo, hopper, road traffic settings and transfer dispatch center; The main vehicle information includes the main vehicle model and the main vehicle physical model; The static and dynamic obstacle information includes pedestrians, vehicles and stone obstacles; The equipment information includes sensors arranged in the activity area of ​​the loader and the main vehicle; The environmental information includes meteorological information and land cover information; The material information includes materials that can be loaded by the loader.

3. A method for constructing a virtual scene of a mixing plant according to claim 2, characterized in that: The identifying key semantic points of the scene information includes: For the main layout of the mixing station, it is necessary to identify the name of the mixing station, the three-dimensional coordinates of the location of the equipment in each area of ​​the mixing station, the length, width and height dimensions, diameter dimensions, quantity and spatial front orientation; For the main vehicle activity area, the parking area needs to identify the position coordinates, length and width dimensions and number of parking spaces; the silo needs to identify the position coordinates, number of silos, length, width and height dimensions of the silo, silo thickness and silo type; the hopper needs to identify the position coordinates, number of hoppers, length, width and height dimensions of the hopper, silo thickness and hopper type; the traffic setting of the passing road needs to identify the road type - cement road, asphalt road, stone road and gravel road, the traffic setting needs to identify three-color signal lights, two-color signal lights and arrow signal lights, and the traffic warning signs need to identify the indication signs and road signs; the transfer dispatch center needs to identify the position coordinates, length and width dimensions of the area and the direction; For the main vehicle information, the main vehicle model and the driving signal of the main vehicle operation need to be identified; For static and dynamic obstacle information, it is necessary to identify the number of pedestrians, pedestrian paths, pedestrian running speed, the number of vehicles, vehicle paths, vehicle running speed, the number of stones and the location coordinates of the stones; For device information, it is necessary to identify the sensor model, sensor physical properties, sensor sensing range, sensor sensing method, sensor sensitivity, sensor quantity and sensor layout location; For environmental information, it is necessary to identify temperature, cloud, rain, snow, wind level, light, and types and areas of green plants on the ground; For material information, the type and size of the material to be loaded and transported must be identified; For retaining walls, the location, quantity, length, width, height and thickness of the retaining walls need to be identified; After the key semantic points are identified, a standardized electronic file is formed according to a certain file format.

4. A method for constructing a virtual scene of a mixing plant according to claim 1, characterized in that: The static model of the mixing station virtual scene is created, including: Driven by the code files of the virtual scene elements, based on the scene element modules that have been constructed in the mixing station, the static model template is mobilized to create a static model that displays the virtual scene of the mixing station, including: the main area of ​​the mixing station, static vehicles, stones, silos, hoppers, road traffic settings, transfer and dispatch locations, static obstacles, auxiliary vehicles, sensors and retaining walls.

5. A method for constructing a virtual scene of a mixing plant according to claim 1, characterized in that: The dynamic model of the mixing station virtual scene is created, including: Driven by the code file of the virtual scene constituent elements, based on the scene element module that has been constructed in the mixing station, the dynamic model template is mobilized to create a dynamic model that displays the virtual scene of the mixing station, and the key parameters of the dynamic model are obtained, including: main vehicle, dynamic obstacles, weather and materials, wherein the key parameters of the main vehicle include the initial position and initial posture parameters of the main vehicle; the key parameters of the dynamic obstacles include the initial position, the running path and the running parameters; the key parameters of the weather include the ambient temperature, cloud density, rain density, snow density and wind level; the key parameters of the material include particle size, density, friction coefficient and elastic coefficient.

6. A method for constructing a virtual scene of a mixing plant according to any one of claims 1 to 5, characterized in that: The components of the mixing station virtual scene include the mixing station main area, parking area, material pile area, unloading area, driving road, transfer dispatching area, main vehicle, NPC resources, sensor resources, environmental climate and materials; Among them, the main area of ​​the mixing station includes the mixing host system, control system, material conveying system, material weighing system and material storage system; The parking area refers to the parking location when the main vehicle is not in operation; The stockpile area refers to the silo of the mixing plant; The unloading area refers to the hopper of the mixing station; Driving road refers to the roads and traffic facilities within the main vehicle activity area; The main vehicle refers to the vehicle that performs tasks in the scene; NPC resources refer to non-active, non-dominant characters, including static obstacles, dynamic obstacles, and auxiliary vehicles; Sensor resources, including lidar, cameras, mmWave, and inertial measurement units; Environmental climate refers to ambient temperature, cloud density, rain density, snow density and wind level; Materials refer to the raw materials used by the mixing plant to produce materials that can be transported and loaded.

7. A virtual scene construction management system for a mixing plant, characterized in that: include: User management module, used for user role assignment, login permission management, and user basic information management; Scene information collection module, used to collect scene information of the mixing station; The code generation module is used to identify and extract objects and key parameters based on the collected scene information, and generate the source code of the mixing plant virtual scene parameters; A code parsing module is used to parse the source code of the mixing plant virtual scene parameters and retrieve the code files of the virtual scene constituent elements; Scene object module, which is used to construct the element module required for the virtual scene of the mixing plant; Static model templates and dynamic model templates, A virtual scene building module is used to be driven by the code file of the virtual scene elements, mobilize the static model template based on the scene element module that has been built in the mixing plant, and create a static model that displays the virtual scene of the mixing plant; And driven by the code file of the elements of the virtual scene, based on the scene element module that has been constructed in the mixing plant, the dynamic model template is mobilized to create a dynamic model that displays the virtual scene of the mixing plant and obtain the key parameters of the dynamic model; As well as the static model and dynamic model based on the virtual scene of the mixing station, the initial operation is completed to complete the construction of the virtual scene of the mixing station.

8. A mixing plant virtual scene construction management system according to claim 7, characterized in that: The user management module is specifically used to: User role creation, user role assignment, user rights management, user information and user login password modification.

9. A mixing plant virtual scene construction management system according to claim 7, characterized in that: The scene information acquisition module is specifically used to: Information entry, information modification, information upload and download, information storage, information cleaning, information standardization, information verification, information update and information visualization.

10. A mixing plant virtual scene construction management system according to claim 7, characterized in that: The code generation module includes automatic reading of scene information, mobilizing parameter drive templates, drive parameter code generation, metadata management, template customization, one-click generation, multi-language support and code testing; The automatic reading of scene information is used to identify and read scene objects and key parameters according to the scene information data provided by the scene information acquisition module; The parameter mobilization drive module is used to automatically retrieve the parameter drive template after completing the key parameter identification and reading; The driving parameter code generation is used to automatically generate parameter driving code for scene modeling from a parameter driving template; The metadata management is used to provide a visualization tool; The template customization is used to provide a code template for scene object generation, including a blank template and a default scene object template; The one-key generation is used to automatically generate parameter-driven code; The multi-language support is used to support multiple programming languages ​​and development frameworks; The code test is used to run the produced parameter-driven code, detect whether it can run normally and whether there are errors, and modify the relevant object templates.

11. A mixing plant virtual scene construction management system according to claim 7, characterized in that: The code parsing module is specifically used for: Code parsing, code optimization, code annotation, cross-platform support, and parsed code storage.

12. A mixing plant virtual scene construction management system according to claim 7, characterized in that: The scene object module includes a scene resource module, a main vehicle resource module, an NPC resource module, a sensor module, a material resource module and an environment rendering module; The scene resource module includes a mixer, a feeding belt, a cement silo, a screw conveyor, a cement metering device, a water and admixture metering device, a transition storage silo, an admixture supply device, a gas circuit device, a water supply device and an electrical control room; the main vehicle resource module includes vehicle equipment used to transport materials in the mixing station; the NPC resource module includes static obstacles and dynamic obstacles that appear in the mixing station; the sensor module includes sensors installed and used in the main vehicle activity area; the material resource module includes sand and gravel; the environment rendering module includes light, wind, rain, snow and clouds; Each type of module in the scene object module exists independently and can be added, deleted and modified according to actual needs.

Images