Intelligent management and control system and method for seed detection equipment based on unreal engine

Abstract

The invention discloses a seed detection device intelligent management and control system and method based on an unreal engine, and the construction method comprises the steps: constructing a three-dimensional model of each seed entity detection device, and importing the three-dimensional model into an unreal engine platform; a material editor is used for adding materials and textures to the three-dimensional model, rendering is carried out, and a virtual model is obtained; the virtual model and the corresponding seed detection entity equipment are interacted through blueprint compiling, data transmission, remote control and state feedback between a virtual digital space and real equipment are achieved, and the seed detection entity equipment is monitored, controlled and simulated through the system; a control interface is perfected, an information interface, a menu bar and a toolbar module are designed, an intelligent management and control system is formed, and remote management and interaction functions are provided.

Description

Technical Field

[0001] This application belongs to the field of seed sampling detection, and specifically relates to an intelligent control system and method for seed detection equipment based on the Unreal Engine. Background Art

[0002] In recent years, with the development of agricultural technology, agricultural production management is steadily moving towards a new era of automation and intelligence. Seeds, as the starting point of agricultural production, not only affect food security but also serve as a key detection indicator for measuring the performance of related agricultural machinery.

[0003] Seed sampling inspection can be achieved by machines. However, there are still problems such as insufficient intelligence level, inconvenient management, and low efficiency in the management of related equipment, especially the unified management when multiple devices are running simultaneously.

[0004] Therefore, based on the original voice emotion recognition method, how to implement an intelligent control method for seed detection equipment based on the Unreal Engine has become a challenging task. Summary of the Invention

[0005] Based on digital twin technology, developing a management system for seed detection equipment on the Unreal Engine platform can visualize detection data, simulate the actual working states of multiple devices, synchronize the real world and the virtual digital space, which not only helps with remote monitoring and control of equipment but also realizes the intelligent management of seed detection equipment.

[0006] Currently, digital twin technology is continuously integrating with technologies such as the Internet of Things, big data, cloud computing, and artificial intelligence to achieve more efficient data collection, transmission, processing, and analysis, accurately reflecting the situation of the real world. There are mainly four implementation methods of digital twin on the market: constructing 3D scenes using engines such as UE and Unity, constructing 3D scenes through code programming using webGL technology, constructing 3D scenes using open-source platforms, and constructing using low-code or no-code editors developed by other companies. This invention uses the Unreal Engine UE, which provides a higher-quality rendering and interaction experience, has a rich resource library, combines blueprint visual programming to improve development speed and quality, and has platform compatibility, facilitating the wide application of the intelligent control system.

[0007] Objective: In view of at least one of the above technical problems, this application provides an intelligent control system and method for seed detection equipment based on the Unreal Engine, which solves the problems of insufficient intelligence in the management of seed detection equipment, inconvenient unified monitoring when multiple devices are working simultaneously, and low management efficiency.

[0008] The technical solution adopted by this application is as follows:

[0009] In a first aspect, the present application provides a method for constructing an intelligent control system for seed detection devices based on the Unreal Engine, including:

[0010] S1: Construct three-dimensional models of various sub-entity detection devices and import them into the Unreal Engine platform;

[0011] S2: Use the material editor to add materials and textures to the three-dimensional models and perform rendering to obtain virtual models;

[0012] S3: Through blueprint compilation, interact the virtual models with the corresponding seed detection entity devices to achieve data transmission, remote control, and status feedback between the virtual digital space and the real devices, and monitor, control, and simulate the seed detection entity devices through the system;

[0013] S4: Improve the control interface, design information interface, menu bar, and toolbar modules to form an intelligent control system and provide remote management and interaction functions.

[0014] In a second aspect, the present application provides an intelligent control system for seed detection devices based on the Unreal Engine, which is constructed by the above construction method.

[0015] In a third aspect, the present application provides an intelligent control method for seed detection devices based on the Unreal Engine. Based on the intelligent control system for seed detection devices based on the Unreal Engine, the control method includes:

[0016] When the seed entity detection device needs repair and refurbishment, first conduct simulation tests in the corresponding virtual model in the intelligent control system for seed detection devices to verify the feasibility of the plan;

[0017] By connecting the Unreal Engine platform and the sensors on the seed detection entity device, the detection results are updated and stored in real time in the information interface module, enabling real-time monitoring and historical data traceability. The detection results include the current seed detection situation, the current detection time, the current weight of passed seeds, the total number of passed seeds, the total number of damaged seeds, the total weight of passed seeds, the total weight of damaged seeds, the damage ratio, the damage rate, and the light intensity of the environment where the entity detection device is located;

[0018] Use the menu bar module to call up the real-time monitoring screen of the device operation, display device parameters and seed information, visualize the seed purity, cleanliness, and damage rate using a data dashboard, and switch between the virtual models corresponding to multiple seed entity detection devices;

[0019] Use the toolbar module to control the hardware, including the control of the conveyor belt, the light switch, the photoresistor switch, the voice prompt switch, the 360° omnidirectional verification and adjustment of the device, and data export.

[0020] In some embodiments, the intelligent management and control method for the seed detection device based on the Unreal Engine further includes: dynamically displaying the energy consumption value through device monitoring to reflect the operating state of the device, setting an upper limit value for the energy consumption, and when the energy consumption exceeds the upper limit value, the system will control the corresponding seed entity detection device to activate the self-protection mechanism and automatically stop running.

[0021] Beneficial effects: The intelligent management and control system and method for the seed detection device based on the Unreal Engine provided in this application have the following advantages: The present invention develops a visualization platform based on the Unreal Engine, focusing on the intelligent management of a batch of seed detection devices during operation, presenting the operation conditions of different devices in real time, and intuitively displaying key information such as the device operating state and seed detection data. The system has the function of interacting with external devices, realizing remote control, real-time monitoring, and historical data traceability of the client, can centrally control the devices, provides an effective management approach for the operation of a large number of devices, and reduces the frequency of on-site manual intervention. At the level of efficient resource allocation and utilization, the system can intelligently adjust the device working state according to environmental information such as light intensity, combined with the operating parameters of the device; the system also helps with the management of equipment repair and refurbishment and the optimization of the decision-making process, thus promoting resource conservation and efficient utilization in multiple dimensions and contributing to the sustainable development of agricultural production. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 Schematic flowchart of the construction method of the intelligent management and control system for the seed detection device based on an embodiment of the present application;

[0023] Figure 2 Schematic flowchart of the intelligent management and control method for the seed detection device according to an embodiment of the present application;

[0024] Figure 3 Schematic diagram of the information interface according to an embodiment of the present application;

[0025] Figure 4 Schematic diagram of the menu bar according to an embodiment of the present application;

[0026] Figure 5 Schematic diagram of the virtual and real interaction of the intelligent management and control system according to an embodiment of the present application;

[0027] Figure 6 Schematic diagram of the working principle of pixel streaming according to an embodiment of the present application;

[0028] Figure 7 Schematic diagram of the data visualization effect according to an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0029] The present application will be further described below in conjunction with the accompanying drawings and embodiments. The following embodiments are only used to more clearly illustrate the technical solutions of the present application, and cannot be used to limit the protection scope of the present application.

[0030] In the description of the present application, the meaning of several is more than one, the meaning of multiple is more than two, and understandings such as greater than, less than, exceeding, etc. do not include the present number, and understandings such as above, below, within, etc. include the present number. If there is a description of first and second, it is only for the purpose of distinguishing technical features, and cannot be understood as indicating or implying relative importance or implicitly indicating the quantity of the indicated technical features or implicitly indicating the sequence relationship of the indicated technical features.

[0031] In the description of the present application, the description with reference to terms such as "one embodiment", "some embodiments", "schematic embodiments", "examples", "specific examples" or "some examples" means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic descriptions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in a suitable manner in any one or more embodiments or examples.

[0032] The term "and / or" is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " generally represents an "or" relationship between the associated objects before and after.

[0033] Embodiment 1: This embodiment provides a construction method for an intelligent control system of a seed detection device based on the Unreal Engine, as Figure 1 shown, including:

[0034] It should be noted that in this embodiment, the method selects a computer with a central processing unit (CPU) above Core i5, a graphics card (GPU) of RTX 3060, and a memory of more than 8GB as the running terminal, and ensures that it is installed with a 64-bit operating system of Windows 10 / Windows 11. Install the Unreal Engine 5 (UE5) development platform and Blender software for 3D modeling on the computer. In UE5, use its built-in tools and physical effect engine to build the basic framework of the intelligent management system of the seed detection device.

[0035] S1: Build 3D models of various sub-entity detection devices and import them into the Unreal Engine platform;

[0036] In some embodiments, in this step, use the modeling tool Blender to build 3D models of various sub-detection devices.

[0037] More specifically, 3D models of each physical device are created using the 3D modeling software Blender, and the models are imported into Unreal Engine.

[0038] In this embodiment, taking wheat detection as an example, according to the actual structure of the seed detection device and the morphological characteristics of the seeds, 3D modeling is carried out using the modeling tools of Blender. During the modeling process, each component of the device, such as the conveyor belt, camera, servo, etc., is designed in detail to ensure the accuracy and authenticity of the model.

[0039] The model is exported in the FBX file format. Open UE5 and import the FBX file into the project.

[0040] S2: Use the material editor to add materials and textures to the 3D model and perform rendering to obtain a virtual model;

[0041] In some embodiments, in this step, materials and textures are added to the 3D model through the Unreal Engine material editor.

[0042] More specifically, in this embodiment, in UE5, the position, size, and angle of the model are adjusted to meet the layout requirements of the system and integrate with the scene elements in UE5. Materials and textures are added to the adjusted model to simulate the metallic texture of the device and the surface characteristics of the seeds, and then rendering is performed.

[0043] S3: Through blueprint compilation, the virtual model interacts with the corresponding seed detection physical device to achieve data transmission, remote control, and status feedback between the virtual digital space and the real device, and monitor, control, and simulate the seed detection physical device through the system;

[0044] In some embodiments, IoT and sensors are deployed on the physical device to collect various data of the device in real time, such as temperature, light, etc. The collected data is transmitted to the system through wireless or wired networks, and multi-protocols such as serial communication and 5G wireless communication are used for information interaction to support low-latency and low-bandwidth data transmission. The virtual space is hardware-connected to the actual device, so that the virtual model and the actual model are fully interactively corresponding. When the device needs repair and refurbishment, the system can be used to simulate and test the feasibility of the solution first to avoid unnecessary losses caused by operating the original machine.

[0045] In UE5, code logic is written using the blueprint compilation system. Through blueprint compilation, UDP data and instructions are transmitted to interact the 3D digital model with the actual device; Flask video stream transmission is implemented, and the image data is encoded and compressed to convert the image frames into video streams. Blueprint compilation also requires creating a data transmission channel to accurately transmit the detected data to the host computer for processing and display. The data displayed in this example includes the current seed detection situation, the current detection time, the current weight of the passed seeds, the total number of passed seeds, the total number of damaged seeds, the total weight of the passed seeds, the total weight of the damaged seeds, the damage ratio, the damage rate, etc., and the light intensity of the environment where the device is located. The detection results are automatically processed by the system to obtain comprehensive data such as the purity, cleanliness, and damage rate of the seeds; a remote control instruction receiving and parsing mechanism is set up to enable the host computer to send control instructions through the Unreal Engine platform. In this example, the start and stop of the conveyor belt, the photosensitive resistor switch, the light switch, the 360° omnidirectional verification and adjustment of the device, and data export can be adjusted; a status feedback channel is established to timely feedback the detection results and operating status of the device to the Unreal Engine platform where the host computer is located to achieve real-time monitoring. In this example, the energy consumption and fault information of the device can be fed back. Then, a visual data dashboard is embedded in the system using WebUI.

[0046] As described above, the formulas for purity, cleanliness, and damage rate are:

[0047]

[0048]

[0049]

[0050] S4: Improve the control interface, design information interface, menu bar, and toolbar modules to form an intelligent management and control system and provide remote management and interaction functions. Figure 5 It is a schematic diagram of the virtual and real interaction of the intelligent management and control system described in the present invention.

[0051] In this embodiment, as Figure 2As shown, create a startup interface in the user interface design tool of UE5. Add a "Start" button and bind the event to start the system and enter the main interface; add an "About" button and bind the event to pop up system-related information; add an "Exit" button and bind the event to end the system operation. Improve the main interface in the user interface design tool of UE5. Set up an information interface, a menu bar, and a toolbar module. Manage the detection results and device monitoring dynamics in the information interface; design five buttons in the menu bar module, namely real-time monitoring, device parameters, seed information, data dashboard, and other devices. The above buttons provide different functions respectively: bring up the real-time monitoring screen of the device working, display parameters such as the weight, size, and working voltage of the device, record the detected seed data, summarize the data to obtain comprehensive indicators such as seed purity, cleanliness, and breakage rate and visualize the data, switch and control other devices such as Device 2 and Device 3; integrate the function of controlling the hardware in the toolbar module. Finally, package the complete project and transmit the video stream to the terminal under stable network conditions to ensure that the system is compatible and can run stably on multiple browsers, providing users with intuitive device working conditions and detection data.

[0052] In some embodiments, as Figure 3 shown, the information interface is provided with a detection result and a device monitoring dynamics button;

[0053] The detection result button is used to display the current seed detection situation, the current detection time, the current weight of passed seeds, the total number of passed seeds, the total number of broken seeds, the total weight of passed seeds, the total weight of broken seeds, the breakage ratio, the breakage rate, and the light intensity of the environment where the entity detection device is located;

[0054] The device monitoring dynamics button is used to: monitor whether the energy consumption value exceeds the energy consumption upper limit value (the energy consumption upper limit value is set to 1KW in this embodiment). If the energy consumption value exceeds the energy consumption upper limit value, activate the self-protection mechanism; if the energy consumption value does not exceed the energy consumption upper limit value, record the data and continue to work.

[0055] In some embodiments, as Figure 4 shown, the menu bar is provided with real-time monitoring, device parameters, seed information, data dashboard, and other devices buttons;

[0056] The real-time monitoring button is used to bring up the real-time monitoring screen of the entity detection device working, the device parameters button is used to display the weight, size, working voltage, and detection accuracy of the corresponding device, the seed information button is used to summarize the perfect / broken and weight to obtain seed purity, cleanliness, and breakage rate, the data dashboard button is used to visualize the summarized seed purity, cleanliness, and breakage rate, and the other devices button is used to realize switching and controlling other devices.

[0057] The toolbar is provided with multi - perspective switching control, light switch, photoresistor switch, voice prompt switch, conveyor belt control, data export, and system exit buttons; which are respectively used to realize 360° omnidirectional verification and adjustment of the device, light switch, photoresistor switch, voice prompt switch, start - stop control of the conveyor belt, and export of relevant data.

[0058] In some embodiments, the construction method further includes: S5: Transmitting the intelligent control system built on the Unreal Engine platform to the terminal (such as the upper computer) through pixel streaming technology, so that the system can run stably in multiple browsers. As Figure 6 The schematic diagram of the pixel streaming working principle of the present invention is shown.

[0059] Embodiment 2: Based on Embodiment 1, this embodiment also provides an intelligent control system for a seed detection device based on the Unreal Engine, which is constructed by the above - mentioned construction method.

[0060] The constructed intelligent control system for the seed detection device also needs to undergo system testing and optimization protection; specifically: Connect the seed detection device to the upper computer to verify whether the data transmission and control instruction interaction are normal; at the same time, test whether the system runs smoothly without lag in multiple browsers. The device monitoring dynamic module reflects the operating status of the device by displaying energy consumption data. When the energy consumption exceeds the upper limit value, the system will control the device to enter the self - protection state and automatically stop running.

[0061] Embodiment 3: Based on Embodiment 1 and Embodiment 2, this embodiment also provides an intelligent control method for a seed detection device based on the Unreal Engine. Based on the above - mentioned intelligent control system for the seed detection device, specifically, it performs intelligent control through three modules: the information interface, the menu bar, and the toolbar. The control method includes:

[0062] When the seed entity detection device needs repair and refurbishment, first perform simulation testing in the corresponding virtual model in the intelligent control system of the seed detection device to verify the feasibility of the solution;

[0063] By connecting the Unreal Engine platform and the sensors on the seed detection entity device, the detection results are updated and stored in real - time in the information interface module, enabling real - time monitoring and historical data traceability. The detection results include the current seed detection situation, the current detection time, the current weight of the passed seeds, the total number of passed seeds, the total number of damaged seeds, the total weight of the passed seeds, the total weight of the damaged seeds, the damage ratio, the damage rate, and the light intensity of the environment where the entity detection device is located;

[0064] Use the menu bar module to call out the real - time monitoring screen of the device operation, display device parameters and seed information, and use the data dashboard to visualize the seed purity, cleanliness, and damage rate (such as Figure 7as shown), and switch before the virtual models corresponding to multiple seed entity detection devices;

[0065] Use the toolbar module to control the hardware, including the control of the conveyor belt, light switch, photoresistor switch, voice prompt switch, 360° omnidirectional verification and adjustment of the device, and data export.

[0066] It also includes: dynamically displaying the energy consumption value through device monitoring to reflect the operating state of the device, setting an upper limit value for energy consumption. When the energy consumption exceeds the upper limit value of energy consumption, the system will control the corresponding seed entity detection device to activate the self-protection mechanism and automatically stop running.

[0067] In summary, the intelligent control system for seed detection devices based on the Unreal Engine provided by the present invention develops a visualization platform based on the Unreal Engine, focuses on the intelligent management of batch seed detection devices during operation, presents the operation conditions of different devices in real time, and intuitively displays key information such as the device operating state and seed detection data. The system has the function of interacting with external devices, realizes remote control by the client, real-time monitoring, and historical data traceability, can centrally control the devices, provides an effective management approach for the work of a large number of devices, and reduces the frequency of on-site manual intervention. At the level of efficient allocation and utilization of resources, the system can intelligently adjust the device working state according to environmental information such as light intensity and in combination with the operating parameters of the device; the system also helps with the management of equipment repair and refurbishment and the optimization of the decision-making process, thus promoting the conservation and efficient utilization of resources in multiple dimensions and contributing to the sustainable development of agricultural production.

[0068] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0069] The present application is described with reference to the flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each flow and / or block in the flowchart and / or block diagram, and the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices generate for implementing in the process Figure 1 one process or multiple processes and / or blocks Figure 1a device for the functions specified in one or more boxes.

[0070] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device that implements the functions specified in one Figure 1 process or more processes and / or boxes Figure 1 a box or more boxes.

[0071] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to produce a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one Figure 1 process or more processes and / or boxes Figure 1 a box or more boxes.

[0072] The above are only the preferred embodiments of the present application. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present application, several improvements and refinements can be made, and these improvements and refinements should also be regarded as the protection scope of the present application.

Claims

1. A method for constructing an intelligent management and control system for seed detection equipment based on Unreal Engine, characterized in that: include: S1: Build 3D models of various sub-entity detection devices and import them into the Unreal Engine platform; S2: Use a material editor to add materials and textures to the 3D model and render it to obtain a virtual model; S3: Through blueprint compilation, the virtual model interacts with the corresponding seed detection physical equipment, realizes data transmission, remote control and status feedback between the virtual digital space and the real equipment, and monitors, controls and simulates the seed detection physical equipment through the system; S4: Improve the control interface, design the information interface, menu bar and toolbar modules, form an intelligent management and control system and provide remote management and interactive functions.

2. The construction method according to claim 1, characterized in that: Use the modeling tool Blender to build 3D models of various sub-detection equipment.

3. The construction method according to claim 1, characterized in that: Add materials and textures to 3D models through the Unreal Engine Material Editor.

4. The construction method according to claim 1, characterized in that: The information interface is provided with buttons for test results and equipment monitoring dynamics; The detection result button is used to display the current seed detection status, current detection time, current passed seed weight, total number of passed seeds, total number of damaged seeds, total weight of passed seeds, total weight of damaged seeds, percentage of damaged seeds, damage rate and light intensity of the environment in which the physical detection equipment is located; The device monitoring dynamic button is used to: monitor whether the energy consumption value exceeds the energy consumption upper limit value. If the energy consumption value exceeds the energy consumption upper limit value, start the self-protection mechanism; if the energy consumption value does not exceed the energy consumption upper limit value, record the data and continue working.

5. The construction method according to claim 1, characterized in that: The menu bar is provided with real-time monitoring, device parameters, seed information, data large screen and other device buttons; The real-time monitoring button is used to call up the real-time monitoring screen of the physical detection equipment. The equipment parameter button is used to display the weight, size, operating voltage, and detection accuracy of the corresponding equipment. The seed information button is used to summarize the perfection / breakage and weight to obtain the seed purity, clarity, and breakage rate. The data screen button is used to visualize the summarized seed purity, clarity, and breakage rate. The other equipment buttons are used to switch and control other equipment.

6. The construction method according to claim 1, characterized in that: The toolbar is provided with multi-perspective switching control, light switch, photoresistor switch, voice prompt switch, conveyor belt control, data export and system exit buttons; which are respectively used to realize 360° all-round verification and adjustment of the equipment, light switch, photoresistor switch, voice prompt switch, conveyor belt start and stop control and export relevant data.

7. The construction method according to any one of claims 1 to 6, characterized in that: Also includes: The intelligent management and control system built on the Unreal Engine platform is transmitted to the terminal through pixel streaming technology.

8. An intelligent management and control system for seed detection equipment based on Unreal Engine, characterized in that: It is constructed by the construction method according to any one of claims 1 to 7.

9. A method for intelligent management and control of seed detection equipment based on Unreal Engine, characterized in that: Based on the Unreal Engine-based seed detection equipment intelligent management and control system of claim 8, the management and control method includes: When the seed physical testing equipment is facing maintenance and renovation, first conduct simulation tests in the corresponding virtual model of the seed testing equipment intelligent management and control system to verify the feasibility of the solution; By connecting the Unreal Engine platform and the sensors on the physical seed detection equipment, the information interface module updates and stores the detection results in real time, enabling real-time monitoring and historical data tracing. The detection results include the current seed detection status, current detection time, current weight of seeds that have passed, total number of seeds that have passed, total number of broken seeds, total weight of seeds that have passed, total weight of broken seeds, percentage of broken seeds, breakage rate, and light intensity of the environment where the physical detection equipment is located; Use the menu bar module to call up the real-time monitoring screen of the equipment, display equipment parameters and seed information, use the data screen to visualize the seed purity, cleanliness and breakage rate, and switch between the virtual models corresponding to multiple seed entity detection devices; Use the toolbar module to control hardware, including conveyor belt control, light switch, photoresistor switch, voice prompt switch, 360° equipment verification and adjustment, and data export.

10. The method for intelligent management and control of seed detection equipment based on Unreal Engine according to claim 9, characterized in that: Also includes: The energy consumption value is dynamically displayed through equipment monitoring to reflect the operating status of the equipment, and an upper limit of energy consumption is set. When the energy consumption exceeds the upper limit, the system will control the corresponding seed entity detection equipment to start the self-protection mechanism and automatically stop running.

Images