A multi-platform integrated method and system for real-time visualization of unmanned agricultural machinery operations

Abstract

This invention provides a multi-platform integrated real-time operation visualization method and system for unmanned agricultural machinery, relating to the field of smart agriculture technology. It utilizes a dual architecture based on uni-app, consisting of a main project and a WebGIS visualization project: the main project uses a single source code to compile both an app and an H5 page, integrating full lifecycle management of agricultural machinery and multi-dimensional task scheduling; the visualization project is deployed independently, with a 2.5D map view that automatically rotates with the agricultural machinery's heading and dynamically throttles sampling based on speed, balancing real-time performance and smooth operation; the main project is embedded via a webview, and cross-project bidirectional communication is achieved through URL parameters and message events; ultimately, a single compilation allows for multi-terminal operation, enabling real-time viewing of the agricultural machinery's position, direction, speed, and trajectory on both mobile phones and browsers. This solves problems of poor cross-platform compatibility, inconsistent user experience, and rendering lag, providing unified, efficient, and low-latency visualization support for precision agriculture.

Description

Technical Field

[0001] This invention relates to the field of smart agriculture technology, specifically to a multi-platform integrated method and system for real-time visualization of unmanned agricultural machinery operations. Background Technology

[0002] With the rapid development of modern agriculture, unmanned agricultural machinery (UAVs) are being used more and more widely in agricultural production. Real-time visualization of UAV operations is an important means to improve operational efficiency, optimize operational paths, and achieve precision agriculture. Traditional visualization systems are often limited to specific platforms, such as PCs or single mobile apps. However, with the popularization of mobile internet and the emergence of diverse terminal devices, users' demand for cross-platform access is becoming increasingly strong. Users want to be able to view the operation status of UAVs in real time on their mobile phones and computers. Therefore, developing a visualization method that can be integrated across platforms has become an important research direction in the field of smart agriculture.

[0003] Currently, development based on the uniapp framework enables cross-platform application development, allowing applications to run on both APP and H5 platforms, which can solve the visualization problem of cross-platform integration to some extent. However, the following problems still exist in the real-time operation visualization application of unmanned agricultural machinery: 1) Poor cross-platform compatibility: Limited support for map components on the APP side, making it impossible to implement advanced functions such as dynamic map rotation, tilt setting, and dynamic trajectory addition, resulting in the inability to dynamically display the operation trajectory and position of unmanned agricultural machinery in real time; 2) Inconsistent user experience: Due to the inconsistent functions of map components on different platforms, the user experience is inconsistent, affecting the overall effect of the system and user satisfaction; 3) When receiving high-frequency positioning data, the interface may lag due to the data throughput exceeding the front-end rendering capacity. Summary of the Invention

[0004] To overcome the problems of existing technologies, this invention provides a multi-platform integrated method and system for real-time visualization of unmanned agricultural machinery operations. A collaborative architecture of a main project and an agricultural machinery visualization project is constructed based on the uniapp framework. The main project, as the core management platform, integrates key functional modules such as agricultural machinery equipment management, task scheduling, and creation, comprehensively covering the intelligent management needs of agricultural machinery operations. The agricultural machinery visualization project focuses on high-precision map rendering and dynamic data display, realizing advanced map interaction functions such as visualization of agricultural machinery planning paths, real-time location tracking, and dynamic drawing of operation trajectories, and optimizing rendering performance through dynamic throttling strategies. The agricultural machinery visualization project is seamlessly embedded into the main project using WebView technology. Finally, the main project is compiled to multiple platforms, achieving efficient cross-platform integration and data interaction, providing users with an integrated agricultural machinery operation management and real-time monitoring solution, which solves the problems of poor cross-platform compatibility, inconsistent user experience, and rendering lag existing in existing technologies. The specific technical solution is as follows:

[0005] A multi-platform integrated method for real-time visualization of unmanned agricultural machinery operations includes the following steps:

[0006] Create a cross-platform main project that enables it to compile for both APP and H5 applications under the same source code.

[0007] Develop agricultural machinery equipment management and task scheduling modules in the main project;

[0008] Develop an agricultural machinery visualization project, initialize a tilted view map, and bind the map rotation angle to the agricultural machinery's driving direction in real time to achieve viewpoint tracking;

[0009] In the visualization project, the location and status data of the agricultural machinery terminal are continuously received, and the data sampling interval is dynamically adjusted according to the real-time speed of the agricultural machinery in order to achieve a balance between data real-time performance and interface smoothness.

[0010] The visualization project is compiled into an H5 file and deployed to the server to form a visualization resource that can be accessed remotely.

[0011] Embed the deployed visualization project into the main project to integrate map interaction and management functions on the same interface;

[0012] A two-way communication link is established between the main project and the sub-project. The main project transmits parameters to the agricultural machinery visualization project by appending parameters to the URL, and the main project receives the parameters returned by the agricultural machinery visualization project through message events.

[0013] The integrated system is compiled into APP and H5 respectively, so that the APP can be installed on mobile terminals and the H5 can be published to browsers, enabling the same function to run on multiple platforms.

[0014] After adding agricultural machinery and creating tasks on both the APP and H5 platforms, the location, direction of travel, and operating speed of the agricultural machinery are displayed in real time on the same visual interface, and the trajectory is dynamically drawn.

[0015] A multi-platform integrated real-time operation visualization system for unmanned agricultural machinery includes the following modules:

[0016] The main project creation module creates a cross-platform main project, enabling it to compile for both APP and H5 applications under the same source code.

[0017] The management and scheduling development module includes the agricultural machinery equipment management module and the task scheduling module, which are developed within the main project.

[0018] The visualization project development module allows for the development of agricultural machinery visualization projects. It initializes a tilted view map and binds the map rotation angle to the agricultural machinery's driving direction in real time, enabling the view to follow the movement.

[0019] The module continuously receives location and status data from agricultural machinery terminals in the visualization project, and dynamically adjusts the data sampling interval according to the real-time speed of the agricultural machinery to achieve a balance between data real-time performance and interface smoothness.

[0020] The H5 compilation module compiles the visualization project into an H5 file and deploys it to the server, forming a visualization resource that can be accessed remotely.

[0021] The embedded module embeds the deployed visualization project into the main project, integrating map interaction and management functions into the same interface;

[0022] The communication link establishment module establishes a two-way communication link between the main project and the sub-project. The main project transmits parameters to the agricultural machinery visualization project by appending parameters to the URL, and the main project receives the parameters returned by the agricultural machinery visualization project through the message event.

[0023] The multi-terminal operation module compiles the integrated system into APP and H5 respectively, so that the APP can be installed on mobile terminals and the H5 can be published to browsers, realizing the same function running on multiple terminals;

[0024] The trajectory drawing module allows for the real-time display of the agricultural machinery's location, direction of travel, and operating speed, as well as the dynamic drawing of its trajectory, on the same visual interface after the agricultural machinery has been added and the task created on both the APP and H5 platforms.

[0025] An electronic device includes: one or more processors; and a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors cause the one or more processors to implement the method.

[0026] A computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, cause the processor to implement the method described thereon.

[0027] The present invention has the following beneficial effects:

[0028] This invention achieves true cross-platform compatibility by using the uniapp framework and webview component, supporting both App and H5 platforms. The agricultural machinery visualization project is implemented using web technology, fully utilizing the advanced features of web map libraries to achieve advanced functions such as map rotation and tilt settings. Furthermore, the webview component's ability to embed web pages enables advanced map interaction within the uniapp-developed app.

[0029] This invention provides a more consistent user experience. The independent deployment and embedding of agricultural machinery visualization projects ensure consistent functionality and user experience across different platforms, thereby improving the overall system performance and user satisfaction.

[0030] This invention offers superior rendering performance by achieving an intelligent balance between real-time data transmission and system smoothness through a dynamic throttling strategy. Attached Figure Description

[0031] Figure 1 This is a flowchart of the processing of the present invention. Detailed Implementation

[0032] To make the objectives, technical solutions, and advantages of this invention clearer, the invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the invention. Furthermore, the technical features involved in the various embodiments of this invention described below can be combined with each other as long as they do not conflict with each other. To achieve the above objectives, this invention adopts the following technical solution.

[0033] This invention provides a multi-platform integrated method and system for real-time visualization of unmanned agricultural machinery operations, such as... Figure 1 As shown, it includes the following steps:

[0034] Step 1: Build a cross-platform main project. The main project serves as the core management platform, integrating core functional modules such as full lifecycle management of agricultural machinery equipment, task scheduling and creation, to fully meet the intelligent management needs of modern agriculture for agricultural machinery operations.

[0035] Specifically, a uni-app cross-platform application is created using front-end development tools. Cross-platform refers to both apps and H5. H5 stands for HTML5, the fifth generation of hypertext markup language standard for building modern web pages and web applications. uni-app is a front-end application framework that uses Vue.js syntax and development paradigms. Developers write one set of code and can deploy it to multiple platforms such as iOS, Android, Web, and various mini-programs.

[0036] Step 2: Based on the main project built in Step 1, develop functional modules such as agricultural machinery equipment management, agricultural machinery task scheduling and creation.

[0037] Specifically, an agricultural machinery equipment management module was developed to enable operations such as adding, modifying, and deleting agricultural machinery; a task scheduling system was built to support the creation of agricultural machinery tasks based on multiple dimensions such as task type, agricultural machinery model, implement configuration, and operation parameters, thereby achieving precise operation management.

[0038] Step 3: Build an agricultural machinery visualization project to realize agricultural machinery control, display the planned path of agricultural machinery, real-time location, direction and operation trajectory.

[0039] Specifically, a WebGIS technology stack (integrating open-source map libraries such as Leaflet, Cesium, and Gaode Maps) is adopted. WebGIS (Web Geographic Information System) is a technology system that uses Web technology to store, manage, analyze, share, and display geospatial data. This system is used to develop a real-time agricultural machinery operation visualization system. The system employs a 2.5D tilted view, enabling the map to intelligently rotate with the direction of the agricultural machinery's movement, ensuring the viewpoint is always aligned with the machinery's direction of travel, providing users with an immersive visualization experience. It also provides functions that can display key information such as the agricultural machinery's planned path, current location, direction of travel, and operational trajectory in real time.

[0040] Step 4: Building upon Step 3, the agricultural machinery visualization project achieves real-time data acquisition for agricultural machinery. Through IoT and instant messaging technologies, it receives real-time data such as location coordinates and operating status from agricultural machinery terminals, ensuring the timeliness and accuracy of the information. The received location coordinates and operating status information are then displayed on a map.

[0041] Specifically, when visualizing and tracking agricultural machinery operations, a dynamic throttling strategy is employed to prevent interface lag caused by high-frequency data, thus achieving a balance between data transmission efficiency and system performance. The formula for the dynamic throttling strategy is as follows:

[0042] ;

[0043] Where T represents the actual time indicator. The basic throttling time interval; The weighting coefficient is (0-1). For the real-time speed of agricultural machinery; Maximum speed; The importance coefficient is 0-1.

[0044] Step 5: Based on Step 4, compile and deploy the agricultural machinery visualization project. Compile the agricultural machinery visualization project into an H5 project and deploy it to the server.

[0045] Step 6: Based on Steps 2 and 5, perform system integration. Seamlessly integrate the agricultural machinery visualization project into the main project using the WebView component, achieving deep integration of map interaction functions and the core management system. The WebView component is a browser engine that can be embedded into native applications (Apps). It can display web page content within the native application.

[0046] Step 7: Implement data communication and synchronization based on Step 6: A cross-project communication mechanism is adopted. The main project passes parameters to the agricultural machinery visualization project by appending parameters to the URL. The main project receives the parameters returned by the agricultural machinery visualization project through the message event.

[0047] Specifically, the main project interacts with the visualization project via URL parameters. The visualization project parses the parameters using URLSearchParams and employs an environment-adaptive communication strategy: the development environment uses the webview.postMessage method, while the production environment uses the uni.navigateTo method for data return. The main project receives and processes the returned parameters through a message event listener mechanism, ensuring the reliability and real-time nature of data communication. URLSearchParams is a Web API, a native JavaScript interface provided by modern browsers. It is specifically designed for handling URL query strings. uni.navigateTo is a routing navigation API provided by the uni-app framework, used for navigating to new pages within the application. webview.postMessage is a mechanism for bidirectional communication between the webpage view and external pages.

[0048] Step 8: Based on Step 7, compile the integrated system into an APP and an H5 project respectively. The APP is launched and run after installation on the mobile phone, and the H5 project is deployed to the server and opened and run in a browser.

[0049] Step 9: Based on Step 8, perform the operations in both the APP and H5 projects and compare the results to obtain the same visualization effect: After completing operations such as adding agricultural machinery and creating tasks on the main platform, the operation status of agricultural machinery can be monitored in real time on the visualization interface. The system dynamically displays key indicators such as the location of agricultural machinery, driving direction, and operating speed, and draws the operation trajectory in real time, providing strong data support and decision-making basis for precision agriculture.

[0050] The present invention provides a more specific embodiment, namely, a multi-platform integrated real-time operation visualization method and system for unmanned agricultural machinery, comprising the following steps:

[0051] Step 1: Build a cross-platform main project. This main project serves as the core management platform, integrating core functional modules such as full lifecycle management of agricultural machinery equipment, task scheduling and creation, etc., to fully meet the intelligent management needs of modern agriculture for agricultural machinery operations. The project can be created using the HBuilderX front-end development tool. HBuilderX is an integrated development environment designed specifically for front-end and hybrid application development; it is a tool for writing code.

[0052] Step 2: Based on the main project built in Step 1, develop functional modules such as agricultural machinery equipment management, agricultural machinery task scheduling and creation. Use the Vue development framework and components provided by the UniApp framework to develop the agricultural machinery equipment management module, enabling operations such as adding, modifying, and deleting agricultural machinery; build a task scheduling system that supports the creation of agricultural machinery tasks based on multiple dimensions such as task type, agricultural machinery model, implement configuration, and operating parameters, achieving precise operation management.

[0053] Step 3: Construct an agricultural machinery visualization project to realize agricultural machinery control and display the planned path, real-time location, direction, and work trajectory of the agricultural machinery. This project can be created using the HBuilderX development tool. Select Amap (Gaode Map) as the map frame. When initializing the map, set the pitch angle to 50 degrees and the map zoom level to 18. Dynamically bind the map's rotation property to the real-time direction of the agricultural machinery to ensure that the viewpoint is always consistent with the direction of the agricultural machinery's movement. Develop a function that can display key information such as the agricultural machinery's planned path, current location, direction of travel, and work trajectory in real time.

[0054] Step 4: Based on Step 3, implement real-time acquisition of agricultural machinery data in the visualization project. Receive location coordinates, operating status, and other data transmitted by the agricultural machinery terminal in real time via MQTT and WebSocket, and display the machinery's location, trajectory, and status information on a map. MQTT is a message protocol that defines the message format, how to transmit messages, and how to process messages. WebSocket is a communication protocol that solves the problem of establishing a persistent, full-duplex communication channel between the client and server.

[0055] Specifically, when visualizing agricultural machinery operation trajectories and tracking agricultural machinery, a dynamic throttling strategy is adopted to avoid interface lag caused by high-frequency data, thereby achieving a balance between data transmission efficiency and system performance.

[0056] Step 5: Based on Step 4, compile and deploy the agricultural machinery visualization project. Compile the agricultural machinery visualization project into an H5 project and deploy it to the server.

[0057] Step 6: Based on Steps 2 and 5, perform system integration. In the main project, seamlessly integrate the agricultural machinery visualization project through the webview component to achieve deep integration of map interaction functions and the core management system.

[0058] Step 7: Implement data communication and synchronization based on Step 6: The main project passes task parameters to the visualization project via URL parameters. The visualization project parses the parameters using URLSearchParams and retrieves real-time information about the agricultural machinery based on the parameters. In the development environment, the webview.postMessage method is used; in the production environment, the uni.navigateTo method is used to send data back to the main project for page return. The main project receives and processes the returned parameters through a message event listener mechanism, ensuring the reliability and real-time nature of data communication.

[0059] Step 8: Based on Step 7, compile the integrated system into an APP and an H5 project respectively. The APP is launched and run after installation on the mobile phone, and the H5 project is deployed to the server and opened and run in a browser.

[0060] Step 9: Based on Step 8, after completing operations such as adding agricultural machinery and creating tasks on the main platform, click "Start Task" to transfer task information to the visualization interface. In the visualization interface, parse parameters to obtain task information and receive agricultural machinery operation status information in real time. Based on the obtained information, the system dynamically displays key indicators such as agricultural machinery location, driving direction, and operating speed, and draws the operation trajectory in real time, providing strong data support and decision-making basis for precision agriculture.

[0061] Another aspect of the present invention provides a multi-platform integrated real-time operation visualization system for unmanned agricultural machinery, comprising the following modules:

[0062] The main project creation module creates a cross-platform main project, enabling it to compile for both APP and H5 applications under the same source code.

[0063] The management and scheduling development module includes the agricultural machinery equipment management module and the task scheduling module, which are developed within the main project.

[0064] The visualization project development module allows for the development of agricultural machinery visualization projects. It initializes a tilted view map and binds the map rotation angle to the agricultural machinery's driving direction in real time, enabling the view to follow the movement.

[0065] The module continuously receives location and status data from agricultural machinery terminals in the visualization project, and dynamically adjusts the data sampling interval according to the real-time speed of the agricultural machinery to achieve a balance between data real-time performance and interface smoothness.

[0066] The H5 compilation module compiles the visualization project into an H5 file and deploys it to the server, forming a visualization resource that can be accessed remotely.

[0067] The embedded module embeds the deployed visualization project into the main project, integrating map interaction and management functions into the same interface;

[0068] The communication link establishment module establishes a two-way communication link between the main project and the sub-project. The main project transmits parameters to the agricultural machinery visualization project by appending parameters to the URL, and the main project receives the parameters returned by the agricultural machinery visualization project through the message event.

[0069] The multi-terminal operation module compiles the integrated system into APP and H5 respectively, so that the APP can be installed on mobile terminals and the H5 can be published to browsers, realizing the same function running on multiple terminals;

[0070] The trajectory drawing module allows for the real-time display of the agricultural machinery's location, direction of travel, and operating speed, as well as the dynamic drawing of its trajectory, on the same visual interface after the agricultural machinery has been added and the task created on both the APP and H5 platforms.

[0071] Another aspect of the present invention provides an electronic device, comprising: one or more processors; and a memory for storing one or more programs, wherein, when the one or more programs are executed by the one or more processors, the one or more processors cause the one or more processors to implement the method.

[0072] Another aspect of the present invention provides a computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, cause the processor to implement the method described thereon.

Claims

1. A multi-platform integrated unmanned agricultural machine real-time operation visualization method, characterized in that, The method comprises the following steps: Create a cross-platform main project that has compilation capabilities for APP and H5 under the same source code; Develop a farm equipment management module and a task scheduling module in the main project; Develop a farm visualization project, initialize the inclined perspective map, and bind the map rotation angle to the farm driving direction in real time to realize perspective following; Continuously receive the position and state data of the farm terminal in the visualization project, and dynamically adjust the data sampling interval according to the real-time speed of the farm to balance between data real-time and interface smoothness; Compile the visualization project into H5 and deploy it to the server to form a remotely accessible visualization resource; Embed the deployed visualization project into the main project to integrate the map interaction function and the management function in the same interface; Establish a main-sub project bidirectional communication link, and the main project transmits parameters to the farm visualization project by splicing parameters after the URL, and the main project receives the parameters returned by the farm visualization project through message events; Compile the integrated system into APP and H5 to realize multi-end operation of the same function; After completing the addition of the farm and the creation of the task on both APP and H5, display the position, driving direction, and operation speed of the farm in real time and dynamically draw the trajectory in the same visualization interface. 2.The multi-platform integrated unmanned agricultural machine real-time operation visualization method according to claim 1, characterized in that, Create a cross-platform main project using uni-app, which distinguishes between APP and H5 platforms in the same source code through conditional compilation instructions. 3.The multi-platform integrated unmanned agricultural machine real-time operation visualization method of claim 1, wherein, Initialize using the WebGIS technology stack, complete 2.5D perspective initialization by setting a preset inclination and zoom level, and keep the map rotation property and the farm heading in real-time synchronization. 4.The multi-platform integrated unmanned agricultural machine real-time operation visualization method of claim 1, wherein, The dynamic adjustment of the data sampling interval is automatically accelerated or decelerated by the visualization project according to the farm speed without additional server instructions.

5. The multi-platform integrated unmanned agricultural machine real-time operation visualization method according to claim 1, characterized in that, Integrate the farm visualization project in the main project through the webview component to realize the deep integration of the map interaction function and the core management system. 6.The multi-platform integrated unmanned agricultural machine real-time operation visualization method of claim 1, wherein, Develop the farm equipment management module to realize the addition, modification, and deletion of the farm; the task scheduling system supports the creation of farm tasks in multiple dimensions according to the task type, farm model, farm tool configuration, and operation parameters.

7. The multi-platform integrated unmanned agricultural machine real-time operation visualization method according to claim 4, characterized in that, The dynamic adjustment of the data sampling interval adopts a dynamic throttling strategy, and the formula of the dynamic throttling strategy is as follows: ； Wherein, T is an actual time index, is a basic throttling time interval; is a weight coefficient; is a real-time speed of the agricultural machine; is a maximum speed; is an important coefficient.

8. A multi-platform integrated unmanned agricultural machine real-time operation visualization system, characterized in that, The method comprises the following modules: The main project creation module creates a cross-platform main project that has compilation capabilities for APP and H5 under the same source code; The management and scheduling development module develops a farm equipment management module and a task scheduling module in the main project; The visualization project development module develops a farm visualization project, initializes the inclined perspective map, and binds the map rotation angle to the farm driving direction in real time to realize perspective following; The module continuously receives the position and state data of the farm terminal in the visualization project, and dynamically adjusts the data sampling interval according to the real-time speed of the farm to balance between data real-time and interface smoothness; The H5 compilation module compiles the visualization project into H5 and deploys it to the server to form a remotely accessible visualization resource; An embedding module, embedding the deployed visualization project into the main project, fusing the map interaction function and the management function in the same interface; A communication link establishing module, establishing a main-sub project bidirectional communication link, the main project transmitting parameters to the agricultural machinery visualization project by splicing parameters after URL, the main project receiving parameters returned by the agricultural machinery visualization project through message event; A multi-terminal running module, compiling the integrated system into APP and H5 respectively, installing the APP in mobile terminals and publishing the H5 to browsers, realizing multi-terminal running of the same function; A trajectory drawing module, after completing agricultural machinery addition and task creation in APP and H5, real-time displaying the agricultural machinery position, running direction and operation speed and dynamically drawing the trajectory in the same visualization interface.

9. An electronic device, comprising: comprise: one or more processors; a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method of any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, a processor, and a memory having stored thereon executable instructions that, as a result of execution by the processor, cause the processor to implement any one of the methods of claims 1 to 7.

Images