Crop monitoring method, system and device based on digital twinborn technology

Abstract

The invention discloses a crop monitoring method, system and device based on a digital twinborn technology. The method comprises the following steps: acquiring real-time monitoring data of crops in a target farm area; inputting the real-time monitoring data into a preset farm digital twinborn model, and obtaining fusion feature data based on the farm digital twinborn model; inputting the fused feature data and the historical fused feature data into a monitoring prediction model to obtain a crop state prediction result; and determining a regulation and control instruction according to the crop state prediction result, and adjusting the growth environment of crops in the target farm area according to the regulation and control instruction. According to the method, the real-time monitoring data of the crops is acquired, the real-time monitoring data is processed by using the constructed farm digital twinborn model and the monitoring prediction model, and the optimal regulation and control instruction for the growth of the crops is determined, so that the growth environment of the crops is optimized, the crops are accurately monitored and regulated, and the yield of the crops is improved.

Description

Technical Field

[0001] The present invention relates to the field of information automation control technology, and in particular to a crop monitoring method, system and device based on digital twin technology. Background Art

[0002] Existing crop monitoring mainly uses single technology applications such as remote sensing, Internet of Things, image recognition and machine vision to monitor the physiological and pest characteristics of crops. Although certain monitoring effects can be achieved, crop growth is affected by multiple factors such as weather, temperature, humidity, pests and diseases. A single data source or dimension of information is not enough to fully reflect the growth of crops in a complex environment, and it is impossible to obtain accurate monitoring information, and thus it is impossible to achieve precise and scientific management of crops.

[0003] Therefore, the prior art needs further improvement. Summary of the invention

[0004] In view of the shortcomings of the above-mentioned related technologies, the purpose of the present invention is to provide a crop monitoring method, system and device based on digital twin technology, so as to overcome the defect that the prior art cannot realize comprehensive and accurate monitoring of crops.

[0005] The technical solution adopted by the present invention to solve the technical problem is as follows:

[0006] In a first aspect, this embodiment discloses a crop monitoring method based on digital twin technology, which includes:

[0007] Obtain real-time monitoring data of crops in the target farm area;

[0008] Input the real-time monitoring data into a preset farm digital twin model, and obtain fused feature data based on the farm digital twin model;

[0009] Inputting the fused feature data and the historical fused feature data into a trained monitoring prediction model to obtain a crop state prediction result output by the monitoring prediction model;

[0010] Control instructions are determined based on the crop state prediction results, and the growth environment of the crops in the target farm area is adjusted based on the control instructions.

[0011] Optionally, the real-time monitoring data includes: environmental monitoring data, crop growth data, farm equipment data, geographic location information and meteorological data of the target farm, and market dynamics data of crops.

[0012] Using information collection equipment deployed in the target farm area to collect environmental monitoring data of crops in the target farm;

[0013] Using smart devices to collect crop growth data of crops in target farms;

[0014] Using crop growth control equipment to obtain farm equipment data of crops in a target farm;

[0015] Use GIS system to obtain the geographical location information of the target farm;

[0016] Obtain the weather data of the current target farm area;

[0017] Use web crawler technology to obtain market dynamics data on crops in target farms.

[0018] Optionally, after the step of obtaining real-time monitoring data of crops in the target farm area, the method further includes:

[0019] Preprocessing the real-time monitoring data to obtain preprocessed real-time monitoring data;

[0020] The preprocessed real-time monitoring data is sequentially normalized, logarithmically and one-hot encoded to obtain the converted monitoring data;

[0021] The converted monitoring data is subjected to feature engineering processing to obtain real-time monitoring data after feature selection and feature fusion.

[0022] Optionally, before the step of inputting the real-time monitoring data into a preset farm digital twin model and obtaining fusion feature data based on the farm digital twin model, the step further includes:

[0023] Construct a spatial characteristic model of the target farm area based on the geographical location information of the target farm;

[0024] Build a physical feature model of crops based on the environmental monitoring data of crops in the target farm and the operating status and performance data obtained by the growth control equipment;

[0025] Constructing a crop activity characteristic model based on the crop growth status data in the target farm;

[0026] Build a regular feature model of crops based on the market dynamics data of crops in the target farm;

[0027] According to the hierarchical relationship and spatial constraints among the spatial feature model, entity feature model, activity feature model and rule feature model, the spatial feature model, entity feature model, activity feature model and rule feature model are fused and assembled into a farm digital twin model.

[0028] Optionally, the step of inputting the real-time monitoring data into a preset farm digital twin model and obtaining fused feature data based on the farm digital twin model includes:

[0029] Input the real-time monitoring data into the preset farm digital twin model to obtain an updated digital twin model;

[0030] Comparing the simulated data output by the updated farm digital twin model with the real-time monitoring data to obtain a comparison result;

[0031] The updated farm digital twin model is corrected based on the comparison results, and the corrected fusion feature data is output.

[0032] Optionally, before the step of inputting the fused feature data and the historical fused feature data into a trained monitoring prediction model to obtain a crop state prediction result output by the monitoring prediction model, the step includes:

[0033] Obtain historical monitoring data of crops and build a training data set based on the historical monitoring data;

[0034] The preset long short-term memory network multi-task learning model is trained using the training data set to obtain a trained monitoring prediction model.

[0035] Optionally, the step of determining a control instruction according to the crop state prediction result, and adjusting the growth environment of the crops in the target farm area according to the control instruction includes:

[0036] According to the crop status prediction results, an optimized decision plan is generated by minimizing the weighted loss function and regularization term;

[0037] Generate control instructions corresponding to the items based on the optimized decision-making scheme and the updated farm digital twin model;

[0038] The growing environment of crops in the target farm area is adjusted according to the control instructions.

[0039] Optionally, the optimization decision function corresponding to the optimization decision scheme is:

[0040] D(y pred )=argmind(L(y pred ,d)+λR(d));

[0041] Among them, D(y pred ) is the optimization decision function, d is the optimal decision solution output by the optimization decision function; L is the loss function, which is used to measure the difference between the current decision solution and the predicted result; R is the regularization term; λ is the trade-off factor.

[0042] In a second aspect, the present application discloses a crop monitoring system based on digital twin technology, which includes:

[0043] A data acquisition module, used to obtain real-time monitoring data of crops in the target farm area;

[0044] A digital twin module, used to input real-time monitoring data into a preset farm digital twin model, and obtain fused feature data based on the farm digital twin model;

[0045] A prediction module, used for inputting the fused feature data and the historical fused feature data into a trained monitoring prediction model to obtain a crop state prediction result output by the monitoring prediction model;

[0046] The control execution module is used to determine the control instructions according to the crop state prediction result, and adjust the growth environment of the crops in the target farm area according to the control instructions.

[0047] In a third aspect, the present application also discloses a crop monitoring device based on digital twin technology, which includes: a data acquisition device and a data processing device;

[0048] The data collection equipment is arranged in the target farm area and is used to collect real-time monitoring data of crops in the target farm area;

[0049] The data processing device is used to receive real-time monitoring data collected by the data acquisition device, input the real-time monitoring data into a preset farm digital twin model, and obtain fused feature data based on the farm digital twin model, input the fused feature data and historical fused feature data into a trained monitoring prediction model, obtain the crop status prediction result output by the monitoring prediction model, and determine the control instructions according to the crop status prediction result, and adjust the growth environment of the crops in the target farm area according to the control instructions.

[0050] Beneficial effects:

[0051] This embodiment discloses a crop monitoring method based on digital twin technology, which obtains real-time monitoring data of crops in a target farm area; inputs the real-time monitoring data into a preset farm digital twin model, and obtains fusion feature data based on the farm digital twin model; inputs the fusion feature data and historical fusion feature data into a trained monitoring prediction model to obtain a crop state prediction result output by the monitoring prediction model; determines control instructions based on the crop state prediction result, and adjusts the growth environment of crops in the target farm area based on the control instructions. The method of this embodiment obtains real-time monitoring data of crops, processes the real-time monitoring data using the constructed farm digital twin model and monitoring prediction model, determines the optimal control instructions for crop growth, optimizes the growth environment of crops, and accurately monitors and controls crops, thereby increasing crop yields. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 This is a flowchart of a method for monitoring crops based on digital twin technology according to an embodiment of the present invention;

[0053] Figure 2 It is a principle block diagram of real-time monitoring data collection in an embodiment of the present invention;

[0054] Figure 3 This is a flow chart of the steps for constructing a farm digital twin model in an embodiment of the present invention;

[0055] Figure 4 is a flowchart of the steps of crop state prediction in an embodiment of the present invention;

[0056] Figure 5 It is a principle block diagram of a crop monitoring system based on digital twin technology in an embodiment of the present invention. DETAILED DESCRIPTION

[0057] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0058] Crop detection is to monitor the growth status of crops, early warning of pests and diseases, optimize planting management, and improve agricultural production efficiency. The crop detection methods based on machine learning disclosed in the prior art generally use a single technology such as remote sensing, Internet of Things, image recognition, or machine vision. However, since the growth of crops is affected by many aspects, the use of a single technology application cannot achieve full acquisition of crop information, and thus cannot achieve comprehensive, accurate, and systematic monitoring of crops based on the acquired information.

[0059] In order to overcome the defects in the above-mentioned prior art, the present application provides a crop monitoring method, system and device based on digital twin technology. First, through the application of multiple and multi-dimensional technologies, all-round acquisition of crop information is realized. Secondly, the real-time monitoring data of crops is fused and processed by the constructed farm digital twin model, and then input into the monitoring prediction model. The monitoring prediction model is used to obtain corresponding control instructions. Finally, the growth conditions and growth environment of crops are adjusted based on the control instructions to improve the production efficiency of crops.

[0060] The following is a further description of a crop monitoring method, system and device based on digital twin technology disclosed in this embodiment in conjunction with the accompanying drawings.

[0061] In the first aspect, this embodiment discloses a crop monitoring method based on digital twin technology, such as Figure 1 As shown, the crop monitoring method comprises:

[0062] Step S1: Acquire real-time monitoring data of crops in a target farm area.

[0063] Since the growth of crops is not only related to themselves, but also affected by many aspects, such as: environmental temperature, humidity, pests and diseases, and geographical location, in order to accurately obtain the growth environment information, growth status information and related information of growth control equipment of crops in the target farm area, this step uses a multi-dimensional information acquisition method to obtain information from different aspects, and then obtain real-time monitoring data of crops.

[0064] Furthermore, in order to collect real-time monitoring data of crops, it is first necessary to deploy sensors, networks and other data collection equipment for data collection in the target farm area. Specifically, the sensor can be a temperature sensor, an illumination sensor, a humidity sensor, or a wind direction sensor, etc., which are devices for measuring temperature, light intensity, ambient humidity or wind direction respectively. The above sensors will establish a connection with the data processing device and transmit the collected data to the data processing device to realize further processing of the above data.

[0065] In one embodiment, the real-time monitoring data includes: environmental monitoring data, crop growth data, farm equipment data, geographic location information and weather data of the target farm, and market dynamics data of the crops.

[0066] Specifically, combined Figure 2 As shown, this step includes:

[0067] The environmental monitoring data of crops in the target farm is collected using information collection equipment deployed in the target farm area; the environmental monitoring data includes: data collected in real time on the environment such as light, temperature and humidity, soil conditions, water resources, wind speed and direction using sensors, monitoring equipment or network technology.

[0068] Use smart devices to collect crop growth data of crops in the target farm; among them, crop growth data is data related to the growth status of crops, including: crop types, growth conditions, pests and diseases, etc. obtained through monitoring equipment such as satellites, drone remote sensing, and ground monitoring networks.

[0069] The crop growth control equipment is used to obtain farm equipment data of crops in the target farm; the farm equipment data includes: the operation status and performance data of equipment management systems such as agricultural machinery, irrigation systems, and storage facilities.

[0070] The GIS system is used to obtain the geographic location information of the target farm; the geographic location information includes: collecting geographic information such as topography, land use, soil type, etc. through the GIS system.

[0071] Obtain the meteorological data of the current target farm area; the meteorological data is obtained by querying historical weather and real-time weather through the API interface provided by the meteorological website.

[0072] Use web crawler technology to obtain market dynamics data of crops in the target farm, where the market dynamics data includes: collecting data such as agricultural production costs, agricultural product market demand, prices and sales channels through web crawler technology to obtain market dynamics data related to crops.

[0073] Furthermore, after the corresponding data are obtained through the above-mentioned methods, in order to facilitate more efficient data processing, the collected data also needs to be processed to improve the quality of the collected data and obtain more accurate processing results.

[0074] Specifically, after this step, the following steps are also included:

[0075] Step S110: pre-process the real-time monitoring data to obtain pre-processed real-time monitoring data.

[0076] Data preprocessing is to remove missing data, abnormal data or duplicate data to avoid the deviation of data processing results caused by missing data, abnormal data or duplicate data. Specifically, data preprocessing mainly includes:

[0077] Process the missing values ​​of the original data: Dmissing = fill (D, S);

[0078] Outlier processing: Doutliers = clip(Dmissing, lower, upper);

[0079] And, deduplication processing: Dunique=unique(Doutliers).

[0080] Among them, fill is a missing value processing function, which is used to fill missing values ​​according to S (such as mean, median, front and back value filling, etc.); clip is an exception processing function, which is used to limit the data to the range of [lower, upper], and the values ​​out of the range are set to the boundary value; unique is a deduplication function, which is used to remove duplicate data records.

[0081] Step S120: standardize, logarithmize and convert the preprocessed real-time monitoring data into one-hot encoding data in turn to obtain converted monitoring data.

[0082] In order to achieve better data processing effect, the pre-processed real-time monitoring data is further converted in this step to facilitate subsequent data analysis. Specifically, in this step, data conversion includes: data standardization conversion, logarithmic conversion and unique hot encoding conversion. The data conversion is to standardize the data. scaled = scale (Dunique), logarithmic transformation D log =log(D scaled ) and one-hot encoding D onehot =onehot(D log )deal with.

[0083] Step S130: performing feature engineering processing on the converted monitoring data to obtain real-time monitoring data after feature selection and feature fusion.

[0084] After the real-time monitoring data is converted in the above step S120, feature engineering processing is also performed on it to extract more feature information from the data, or in order to better apply the real-time monitoring data to the model to improve model performance, increase model robustness and generalization ability, in this step, feature engineering processing is also performed on the preprocessed data to obtain real-time monitoring data after feature selection and feature fusion.

[0085] Feature engineering is to select features from data. features D=select(D log , features) and feature fusion D′=fuse(D features) operation. Among them, select is a feature selection function used to select the most important features for analysis; fuse is a feature fusion function used to weight and fuse multiple features into a comprehensive feature through principal component analysis (PCA) to obtain the fused real-time monitoring data.

[0086] Step S2: input the real-time monitoring data into a preset farm digital twin model, and obtain fused feature data based on the farm digital twin model.

[0087] The real-time monitoring data obtained in the above step S1 is input into the preset farm digital twin model, and the fused feature data is obtained through the farm digital twin model.

[0088] The farm digital twin model is a three-dimensional model built based on farm-related data. It is a digital farm model that is built in the digital world and completely corresponds to the real world (physical world). The model records and displays all aspects of farm information in the real world to monitor crops in the farm area in real time, realize digital planting, and improve production efficiency.

[0089] In this step, the real-time monitoring data is input into the farm digital twin model so that the farm digital twin model can correct and display the farm digital twin model according to the real-time monitoring data. The received real-time monitoring data is then analyzed and processed into fused feature data.

[0090] In one embodiment, the farm digital twin model analyzes and processes the real-time monitoring data to obtain the formula for fusion feature data:

[0091] D′=fuse(select(log(scale(unique(fill(D,strategy),lower,upper),features))));

[0092] Among them, the real-time monitoring data is D, and the fused feature data obtained after processing is D′.

[0093] It can be imagined that before the real-time monitoring data is input into the preset farm digital twin model, it also includes the step of building a farm digital twin model. The digital twin model is a virtual model with multi-dimensional, multi-temporal and multi-domain descriptions, which is dynamically constructed in the virtual space based on real-time collected data.

[0094] Specifically, combined Figure 3 As shown in the figure, the steps to build a farm digital twin model include:

[0095] S201: Construct a spatial feature model of the target farm area based on the geographical location information of the target farm.

[0096] A spatial model of the target farm is constructed based on point cloud (obtained through 3D scanning technology), elevation and terrain data.

[0097]

[0098] Among them, M represents the spatial model of the target farm, T represents the terrain surface model, P represents the point cloud data, x and y are horizontal coordinates, and z is the elevation value. Represents a model fusion operation.

[0099] S202: Constructing a physical feature model of the crops based on the environmental monitoring data of the crops in the target farm and the operating status and performance data acquired by the growth control equipment.

[0100] Taking the collected data of crops, machinery and facilities as input, combining the advantages of multiple regression, and using regularization technology to improve the generalization ability of the entity model, the entity model of the target farm is constructed.

[0101] f(x)=k T x+b;

[0102] Among them, x contains multiple feature input vectors, f(x) is the output of the model (predicted target variable), k T is the feature weight, and b is the intercept or bias of the model. That is, by learning k T and b make f(x) as close as possible to the actual observed value of the target farm, and output the predicted result for the farm entity.

[0103] S203: Constructing an activity characteristic model of crops based on the growth status data of crops in the target farm.

[0104] In order to effectively capture the dynamic changes and dependencies in time series data such as tillage, irrigation and harvesting during crop growth, the recurrent neural network (RNN) method is used to construct a digital twin activity feature model of the target farm.

[0105] F(x t )=h t =tanh(W xh x t +W hh h t -1+b h );

[0106] Among them, F is the RNN model, x t is the input feature vector at time step t, h t is the hidden state at time step t, W xh is the weight matrix input to the hidden state, W hhis the weight matrix from the previous time step hidden state to the current hidden state, b h is the bias vector of the hidden state and tanh is the hyperbolic tangent activation function.

[0107] S204: Construct a rule feature model of crops based on the market dynamics data of crops in the target farm.

[0108] The rule model is generated by combining management strategies (such as farming methods, crop rotation, irrigation, etc.), empirical knowledge (such as historical crop yields, weather patterns, frequency of pests and diseases, etc.) and market development data (such as market prices of crops, consumer demand, competitor behavior, etc.).

[0109]

[0110] Among them, R represents the output of the rule model, which is the expected yield, crop maturity or other key performance indicators of the target farm; M is the management strategy vector, which contains different management practices and decisions; E is the experience vector, which contains historical data and knowledge. S is the market data vector, which contains price, demand and other market factors. i , γ j and δ k represents the degree of influence of management strategy, experience and market data on farm performance. m, n and p are the number of features of management strategy, experience and market data, respectively.

[0111] S205: According to the hierarchical relationship and spatial constraints among the spatial feature model, entity feature model, activity feature model and rule feature model, the spatial feature model, entity feature model, activity feature model and rule feature model are integrated and assembled into a farm digital twin model.

[0112] In order to build a comprehensive digital twin model and achieve a comprehensive description and prediction of the target farm, the spatial feature model, entity feature model, activity feature model and rule feature model constructed in the above steps are firstly integrated. The function expression is:

[0113] F(x,y,z,w)=α·S(x)+β·E(y)+γ·A(z)+δ·R(w);

[0114] Among them, S(x) represents the spatial model, E(y) represents the entity feature model, A(z) represents the activity feature model, R(w) represents the rule feature model, and α, β, γ, and δ are weight coefficients used to adjust the proportion of different models in the fusion process.

[0115] Then, according to the hierarchical relationship of the spatial feature model (S), entity feature model (E), activity feature model (A) and rule feature model (R) and the spatial constraints, they are assembled into a farm digital twin model (DTIS).

[0116] The functional formula of the farm twin digital model is: DTIS=f(S,E,A,R).

[0117] The specific steps of obtaining fused feature data based on the farm twin digital model in this step include:

[0118] The real-time monitoring data is input into a preset farm digital twin model to obtain an updated digital twin model; the simulation data output by the updated farm digital twin model is compared with the real-time monitoring data to obtain a comparison result; the updated farm digital twin model is corrected according to the comparison result, and the corrected fusion feature data is output.

[0119] During the specific implementation, the farm data collected in real time will be input into the farm digital twin model to carry out farm reality simulation, compare the simulation with the actual growth conditions, and correct the model through the feedback mechanism, thereby continuously learning and adapting to improve the accuracy of the farm digital twin model's simulation of the real-world farm, thereby better guiding farm management decisions.

[0120]

[0121] Among them, M corrected is the calibrated farm digital twin model; M initial It is the initial farm digital twin model. real It is real-time monitoring data, including real-time collection of crop growth, soil moisture, temperature, etc. sim It is the simulated growth data generated by the initial digital twin model. After the correction of the farm digital twin model, the final output of the simulated growth data is the fused feature data.

[0122] Step S3: input the fused feature data and the historical fused feature data into the trained monitoring prediction model to obtain the crop state prediction result output by the monitoring prediction model.

[0123] After the fused feature data is obtained in the above steps, the fused feature data and the historical fused feature data are combined and input into the trained monitoring prediction model. The monitoring prediction model processes the received fused feature data and the historical fused feature data to obtain the prediction result of the crop status.

[0124] It can be imagined that before inputting the fused feature data and the historical fused feature data into the monitoring prediction model, it is necessary to obtain the trained monitoring prediction model. Therefore, before this step, it also includes:

[0125] The historical monitoring data of crops is obtained, a training data set is constructed according to the historical monitoring data, and the training data set is used to train the preset long short-term memory network multi-task learning model to obtain a trained monitoring prediction model.

[0126] like Figure 4 As shown, in a specific application embodiment, the steps of training to obtain a monitoring prediction model are as follows:

[0127] Step S301: extracting features of the crop monitoring data in the training data set.

[0128] Obtain relevant data in the target farm area, extract features from the relevant data, and construct a training data set. The extracted features can be expressed as:

[0129]

[0130] Among them, x1, x2, …, xn may include climate data (such as temperature, humidity, rainfall, etc.), soil conditions (such as pH value, nutrient content, etc.), crop growth stage information (such as growth cycle, growth rate, etc.), historical yield data, etc.

[0131] Step S302, constructing a farm digital twin model.

[0132] In one implementation, a long short-term memory network (LSTM) multi-task learning model is used as a preset network model. Since LSTM is good at processing time series data, it is suitable for tasks such as predicting crop growth trends. Specifically, the expression for constructing the preset network model is:

[0133]

[0134] Where M is a long short-term memory network (LSTM) multi-task learning model. L is a learning function that uses the feature set and model parameters θ to train the model.

[0135] Step S303, defining a loss function.

[0136] In the process of training the preset network model, it is also necessary to define the loss function and find the optimal model parameters.

[0137] In one embodiment, the loss function expression is defined as:

[0138]

[0139] Among them, y true is the true label vector, y pred is the label vector predicted by the preset network model, m is the number of training samples, and the loss function is the mean square error (MSE), which is used to measure the difference between the predicted value and the true value.

[0140] Step S304, performing algorithm optimization on the constructed model.

[0141] Find the optimal model parameter θ by minimizing the loss function * , the expression of the preset network model parameters is:

[0142]

[0143] Among them, y true is the true label vector, and θ is the original model parameter.

[0144] Step S305, using the trained monitoring prediction model to predict the growth of crops.

[0145] Use the trained model parameters θ * , with data collected in real time from the target farm The farm environment, crop growth, and pest and disease status of crops are predicted using the data as input.

[0146]

[0147] Step S4: determining control instructions according to the crop state prediction result, and adjusting the growth environment of the crops in the target farm area according to the control instructions.

[0148] When the above steps obtain the crop state prediction results based on the monitoring prediction model output, the corresponding control instructions can be determined according to the crop state prediction results, and the control instructions are executed to adjust the growth environment of the crops.

[0149] Specifically, according to the prediction results of the target farm status, an optimized decision scheme is generated by minimizing the weighted loss function and the regularization term.

[0150] D(y pred )=argmind(L(y pred ,d)+λR(d))

[0151] Among them, D is the optimization decision function, which outputs the optimal decision plan d; L is the loss function, which measures the difference between the current decision plan and the predicted result; R is the regularization term, which includes factors such as resource consumption and disaster resistance to ensure the feasibility and sustainability of the decision plan; λ is the trade-off factor used to balance the impact between the loss function and the regularization term.

[0152] According to the optimized decision function (D) and the updated data twin model (M), corresponding control instructions are generated to achieve precise control of the target farm.

[0153] C = argmin C {L(c,D)+λR(c)}

[0154] Among them, C is the set of generated control instructions; c is a single control instruction; L(c,D) is the loss function, which represents the difference between the control instruction c and the optimization decision D; R(c) is the regularization term, which represents the impact of the control instruction c on resource consumption; λ is a trade-off factor used to balance the loss function and the regularization term.

[0155] Control instructions include but are not limited to: switching on and off the irrigation system and adjusting the amount of water; adjusting the fertilization plan, including the type and amount of fertilizer; implementing pest control measures, such as the time and frequency of spraying pesticides; optimizing crop planting plans, including planting density and crop rotation; arranging harvest plans, including harvest time and harvest methods. These instructions will be dynamically adjusted based on the farm's real-time data and monitoring prediction models to ensure the optimization of farm operations. In this way, efficient use of resources can be achieved, crop yield and quality can be increased, and environmental impact can be reduced.

[0156] It can be imagined that the farm digital twin model and the monitoring prediction model disclosed in this embodiment are interrelated. The farm digital twin model outputs fused feature data processed based on real-time monitoring data to the monitoring prediction model. After processing the fused feature data, the monitoring prediction model obtains a crop state prediction result, and adjusts the growth environment of the crops based on the crop state prediction result. During the growth of crops, if the actual crop growth state caused by environmental changes is different from the crop state prediction result, the farm digital twin model can correct the model in real time according to the real-time monitoring data obtained from the real scene, and output the corrected fused feature data to the monitoring prediction model. The monitoring prediction model outputs a new crop state prediction result, and determines a new control instruction based on the new crop state prediction result, thereby adjusting the strategy for adjusting the growth environment of the crops, and then realizing real-time updating of the control instructions according to the actual situation, so as to realize the growth of crops in the most suitable environment, thereby improving the yield and quality of crops.

[0157] While disclosing the above method, this embodiment also proposes a crop monitoring system based on digital twin technology, such as Figure 5 As shown, including:

[0158] The data acquisition module 510 is used to acquire real-time monitoring data of crops in the target farm area; its function is as described in step S1.

[0159] The digital twin module 520 is used to input the real-time monitoring data into the preset farm digital twin model, and obtain fused feature data based on the farm digital twin model; its function is as described in step S2.

[0160] The prediction module 530 is used to input the fused feature data and the historical fused feature data into the trained monitoring prediction model to obtain the crop state prediction result output by the monitoring prediction model; its function is as described in step S3.

[0161] The control execution module 540 is used to determine the control instructions according to the crop state prediction result, and adjust the growth environment of the crops in the target farm area according to the control instructions. Its function is as described in step S4.

[0162] Furthermore, the real-time monitoring data includes: environmental monitoring data, crop growth data, farm equipment data, geographic location information and meteorological data of the target farm, and market dynamics data of crops.

[0163] The data acquisition module is used to collect environmental monitoring data of crops in the target farm using information collection equipment deployed in the target farm area; collect crop growth data of crops in the target farm using intelligent equipment; obtain farm equipment data of crops in the target farm using crop growth control equipment; obtain geographical location information of the target farm using the GIS system; obtain meteorological data of the current target farm area; and obtain market dynamics data of crops in the target farm using web crawler technology.

[0164] Furthermore, the system also includes: a data preprocessing module.

[0165] The data preprocessing module includes: preprocessing the real-time monitoring data to obtain preprocessed real-time monitoring data; standardizing, logarithmically and converting the preprocessed real-time monitoring data into one-hot encoding data in sequence to obtain converted monitoring data; and performing feature engineering processing on the converted monitoring data to obtain real-time monitoring data after feature selection and feature fusion.

[0166] Furthermore, the system also includes: a digital twin model construction module.

[0167] The digital twin model construction module is used to construct a spatial feature model of the target farm area according to the geographic location information of the target farm; to construct a physical feature model of the crops according to the environmental monitoring data of the crops in the target farm, and the operating status and performance data obtained by the growth control equipment; to construct an activity feature model of the crops according to the growth status data of the crops in the target farm; to construct a rule feature model of the crops according to the market dynamics data of the crops in the target farm; and to integrate the spatial feature model, the physical feature model, the activity feature model and the rule feature model into a farm digital twin model according to the hierarchical relationship and spatial constraints among the spatial feature model, the physical feature model, the activity feature model and the rule feature model.

[0168] Furthermore, the digital twin module includes: a model updating module, an information comparison module and a feature fusion module.

[0169] The model update module is used to input real-time monitoring data into the preset farm digital twin model to obtain an updated digital twin model.

[0170] The information comparison module is used to compare the simulation data output by the updated farm digital twin model with the real-time monitoring data to obtain a comparison result.

[0171] The feature fusion module is used to calibrate the updated farm digital twin model according to the comparison results and output the corrected fused feature data.

[0172] Furthermore, the system also includes: a prediction model building module.

[0173] The prediction model building module is used to obtain historical monitoring data of crops and build a training data set based on the historical monitoring data; the training data set is used to train the preset long short-term memory network multi-task learning model to obtain a trained monitoring prediction model.

[0174] Furthermore, the control execution module includes: a decision generation module, an instruction generation module and an instruction execution module.

[0175] The decision generation module is used to generate an optimized decision plan based on the crop status prediction results by minimizing the weighted loss function and regularization term;

[0176] An instruction generation module is used to generate control instructions corresponding to items based on the optimized decision-making scheme and the updated farm digital twin model;

[0177] The instruction execution module is used to adjust the growth environment of crops in the target farm area according to the control instruction. Specifically, the optimization decision function corresponding to the optimization decision scheme is:

[0178] D(ypred )=argmind(L(y pred ,d)+λR(d));

[0179] Among them, D(y pred ) is the optimization decision function, d is the optimal decision solution output by the optimization decision function; L is the loss function, which is used to measure the difference between the current decision solution and the predicted result; R is the regularization term; λ is the trade-off factor.

[0180] On the premise of providing the above-mentioned crop monitoring system, this embodiment further provides a crop monitoring device based on digital twin technology, and the monitoring device includes: a data acquisition device and a data processing device.

[0181] The data collection equipment is arranged in the target farm area and is used to collect real-time monitoring data of crops in the target farm area.

[0182] The data processing device is used to receive real-time monitoring data collected by the data acquisition device, input the real-time monitoring data into a preset farm digital twin model, and obtain fused feature data based on the farm digital twin model, input the fused feature data and historical fused feature data into a trained monitoring prediction model, obtain the crop status prediction result output by the monitoring prediction model, and determine the control instructions according to the crop status prediction result, and adjust the growth environment of the crops in the target farm area according to the control instructions.

[0183] Furthermore, the data processing device further includes:

[0184] Communication interface, used for communication between memory and processor.

[0185] Memory is used to store computer programs that can be run on the processor.

[0186] The memory may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0187] If the memory, processor and communication interface are implemented independently, the communication interface, memory and processor can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc.

[0188] Optionally, in a specific implementation, if the memory, processor and communication interface are integrated on a chip, the memory, processor and communication interface can communicate with each other through an internal interface.

[0189] The processor may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.

[0190] The method, system and device disclosed in this embodiment, firstly, realizes the real-time data collection of multiple and multi-dimensional data such as the environment, crop growth, farm equipment, geographic information, meteorology, economy and society of the target farm, which can provide data support for the comprehensive monitoring of crops. Secondly, the farm digital twin model constructed by the present invention based on digital twin technology can more intuitively reflect the complex interactions and changes of the target farm at different time and space scales, and input the multiple and multi-dimensional real-time data into the farm digital twin model. The farm digital twin model can realize the dynamic update and continuous optimization of the model, which provides important technical guarantee for real-time and comprehensive monitoring of the target farm. Finally, based on historical experience data and real-time collection data, the present invention designs deep learning algorithms and monitoring prediction models to predict the growth trend of crops, so as to provide a basis for making early pest and disease prevention and control measures and scientific farming operations (such as optimizing irrigation plans, fertilization plans, pest and disease prevention measures, etc.) decision-making.

[0191] In addition, the present invention also involves a farm control method based on a digital twin platform, which dynamically generates control instructions based on the farm's real-time data and prediction models, and automatically or semi-automatically adjusts the farm's irrigation system, fertilization strategy, pest and disease control measures, etc., to optimize the crop growth environment and improve crop yield and quality.

[0192] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0193] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A crop monitoring method based on digital twin technology, characterized in that: include: Obtain real-time monitoring data of crops in the target farm area; Input the real-time monitoring data into a preset farm digital twin model, and obtain fused feature data based on the farm digital twin model; Inputting the fused feature data and the historical fused feature data into a trained monitoring prediction model to obtain a crop state prediction result output by the monitoring prediction model; Control instructions are determined based on the crop state prediction results, and the growth environment of the crops in the target farm area is adjusted based on the control instructions.

2. The crop monitoring method based on digital twin technology according to claim 1, characterized in that: The real-time monitoring data includes: environmental monitoring data, crop growth data, farm equipment data, geographic location information and weather data of the target farm, and market dynamics data of crops; The step of obtaining real-time monitoring data of crops in the target farm area includes: Using information collection equipment deployed in the target farm area to collect environmental monitoring data of crops in the target farm; Using smart devices to collect crop growth data of crops in target farms; Using crop growth control equipment to obtain farm equipment data of crops in a target farm; Use GIS system to obtain the geographical location information of the target farm; Obtain the weather data of the current target farm area; Use web crawler technology to obtain market dynamics data on crops in target farms.

3. The crop monitoring method based on digital twin technology according to claim 2 is characterized in that: After the step of obtaining the real-time monitoring data of crops in the target farm area, the method further includes: Preprocessing the real-time monitoring data to obtain preprocessed real-time monitoring data; The preprocessed real-time monitoring data is sequentially normalized, logarithmically and one-hot encoded to obtain the converted monitoring data; The converted monitoring data is subjected to feature engineering processing to obtain real-time monitoring data after feature selection and feature fusion.

4. The crop monitoring method based on digital twin technology according to claim 2 is characterized in that: Before the step of inputting the real-time monitoring data into the preset farm digital twin model and obtaining the fusion feature data based on the farm digital twin model, the method further includes: Construct a spatial characteristic model of the target farm area based on the geographical location information of the target farm; Build a physical feature model of crops based on the environmental monitoring data of crops in the target farm and the operating status and performance data obtained by the growth control equipment; Constructing a crop activity characteristic model based on the crop growth status data in the target farm; Build a regular feature model of crops based on the market dynamics data of crops in the target farm; According to the hierarchical relationship and spatial constraints among the spatial feature model, entity feature model, activity feature model and rule feature model, the spatial feature model, entity feature model, activity feature model and rule feature model are fused and assembled into a farm digital twin model.

5. The crop monitoring method based on digital twin technology according to claim 1, characterized in that: The step of inputting the real-time monitoring data into a preset farm digital twin model and obtaining fused feature data based on the farm digital twin model includes: Input the real-time monitoring data into the preset farm digital twin model to obtain an updated digital twin model; Comparing the simulated data output by the updated farm digital twin model with the real-time monitoring data to obtain a comparison result; The updated farm digital twin model is corrected based on the comparison results, and the corrected fusion feature data is output.

6. The crop monitoring method based on digital twin technology according to claim 1, characterized in that: Before the step of inputting the fused feature data and the historical fused feature data into the trained monitoring prediction model to obtain the crop state prediction result output by the monitoring prediction model, the method includes: Obtain historical monitoring data of crops and build a training data set based on the historical monitoring data; The preset long short-term memory network multi-task learning model is trained using the training data set to obtain a trained monitoring prediction model.

7. The crop monitoring method based on digital twin technology according to claim 1, characterized in that: The steps of determining a control instruction according to the crop state prediction result, and adjusting the growth environment of the crops in the target farm area according to the control instruction include: According to the crop status prediction results, an optimized decision plan is generated by minimizing the weighted loss function and regularization term; Generate control instructions corresponding to the items based on the optimized decision-making scheme and the updated farm digital twin model; The growing environment of crops in the target farm area is adjusted according to the control instructions.

8. The crop monitoring method based on digital twin technology according to claim 7, characterized in that: The optimization decision function corresponding to the optimization decision scheme is: <h2 style=";text-align:left;direction:ltr">D(y<h2 style=";text-align:left;direction:ltr"> pred <h2 style=";text-align:left;direction:ltr"> )=argmind(L(y<h2 style=";text-align:left;direction:ltr"> pred <h2 style=";text-align:left;direction:ltr"> ,d)+λR(d)); Among them, D(y pred ) is the optimization decision function, d is the optimal decision solution output by the optimization decision function; L is the loss function, which is used to measure the difference between the current decision solution and the predicted result; R is the regularization term; λ is the trade-off factor.

9. A crop monitoring system based on digital twin technology, characterized in that: include: A data acquisition module, used to obtain real-time monitoring data of crops in the target farm area; A digital twin module, used to input real-time monitoring data into a preset farm digital twin model, and obtain fused feature data based on the farm digital twin model; A prediction module, used for inputting the fused feature data and the historical fused feature data into a trained monitoring prediction model to obtain a crop state prediction result output by the monitoring prediction model; The control execution module is used to determine the control instructions according to the crop state prediction result, and adjust the growth environment of the crops in the target farm area according to the control instructions.

10. A crop monitoring device based on digital twin technology, characterized in that: include: Data acquisition equipment and data processing equipment; The data collection equipment is arranged in the target farm area and is used to collect real-time monitoring data of crops in the target farm area; The data processing device is used to receive real-time monitoring data collected by the data acquisition device, input the real-time monitoring data into a preset farm digital twin model, and obtain fused feature data based on the farm digital twin model, input the fused feature data and historical fused feature data into a trained monitoring prediction model, obtain the crop status prediction result output by the monitoring prediction model, and determine the control instructions according to the crop status prediction result, and adjust the growth environment of the crops in the target farm area according to the control instructions.

Images