Attitude capturing method and system based on virtual reality
Through the virtual reality-based attitude capture method, the problem that traditional plant growth monitoring cannot capture plant attitude changes and quantify environmental impacts in real time is solved, real-time monitoring and future prediction of plant growth are achieved, and scientific basis for agricultural management is provided.
Patent Information
- Application Number
- CN202411625303.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-14
- Publication Date
- 2025-03-07
- Estimated Expiration
- 2044-11-14
AI Technical Summary
Traditional plant growth monitoring methods cannot capture slight changes in plant posture in real time, and it is difficult to quantify and predict the impact of environmental changes on plant growth.
Using a virtual reality-based pose capture method, by obtaining the growth environment data of plants and capturing their pose data in real time, specific pose characteristics are extracted, whether there are abnormal poses, and a virtual reality model for plant growth is established, environmental parameter adjustment interface is set up, and growth pose changes in different growth environment data are analyzed.
In-depth analysis of plant posture data is realized, abnormal postures are quickly identified, and plant growth in different environments is simulated through virtual reality technology, help understand the impact of environmental changes on plant growth, and provide a scientific basis for long-term management of plants.
Smart Images

Figure CN119580139A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the field of virtual reality, and in particular relates to a posture capture method and system based on virtual reality. Background Art
[0002] The virtual reality gesture capture system is an advanced technology used in plant growth analysis. It uses virtual reality technology and gesture capture technology to capture the posture and motion data of plants in real time and present them in a virtual form. Through virtual reality technology, the posture and motion data of plants can be presented in the form of a three-dimensional virtual model, allowing researchers to observe and analyze the growth process of plants more intuitively. At the same time, virtual reality technology can also provide interactivity. Researchers can interact with virtual models through gestures or other means to further study the growth mechanism of plants.
[0003] The application of virtual reality posture capture system provides a new method for plant growth analysis. It uses virtual reality technology and posture capture technology to capture and present the posture and movement data of plants in real time, providing researchers with a more intuitive and interactive research tool, which helps to deeply understand the growth mechanism and law of plants.
[0004] Traditional plant growth monitoring often relies on periodic observation and data collection, which is unable to capture subtle changes in plant posture in real time. In addition, the specific impact of environmental changes on plant growth is often difficult to quantify and predict. Summary of the invention
[0005] The purpose of the present invention is to provide a posture capture method based on virtual reality, aiming to solve the technical problems existing in the prior art identified in the background technology.
[0006] The present invention is implemented in this way: a posture capture method based on virtual reality, the method comprising the following steps: Obtain the current plant growth environment data, capture the plant posture data in real time through the camera, and extract specific posture features from the posture data; Analyze the extracted posture features to identify and determine whether the current plant has an abnormal posture; A plant growth virtual reality model is established when the plant has an abnormal posture and when the plant does not have an abnormal posture, and an environmental parameter adjustment interface is set to analyze the growth posture changes in different growth environment data; Based on the growth posture change data, the optimal growth environment data is obtained and a report is generated.
[0007] As a further solution of the present invention, the acquisition of the current plant growth environment data, and the capture of the plant posture data in real time by a camera, and the extraction of specific posture features of the posture data specifically include: Various environmental parameters in the plant growth environment are collected in real time through sensors, and an environmental parameter set is established to store the data; Capture the posture of plants from different angles and extract posture feature information, including but not limited to: leaf angle, leaf morphology changes, branch curvature, and plant height.
[0008] As a further solution of the present invention, the extracted posture features are analyzed to identify and determine whether the current plant has an abnormal posture, specifically including: Establish an anomaly detection model, analyze the extracted plant posture features, and determine whether there is an abnormal posture based on the status data of all plants; Based on the abnormal detection results, the health status of the plants is comprehensively evaluated and the plant change trends are analyzed.
[0009] As a further solution of the present invention, the establishment of a plant growth virtual reality model and the setting of an environmental parameter adjustment interface to analyze the growth posture changes in different growth environment data specifically include: Obtain abnormal posture analysis results. If there is no abnormal posture, analyze the current growth environment data; if there is an abnormal posture, establish several growth environment control groups based on the current growth environment data; When there is no abnormal posture, a virtual reality model of plant growth is established in combination with the analysis results of the growth environment data, and the future growth posture change results of the plant are generated based on the current growth environment data; When there is an abnormal posture, a plant growth virtual reality model is established to generate the results of future plant growth posture changes under different control groups, and identify the plant growth virtual reality model with no abnormal posture or the smallest abnormal posture, as well as the corresponding control group data.
[0010] Another object of the present invention is to provide a virtual reality-based gesture capture system, the system comprising: The environment status and posture capture module is used to obtain the current plant growth environment data, and to capture the plant posture data in real time through the camera, and to extract specific posture features from the posture data; The posture state evaluation and analysis module is used to analyze the extracted posture features, identify and determine whether the current plant has an abnormal posture; A virtual reality connection module is used to establish a plant growth virtual reality model when the plant has an abnormal posture and when the plant does not have an abnormal posture, and to set an environmental parameter adjustment interface to analyze the growth posture changes in different growth environment data; The optimal state analysis module is used to obtain the optimal growth environment data based on the growth posture change data and generate a report.
[0011] As a further solution of the present invention, the environment state and posture capture module includes: The environmental sensing unit is used to collect various environmental parameters in the plant growth environment in real time through sensors, and establish an environmental parameter set to store the data; The posture capture unit is used to capture the posture of the plant from different angles and extract posture feature information, including but not limited to: leaf angle, leaf morphology change, branch curvature, and plant height.
[0012] As a further solution of the present invention, the posture state evaluation and analysis module includes: The abnormal posture detection unit is used to establish an abnormal detection model, analyze the extracted plant posture features, and determine whether there is an abnormal posture based on the status data of all plants; The health assessment unit is used to comprehensively assess the health status of plants based on abnormal detection results and analyze plant change trends.
[0013] As a further solution of the present invention, the virtual reality connection module includes: The abnormal state analysis unit is used to obtain the abnormal posture analysis result. If there is no abnormal posture, the current growth environment data is analyzed; if there is an abnormal posture, several growth environment control groups are established based on the current growth environment data; A virtual reality model generation unit is used to establish a virtual reality model of plant growth in combination with the growth environment data analysis results when there is no abnormal posture, and to generate the future growth posture change results of the plant based on the current growth environment data; When there is an abnormal posture, a plant growth virtual reality model is established to generate the results of future plant growth posture changes under different control groups, and identify the plant growth virtual reality model with no abnormal posture or the smallest abnormal posture, as well as the corresponding control group data.
[0014] The beneficial effects of the present invention are: This solution conducts in-depth analysis of the captured posture data to quickly identify whether the plant has abnormal postures, which helps to take timely measures. When abnormal postures are identified, multiple growth environment control groups can be established to simulate plant growth in different environments through virtual reality technology, helping researchers or agricultural workers understand the impact of environmental changes on plant growth. For plants with normal postures, the system can also generate predictions of future growth posture changes, providing a scientific basis for long-term plant management. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] Figure 1 A flowchart of a posture capture method based on virtual reality provided by an embodiment of the present invention; Figure 2 A flowchart of obtaining the current plant growth environment data provided by an embodiment of the present invention, capturing the plant posture data in real time through a camera, and extracting specific posture features from the posture data; Figure 3 A flowchart for analyzing the extracted posture features, identifying and judging whether the current plant has an abnormal posture provided by an embodiment of the present invention; Figure 4 A flow chart of establishing a plant growth virtual reality model, setting an environmental parameter adjustment interface, and analyzing growth posture changes in different growth environment data provided by an embodiment of the present invention; Figure 5 A structural block diagram of a virtual reality-based gesture capture system provided by an embodiment of the present invention; Figure 6 A structural block diagram of an environment state and posture capture module provided by an embodiment of the present invention; Figure 7 A structural block diagram of a posture state evaluation and analysis module provided in an embodiment of the present invention; Figure 8 This is a structural block diagram of a virtual reality connection module provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0016] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0017] It is understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but unless otherwise specified, these elements are not limited by these terms. These terms are only used to distinguish a first element from another element. For example, without departing from the scope of this application, a first xx script may be referred to as a second xx script, and similarly, a second xx script may be referred to as a first xx script.
[0018] Figure 1 A flowchart of a posture capture method based on virtual reality provided by an embodiment of the present invention, such as Figure 1 As shown, a posture capture method based on virtual reality, the method comprising: S100, obtaining the current plant growth environment data, and capturing the plant posture data in real time through a camera, and extracting specific posture features from the posture data; The sensors used in this step include temperature sensors, humidity sensors, light sensors, CO2 sensors, soil moisture sensors, etc. Various environmental parameters in the plant growth environment, such as temperature, humidity, light intensity, CO2 concentration, soil moisture, etc., can be collected in real time through the above sensors, and these parameters are used as growth environment data; To capture the posture of plants, high-resolution cameras, 3D sensors, depth cameras and other equipment are used to capture the posture of plants from multiple angles to ensure the comprehensiveness and accuracy of the posture data.
[0019] S200, analyzing the extracted posture features to identify and determine whether the current plant has an abnormal posture; In this step, key features such as leaf angle, leaf shape change, branch curvature, plant height, etc. are extracted from the captured plant posture data. At the same time, an abnormal monitoring model is set to analyze the extracted posture features and identify whether there is an abnormal posture. The threshold range is set to determine whether the feature parameters exceed the normal range and detect possible posture anomalies. During the recognition process, specific abnormality types (such as leaf drooping, leaf curling, branch bending, etc.) are identified and the detection results are recorded.
[0020] Based on the abnormal detection results and other posture features, the plant's health status will be comprehensively evaluated and a health score will be given. The current posture features will be compared with historical data to analyze the changing trend of the plant's health status. A detailed health report will be generated later, including the abnormal detection results, health score and change trend analysis.
[0021] Through the collaborative work of multiple modules, the posture characteristics of plants can be analyzed efficiently and accurately, abnormal postures can be identified and the health status of plants can be evaluated, providing reliable data support for the establishment of subsequent virtual reality models and the analysis of optimal states.
[0022] S300, respectively, when the plant has an abnormal posture and when the plant does not have an abnormal posture, establish a plant growth virtual reality model, set an environmental parameter adjustment interface, and analyze the growth posture changes in different growth environment data; This step integrates functions such as real-time data reception, virtual reality modeling, anomaly identification, environmental parameter adjustment, future growth prediction, control group establishment and analysis, optimal model display and report generation.
[0023] If there is no abnormal posture, the current growth environment data is analyzed, and a virtual reality model of plant growth is established based on the growth environment data analysis results. Based on the current growth environment data, the results of the plant's future growth posture changes are generated; If there are abnormal postures, several growth environment control groups are established based on the current growth environment data, and a plant growth virtual reality model is established to generate the results of future growth posture changes of plants under different control groups, and identify plant growth virtual reality models with no abnormal posture or the least abnormal posture, as well as the corresponding control group data.
[0024] S400, based on the growth posture change data, obtaining optimal growth environment data and generating a report.
[0025] Figure 2 The flowchart of the embodiment of the present invention for obtaining the current plant growth environment data, capturing the plant posture data in real time through a camera, and extracting specific posture features from the posture data is as follows: Figure 2 As shown, the method of obtaining the current plant growth environment data, capturing the plant posture data in real time through a camera, and extracting specific posture features from the posture data specifically includes: S110, collecting various environmental parameters in the plant growth environment in real time through sensors, and establishing an environmental parameter set to store the data; S120, capturing the posture of the plant from different angles, and extracting posture feature information, including but not limited to: leaf angle, leaf shape change, branch curvature, and plant height.
[0026] In the embodiment of the present invention, the process of collecting various environmental parameters in the plant growth environment in real time through sensors and establishing an environmental parameter set to store the data corresponds to the following relationship: ; in, Indicates the total length of the time period, Indicates a point in time, Indicates at a point in time t A comprehensive set of environmental parameters under Indicates environmental parameters i The weight factor of Indicates at a point in time t Environmental parameters i Real-time data, A natural exponential function that represents the nonlinear effects of environmental conditions, represents the adjustment factor used to control the influence of the exponential function on the final result, represents the attenuation factor used to adjust the decay speed in the exponential function, Indicates the number of environmental parameter types, Table of environmental conditions, Indicates environmental conditions j The weight factor of Indicates at a point in time t Under environmental conditions j real-time data.
[0027] In the process of establishing the environmental parameter set, the weighted summation part of the present invention The influence of each environmental parameter in the comprehensive environmental parameter set can be flexibly adjusted by using weights, so the weights can be adjusted according to the type and specific needs of the plants to customize the importance of each environmental parameter.
[0028] And the exponential decay part It can capture the nonlinear effects of certain environmental conditions, such as the rapid effects of extreme light or humidity on plant growth. Through exponential decay, this part can effectively reduce the impact of some adverse environmental conditions while amplifying the positive effects of key environmental conditions, thereby more accurately reflecting the impact on plants in the real environment. The adjustment factor and weakening factor provide the ability to control the influence and decay rate of the exponential function, ensuring the flexibility of the calculation process.
[0029] Finally, the changes in environmental parameters over the entire time period are taken into account through time integration, providing a global perspective, avoiding the limitations of data at a single time point, and being able to capture the dynamic changes in environmental parameters and reflect the time-varying characteristics of the plant growth environment, thereby providing a more comprehensive and accurate set of environmental parameters.
[0030] Figure 3 The flowchart provided by the embodiment of the present invention is to analyze the extracted posture features, identify and judge whether the current plant has an abnormal posture, such as Figure 3 As shown, the extracted posture features are analyzed to identify and determine whether the current plant has an abnormal posture, specifically including: S210, establishing an abnormality detection model, analyzing the extracted plant posture features, and judging whether there is an abnormal posture based on the status data of all plants; S220, based on the abnormality detection results, comprehensively evaluate the health status of the plants and analyze the plant change trend.
[0031] In the embodiment of the present invention, judging whether there is an abnormal posture based on the status data of all plants specifically includes: Read all the status data of the plant posture and create a dimension vector: ; in, Indicates all status data, Indicates n data points; Standardize all acquired data: ; in, express The mean of express The standard deviation of Indicates n Normalized data points; Choose a distance metric, each data point To its Nearest Neighbor Distance: ; in, Represents data points and Nearest Neighbor The distance between Indicates Nearest Neighbor , Represents data points To its Nearest Neighbor distance; Calculate each data point The reachable distance: ; in, Represents data points of Neighborhood features, Represents data points and data points The actual distance between Calculate each data point The local reachable density of is: ; in, Represents data points of The number of data points in the neighborhood, Data Points The local reachable density of Represents data points of Neighborhood; Calculate each data point The local anomaly factor value of is: ; in, Represents data points The local anomaly factor value of Represents data points and data points The local reachable density of Based on the above calculation, the local anomaly factor value of each data point is obtained and the threshold is selected , make abnormal judgment.
[0032] The setting of the threshold can be determined based on specific experiments and data analysis, and the usual empirical value is between 1.5 and 2.
[0033] Suppose we have a dataset with the following features: Leaf density ( ), the number or mass of leaves per unit area.
[0034] Bending angle ( ), the degree of bending of plant branches or leaves, which can be measured by angle.
[0035] Plant height ( ), the vertical height of a plant from root to tip.
[0036] Blade Angle ( ), the angle of inclination of the leaf relative to the stem or branch.
[0037]
[0038] Subsequent steps: Data standardization: Standardize each feature.
[0039] Calculate k-distance: Choose a suitable distance metric (such as Euclidean distance) and calculate the distance from each data point to its The distance to the nearest neighbor.
[0040] Calculate reachable distance: Calculate the reachable distance for each data point.
[0041] Compute Local Reachable Density: Compute the local reachable density for each data point.
[0042] Calculate the Local Outlier Factor (LOF): Calculate the LOF value for each data point.
[0043] The LOF values obtained after calculation are as follows:
[0044] In this example, the LOF value of the data point (50, 45, 300, 90) is 3.5, which is significantly higher than the other data points, indicating that it is an outlier.
[0045] In the embodiment of the present invention, the process of comprehensively evaluating the health status of the plant based on the abnormal detection result corresponds to the following relationship: ; in, Indicates at a point in time t The health status of the plants under represents the comprehensive regulatory factor, represents the number of extracted posture features, Indicates posture characteristics The weight factor of Indicates at a point in time t Lower posture features Real-time data, Indicates at a point in time t Lower posture features The anomaly detection result matrix, represents the integral adjustment factor, Indicates 0 to time point t The time points between Indicates at a point in time The incremental change data matrix of the posture feature is: Indicates at a point in time The environmental response matrix of the posture feature is represents a state adjustment factor for controlling the influence of plant state data, Indicates at a point in time Below is the overall plant status data matrix.
[0046] In the above process of comprehensively evaluating the health status of plants, the weighted summation part of the present invention By taking a weighted sum of multiple posture features, various factors affecting plant health are comprehensively considered, and the weights It can be adjusted according to the importance of different features, and can be flexibly adapted to different environments and plant species.
[0047] In addition, the integral part It takes into account the cumulative changes of posture characteristics over a period of time, reflects the dynamic changes of posture characteristics and environmental responses, avoids the limitations of data at a single time point, captures the dynamic changes of posture characteristics, and provides a comprehensive and accurate health status assessment.
[0048] Figure 4A flowchart of establishing a plant growth virtual reality model, setting an environmental parameter adjustment interface, and analyzing the growth posture changes in different growth environment data provided by an embodiment of the present invention, wherein the establishment of a plant growth virtual reality model, setting an environmental parameter adjustment interface, and analyzing the growth posture changes in different growth environment data specifically includes: S310, obtaining abnormal posture analysis results, if there is no abnormal posture, analyzing the current growth environment data; if there is an abnormal posture, establishing several growth environment control groups based on the current growth environment data; S320, when there is no abnormal posture, a virtual reality model of plant growth is established in combination with the growth environment data analysis result, and the future growth posture change result of the plant is generated based on the current growth environment data; When there is an abnormal posture, a plant growth virtual reality model is established to generate the results of future plant growth posture changes under different control groups, and identify the plant growth virtual reality model with no abnormal posture or the smallest abnormal posture, as well as the corresponding control group data.
[0049] In the embodiment of the present invention, when there is no abnormal posture, the process of establishing a virtual reality model of plant growth in combination with the growth environment data analysis result corresponds to the following relationship: ; in, Represents a virtual reality model without abnormal conditions. Represents three different regulatory factors, Indicates at a point in time t Environmental parameters i Real-time data, Indicates at a point in time The lower environmental parameter matrix; Indicates at a point in time The overall plant status data matrix below; Indicates at a point in time t The plant posture feature data matrix below; Indicates at a point in time t The pose feature weight matrix under .
[0050] In the embodiment of the present invention, when there is an abnormal posture, the process of establishing a plant growth virtual reality model corresponds to the following relationship: ; in, A virtual reality model representing an abnormal situation, represents the number of growth environment control groups, The control group The weight factor of Indicates at a point in time t Lower control group The model data matrix, The control group The regulating factor, represents the number of environmental parameter types in each control group, Indicates environmental parameters k The weight factor of Indicates at a point in time t In the control group Internal environmental parameters k Real-time data; Indicates at a point in time t Lower posture features k Real-time data; represents the integral adjustment factor, Indicates time point Lower control group The accumulated environment and posture feature data.
[0051] In the process of establishing the virtual reality model without abnormal conditions, the weighted sum of environmental parameters and posture feature data was performed to comprehensively consider various factors affecting plant growth, and the adjustment factor It can be adjusted according to the importance of different parameters, flexibly respond to different environments and plant species, and provide virtual reality model output without abnormal situations, ensuring the comprehensiveness and accuracy of the model.
[0052] In the process of establishing the virtual reality model under abnormal conditions, multiple control groups were established to analyze the changes in the growth posture of plants under different environments. The integral part took into account the cumulative changes in the environment and posture characteristics over a time period, reflecting the dynamic changes in posture characteristics and environmental responses, and providing the output of the virtual reality model under abnormal conditions, ensuring the adaptability and accuracy of the model in different environments.
[0053] Figure 5 A structural block diagram of a virtual reality-based gesture capture system provided by an embodiment of the present invention, such as Figure 5 As shown, a posture capture system based on virtual reality, the system comprises: The environment state and posture capture module 100 is used to obtain the current plant growth environment data, and to capture the plant posture data in real time through a camera, and to extract specific posture features from the posture data; The posture state evaluation and analysis module 200 is used to analyze the extracted posture features, identify and determine whether the current plant has an abnormal posture; The virtual reality connection module 300 is used to establish a plant growth virtual reality model when the plant has an abnormal posture and when the plant does not have an abnormal posture, and to set an environmental parameter adjustment interface to analyze the growth posture changes in different growth environment data; The optimal state analysis module 400 is used to obtain the optimal growth environment data based on the growth posture change data and generate a report.
[0054] Figure 6 The structural block diagram of the environment state and posture capture module provided by the embodiment of the present invention is as follows: Figure 6 As shown, the environment state and posture capture module includes: The environmental sensing unit 110 is used to collect various environmental parameters in the plant growth environment in real time through sensors, and establish an environmental parameter set to store the data; The posture capture unit 120 is used to capture the posture of the plant from different angles and extract posture feature information, including but not limited to: leaf angle, leaf shape change, branch curvature, and plant height.
[0055] Figure 7 The structural block diagram of the posture state evaluation and analysis module provided in the embodiment of the present invention is as follows: Figure 7 As shown, the posture state evaluation and analysis module includes: The abnormal posture detection unit 210 is used to establish an abnormality detection model, analyze the extracted plant posture features, and determine whether there is an abnormal posture based on the status data of all plants; The health assessment unit 220 is used to comprehensively assess the health status of the plant based on the abnormality detection results and analyze the plant change trend.
[0056] Figure 8 A structural block diagram of a virtual reality connection module provided in an embodiment of the present invention, such as Figure 8 As shown, the virtual reality connection module includes: The abnormal state analysis unit 310 is used to obtain abnormal posture analysis results. If there is no abnormal posture, the current growth environment data is analyzed; if there is an abnormal posture, a plurality of growth environment control groups are established based on the current growth environment data; A virtual reality model generation unit 320 is used to establish a virtual reality model of plant growth in combination with the growth environment data analysis result when there is no abnormal posture, and to generate the future growth posture change result of the plant based on the current growth environment data; When there is an abnormal posture, a plant growth virtual reality model is established to generate the results of future plant growth posture changes under different control groups, and identify the plant growth virtual reality model with no abnormal posture or the smallest abnormal posture, as well as the corresponding control group data.
[0057] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.
[0058] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0059] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0060] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.
[0061] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.
Claims
1. A posture capture method based on virtual reality, characterized in that: The method comprises the following steps: Obtain the current plant growth environment data, capture the plant posture data in real time through the camera, and extract specific posture features from the posture data; Analyze the extracted posture features to identify and determine whether the current plant has an abnormal posture; A plant growth virtual reality model is established when the plant has an abnormal posture and when the plant does not have an abnormal posture, and an environmental parameter adjustment interface is set to analyze the growth posture changes in different growth environment data; Based on the growth posture change data, obtain the optimal growth environment data and generate a report; The method of obtaining the growth environment data of the current plant, capturing the posture data of the plant in real time through a camera, and extracting specific posture features from the posture data specifically includes: Various environmental parameters in the plant growth environment are collected in real time through sensors, and an environmental parameter set is established to store the data; Capture the posture of plants from different angles and extract posture feature information, including but not limited to: leaf angle, leaf morphology changes, branch curvature, and plant height.
2. A virtual reality based gesture capture method according to claim 1, characterized in that: The process of collecting various environmental parameters in the plant growth environment in real time through sensors and establishing an environmental parameter set to store data corresponds to the following relationship: ; in, Indicates the total length of the time period, Indicates a point in time, Indicates at a point in time t A comprehensive set of environmental parameters under Indicates environmental parameters i The weight factor of Indicates at a point in time t Environmental parameters i Real-time data, A natural exponential function that represents the nonlinear effects of environmental conditions, represents the adjustment factor used to control the influence of the exponential function on the final result, represents the attenuation factor used to adjust the decay speed in the exponential function, Indicates the number of environmental parameter types, Table of environmental conditions, Indicates environmental conditions j The weight factor of Indicates at a point in time t Environmental conditions j real-time data.
3. A virtual reality based gesture capture method according to claim 2, characterized in that: The step of analyzing the extracted posture features to identify and determine whether the current plant has an abnormal posture specifically includes: Establish an anomaly detection model, analyze the extracted plant posture features, and determine whether there is an abnormal posture based on the status data of all plants; Based on the abnormal detection results, the health status of the plants is comprehensively evaluated and the plant change trends are analyzed.
4. A method for capturing gestures based on virtual reality according to claim 3, characterized in that: The process of comprehensively evaluating the health status of the plant based on the abnormal detection results corresponds to the following relationship: ; in, Indicates at a point in time t The health of the plants below, represents the comprehensive regulatory factor, represents the number of extracted posture features, Indicates posture characteristics The weight factor of Indicates at a point in time t Lower posture features Real-time data, Indicates at a point in time t Lower posture features The anomaly detection result matrix, represents the integral adjustment factor, Indicates 0 to time point t The time points between Indicates at a point in time The incremental change data matrix of the posture feature is: Indicates at a point in time The environmental response matrix of the posture feature is represents a state adjustment factor for controlling the influence of plant state data, Indicates at a point in time Below is the overall plant status data matrix.
5. A method for capturing gestures based on virtual reality according to claim 4, characterized in that: The step of judging whether there is an abnormal posture based on the status data of all plants specifically includes: Read all the status data of the plant posture and create a dimension vector: ; in, Indicates all status data, Indicates n data points; Standardize all acquired data: ; in, express The mean of express The standard deviation of Indicates n Normalized data points; Choose a distance metric, each data point To its Nearest Neighbor Distance: ; in, Represents data points and Nearest Neighbor The distance between Indicates Nearest Neighbor , Represents data points To its Nearest Neighbor distance; Calculate each data point The reachable distance: ; in, Represents data points of Neighborhood features, Represents data points and data points The actual distance between Calculate each data point The local reachable density of is: ; in, Represents data points of The number of data points in the neighborhood, Data Points The local reachable density of Represents data points of Neighborhood; Calculate each data point The local outlier factor value of is: ; in, Represents data points The local anomaly factor value of Represents data points and data points The local reachable density of Based on the above calculation, the local anomaly factor value of each data point is obtained and the threshold is selected , make abnormal judgment.
6. A method for capturing gestures based on virtual reality according to claim 5, characterized in that: The plant growth virtual reality model is established, and an environmental parameter adjustment interface is set to analyze the growth posture changes in different growth environment data, specifically including: Obtain abnormal posture analysis results. If there is no abnormal posture, analyze the current growth environment data; if there is an abnormal posture, establish several growth environment control groups based on the current growth environment data; When there is no abnormal posture, a virtual reality model of plant growth is established in combination with the analysis results of the growth environment data, and the future growth posture change results of the plant are generated based on the current growth environment data; When there is an abnormal posture, a plant growth virtual reality model is established to generate the results of future plant growth posture changes under different control groups, and identify the plant growth virtual reality model with no abnormal posture or the smallest abnormal posture, as well as the corresponding control group data.
7. A method for capturing gestures based on virtual reality according to claim 6, characterized in that: When there is no abnormal posture, the process of establishing a virtual reality model of plant growth in combination with the growth environment data analysis results corresponds to the following relationship: ; in, Represents a virtual reality model without abnormal conditions. Represents three different regulatory factors, Indicates at a point in time t Environmental parameters i Real-time data, Indicates at a point in time The environmental parameter matrix under Indicates at a point in time The overall plant status data matrix under Indicates at a point in time t The plant posture feature data matrix under Indicates at a point in time t The pose feature weight matrix under .
8. The method for capturing gestures based on virtual reality according to claim 7, characterized in that: When there are abnormal postures, the process of establishing a plant growth virtual reality model corresponds to the following relationship: ; in, A virtual reality model representing an abnormal situation, represents the number of growth environment control groups, The control group The weight factor of Indicates at a point in time t Lower control group The model data matrix, The control group The regulating factor, represents the number of environmental parameter types in each control group, Indicates environmental parameters k The weight factor of Indicates at a point in time t In the control group Internal environmental parameters k Real-time data; Indicates at a point in time t Lower posture features k Real-time data; represents the integral adjustment factor, Indicates time point Lower control group The accumulated environment and posture feature data.
9. A virtual reality-based gesture capture system, the system applying the virtual reality-based gesture capture method according to any one of claims 1 to 8, characterized in that: The system comprises: The environment status and posture capture module is used to obtain the current plant growth environment data, and to capture the plant posture data in real time through the camera, and to extract specific posture features from the posture data; The posture state evaluation and analysis module is used to analyze the extracted posture features, identify and determine whether the current plant has an abnormal posture; A virtual reality connection module is used to establish a plant growth virtual reality model when the plant has an abnormal posture and when the plant does not have an abnormal posture, and to set an environmental parameter adjustment interface to analyze the growth posture changes in different growth environment data; The optimal state analysis module is used to obtain the optimal growth environment data based on the growth posture change data and generate a report.
Citation Information
Patent Citations
Greenhouse control system based on augmented reality technology application
CN108427457A
Panoramic three-dimensional modeling method for offshore wind power plant and related device
CN118587364A
Process analysis method and device based on multi-modal data
CN118656751A
Semi-autonomous digital human posturing
US20130197887A1
Virtual-real fusion-based ergonomic assessment method and simulation system
WO2024178782A1
