Growth support system, growth support method, and growth support program
The growth support system uses drones to capture and analyze images of seedlings, addressing the challenge of managing growth status in difficult terrains by providing real-time evaluation and management recommendations for optimal growth.
Patent Information
- Application Number
- JP2023085101
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-24
- Publication Date
- 2024-12-05
AI Technical Summary
Existing technologies face challenges in efficiently managing afforestation by accurately determining the growth status of seedlings, particularly in difficult terrains like steep slopes, which hinders effective growth management.
A growth support system utilizing an unmanned aircraft equipped with a camera and LIDAR to capture images and three-dimensional measurements, coupled with a control unit that analyzes these images to evaluate the growth state of seedlings, compares with growth curves, and provides management recommendations.
Enables efficient growth management of seedlings by providing real-time evaluation of their health and growth status, allowing for timely interventions such as underbrush management and thinning, thereby optimizing growth and reducing operational costs.
Smart Images

Figure 2024168420000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a growth support system, a growth support method, and a growth support program for cultivating plants. [Background technology]
[0002] To check the survival of seedlings after planting, visual inspection is carried out by surveying the plantation area. In this case, the growth rate is checked by measuring tree height and diameter at breast height for each tree. However, it is difficult to survey all trees on steep slopes.
[0003] Therefore, technology for determining the condition of seedlings in a forest has also been considered (see, for example, Patent Document 1). In the technology described in Patent Document 1, aerial image information of a forest captured from the air is acquired. Next, reference aerial image information of a forest captured from the air in the past is referenced to three or more levels of correlation between the condition of seedlings in the forest. Then, the condition of seedlings is determined by giving priority to those with a higher correlation.
[0004] Also, a table predicting the yield of artificial forests has been disclosed (see, for example, Non-Patent Document 1). This table predicts the yield of artificial forests, and shows the stand constituent factors (diameter, tree height, number of standing trees, sectional area at breast height, timber volume, form factor, growth amount, etc.) predicted to be produced for even-aged simple forests of a certain tree species when they are grown in a healthy manner using a certain management method, by site and age class, for main and secondary trees.
[0005] As shown in Figure 6, by using the upper tree height growth curve by site in the artificial forest harvest forecast table, it is possible to identify the relationship between tree age and upper tree height for each site classification (special grade to third grade), which is an index showing the volume productivity of a forest land. Here, the site classification is an index showing the volume productivity of a forest land, and is a combination of land factors such as structure, topography, and soil conditions. Then, for each site classification, the upper tree height is identified according to the number of days since planting (tree age). [Prior art documents] [Patent documents]
[0006] [Patent Document 1] Patent Publication No. 2022-53465 [Non-patent literature]
[0007] [Non-Patent Document 1] Satoshi Ishibashi et al., "Hokkaido Regional Edition: Larch Plantation Harvest Forecast Table 2005", [online], February 1, 2006, Hokkaido Branch of the Forestry and Forest Products Research Institute, p.1 [Retrieved April 23, 2023], Internet<URL:https: / / www.ffpri.affrc.go.jp / pubs / chukiseika / documents / 1st-chukiseika-9.pdf> Summary of the Invention [Problem to be solved by the invention]
[0008] The technology described in Patent Document 1 determines the condition of seedlings in a forest. However, it is difficult to appropriately manage afforestation based only on the condition of seedlings in a forest. [Means for solving the problem]
[0009] A growth support system that solves the above problems includes a control unit connected to a user device and a measurement device, and the control unit acquires an afforestation image of a plurality of transplanted seedlings from the measurement device, identifies the seedlings in the afforestation image, identifies a growth state of the seedlings, compares the growth state with a growth curve diagram, and outputs a determination result of the growth state to the user device. Effect of the Invention
[0010] According to the present invention, it is possible to efficiently support the growth management of seedlings. [Brief description of the drawings]
[0011] [Figure 1]FIG. 1 is an explanatory diagram of a growth support system according to an embodiment. [Diagram 2] FIG. 2 is an explanatory diagram of a hardware configuration of the embodiment. [Diagram 3] FIG. 2 is an explanatory diagram of a processing procedure according to an embodiment. [Figure 4] FIG. 2 is an explanatory diagram of a processing procedure according to an embodiment. [Diagram 5] FIG. 2 is an explanatory diagram of a processing procedure according to an embodiment. [Figure 6] FIG. 1 is a conventional upper tree height growth curve by location. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] An embodiment of a growth support system, a growth support method, and a growth support program will be described with reference to Figs. 1 to 5. As shown in FIG. 1, in this embodiment, a larch sapling P1 is grown, and a growth state is identified using a photographed image (a plantation image) of the tree. The growth support system A1 of this embodiment includes a user device 10, a measuring device 15, and a support server 20.
[0013] (Hardware configuration example) FIG. 2 shows an example of the hardware configuration of an information processing device H10 that functions as the user device 10, the measuring device 15, the assistance server 20, and the like.
[0014] The information processing device H10 includes a communication device H11, an input device H12, a display device H13, a storage device H14, and a processor H 15. Note that this hardware configuration is an example, and the information processing device H10 may include other hardware.
[0015] The communication device H11 is an interface that establishes a communication path with another device and transmits and receives data, and is, for example, a network interface or a wireless interface.
[0016] The input device H12 is a device that accepts input from a user, etc., and is, for example, a mouse, a keyboard, etc. The display device H13 is, for example, a display or a touch panel that displays various information.
[0017] The storage device H14 is a storage device that stores data and various programs for executing various functions of the user device 10, the measuring device 15, and the assistance server 20. Examples of the storage device H14 include a ROM, a RAM, and a hard disk.
[0018] The processor H15 uses programs and data stored in the storage device H14 to control each process in the user device 10, the measuring device 15, and the assistance server 20. Examples of the processor H15 include a CPU and an MPU. The processor H15 loads a program stored in a ROM or the like into a RAM and executes various processes corresponding to various processes. For example, when an application program in the user device 10, the measuring device 15, or the assistance server 20 is started, the processor H15 operates a process that executes each process described below.
[0019] The processor H15 is not limited to a processor that performs software processing for all the processes it executes. For example, the processor H15 may include a dedicated hardware circuit (e.g., an application specific integrated circuit (ASIC)) that performs hardware processing for at least a part of the processes it executes. That is, the processor H15 may be configured as follows:
[0020] (1) One or more processors that operate according to a computer program (software) (2) One or more dedicated hardware circuits that perform at least some of the processes; or (3) A circuit that includes a combination of these. The processor includes a CPU and memory, such as RAM and ROM, that stores program codes or instructions configured to cause the CPU to execute processes. Memory, i.e., computer-readable media, includes any available media that can be accessed by a general-purpose or special-purpose computer.
[0021] (Functions of the growth support system) As shown in FIG. 1, a user device 10 and a measuring device 15 are connected to an assistance server 20 via a network to perform communication. The user device 10 is a computer terminal used by a plantation manager.
[0022] The measuring device 15 is an unmanned aerial vehicle (drone) that can be flown by remote control or automatic piloting. The measuring device 15 moves along a flight route set by the administrator of the administrator. The measuring device 15 acquires various information during the movement. In this embodiment, the measuring device 15 is equipped with an imaging device and captures images of the afforestation on the ground. The imaging device includes a camera that captures RGB images and a LIDAR (Light Detection and Ranging) device that captures three-dimensional measurement images (point cloud images). The measuring device 15 transmits measurement information to the support server 20. This measurement information includes information on the captured images (RGB images, point cloud images), flight altitude, shooting position (latitude and longitude), etc.
[0023] The support server 20 is a computer system that manages the transplanted seedlings P1 based on the measurement information acquired from the measurement device 15. The support server 20 includes a control unit 21, a basic information storage unit 22, and a measurement information storage unit .
[0024] The control unit 21 performs processes (including an information acquisition stage, a recognition stage, an analysis stage, etc.) described below. By executing a growth support program for this purpose, the control unit 21 functions as an information acquisition unit 211, a recognition unit 212, an analysis unit 213, etc.
[0025] The information acquiring unit 211 executes a process of acquiring measurement information from the measuring device 15 . The recognition unit 212 executes a process of recognizing a subject in the captured image by image processing. Specifically, the recognition unit 212 recognizes seedlings, soil, and undergrowth.
[0026] The analysis unit 213 analyzes the growth state of the seedling P1 using the state information of the seedling P1. The analysis unit 213 has a seedling evaluation model that evaluates the health of each seedling. The seedling evaluation model is generated by machine learning using teacher information including captured images (RGB information) of healthy and unhealthy seedlings and the evaluation results of health. The analysis unit 213 also holds information regarding the density of undergrowth and the standard values of grass height for issuing instructions to cut undergrowth.
[0027] Basic information for managing afforestation is recorded in the basic information storage unit 22. This basic information is recorded when afforestation is carried out. The basic information includes data on a growth curve chart, an elevation map, and an afforestation map.
[0028] The growth curve data records information showing the relationship between forest age and upper tree height for each site classification. The altitude map data includes terrain information (topography map) relating to altitude relative to the coordinates (latitude and longitude) of the area where the seedlings P1 were planted. The afforestation map data records information regarding the afforestation time and site area for each plot where the seedlings P1 were planted, along with the coordinates (latitude and longitude) of the plot.
[0029] The measurement information storage unit 23 records measurement management data using the measurement information acquired from the measurement device 15. This measurement information is recorded when an analysis is performed using the measurement information obtained using the measurement device 15. The measurement management data records data related to the section ID, measurement date and time, captured image, crown feature amount, and growth state.
[0030] The plot ID data is an identifier for identifying the area (plot) in the afforestation area in which the sapling P1 is planted. The measurement date and time data is the date and time when the measurement was performed on this section.
[0031] The captured image data is images (RGB images and point cloud images) captured by the measurement device 15 for this section. The crown feature data is the feature of the crown of the sapling P1 identified for this plot from the captured image. Here, the crown is the part of the plant above ground, and is characterized by width, height, surface area, volume, density, etc.
[0032] The growth status data is the growth status of the seedlings P1 in this section. Here, the growth status is determined by the state of the seedlings P1 identified from the photographed image and the status classification estimated from the tree height. Also, if the status classification (actual measurement value) is lower than the status classification on the afforestation map, warning information is recorded.
[0033] (Growth management treatment) The growth management process will be described with reference to Fig. 3. This growth management process is executed periodically (for example, at a predetermined time every month). In this case, the measurement device 15 moves along a predetermined flight route. This flight route is set so as to cover the entire afforestation area.
[0034] First, the control unit 21 of the support server 20 executes a process of acquiring photographed images for each afforestation section (step S11). Specifically, the measurement device 15 acquires photographed images (RGB images, point cloud images) using an imaging device at a predetermined position on the flight path. Then, the measurement device 15 transmits measurement information to the support server 20. This measurement information includes information on the photographed image, flight altitude, photographing position (latitude and longitude), etc.
[0035] In this case, the information acquisition unit 211 of the control unit 21 acquires the captured image from the measurement device 15. Then, the information acquisition unit 211 records the acquired measurement information in the measurement information storage unit 23 in association with the measurement date and time (current date and time).
[0036] When the photographed images are acquired for all afforestation sections, the control unit 21 of the support server 20 executes a process of identifying seedlings in the photographed images (step S12). Specifically, the recognition unit 212 of the control unit 21 identifies the afforestation area (section) in the photographed images using the afforestation map. Furthermore, the recognition unit 212 identifies the seedling area in which the seedlings are photographed in each section by image recognition.
[0037] Next, the control unit 21 of the support server 20 executes a calculation process of the crown feature amount (step S13). Specifically, the analysis unit 213 of the control unit 21 generates a tree surface map of the subject including the top layer of trees in the sapling area using the point cloud image of the measurement information. This tree surface map includes height information according to the distance of each position (latitude and longitude) from the measurement device 15 at the time of shooting and the flight altitude. Next, the analysis unit 213 identifies a topographical map in the shooting area from the altitude map in the basic information storage unit 22. Then, the analysis unit 213 calculates the tree height of the sapling P1 by subtracting the altitude of the topographical map from the height of the tree surface map. Furthermore, the analysis unit 213 calculates the crown feature amount (width, surface area, volume, density, etc.) of each sapling P1 according to the spread of the sapling P1 from the upper layer to the lower layer. Then, the analysis unit 213 calculates statistics (for example, average values) of the crown feature amounts including the calculated tree height for the saplings P1 in this section, and records them in the measurement information storage unit 23.
[0038] Next, the control unit 21 of the support server 20 executes a process of evaluating the growth state (step S14). Specifically, the analysis unit 213 of the control unit 21 inputs RGB information contained in the captured image into a seedling evaluation model to evaluate the growth state (healthiness).
[0039] Next, the control unit 21 of the support server 20 executes a process of determining the status classification according to the growth state (step S15). Specifically, the analysis unit 213 of the control unit 21 acquires planting time information from the measurement information storage unit 23, and calculates the number of years that have passed since planting. Next, the analysis unit 213 uses the growth curve diagram recorded in the basic information storage unit 22 to determine the status classification (actual measurement value) from the number of years that have passed and the tree height.
[0040] Next, the control unit 21 of the support server 20 executes a process of evaluating the deviation of the status classification (step S16). Specifically, the analysis unit 213 of the control unit 21 acquires the status classification corresponding to the photographed area from the afforestation map in the basic information storage unit 22. Then, the analysis unit 213 compares the status classification (actual measurement value) with the status classification of the afforestation map. If the status classification (actual measurement value) is lower than the status classification of the afforestation map, the analysis unit 213 records warning information in the measurement information storage unit 23.
[0041] Next, the control unit 21 of the support server 20 executes undergrowth handling processing (step S17). Here, it is determined whether the undergrowth state is appropriate. This processing will be described later with reference to FIG. Next, the control unit 21 of the support server 20 executes a thinning process (step S18). Here, it is determined whether the uniformity of the tree heights of the seedlings P1 among the upper, middle, and lower layers is appropriate. This process will be described later with reference to FIG. 5.
[0042] Next, the control unit 21 of the support server 20 executes a process of outputting the judgment result (step S19). Specifically, the analysis unit 213 of the control unit 21 outputs the evaluation result, which is the growth state recorded in the measurement information storage unit 23 for each section, to the user device 10.
[0043] (Undergrowth processing) Next, the undergrowth handling process will be described with reference to FIG. Here, the control unit 21 of the support server 20 executes a process of identifying undergrowth in the captured image (step S21). Specifically, the recognition unit 212 of the control unit 21 identifies an undergrowth area in which a sapling is photographed by image recognition in the captured image. Note that the recognition of the undergrowth area may identify an area included in a predetermined height range as the undergrowth area.
[0044] Next, the control unit 21 of the support server 20 executes a process for determining the state of undergrowth (step S22). Specifically, the analysis unit 213 of the control unit 21 calculates the density and height of undergrowth. In addition, if seedlings cannot be determined, it may be determined that there is excessive undergrowth.
[0045] Next, the control unit 21 of the support server 20 executes processing for outputting an instruction to cut undergrowth (step S23). Specifically, the analysis unit 213 of the control unit 21 compares the undergrowth state with a reference value. Then, when the undergrowth state exceeds the reference value, the analysis unit 213 outputs an instruction to cut undergrowth to the user device 10.
[0046] (Thinning treatment) Next, the thinning process will be described with reference to FIG. First, the control unit 21 of the support server 20 executes a process of distinguishing between upper, middle, and lower layers (step S31). Specifically, the analysis unit 213 of the control unit 21 distinguishes each sapling P1 in the captured image into an upper layer, middle layer, or lower layer according to the crown feature amount.
[0047] Next, the control unit 21 of the support server 20 executes a process of determining uniformity (step S32). Specifically, the analysis unit 213 of the control unit 21 calculates the ratios of the upper, middle, and lower layers to calculate the variation state of the ratios of each layer, and determines the uniformity based on this variation state.
[0048] Next, the control unit 21 of the support server 20 executes a thinning instruction process when the uniformity is poor (step S33). Specifically, the analysis unit 213 of the control unit 21 outputs a thinning instruction to the user device 10 when the variation is large and the uniformity is out of a predetermined range.
[0049] According to this embodiment, the following effects can be obtained. (1) In this embodiment, an unmanned aerial vehicle (drone) is used as the measuring device 15. Then, the control unit 21 of the support server 20 executes a process for acquiring the captured image (step S11). This makes it possible to efficiently carry out an inspection of each tree regarding the rooting and growth status of the seedlings P1 in the reforestation area, which is a time-consuming task.
[0050] (2) In this embodiment, the control unit 21 of the support server 20 executes a process of identifying a sapling in the captured image (step S12) and a process of calculating a crown feature amount (step S13), thereby making it possible to evaluate the state of the sapling P1.
[0051] (3) In this embodiment, the control unit 21 of the support server 20 executes a process for evaluating the growth state (step S14). Since the color of leaves, etc. changes depending on the health of the seedling, the growth state can be grasped using a seedling evaluation model.
[0052] (4) In this embodiment, the control unit 21 of the support server 20 executes a process of determining the status classification according to the growth state (step S15). This makes it possible to evaluate the growth state in consideration of the growth curve.
[0053] (5) In this embodiment, the control unit 21 of the support server 20 executes an evaluation process of deviations in the position classification (step S16) and an output process of the judgment result (step S19). This makes it possible to judge unexpected situations such as deviations from the original growth curve. Then, the felling time can be estimated taking the growth curve into consideration.
[0054] (6) In this embodiment, the control unit 21 of the support server 20 executes undergrowth handling processing (step S17). While undergrowth can prevent the soil from drying out, excessive undergrowth in relation to the seedlings can hinder the growth of the seedlings. This allows the manager to be instructed to cut undergrowth at an appropriate time depending on the situation. Furthermore, by preventing unnecessary undergrowth cutting, costs can be reduced.
[0055] (7) In this embodiment, the control unit 21 of the support server 20 executes a thinning process (step S18), which allows pruning of trees at appropriate timing as needed.
[0056] This embodiment can be modified as follows: This embodiment and the following modifications can be combined with each other to the extent that there is no technical contradiction. In the above embodiment, a larch tree is used as the seedling P1, but the application is not limited to larch trees. For example, the present invention may be applied to cedars and cypresses.
[0057] In the above embodiment, a drone is used as the measurement device 15, but the measurement device is not limited to a drone as long as it can measure the growth state of the seedling P1. In the above embodiment, the control unit 21 of the support server 20 executes a process of calculating the crown feature amount (step S13). Here, the crown feature amount includes the width, height, surface area, volume, density, etc. of the plant. As long as the growth state of the plant can be quantitatively and qualitatively evaluated, the feature amount is not limited to these. In the above embodiment, the image is taken from the sky, but the image taking position is not limited to this. The robot may fly or run between trees. In this case, the sapling P1 may be photographed using a wide-angle camera or a celestial camera. Also, for height measurement, a three-dimensional camera capable of three-dimensional measurement may be used.
[0058] In the above embodiment, captured images (RGB images and point cloud images) are acquired by the measurement device 15. The captured images are not limited to these. In the above embodiment, the control unit 21 of the support server 20 executes undergrowth processing (step S17) and thinning processing (step S18). It is not necessary to execute both processes, and either one or the other process may be executed. In addition, the support server 20 may acquire timber demand information, and use the growth state of the seedling P1 and the demand information to determine the time when it is possible to cut down the tree, and output a cutting instruction.
[0059] Next, the technical ideas that can be understood from the above-described embodiment and other examples will be described below. (a) the control unit, determining an undergrowth state in the afforestation image; 3. The growth support system according to claim 1, further comprising: an instruction to cut undergrowth is output to the user device according to the result of the determination of the undergrowth state. (b) the control unit, determining a variation state of tree heights of the plurality of seedlings identified in the afforestation image; 3. The growth support system according to claim 1, further comprising: a thinning instruction being output to the user device according to a result of the determination of the variation state. (c) A growth support system as described in any one of 1 or 2, (a) or (b), characterized in that the control unit acquires an RGB image as the reforestation image and identifies the growth state based on the color of the seedlings in the RGB image. (d) A growth support system according to any one of (a) to (c) in claim 1 or 2, characterized in that an unmanned aerial vehicle is used as the measuring device. [Explanation of symbols]
[0060] A1...growth support system, P1...sapling, 10...user device, 15...measuring device, 20...support server, 21...control unit, 211...information acquisition unit, 212...recognition unit, 213...analysis unit, 22...basic information storage unit, 23...measurement information storage unit.
Claims
1. A growth support system including a control unit connected to a user device and a measurement device, The control unit: Acquire plantation images of the transplanted seedlings from the measurement device; Identifying the seedlings in the afforestation image; Identifying the growth state of the seedlings; A growth support system characterized by comparing the growth state with a growth curve chart and outputting a judgment result of the growth state to the user device.
2. The control unit: Calculating tree height in the afforestation image; The growth support system according to claim 1, characterized in that a location classification is identified from the tree height in the growth curve diagram.
3. A method for supporting the growth of seedlings using a growth support system including a control unit connected to a user device and a measurement device, comprising: The control unit: Acquire plantation images of the transplanted seedlings from the measurement device; Identifying the seedlings in the afforestation image; Identifying the growth state of the seedlings; A growth support method comprising: comparing the growth state with a growth curve chart; and outputting a determination result of the growth state to the user device.
4. A growth support program for supporting the growth of a seedling using a growth support system including a control unit connected to a user device and a measurement device, The control unit, Acquire plantation images of the transplanted seedlings from the measurement device; Identifying the seedlings in the afforestation image; Identifying the growth state of the seedlings; A growth support program for functioning as a means for comparing the growth state with a growth curve chart and outputting a result of the determination of the growth state to the user device.
Citation Information
Patent Citations
Program for discriminating seedlings
JP2022053465A
