GROWTH CONDITION EVALUATION SYSTEM, GROWTH CONDITION EVALUATION DEVICE, GROWTH CONDITION EVALUATION METHOD, AND PROGRAM
Patent Information
- Application Number
- JP2021075936
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-04-28
- Publication Date
- 2025-02-17
- Estimated Expiration
- 2041-04-28
AI Technical Summary
【0013】 本発明によれば、農業従事者に対して安価にかつタイムリーに特定の農地における農作物の生育状況を提供することができる。
Smart Images

Figure 0007630164000001 
Figure 0007630164000002 
Figure 0007630164000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a growth condition evaluation system, a growth condition evaluation device, a growth condition evaluation method and a program, and in particular to a growth condition evaluation system, a growth condition evaluation device, a growth condition evaluation method and a program for evaluating the growth condition of agricultural crops based on satellite images. [Background technology]
[0002] For example, there is known a technology for analyzing the growth conditions of vegetation using radar image data obtained by a radar device mounted on an artificial satellite or other flying object that captures a wide range of the ground surface in the target area to acquire the conditions of the ground surface (e.g., Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2010-117327 A Summary of the Invention [Problem to be solved by the invention]
[0004] In order to know the growing conditions of crops in a certain field, it is necessary to specify or extract the area corresponding to that field from radar image data, but this is a time-consuming and costly task that requires geometric correction and image specification by latitude and longitude. Therefore, this type of service has not been easily available to farmers in terms of both cost and speed.
[0005] Therefore, an object of the present invention is to provide farmers with information on the growth status of crops in specific farmland at low cost and in a timely manner. [Means for solving the problem]
[0006] In order to solve the above-mentioned problems, the first aspect of the present invention is An acquisition unit that acquires an image of the earth's surface including markers arranged so as to surround the farmland, the image being taken by an artificial satellite; a cutout unit that detects light points of the markers from the acquired image and cuts out an area surrounded by the light points from the image; an evaluation unit that evaluates a growth stage of the crops planted in the farmland based on the extracted image; A growth status evaluation device comprising: to provide.
[0007] In the growth status evaluation device of the present invention, the image of the earth's surface is an image taken by an active microwave sensor mounted on the satellite; is preferred.
[0008] In addition, in the growth status evaluation device of the present invention, the evaluation unit compares the crop image with a reference image corresponding to the crop growth stage, and evaluates the crop growth stage based on a comparison result; is preferred.
[0009] In addition, the growth status evaluation device of the present invention is a display unit that displays the evaluation result of the growth stage together with weather information including at least one of a temperature history and a precipitation history; is preferred.
[0010] In addition, the second aspect of the present invention is For the growth status evaluation device, acquiring an image of the earth's surface, the image including markers arranged to surround the farmland, taken by a satellite; detecting light points of the markers from the acquired image and extracting an area surrounded by the light points from the image; A step of evaluating a growth stage of a crop planted in the farmland based on the cut-out image; A method for evaluating a growth state, comprising: to provide.
[0011] In addition, the third aspect of the present invention is For the growth status evaluation device, acquiring an image of the earth's surface, the image including markers arranged to surround the farmland, taken by a satellite; detecting light points of the markers from the acquired image and extracting an area surrounded by the light points from the image; A step of evaluating a growth stage of a crop planted in the farmland based on the cut-out image; A program for carrying out a procedure including to provide.
[0012] Moreover, a fourth aspect of the present invention is A growth status evaluation system including an artificial satellite that photographs the earth's surface, markers arranged so as to surround farmland on the earth's surface, and a growth status evaluation device, The growth status evaluation device includes: an acquisition unit that acquires an image of the earth's surface captured by an artificial satellite; a cutout unit that detects light points of the markers from the acquired image and cuts out an area surrounded by the light points from the image; an evaluation unit that evaluates a growth stage of the crops planted in the farmland based on the extracted image; A growth status evaluation system comprising: to provide. Effect of the Invention
[0013] According to the present invention, it is possible to provide farmers with information on the growth status of crops in specific farmland at low cost and in a timely manner. [Brief description of the drawings]
[0014] [Figure 1] FIG. 1 is a schematic diagram of a growth status evaluating system 1 according to a representative embodiment of the present invention. [Diagram 2] FIG. 2 is a diagram showing an example of the relationship between growth stages of crops G and satellite images P corresponding to each growth stage. [Diagram 3] 1 is a schematic diagram of an artificial satellite 10, a target marker 20, and a growth status evaluation device 30 included in a growth status evaluation system 1. FIG. [Figure 4] 2 is a schematic diagram showing an example of a target marker 20. FIG. [Diagram 5] FIG. 2 is a diagram showing an outline of a method for cutting out an area AA corresponding to the farmland A in FIG. 1 from a satellite image P. [Figure 6] FIG. 13 is a diagram showing an example of a display of an evaluation result. [Figure 7] 4 is a flowchart showing the operation of the growth status evaluating system 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0015] Hereinafter, a growth status evaluation system, a growth status evaluation device, a growth status evaluation method, and a program according to representative embodiments of the present invention will be described in detail with reference to the drawings. However, the present invention is not limited to these drawings. In addition, since the drawings are intended to conceptually explain the present invention, dimensions, ratios, or numbers may be exaggerated or simplified as necessary for ease of understanding.
[0016] 1. Overview of the growth status evaluation system This embodiment automatically and continuously acquires satellite images of individual farmland units through target markers (hereinafter referred to as markers) in order to provide agricultural workers (especially farmers and agricultural corporations) with information on growth conditions and predictions of harvest times, and provides agricultural support solutions that utilize these images.
[0017] As shown in Fig. 1, the growth status evaluation system 1 includes an artificial satellite 10, a marker 20, and a growth status evaluation device 30. Note that a user terminal 40 collectively represents multiple terminals used by farmers and agricultural corporations (see Fig. 3).
[0018] The markers 20 are radio wave "mirror"-like hardware that are placed around the farmland A on the earth's surface S. Alternatively, the markers 20 may be said to be placed at positions that form the vertices of the farmland A. Details of the markers 20 will be described later.
[0019] The artificial satellite 10 emits radio waves toward the earth's surface S, receives the reflected waves from the earth's surface S, and generates an image, i.e., a satellite image P, based on the received reflected waves (see FIG. 5). A light spot Q of the marker 20 appears in the satellite image P. Details of the artificial satellite 10 will be described later.
[0020] The growth condition evaluation device 30 cuts out an area AA surrounded by light spots Q of the markers 20 from the satellite image P as an image of the farmland A, and evaluates the growth condition of the crops G based on the cut-out image. The growth condition evaluation device 30 will be described in detail later.
[0021] 2.Artificial satellite The artificial satellite 10 is equipped with an active microwave sensor as an observation sensor. Therefore, the artificial satellite 10 can image the earth's surface by irradiating microwaves from its antenna to the earth's surface S and measuring the reflection intensity of the radio waves. In this embodiment, a synthetic aperture radar (SAR) is assumed as the observation sensor, but the present invention is not limited to this.
[0022] The image data obtained by a SAR sensor is called "tactile." For example, in the case of farmland, when rice ears ripen they appear rough, and when fruit leaves set they appear fluffy, making it ideal for continuously monitoring changes in crops G, or in other words, for monitoring their growth conditions.
[0023] Microwaves are classified into P-band, L-band, C-band, X-band, etc. in order of longest wavelength, and in synthetic aperture radar, the relatively high frequency L-band, C-band, and X-band are used for microwave remote sensing. The lower the frequency of microwaves, the higher their penetrating ability is, and they can penetrate not only clouds but also vegetation, and also have high resolution.
[0024] Therefore, by using a SAR sensor, it is possible to obtain information such as the presence or absence of an object, changes in the object's material (whether it is manmade, natural, or water), and soil moisture. In addition, a SAR sensor has the advantage that it can capture images even when the earth's surface S is covered with clouds or at night, making it easy to compare images taken under the same conditions (same date and time). Therefore, as shown in Figure 2, by continuously and repeatedly capturing images with a SAR sensor, it is possible to grasp the growth status of crops G based on the differences in scattering patterns (differences in reflection intensity) that accompany growth.
[0025] 3. Target marker (marker) The marker 20 has the function of reflecting radio waves transmitted from the artificial satellite 10 and returning them in the direction from which the radio waves came. The marker 20 is assumed to be a square type or a triangular type, but is not limited to this.
[0026] The dimensions of the marker 20 can be set appropriately depending on the evaluation of radio wave characteristics and the link design with the satellite, but from the viewpoint of portability, an outer diameter of 150 cm to 50 cm is preferable, and more preferably, approximately 100 cm to 60 cm.
[0027] From the viewpoint of weight reduction and outdoor use (to prevent rain from accumulating and to reduce the effects of wind), it is preferable to form a hole 21A in the marker 20 as shown in FIG. 4. The diameter of the hole 21A is preferably 1 / 5 to 1 / 10 of the wavelength in order to reflect radio waves without escaping. For example, in a SAR satellite, considering that the frequency band of the QPS satellite is the X-band (2.4 cm to 3.75 cm) and the frequency band of the ALOS satellite is the L-band (15 cm to 30 cm), it is preferable to set the diameter of the hole 21A to about 2.4 mm to 7.5 mm and about 15 mm to 100 mm, respectively. In particular, it is preferable that the diameter of the hole 21A is 4 mm to 6 mm for the X-band and 30 mm to 50 mm for the L-band.
[0028] The main body 21 of the marker 20 may be installed on the earth's surface S, or may be placed on a pedestal 22 (including a tripod or the like) as shown in Fig. 4. By using the pedestal 22, the main body 21 of the marker 20 can be prevented from being hidden by grown crops G when viewed from the artificial satellite 10.
[0029] The number of markers 20 may be sufficient as long as one piece of farmland A can be identified in the surface direction, and may be at least three or more, and preferably four or more. For example, the number of markers 20 may correspond to the shape (number of vertices) of farmland A. Also, it is assumed that the marker 20 installed at one vertex of farmland A will be used in the form of one unit. However, considering that the number of SAR satellites will increase in the future and that the satellites will come from various directions when viewed from the ground, multiple units (for example, four units) may be used in combination.
[0030] The material of the marker 20 may be any material that reflects radio waves from the artificial satellite 10, but stainless steel is preferable. In addition, in consideration of portability, it is preferable that the marker 20 be of an assembled type.
[0031] 4.Growth Status Evaluation Device The growth status evaluation device 30 is configured as one or more computers including a CPU, RAM, ROM, and a communication unit. The growth status evaluation device 30 includes the functional units of an acquisition unit 31, a cutout unit 32, an evaluation unit 33, a display unit 34, and a storage unit 35. In the growth status evaluation device 30, the CPU reads out programs and various data stored in the ROM into the RAM and executes them, thereby realizing various functions described below. Each functional unit will be described in detail below.
[0032] The acquisition unit 31 acquires a satellite image P captured by the artificial satellite 10 directly from the artificial satellite 10 or via another device such as a server. As shown in Fig. 5, a bright point (light point Q) originating from the marker 20 is reflected in the satellite image P. The acquisition unit 31 preferably acquires satellite images at regular time intervals (for example, every day, every few days, or every week).
[0033] The cutout unit 32 cuts out an area AA surrounded by the light spot Q from the satellite image P, and stores the cutout image in the storage unit 35. The cutout image corresponds to the farmland A.
[0034] The evaluation unit 33 compares the cut-out image with a reference image to evaluate the growth stage of the crop G. The reference images are images of the crop G taken at each growth stage (see FIG. 2) and are stored in advance in the storage unit 35. The comparison between the cut-out image and the reference image may be performed based on whether or not feature quantities such as spectrum, histogram, brightness, and luminance of both images are within the allowable error range.
[0035] Therefore, by comparing the cropped image with the reference image, the evaluation unit 33 can grasp the growth stage of the crop G and predict the harvest time of the crop G. The growth stage of the crop G may be expressed, for example, as a growth rate in which the stage of the crop that has reached the harvest time is set to 100%, or may be displayed as a stage such as 5 stages or 10 stages (see FIG. 6).
[0036] The evaluation unit 33 may also evaluate the speed of growth of the crop G (same pace as normal, advanced, delayed, etc.) based on the growth stage of the crop G at each predetermined time interval. When making such an evaluation, the evaluation unit 33 may refer to past weather data (temperature, amount of solar radiation, amount of rainfall, etc.) and weather forecasts.
[0037] The display unit 34 outputs the evaluation result of the evaluation unit 33 for display. The display unit 34 may display the evaluation result on its own display, or may display the evaluation result on the display of another terminal (for example, a user terminal 40 installed at a farmer or an agricultural corporation). Thus, the user (farmer or agricultural corporation) can grasp the growth status and harvest time of the agricultural crop G.
[0038] The display unit 34 may display the evaluation result together with the temperature history, the precipitation history, etc., as shown in Fig. 6. The display unit 34 may also display measures such as increasing the amount of fertilizer or water when, for example, the growth of the crop G is delayed.
[0039] The storage unit 35 stores various data and programs. The various data include, for example, images cut out by the cutout unit 32, reference images for each type of agricultural crop, evaluation results by the evaluation unit 33, and weather data for the farmland A.
[0040] 5. Operation of the growth status evaluation system The operation of the growth state evaluating system 1 will be described with reference to FIG.
[0041] In step S1, markers 20 are placed around the periphery (vertices) of farmland A.
[0042] In step S2, the artificial satellite 10 uses a microwave sensor or the like to capture an image of the earth's surface S including the farmland A and the markers 20, and obtains a satellite image P. The satellite image P is captured periodically, for example, once a day, once every few days, or once a week, and data of the satellite image P is transmitted to the growth status evaluation device 30 or another device (such as a server) each time the image is captured.
[0043] In step S3, the growth state evaluating device 30 receives (acquires) a satellite image P from the artificial satellite 10 directly or indirectly.
[0044] In step S4, the growth state evaluating device 30 detects the light points of the markers 20 in the satellite image P, and based on the detection result, cuts out an area AA corresponding to the farmland A from the satellite image P. The cut-out image is stored in the memory unit 35.
[0045] In step S5, the cropped image is compared with a reference image to evaluate the growth status of the crop G in the farmland A. The growth status includes the growth stage, growth rate, predicted harvest time, and the like.
[0046] In step S6, the evaluation result is output for display. The output destination may be a display device of the growth status evaluation device 30, or a display device of another terminal 40. Weather history, weather forecast, etc. may be displayed together with the evaluation result.
[0047] In step S7, it is confirmed whether the crop G has been harvested, and if the crop G has been harvested, the series of procedures is terminated. If the crop G has not yet been harvested, the process returns to step S2 and the above-mentioned procedures are repeated. This allows the user to timely grasp the growth status of the crop G in the farmland A from planting to harvesting, and to take necessary measures such as adding fertilizer and preparing for harvesting. In other words, an improvement in productivity based on objective data can be expected.
[0048] As described above, in this embodiment, the task of extracting the necessary area AA from the satellite image P is performed based on the light spot of the marker 20. Therefore, it is possible to omit time-consuming and costly tasks such as geometric correction and image specification by latitude and longitude. Furthermore, by reducing the cost of these tasks required for each satellite image, it is possible to inexpensively realize an analytical farming support solution that requires understanding of progress using multiple images.
[0049] In addition, because images can be quickly extracted for each farmland based on the markers 20, the speed of providing value to the end users, i.e. farmers, is improved. Also, because only the image of the area AA needs to be stored (i.e. there is no need to analyze and store the entire satellite image P), there is an advantage in terms of server load.
[0050] Representative embodiments of the present invention have been described above, but the present invention is not limited to these, and various design modifications are possible, which are also included in the present invention.
[0051] The image of farmland A cut out from one satellite image P is not limited to one, but may be multiple. For example, one satellite image P may contain images of multiple farmlands. In this case, the farmland can be identified based on the number of light spots Q of the marker 20, the shape and dimensions of the area AA formed by the light spots Q, etc. [Explanation of symbols]
[0052] 1. Growth status evaluation system 10 satellite 20 Target Marker 30 Growth status evaluation device 31 Acquisition Department 32 Cutout part 33 Evaluation Department 34 Display section
Claims
1. An acquisition unit that acquires an image of the earth's surface including markers arranged so as to surround the farmland, the image being taken by an artificial satellite; a cutout unit that detects light points of the markers from the acquired image and cuts out an area surrounded by the light points from the image; an evaluation unit that evaluates a growth stage of the crops planted in the farmland based on the extracted image; A growth status evaluation device comprising:
2. the image of the earth's surface is an image taken by an active microwave sensor mounted on the satellite; 2. The growth status evaluation device according to claim 1,
3. the evaluation unit compares the crop image with a reference image corresponding to the crop growth stage, and evaluates the crop growth stage based on a comparison result; 3. The growth status evaluation device according to claim 1 or 2,
4. a display unit that displays the evaluation result of the growth stage together with weather information including at least one of a temperature history and a precipitation history; The growth status evaluation device according to any one of claims 1 to 3,
5. For the growth status evaluation device, acquiring an image of the earth's surface, the image including markers arranged to surround the farmland, taken by a satellite; detecting light points of the markers from the acquired image and extracting an area surrounded by the light points from the image; A step of evaluating a growth stage of a crop planted in the farmland based on the cut-out image; A growth status evaluation method comprising:
6. For the growth status evaluation device, acquiring an image of the earth's surface, the image including markers arranged to surround the farmland, taken by a satellite; detecting light points of the markers from the acquired image and extracting an area surrounded by the light points from the image; A step of evaluating a growth stage of a crop planted in the farmland based on the cut-out image; A program for executing a procedure including:
7. A growth status evaluation system including an artificial satellite that photographs the earth's surface, markers arranged so as to surround farmland on the earth's surface, and a growth status evaluation device, The growth status evaluation device includes: an acquisition unit that acquires an image of the earth's surface captured by an artificial satellite; a cutout unit that detects light points of the markers from the acquired image and cuts out an area surrounded by the light points from the image; an evaluation unit that evaluates a growth stage of the crops planted in the farmland based on the extracted image; A growth status evaluation system comprising:
Citation Information
Patent Citations
Photogrammetry target and photogrammetry using the photogrammetry target
JP1998185563A
Aerial marking for aerial photography survey
JP2005062143A
Vegetation growth condition analysis method, program, and vegetation growth condition analyzer
JP2010117327A
Method, device and program for identifying crop condition change date
JP2014018140A
Satellite image processing system and method
JP2018097506A