Method for managing farm field, farm field management system, and farm field management program

Abstract

To reduce operations of inputting information of a farm field by a user and support analysis of growth management.SOLUTION: The method for managing a farm field includes detecting the outline 510 of a region including a farm field 400 in a plurality of taken images taking an area including at least the same farm field 400 at different times from the sky. Also, the method for managing a farm field includes detecting the farm field region of the farm field 400 surrounded by the outline 510 on the basis of the detected outline 510 in the plurality of taken images. Detecting the farm field 400 may include detecting the farm field 400 surrounded by the outline 510 by overlapping the detected outline 510 in the taken images.SELECTED DRAWING: Figure 8

Description

[Technical field]

[0001] The present invention relates to a farm field management method, a farm field management system, and a farm field management program. [Background technology]

[0002] In recent years, there has been research into the analysis of cultivation management using information on work performed in a farm field. In order to perform the analysis of cultivation management, the farm field where the work is performed may be registered in a system.

[0003] Patent Document 1 discloses a technique for identifying the shape of a farm field based on satellite photographs taken from the sky and travel path data of a working implement traveling within the farm field. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-101446 A Summary of the Invention [Problem to be solved by the invention]

[0005] The technology described in Patent Document 1 requires travel path data of the working device traveling in the field, and when the travel path data is insufficient, the field cannot be detected. In addition, in order to identify the shape of the field, satellite photos that can detect and divide the area of ​​each field are used. However, depending on the time when the satellite photos were taken, there are cases where the areas of multiple adjacent fields cannot be divided from the image captured in the satellite photos.

[0006] In view of the above circumstances, one of the objects of the present disclosure is to reduce the input operation of farm field information by a user and to support the analysis of cultivation management by using an image captured from the sky. Other objects can be understood from the following description and the explanation of the embodiment. [Means for solving the problem]

[0007] The means for solving the problems will be described below using the numbers and symbols used in the description of the embodiment of the invention. These numbers and symbols are added in parentheses for reference purposes to show an example of the correspondence between the description of the claims and the description of the embodiment of the invention. Therefore, the description in parentheses should not be interpreted as limiting the scope of the claims.

[0008] A farm field management method according to one embodiment for achieving the above object includes detecting a contour (510) of an area (500) including the farm field (400) in a plurality of captured images taken from the air at different times of an area including at least the same farm field (400). The farm field management method also includes detecting a field area of ​​the farm field (400) surrounded by the contour (510) based on the contour (510) detected in the plurality of captured images.

[0009] To achieve the above object, a farm field management method according to one embodiment includes detecting a type of work performed in the farm field (400) based on changes in the farm field (400) in a plurality of captured images taken from the air at different times of an area including at least the same farm field (400). The farm field management method also includes outputting work information indicating the detected type of work.

[0010] To achieve the above object, a farm land management system (1000) according to one embodiment includes a contour detection unit (150) and a farm land management unit (160). The contour detection unit (150) detects a contour (510) of an area (500) including the farm land (400) in a plurality of captured images taken from the air at different times of an area including at least the same farm land (400). The farm land management unit (160) detects a farm land area of ​​the farm land (400) surrounded by the contour (510) based on the contour (510) detected in the plurality of captured images.

[0011] To achieve the above object, a farm land management system (1000) according to one embodiment includes a work detection unit (170) and an output unit (180). The work detection unit (170) detects the type of work performed in the farm land (400) based on changes in the farm land (400) in a plurality of captured images taken from above an area including at least the same farm land (400) at different times. The output unit (180) outputs work information indicating the detected type of work.

[0012] To achieve the above object, a farm field management program (300) according to one embodiment causes a calculation device (120) to detect a contour (510) of an area (500) including a farm field (400) in a plurality of captured images taken from the air at different times of an area including at least the same farm field (400). The farm field management program (300) also causes the calculation device (120) to detect a field area of ​​the farm field (400) surrounded by the contour (510) based on the contour (510) detected in the plurality of captured images.

[0013] To achieve the above object, a farm field management program (300) according to one embodiment causes a calculation device (120) to detect a type of work performed in a farm field (400) based on changes in the farm field (400) in a plurality of captured images taken from the air at different times of an area including at least the same farm field (400). The farm field management program (300) also causes the calculation device (120) to output work information indicating the detected type of work. Effect of the Invention

[0014] According to the above embodiment, it is possible to reduce the number of operations for inputting field information by the user and to assist in the analysis of cultivation management. [Brief description of the drawings]

[0015] [Figure 1] FIG. 1 is a configuration diagram of a farm land management system according to an embodiment. [Diagram 2] FIG. 2 is a diagram for explaining an area imaged by an imaging device in one embodiment. [Diagram 3] FIG. 2 is a diagram illustrating an image captured by an imaging device in one embodiment. [Figure 4] FIG. 2 is a diagram illustrating an image captured by an imaging device in one embodiment. [Diagram 5] 1 is a configuration diagram of a farm land management device according to an embodiment; [Figure 6] FIG. 2 is a diagram illustrating functional blocks executed by a farm land management system according to an embodiment. [Figure 7] FIG. 2 is a configuration diagram of a terminal according to an embodiment. [Figure 8] 4 is a flowchart showing a process performed by a farm land management system in one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] (Embodiment 1) A farm land management system 1000 according to this embodiment of the present invention will be described with reference to the drawings. In this embodiment, as shown in Fig. 1, the farm land management system 1000 includes a farm land management device 100 and a terminal 200. The farm land management device 100 is communicatively connected to the terminal 200 and an image acquisition device 50 via a network 20, for example the Internet.

[0017] As shown in Fig. 2, the image acquisition device 50 acquires image information representing captured images of a plurality of farm fields 400 captured from the sky by an imaging device 60, for example, an artificial satellite. The imaging device 60 captures a plurality of images from the sky of an area including at least the same plurality of farm fields 400, for example, a first field 400-1, a second field 400-2, a third field 400-3, and a fourth field 400-4 adjacent to a road, at different times. For example, as shown in Figs. 3 and 4, the imaging device 60 captures an image of the farm field 400 from the sky before the crops are harvested in the first area 500-1 including the first field 400-1 and the second field 400-2, and after the crops are harvested in the second area 500-2 including the third field 400-3. The imaging device 60 also captures an image of the farm field 400 from the sky before the crops in the fourth area 500-4 including the first field 400-1 are harvested and after the crops in the fifth area 500-5 including the second field 400-2 and the third field 400-3 are harvested. The image acquisition device 50 acquires image information representing the multiple captured images captured by the imaging device 60 from the imaging device 60, and transmits the image information to the farm field management device 100 shown in FIG.

[0018] The farm land management device 100 detects a field area that is an area of ​​the farm land 400, based on a plurality of captured images acquired from the image acquisition device 50. For example, the farm land management device 100 detects a contour 510 of the area 500 that includes the farm land 400, and detects the field area of ​​the farm land 400 based on the detected contour 510.

[0019] Furthermore, the farm land management apparatus 100 detects work, such as planting and harvesting, carried out in the farm field 400 between two captured times based on a plurality of captured images taken at different times. For example, in the example shown in Figures 3 and 4, the farm land management apparatus 100 detects that crops have been harvested in the second farm field 400-2.

[0020] In this way, the farm land management apparatus 100 detects the field area of ​​the field 400 and the work performed in the field 400 based on a plurality of captured images. A user, for example, a worker performing work in the field 400 or the owner of the field 400, can grasp the field area of ​​the field 400 detected by the farm land management apparatus 100 and the work performed in the field 400, and analyze cultivation management. Therefore, the farm land management apparatus 100 reduces the input operation of information about the field 400 by a user, for example, a worker performing work in the field 400 or the owner of the field 400, and supports the user's analysis of cultivation management.

[0021] (Configuration of the farm management system) The configuration of the farm land management device 100 will be described. As shown in FIG. 5, the farm land management device 100 includes an input / output device 110, a calculation device 120, a communication device 130, and a storage device 140. The farm land management device 100 is, for example, a computer. Information for the calculation device 120 to execute processing is input to the input / output device 110. The input / output device 110 outputs a result of the processing executed by the calculation device 120. The input / output device 110 includes various input devices and output devices, for example, a keyboard, a mouse, a microphone, a display, a speaker, a touch panel, and the like. The input / output device 110 may be omitted.

[0022] The communication device 130 is electrically connected to the network 20 and communicates with each device via the network 20. The communication device 130 transfers image information acquired from the image acquisition device 50 to the arithmetic device 120. The communication device 130 also transfers signals generated by the arithmetic device 120 to the terminal 200. The communication device 130 includes various interfaces, such as a network interface card (NIC) and a universal serial bus (USB).

[0023] The storage device 140 stores various data for detecting a work area, such as the farm field management program 300. The storage device 140 is used as a non-transitory tangible storage medium for storing the farm field management program 300. The farm field management program 300 may be provided as a computer program product recorded on a computer-readable storage medium 1, or may be provided as a computer program product downloadable from a server.

[0024] The arithmetic device 120 reads out and executes the farm field management program 300 from the storage device 140, and performs various data processing to detect the farm field area and the work performed in the farm field 400. For example, the arithmetic device 120 includes a central processing unit (CPU) and the like.

[0025] The arithmetic device 120 reads and executes the field management program 300 to realize an outline detection unit 150, a field detection unit 160, an operation detection unit 170, and an output unit 180, as shown in Fig. 6. The outline detection unit 150 detects an outline 510 of an area 500 including the field 400 in the captured image. The field detection unit 160 detects the field area of ​​the field 400 based on the outline 510 of the detected area 500. The operation detection unit 170 detects the operation performed in the field 400 based on the captured image. The output unit 180 outputs field information related to the field 400.

[0026] Next, the configuration of the terminal 200 will be described. As shown in FIG. 7, the terminal 200 includes an input / output device 210, a calculation device 220, a communication device 230, and a storage device 240. The terminal 200 includes, for example, a computer, a tablet, a mobile phone, and the like. Information for the calculation device 220 to execute processing is input to the input / output device 210. In addition, the input / output device 210 outputs the result of the calculation device 220 executing the processing. The input / output device 210 includes various input devices and output devices, and includes, for example, a keyboard, a mouse, a microphone, a display, a speaker, a touch panel, and the like.

[0027] The communication device 230 is electrically connected to the network 20 and communicates with the farm land management device 100 via the network 20. The communication device 230 transfers signals acquired from the farm land management device 100 to the arithmetic device 220. The communication device 230 also transfers signals generated by the arithmetic device 220 to the farm land management device 100. The communication device 230 includes various interfaces, such as a transceiver used for wireless communication such as a wireless LAN (Local Area Network) or a cellular network, a NIC (Network Interface Card), and a USB (Universal Serial Bus).

[0028] The storage device 240 stores various data for displaying farm field information, such as a display program 310. The storage device 240 is used as a non-transitory tangible storage medium for storing the display program 310. The display program 310 may be provided as a computer program product recorded in a computer-readable storage medium 2, or may be provided as a computer program product downloadable from a server.

[0029] The arithmetic device 220 reads and executes the display program 310 to implement the display unit 250 in cooperation with the input / output device 210, as shown in Fig. 6. The display unit 250 acquires field information from the field management device 100, and displays the field information, for example, information indicating the area of ​​the field 400 and information indicating the work performed in the field 400.

[0030] (Farm management system operation) The imaging device 60 shown in Fig. 1 captures an image of an area including a plurality of farm fields 400 from the sky, and transmits image information representing the captured images to the image acquisition device 50. For example, the imaging device 60 periodically captures an image of the farm field 400, and transmits image information representing the captured images to the image acquisition device 50. The image acquisition device 50 stores the image information transmitted from the imaging device 60. The captured images may include radio wave images, e.g., synthetic aperture radar (SAR) images, which are less affected by weather and which are captured by using radio waves, e.g., SAR images, of the farm field 400. The captured images may also include light wave images captured by receiving light waves, e.g., visible light.

[0031] The arithmetic device 120 of the farm field management apparatus 100 shown in Fig. 5 executes the farm field management program 300 and starts the process shown in Fig. 8, which is a farm field management method. For example, the arithmetic device 120 executes the farm field management program 300 when a predetermined time is reached. The arithmetic device 120 may also execute the farm field management program 300 in response to a request from the arithmetic device 220 of the terminal 200. In this case, when an operation for detecting the farm field 400 is input to the input / output device 210, the arithmetic device 220 of the terminal 200 outputs a signal to the arithmetic device 120 of the farm field management apparatus 100 to execute the farm field management program 300.

[0032] In step S110, the contour detection unit 150 realized by the calculation device 120 acquires a plurality of captured images from the image acquisition device 50. The acquired plurality of captured images include captured images taken at different times of an area including at least the same plurality of fields 400. For example, the area captured in the captured images includes a first field 400-1, a second field 400-2, a third field 400-3, and a fourth field 400-4, as shown in FIG.

[0033] In step S120, the contour detection unit 150 detects a contour 510 of the area 500 including the field 400 in the acquired multiple captured images. For example, the contour detection unit 150 performs edge detection processing on the captured images to detect the contour 510 of the area 500 including the field 400. For example, the area 500 of the captured images has a different display form, such as color and gradation value, from the surroundings, as shown in the example of FIG. 3. For example, when the first area 500-1 is before the crop is harvested and the second area 500-2 and the third area 500-3 are after the crop is harvested, the color of the first area 500-1 is different from the color of the second area 500-2 and the third area 500-3. Also, in the SAR image, the energy of the electromagnetic wave received from the first area 500-1 is different from the energy of the electromagnetic wave received from the second area 500-2 and the third area 500-3. For this reason, the contour detection unit 150 performs edge detection processing on the captured image to detect a contour 510 of the area 500 in the captured image. The detected contour 510 includes a part of the field contour, which is the contour of the field 400, as shown in Fig. 3. Furthermore, the area 500 surrounded by the detected contour 510 may include the entire area of ​​at least one field 400.

[0034] The contour detection unit 150 performs edge detection processing on a plurality of captured images, for example, the example shown in FIG. 3. In the example shown in FIG. 3, the contour detection unit 150 detects a contour 510 of a first region 500-1 including a first field 400-1 and a second field 400-2. The contour detection unit 150 also detects a contour 510 of a second region 500-2 including a third field 400-3. The contour detection unit 150 also detects a contour 510 of a third region 500-3 including a fourth field 400-4. Therefore, in the example shown in FIG. 3, the contour detection unit 150 detects a first contour 510-1 representing a field contour between the second field 400-2 and the third field 400-3, but does not detect a field contour between the first field 400-1 and the second field 400-2.

[0035] The contour detection unit 150 performs edge detection processing on a plurality of captured images, for example, the example shown in FIG. 4. In the example shown in FIG. 4, the contour detection unit 150 detects the contour 510 of the fourth region 500-4 including the first field 400-1. The contour detection unit 150 also detects the contour 510 of the fifth region 500-5 including the second field 400-2 and the third field 400-3. Furthermore, the contour detection unit 150 detects the contour 510 of the sixth region 500-6 including the fourth field 400-4. Therefore, in the example shown in FIG. 4, the contour detection unit 150 detects the second contour 510-2 representing the field contour between the first field 400-1 and the second field 400-2, but does not detect the field contour between the second field 400-2 and the third field 400-3.

[0036] In this way, the contour detection unit 150 detects all or part of the field contour of the farm field 400 in each of the captured images. The contour detection unit 150 may further perform post-processing, such as filtering or binarization, on the captured images that have been subjected to edge detection processing in order to detect contours 510. Furthermore, when the area surrounded by the detected contours 510 is smaller than a predetermined area, the contour detection unit 150 may exclude the corresponding contour 510 by determining that it does not include the farm field 400.

[0037] In step S130 shown in Fig. 8, the field detection unit 160 detects a field region of the field 400 based on the contours 510 detected in the multiple captured images. For example, the field detection unit 160 detects the field 400 surrounded by the contours 510 by superimposing the contours 510 detected in the multiple captured images. The field detection unit 160 superimposes the multiple captured images on which edge detection processing has been performed based on latitude and longitude information of the area captured in the captured images. The field detection unit 160 detects the field 400 surrounded by the contours 510 by superimposing the contours 510 detected in the multiple captured images at corresponding positions.

[0038] 3 and 4, the field detection unit 160 superimposes the contours 510 of the region 500 at corresponding positions. The field detection unit 160 superimposes the contours 510 in the first region 500-1, the second region 500-2, the third region 500-3, the fourth region 500-4, the fifth region 500-5, and the sixth region 500-6 at corresponding positions. In this way, the field detection unit 160 detects a first contour 510-1 between the second field 400-2 and the third field 400-3, and a second contour 510-2 between the first field 400-1 and the second field 400-2. Therefore, the field detection unit 160 detects the first field 400-1, the second field 400-2, and the third field 400-3 as different field regions. The field detection unit 160 also detects the fourth field 400-4, which does not have an adjacent field 400, as a field region.

[0039] In step S140 shown in Fig. 8, the work detection unit 170 detects work performed in the field 400 based on changes in the field 400 in images captured at different times. For example, in order to detect work performed in the field 400, the work detection unit 170 stores the work performed in the field 400 in association with the captured images before and after the work was performed. The work detection unit 170 detects a similar captured image that is most similar to the change in the field 400 in the captured images captured at different times from the changes in the stored captured images. The work detection unit 170 detects the work associated with the similar captured image as work performed in the field 400.

[0040] For example, in the example shown in Fig. 3, the first area 500-1 including the second field 400-2 is displayed in a display form representing crops, for example, in green, and in the example shown in Fig. 4, the fifth area 500-5 including the second field 400-2 is displayed in a display form representing soil, for example, in earth color. In this case, the work detection unit 170 estimates that harvesting work has been performed in the second field 400-2 based on a change in the display form, for example, color, of the second field 400-2 in two captured images, for example, a light wave image captured using light waves (visible light). In addition, the work detection unit 170 may estimate that cultivation work of planting crops has been performed in the field 400 when the display form in the field 400 has changed from one representing soil to one representing crops.

[0041] 8, the output unit 180 outputs field information related to the detected field 400 to the display unit 250 of the terminal 200. The field information includes area information indicating the field area of ​​the field 400 and work information indicating the work performed in the field 400.

[0042] In step S160, the display unit 250 of the terminal 200 displays the field information on the input / output device 210 based on the field information received from the output unit 180 of the field management apparatus 100. The display unit 250 displays, for example, an image showing the area of ​​the field 400 detected on a map. The display unit 250 also displays an image showing the work performed in the field 400 in accordance with the area of ​​the field 400. By checking the input / output device 210, the user can understand the field area of ​​the field 400 and the work performed in the field 400, and analyze the cultivation management.

[0043] In this way, the farm land management system 1000 assists the user in analyzing cultivation management.

[0044] (Modification) The configuration described in the embodiment is an example, and the configuration can be changed as long as the function is not impaired. For example, the captured image captured by the imaging device 60 may include captured images captured by any method, or may include captured images captured by a plurality of different methods. For example, the captured image may include both an SAR image captured by using a synthetic aperture radar to capture the farm field 400, and a light wave image captured by receiving light waves.

[0045] In step S130 shown in FIG. 8, the field detection unit 160 may detect the field area of ​​the field 400 by using the contours 510 that satisfy the contour condition among the contours 510 detected from the multiple captured images. For example, the field detection unit 160 detects the field area of ​​the field 400 by using the contours 510 detected in at least a predetermined number of the multiple captured images. In this case, the field detection unit 160 determines whether the contours 510 detected in different captured images represent the same contour 510. For example, the field detection unit 160 determines whether the contours 510 represent the same contour 510 based on the extending direction of the contour 510 and the position of the contour 510. When the number of contours 510 determined to correspond to the same contour 510 among the contours 510 detected in different captured images is greater than a predetermined number, the field detection unit 160 uses the corresponding contours 510 to detect the field area of ​​the field 400. The predetermined number may be a fixed value set in advance, or may be determined based on the number of captured images. For example, the predetermined number may be determined by multiplying the number of captured images by a predetermined ratio.

[0046] The work detection unit 170 shown in Fig. 6 may have artificial intelligence (AI) that estimates the work performed in the field 400 from captured images taken before and after the work is performed. The AI ​​learns using data that combines the work performed in the field 400 and images taken before and after the work is performed. In step S140 shown in Fig. 8, the work detection unit 170 detects the work performed in the field 400 by inputting the captured images to the trained artificial intelligence.

[0047] The captured images used by the work detection unit 170 may include a plurality of captured images captured by a plurality of different methods. For example, the work detection unit 170 may detect work performed in the field 400 using captured images captured by a plurality of different methods, such as a Normalized Difference Vegetation Index (NDVI) image that indicates the presence or absence and activity of vegetation, a light wave image, and an SAR image. The work detection unit 170 detects work performed in the field 400 based on each captured image before and after the work is performed and each captured image captured by the imaging device 60.

[0048] The above-described embodiment and modified examples are merely examples, and the configurations described in each embodiment and modified example may be arbitrarily changed and / or arbitrarily combined as long as the functions are not impaired. Furthermore, some of the functions described in the embodiment and modified examples may be omitted as long as the necessary functions can be realized. For example, the farm field management system 1000 shown in FIG. 1 may not include the terminal 200. Furthermore, all or part of the processing of the farm field management apparatus 100 may be executed by the terminal 200. Furthermore, all or part of the processing of the terminal 200 may be executed by the farm field management apparatus 100. Furthermore, the farm field management program 300 may include a display program 310.

[0049] Furthermore, the farm land management apparatus 100 does not have to include the operation detection unit 170. In this case, step S140 is omitted in the processing shown in FIG.

[0050] Furthermore, the farm field management apparatus 100 does not have to include the farm field detection unit 160. In this case, step S130 is omitted in the process shown in Fig. 8. The work detection unit 170 of the farm field management apparatus 100 stores area information indicating the area of ​​the farm field 400. The work detection unit 170 detects the area of ​​the farm field 400 in the captured image based on the stored area information, and detects work performed in the detected farm field 400. [Explanation of symbols]

[0051] 1, 2: Storage medium 20: Network 50: Image acquisition device 60: Imaging device 100: Field management device 110: Input / Output device 120: Arithmetic device 130: Communication equipment 140: Storage device 150: Contour detection section 160: Field detection unit 170: Work detection unit 180: Output section 200: Terminal 210: Input / Output device 220: Arithmetic device 230:Communication equipment 240: Storage device 250:Display section 300: Field Management Program 310: Display program 400: Field 500: Area 510: Contour 1000: Field management system

Claims

1. Detecting an outline of an area including at least the same farm field in a plurality of captured images taken from above at different times of an area including the farm field; Detecting a field area of ​​the field surrounded by the contour based on the contour detected in the plurality of captured images; A field management method comprising:

2. Detecting the field includes: By superimposing the contours detected in the plurality of captured images, the farm field surrounded by the contours is detected. The farmland management method according to claim 1, further comprising:

3. The plurality of captured images include radio wave images captured using radio waves. The farm land management method according to claim 1 or 2.

4. and detecting a type of work performed in the farm field based on the changes in the farm field detected in the plurality of captured images. The farm land management method according to any one of claims 1 to 3.

5. the plurality of captured images include light wave images captured using light waves, Detecting a type of work performed in the field includes: determining a type of work performed on the field based on changes in the field in the light wave image; The farmland management method according to claim 4, further comprising:

6. Detecting the type of work performed in the farm field based on changes in the farm field in a plurality of images taken from above an area including at least the same farm field at different times; outputting work information representative of the detected type of work; A field management method comprising:

7. a contour detection unit that detects a contour of an area including at least the same farm field in a plurality of captured images taken from above at different times of an area including the farm field; a farm field management unit that detects a farm field area of ​​the farm field that is surrounded by the contours based on the contours detected in the plurality of captured images; A farm management system comprising:

8. a work detection unit that detects a type of work performed in the field based on changes in the field in a plurality of captured images taken from above an area including at least the same field at different times; an output unit that outputs work information indicating the type of the detected work; A farm management system comprising:

9. Detecting an outline of an area including at least the same farm field in a plurality of captured images taken from above at different times of an area including the farm field; Detecting a field area of ​​the field surrounded by the contour based on the contour detected in the plurality of captured images; A farm field management program that causes a computing device to execute the above.

10. Detecting the type of work performed in the farm field based on changes in the farm field in a plurality of images taken from above an area including at least the same farm field at different times; outputting work information representative of the detected type of work; A farm field management program that causes a computing device to execute the above.

Images