Tree planting system, information terminal, and ar glasses

The reforestation system addresses inefficiencies in replanting dying plants by using processors to identify planting positions and generate augmented reality support, enhancing the efficiency and success of reforestation work.

WO2026053842A1PCT designated stage Publication Date: 2026-03-12KOMATSU LTD
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-08-28
Publication Date
2026-03-12

AI Technical Summary

Technical Problem

Existing reforestation systems face inefficiencies in replanting dying plants and lack support for workers in supplementary planting tasks.

Method used

A reforestation system that includes a processor to identify supplementary planting positions, acquire plant data, calculate planting routes, and generate augmented reality images to support workers in replanting efforts.

Benefits of technology

Enhances the efficiency of replanting operations by providing precise positioning and augmented reality support for workers, thereby improving the success rate of reforestation efforts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2025030229_12032026_PF_FP_ABST
    Figure JP2025030229_12032026_PF_FP_ABST
Patent Text Reader

Abstract

This tree planting system comprises a processor. The processor specifies a supplementary planting position indicating a position where a plant body is to be supplementary planted in a tree planting area, acquires plant body data related to the plant body at the supplementary planting position, and stores management data in which the plant body and the plant body data are associated with each other.
Need to check novelty before this filing date? Find Prior Art

Description

Afforestation system, information terminal, and AR glasses

[0001] The present disclosure relates to a reforestation system, an information terminal, and AR glasses.

[0002] In the technical field related to reforestation systems, there is known a reforestation system such as that disclosed in Patent Document 1. In Patent Document 1, plants are planted in soil by a reforestation machine.

[0003] Japanese Patent Application Laid-Open No. 2023-158914

[0004] Plants planted in soil may wither and die. When a plant withers and dies, there is a demand for technology that allows it to be replanted efficiently. Furthermore, when a plant withers and dies, the plant is replanted by a worker. There is a demand for technology that supports the planting work of workers.

[0005] The present disclosure aims to support supplementary planting work. The present disclosure aims to support reforestation work.

[0006] According to the present disclosure, there is provided a reforestation system including a processor that identifies a supplementary planting position indicating a position where a plant should be supplementarily planted in a reforestation area, acquires plant data relating to the plant at the supplementary planting position, and stores management data in which the plant and the plant data are associated with each other.

[0007] According to the present disclosure, there is provided a reforestation system including a processor, which acquires planting positions indicating positions where plants should be planted in a reforestation area, calculates routes for a worker to plant the plants at each of a plurality of planting positions based on the planting positions, and generates display data including the routes.

[0008] According to the present disclosure, there is provided a reforestation system including a processor, which acquires replanting positions indicating positions where plants should be replanted in a reforestation area, identifies completion positions indicating positions where the replanting of the plants has been completed, and generates display data including the completion positions.

[0009] According to the present disclosure, there is provided a reforestation system including a processor that acquires a real image of a reforestation area captured by a camera, generates an augmented reality image for supporting reforestation work in the reforestation area, and displays the augmented reality image on a display device so as to be superimposed on the real image.

[0010] According to the present disclosure, supplementary planting work can be supported. According to the present disclosure, reforestation work can be supported.

[0011] FIG. 1 is a diagram schematically illustrating a reforestation system according to an embodiment. FIG. 2 is a perspective view illustrating a reforestation machine according to an embodiment. FIG. 3 is a hardware configuration diagram illustrating a server according to an embodiment. FIG. 4 is a functional block diagram illustrating a reforestation system according to an embodiment. FIG. 5 is a functional block diagram illustrating an information terminal according to an embodiment. FIG. 6 is a diagram schematically illustrating a reforestation area and a storage area according to an embodiment. FIG. 7 is a flowchart illustrating a method for determining the death of seedlings according to an embodiment. FIG. 8 is a diagram for explaining a method for generating a trained model according to an embodiment. FIG. 9 is a diagram illustrating an example of display data displayed on a display device of an information terminal according to an embodiment. FIG. 10 is a diagram illustrating an example of display data displayed on a display device of an information terminal according to an embodiment. FIG. 11 is a diagram illustrating an example of a route of a worker displayed on a display device of an information terminal according to an embodiment. FIG. 12 is a diagram illustrating an example of a route of a worker displayed on a display device of an information terminal according to an embodiment. FIG. 13 is a diagram illustrating an example of a route of a worker displayed on a display device of an information terminal according to an embodiment. FIG. 14 is a diagram for explaining a method for specifying a completed position according to an embodiment. FIG. 15 is a flowchart illustrating a method for supporting a worker according to an embodiment. FIG. 16 is a diagram illustrating an example of management data displayed on a display device of an information terminal according to an embodiment. Fig. 17 is a flowchart showing a method for processing plant body data according to an embodiment. Fig. 18 is a diagram showing an example of a real image and an AR image displayed on a display device of an information terminal according to an embodiment. Fig. 19 is a flowchart showing a method for generating display data including an AR image according to an embodiment. Fig. 20 is a diagram schematically showing AR glasses according to an embodiment. Fig. 21 is a diagram showing an example of a real image and an AR image displayed on a display device of the AR glasses according to an embodiment.

[0012] [Afforestation System] FIG. 1 is a diagram schematically illustrating an afforestation system 1 according to an embodiment. The afforestation system 1 manages afforestation work. The afforestation system 1 supports afforestation work. The afforestation work includes permanent planting work and supplementary planting work. Permanent planting refers to planting a plant body in soil. Supplementary planting refers to planting a new plant body in the soil where the plant body was planted in the permanent planting work. For example, if a plant body planted in the permanent planting work dies, supplementary planting may include planting a new plant body in the position of the dead plant body. A seedling is exemplified as the plant body. In the following description, the plant body will be referred to as a seedling 8 as appropriate.

[0013] The afforestation system 1 includes a server 2, an afforestation machine 3, an information terminal 4, and a mobile object 9. The server 2 includes a computer. The afforestation machine 3 operates in an afforestation area 11 (see FIG. 6 ) where afforestation work is carried out. The afforestation machine 3 plants seedlings 8 in the soil of the afforestation area 11. The server 2 is disposed outside the afforestation machine 3. The server 2 may be disposed inside or outside the afforestation area 11. In the embodiment, the server 2 is disposed in a remote location from the afforestation area 11. The information terminal 4 is carried by a worker 100 engaged in afforestation work. In the embodiment, the information terminal 4 is a tablet terminal. Note that the information terminal 4 may be a smartphone or a laptop personal computer. The mobile object 9 moves within the afforestation area 11. In the embodiment, the mobile object 9 is an unmanned aerial vehicle (UAV) such as a drone. The mobile object 9 flies above the afforestation area 11.

[0014] The server 2, the reforestation machine 3, the information terminal 4, and the mobile object 9 communicate with each other via a communication system 5. The communication system 5 includes at least one of a mobile phone communication line, an internet communication line, and a communication satellite line.

[0015] The workers 100 include a manager 101 of the reforestation area 11 and workers 102 performing reforestation work. The manager 101 supervises the workers 102.

[0016] The afforestation machine 3 performs permanent planting work. The worker 102 performs supplementary planting work. The worker 102 carries a portable afforestation tool 6 called a hand planter. The worker 102 performs supplementary planting work using the afforestation tool 6. The worker 102 carries a basket 7 containing a plurality of seedlings 8. When performing supplementary planting work, the worker uses the afforestation tool 6 to take out the seedlings 8 from the basket 7 and plant them in soil.

[0017] 2 is a perspective view showing the afforestation machine 3 according to an embodiment. The afforestation machine 3 plants seedlings 8 in the soil of the afforestation area 11. The afforestation machine 3 has a vehicle body 31, a traveling device 32, a planting device 33, a controller 34, and a position sensor 35.

[0018] The vehicle body 31 is disposed above the traveling device 32. The traveling device 32 supports the vehicle body 31. The traveling device 32 travels in the reforestation area 11. The traveling device 32 includes a pair of tracks that rotate using power generated by an engine. The traveling device 32 may also include wheels.

[0019] The planting device 33 plants the seedlings 8 in the soil. The planting device 33 is disposed forward of the vehicle body 31. The planting device 33 has an arm 36, a frame 37, a hydraulic cylinder 38, and multiple planting units 39. In this embodiment, three planting units 39 are provided at intervals in the vehicle width direction of the vehicle body 31. The arm 36 is attached to the frame of the traveling device 32 and supports the planting device 33 so that it can be raised and lowered. The frame 37 is attached to the tip of the arm 36 and supports the multiple planting units 39. The hydraulic cylinder 38 is disposed between the front of the vehicle body 31 and the frame 37 and raises and lowers the frame 37 by extending and retracting.

[0020] The planting section 39 includes a plant body holding section 39A, a main body section 39B, and an expandable section 39C. The plant body holding section 39A is provided on the upper part of the main body section 39B. The main body section 39B is attached to the frame 37. The expandable section 39C protrudes downward from the lower part of the main body section 39B.

[0021] The plant body holding unit 39A holds the seedling 8. The main body unit 39B removes the seedling 8 from the plant body holding unit 39A and sends it to the extension unit 39C. The extension unit 39C extends in the vertical direction while holding the seedling 8, and plants the seedling 8 in the soil. The extension unit 39C extends and contracts using, for example, a hydraulic cylinder. By extending and contracting the extension unit 39C, the seedling 8 can be planted in the soil even if the soil is not flat and the distance between the main body unit 39B and the soil changes.

[0022] The controller 34 includes a computer. The controller 34 outputs control signals to control the traveling device 32 and the planting device 33. The controller 34 communicates with the server 2 via the communication system 5.

[0023] The position sensor 35 detects the position of the reforestation machine 3. The position of the reforestation machine 3 is detected using a global navigation satellite system (GNSS). The global navigation satellite system includes a global positioning system (GPS). The global navigation satellite system detects the position of the reforestation machine 3 in a global coordinate system defined by coordinate data of latitude, longitude, and altitude. The global coordinate system is a coordinate system fixed to the Earth. The position sensor 35 includes a GNSS receiver and detects the position of the reforestation machine 3 in the global coordinate system.

[0024] In the embodiment, the position sensor 35 is provided on the vehicle body 31. The position sensor 35 detects the position of the vehicle body 31. The detection data of the position sensor 35 is transmitted to the controller 34. The controller 34 can calculate a planting position indicating the position of the seedling 8 planted in the soil of the afforestation area 11 based on the detection data of the position sensor 35 and the time when the planting device 33 planted the seedling 8 in the soil. The position sensor 35 detects the position of the position sensor 35 (its own position). The relative position of the position sensor 35 and the planting device 33 is known data derived from the design data or specification data of the afforestation machine 3. The controller 34 can calculate the planting position of the seedling 8 based on the detection data of the position sensor 35, the known data of the relative position of the position sensor 35 and the planting device 33, and the time when the planting device 33 planted the seedling 8 in the soil. The controller 34 transmits the planting position of the seedling 8 to the server 2. Note that the position sensor 35 may be disposed in the planting device 33. The controller 34 can calculate the planting position of the seedling 8 based on the detection data of the position sensor 35 that detects the position of the planting device 33 and the time when the planting device 33 plants the seedling 8 in the soil.

[0025] [Server] FIG. 3 is a hardware configuration diagram showing a server 2 according to an embodiment. The server 2 includes a computer 10. The server 2 includes a processor 10A such as a central processing unit (CPU), a main memory 10B including a nonvolatile memory such as a read-only memory (ROM) and a volatile memory such as a random access memory (RAM), a storage device 10C such as a hard disk or semiconductor memory, an input / output interface 10D including an input / output circuit, and a communication interface 10E including a communication circuit. The functions of the processor 10A are stored in the storage device 10C as a computer program 10F. The processor 10A reads the computer program 10F from the storage device 10C, loads it into the main memory 10B, and executes processing in accordance with the computer program 10F. The computer program 10F may be distributed to the server 2 via a network.

[0026] The controller 34 of the reforestation machine 3 also includes a computer. A controller 41 of the information terminal 4 (see FIGS. 4 and 5) and a controller 91 of the mobile object 9 (see FIG. 4), which will be described later, also include a computer. Like the server 2, the controller 34 of the reforestation machine 3, the controller 41 of the information terminal 4, and the controller 91 of the mobile object 9 each have a processor, a main memory, a storage, an input / output interface, and a communication interface.

[0027] 4 is a functional block diagram showing the reforestation system 1 according to the embodiment. The server 2 has a plurality of functional units. The functional units of the server 2 include a planting position acquisition unit 21, a captured image acquisition unit 22, a supplementary planting position identification unit 23, a work area setting unit 24, an input data acquisition unit 25, and a display data generation unit 26. The functions of the functional units of the server 2 are performed by a processor 10A. The server 2 also has a memory unit 27. The functions of the memory unit 27 of the server 2 are performed by a storage 10C.

[0028] The reforestation machine 3 has a controller 34 and a position sensor 35. The information terminal 4 has a controller 41, an input device 42, a display device 43, a camera 44, and a sensor system 48. The sensor system 48 includes a position sensor 45 and a motion sensor 47. The mobile object 9 has a controller 91, a camera 92, and a position sensor 93.

[0029] The controller 41 of the information terminal 4 communicates with the server 2 via the communication system 5. The input device 42 generates input data when operated by the worker 100. Examples of the input device 42 include a touch panel, a button, and a computer keyboard. The display device 43 displays display data. The display device 43 provides the display data to the worker 100. Examples of the display device 43 include a flat panel display such as a liquid crystal display or an organic EL display. The camera 44 captures images of at least the afforestation area 11. The position sensor 45 includes a GNSS receiver and detects the position of the information terminal 4 in the global coordinate system. By detecting the position of the information terminal 4, the position of the display device 43 in the global coordinate system is detected. The motion sensor 47 detects movement of the information terminal 4. Examples of the motion sensor 47 include an inertial sensor (IMU), an acceleration sensor, and a gyro sensor.

[0030] The controller 91 of the mobile object 9 communicates with the server 2 via the communication system 5. The camera 92 is mounted on the mobile object 9. The camera 92 captures images of at least the afforestation area 11. The camera 92 captures images of the afforestation area 11 from above the afforestation area 11. The position sensor 93 detects the position of the mobile object 9. The position sensor 93 includes a GNSS receiver and detects the position of the mobile object 9 in the global coordinate system. By detecting the position of the mobile object 9, the position of the camera 92 in the global coordinate system is detected.

[0031] The planting position acquisition unit 21 acquires the planting position indicating the position of the seedling 8 planted in the afforestation area 11 by the afforestation machine 3. As described above, the controller 34 of the afforestation machine 3 calculates the planting position of the seedling 8 based on the detection data of the position sensor 35 and the time when the planting device 33 planted the seedling 8 in the soil. The planting position acquisition unit 21 acquires the planting position of the seedling 8 from the controller 34 of the afforestation machine 3. Note that the detection data of the position sensor 35 that detected the position of the afforestation machine 3 and time data that indicates the time when the planting device 33 planted the seedling 8 in the soil may be transmitted from the controller 34 of the afforestation machine 3 to the server 2. The server 2 may calculate the planting position of the seedling 8 based on the detection data of the position sensor 35 that detected the position of the afforestation machine 3 and the time when the planting device 33 planted the seedling 8 in the soil.

[0032] The captured image acquisition unit 22 acquires captured images showing images of the afforestation area 11 captured by the camera 92. The controller 91 of the mobile object 9 transmits the captured images captured by the camera 92 to the server 2. The captured image acquisition unit 22 acquires the captured images from the controller 91 of the mobile object 9.

[0033] The controller 91 of the mobile object 9 calculates the position of the captured image in the global coordinate system based on the detection data of the position sensor 93. The controller 91 acquires the position of the captured image in the camera coordinate system defined by the camera 92. The controller 91 converts the position of the captured image in the camera coordinate system to the position of the captured image in the global coordinate system based on the detection data of the position sensor 93. The captured image acquisition unit 22 acquires the captured image, the position of which in the global coordinate system is defined, from the controller 91 of the mobile object 9.

[0034] The replacement planting position specifying unit 23 specifies a replacement planting position from a plurality of planting positions of the seedlings 8. The replacement planting position refers to a position where the seedling 8 should be planted. Replacement planting refers to planting a new seedling 8 in soil where the seedling 8 was planted in the planting work. For example, if the seedling 8 planted in the planting work dies, the replacement planting may include planting a new plant body at the position of the dead seedling 8. The replacement planting position may include a withered position where the withered seedling 8 is present. The replacement planting position specifying unit 23 acquires a replacement planting position that indicates a position where the seedling 8 should be planted in the afforestation area 11. The replacement planting position specifying unit 23 acquires a replacement planting position that indicates the position of the withered seedling 8 from a plurality of seedlings 8 planted in the afforestation area 11.

[0035] Furthermore, the replanting position specifying unit 23 specifies a survival position from the multiple planting positions of the seedlings 8. A survival position is a position where a seedling 8 is not replanted. In other words, a survival position is a position where a seedling 8 that has not died is planted. The replanting position specifying unit 23 acquires a survival position that indicates the position of a seedling 8 that has not died from the multiple seedlings 8 planted in the reforestation area 11.

[0036] The replanting position specifying unit 23 determines whether the seedling 8 planted at the permanent planting position is dead or not, based on the captured image of the afforestation area 11 acquired by the captured image acquisition unit 22. The memory unit 27 pre-stores a reference image showing at least one of an image of a dead seedling 8 and an image of a non-dead seedling 8. The replanting position specifying unit 23 can compare the reference image with the captured image to determine whether the seedling 8 planted at the permanent planting position is dead or not. The replanting position specifying unit 23 can specify the survival position and the replacement planting position by determining whether the seedling 8 planted at the permanent planting position is dead or not.

[0037] In the embodiment, the withering of a seedling 8 includes the absence of the seedling 8 at the position where it should be planted. For example, a malfunction of the reforestation machine 3 may cause the seedling 8 to be unintentionally unplanted. Furthermore, after the seedling 8 is planted at the planting position, for example, an animal may remove the seedling 8 from the planting position. The replanting position specifying unit 23 also determines that the seedling 8 is withered when the seedling 8 is unintentionally absent from the planting position. Furthermore, the withering of a seedling 8 includes a situation where it is difficult for the planted seedling 8 to grow. After the seedling 8 is planted at the planting position, it may be run over by a vehicle tire or submerged in a puddle, for example, and the seedling 8 may not die, but the growth of the seedling 8 may become difficult. The replanting position specifying unit 23 also determines that the seedling 8 is withered when the growth of the seedling 8 is difficult.

[0038] The work area setting unit 24 sets the work area (see FIG. 11 ) of the worker 102 who will replant at the replanting position in the reforestation area 11 .

[0039] The input data acquisition unit 25 acquires plant body data related to the seedling 8 at the replacement planting position. The input data acquisition unit 25 acquires plant body data related to the dead seedling 8 at the replacement planting position. The worker 100 operates the information terminal 4 to input the plant body data. The information terminal 4 generates the plant body data when operated by the worker 100. The plant body data includes image data of the dead seedling 8 captured by the camera 44. The plant body data includes text data related to the dead seedling 8 input from the input device 42. The input data acquisition unit 25 acquires the plant body data from the information terminal 4 via the communication system 5.

[0040] The display data generation unit 26 generates display data to be displayed on the display device 43 of the information terminal 4. The display data generated by the display data generation unit 26 is transmitted to the information terminal 4. The controller 41 of the information terminal 4 causes the display data transmitted from the display data generation unit 26 to be displayed on the display device 43.

[0041] 5 is a functional block diagram showing an information terminal 4 according to an embodiment. The information terminal 4 has a plurality of functional units. The functional units of the information terminal 4 include a reforestation position acquisition unit 411, a work area acquisition unit 412, a path calculation unit 413, a completion position identification unit 414, a real image acquisition unit 415, an augmented reality processing unit 416, and a display control unit 417. The functions of the functional units of the information terminal 4 are exerted by the processor of the controller 41.

[0042] The planting position acquisition unit 411 acquires the survival position and the replanting position of the seedling 8 identified by the replanting position identification unit 23. The planting position acquisition unit 411 acquires the survival position and the replanting position of the seedling 8 from the replanting position identification unit 23 of the server 2 via the communication system 5.

[0043] The work area acquisition unit 412 acquires the work area of ​​the worker 102 set by the work area setting unit 24. The work area acquisition unit 412 acquires the work area of ​​the worker 102 from the work area setting unit 24 of the server 2 via the communication system 5.

[0044] The route calculation unit 413 calculates the route of the worker 102 who will replant the seedlings 8 at each of the multiple replanting positions based on the replanting positions of the seedlings 8 acquired by the planting position acquisition unit 411.

[0045] The completion position specifying unit 414 specifies a completion position that indicates a planting position where planting of a seedling 8 has been completed among the plurality of planting positions. The completion position specifying unit 414 specifies an incomplete position that indicates a planting position where planting of a seedling 8 has not been completed among the plurality of planting positions. The completion position specifying unit 414 can specify a completion position based on detection data from the position sensor 45.

[0046] The real image acquisition unit 415 acquires a real image showing an image of the afforestation area 11 captured by the camera 44 .

[0047] The augmented reality processing unit 416 generates an augmented reality image to support tree planting work in the tree planting area 11 .

[0048] The display control unit 417 controls the display device 43. The display control unit 417 causes the display device 43 to display the display data generated by the display data generation unit 26 of the server 2. The display control unit 417 can generate display data to be displayed on the display device 43.

[0049] [Afforestation Area and Storage Area] Figure 6 is a diagram schematically showing an afforestation area 11 and a storage area 12 according to the embodiment. As shown in Figure 6, an afforestation area 11 in which seedlings 8 are planted is set. The area of ​​the afforestation area 11 is, for example, 10 hectares or more. The afforestation machine 3 plants the seedlings 8 in the afforestation area 11.

[0050] A storage area 12 is provided around at least a portion of the periphery of the reforestation area 11, where seedlings 8 for replanting are placed. Baskets 7 containing a plurality of seedlings 8 are stored in the storage area 12. When a worker 102 is to perform replanting work, the worker 102 carries the basket 7 stored in the storage area 12 and then moves to the replanting position. After moving to the replanting position, the worker 102 takes the seedling 8 out of the basket 7 and plants it at the replanting position using a reforestation tool 6.

[0051] 7 is a flowchart showing a method for determining the withering or dying of a seedling 8 according to an embodiment. Planting work is carried out by the afforestation machine 3 in the afforestation area 11. The planting position acquisition unit 21 acquires planting positions indicating the positions of the seedlings 8 planted in the afforestation area 11 by the afforestation machine 3. The planting positions acquired by the planting position acquisition unit 21 are stored in the memory unit 27 (step SA1).

[0052] After a predetermined period of time has elapsed since the planting work, the mobile object 9 flies over the afforestation area 11 and the camera 92 takes an image of the afforestation area 11. The camera 92 takes an image of the afforestation area 11, for example, one week to one year after the planting work. As an example, the camera 92 takes an image of the afforestation area 11 15 days after the planting work.

[0053] The captured image acquisition unit 22 acquires a captured image showing an image of the afforestation area 11 captured by the camera 92 (step SA2).

[0054] The replanting position specifying unit 23 determines whether the seedlings 8 are dead or not based on the captured image of the afforestation area 11 acquired by the captured image acquiring unit 22. The replanting position specifying unit 23 determines whether the seedlings 8 are dead or not based on the captured image of the afforestation area 11 and a reference image showing an image of at least one of dead and non-dead seedlings 8 (step SA3).

[0055] After the planting work is carried out, some of the seedlings 8 planted in the planting work may wither and die due to weather, pests such as ants, the surrounding natural environment, soil conditions, etc. Also, as described above, there is a possibility that the seedlings 8 are not intentionally present at the planting position. There is a possibility that the seedlings 8 are in a difficult condition to grow. After a predetermined period of time has elapsed since the planting work, it is determined whether the seedlings 8 have withered or died.

[0056] The replanting position specifying unit 23 may determine whether the seedling 8 is dead or not by, for example, a template matching technique. The replanting position specifying unit 23 may determine whether the seedling 8 is dead or not based on an artificial intelligence (AI) algorithm. In the embodiment, a trained model that receives an image of the afforestation area 11 as an input and outputs a result of determining whether the seedling 8 is dead or not is stored in the storage unit 27 in advance. The replanting position specifying unit 23 uses the trained model stored in the storage unit 27 to determine whether the seedling 8 is dead or not.

[0057] FIG. 8 is a diagram illustrating a method for generating a trained model according to an embodiment. In the embodiment, a trained model is generated by supervised machine learning. As shown in FIG. 8 , in the learning stage of machine learning, multiple training images of seedlings 8 are input to the learning device 20. The training images are an example of reference images. The training images of seedlings 8 include training images of seedlings 8 that are not dead and training images of seedlings 8 that are dead. The training images of seedlings 8 are assigned the state of death of the seedlings 8 as a correct answer label. The training images of the not dead seedlings 8 are assigned the label "not dead seedling" as a correct answer label. The training images of the dead seedlings 8 are assigned the label "dead seedling" as a correct answer label. The learning device 20 performs supervised machine learning on the training images to generate a trained model that uses the captured image as an input and outputs the result of determining the death of the seedlings 8. The trained model generated by the learning device 20 is stored in the memory unit 27. The learning device 20 may be a functional part of the server 2 or may be realized by a computer different from the server 2 .

[0058] The replanting position specifying unit 23 determines whether the seedlings 8 planted in the afforestation area 11 are dead or withered, using the trained model generated by the learning device 20. The captured images of the seedlings 8 acquired by the captured image acquiring unit 22 are input to the trained model. The replanting position specifying unit 23 inputs the captured images of the seedlings 8 acquired by the captured image acquiring unit 22 to the trained model as input data. By inputting the captured images of the seedlings 8 to the trained model, the result of determining whether the seedlings 8 are withered or withered is output as output data.

[0059] The supplementary planting position specifying unit 23 determines whether each of the plurality of seedlings 8 planted in the reforestation area 11 is dead or not (step SA4).

[0060] The replacement planting position specifying unit 23 specifies a replacement planting position from among the multiple planting positions based on the result of the withering determination of the seedling 8 (step SA5). As described above, the replacement planting position indicates the position of the withered seedling 8. The replacement planting position specifying unit 23 specifies the planting position of the seedling 8 determined to be withered as the replacement planting position.

[0061] The replanting position specifying unit 23 specifies a survival position from among the multiple planting positions based on the result of the withering determination of the seedling 8 (step SA6). As described above, the replanting position indicates the position of a seedling 8 that is not withered. The replanting position specifying unit 23 specifies the planting position of the seedling 8 that is determined to be not withered as a survival position.

[0062] The display data generation unit 26 generates display data including the result of the withering determination of the seedling 8 by the replanting position identification unit 23 (step SA7). In the embodiment, the display data generation unit 26 generates the display data based on the replanting position and the survival position identified by the replanting position identification unit 23. The display data generated by the display data generation unit 26 is transmitted to the information terminal 4. The controller 41 of the information terminal 4 causes the display device 43 to display the display data transmitted from the display data generation unit 26.

[0063] FIG. 9 is a diagram showing an example of display data displayed on the display device 43 of the information terminal 4 according to the embodiment. The display data displayed on the display device 43 includes symbols 15 indicating the results of the withering determination of the seedlings 8 by the replanting position identification unit 23. In the embodiment, the symbols 15 are circular (dot-like) images. The symbols 15 include a surviving position symbol 151 indicating a seedling 8 determined to be alive and a replanting position symbol 152 indicating a seedling 8 determined to be dead. The surviving position symbol 151 is displayed at the surviving position of the seedling 8. The replanting position symbol 152 is displayed at the replanting position of the seedling 8. The surviving position symbol 151 indicates the surviving position. The replanting position symbol 152 indicates the replanting position. The surviving position symbol 151 indicates the position of a seedling 8 that is alive. The replanting position symbol 152 indicates the position of a dead seedling 8. The display form of the surviving position symbol 151 and the display form of the replanting position symbol 152 are different. In this embodiment, the survival location symbol 151 is displayed in a first color (e.g., green), and the transplant location symbol 152 is displayed in a second color (e.g., red).

[0064] The symbol 15 is displayed on the display device 43 together with the captured image taken by the camera 92. The symbol 15 is superimposed on the captured image taken by the camera 92. The display data generation unit 26 generates display data in which the survival position symbol 151 and the replanting position symbol 152 are superimposed on the captured image. The display data generation unit 26 superimposes the survival position symbol 151 on a seedling 8 determined to be alive, and superimposes the replanting position symbol 152 on a seedling 8 determined to be dead, in the captured image. In other words, the display data generation unit 26 superimposes the survival position symbol 151 on a survival position, and the replanting position symbol 152 on a replanting position, in the captured image.

[0065] Display data including the results of the withering and dying assessment of the seedlings 8 is generated, allowing the worker 102 to efficiently carry out the replanting work by checking the display data. A replanting position symbol 152 indicating the replanting position is displayed on the display device 43, allowing the worker 102 to efficiently carry out the replanting work by checking the display device 43.

[0066] FIG. 10 is a diagram illustrating an example of display data displayed on the display device 43 of the information terminal 4 according to the embodiment. As illustrated in FIG. 10 , the display device 43 of the information terminal 4 displays a symbol 15 indicating the result of the determination of the withering or dying seedlings 8 by the replanting position identification unit 23, superimposed on an image of the afforestation area 11 captured by the camera 92. In the example illustrated in FIG. 10 , tapping the first button 18A displayed in the upper left corner of the display screen of the display device 43 displays a survival position symbol 151, and tapping the second button 18B displays a replanting position symbol 152. The first button 18A and the second button 18B are examples of the input device 42. That is, the display data generation unit 26 can generate display data in which the survival position symbol 151, indicating the position of a surviving seedling 8, is superimposed on the captured image of the afforestation area 11, based on input data from the input device 42. The display data generation unit 26 can generate display data in which a replacement planting position symbol 152 indicating the position of a dead seedling 8 is superimposed on a captured image of the reforestation area 11 based on input data from the input device 42.

[0067] 10 shows an example in which the implantation position symbol 152 is superimposed on the captured image, and the survival position symbol 151 is not displayed. When the first button 18A is tapped, the survival position symbol 151 is superimposed on the captured image. When both the first button 18A and the second button 18B are tapped, both the survival position symbol 151 and the implantation position symbol 152 are superimposed on the captured image.

[0068] In the embodiment, the supplementary planting position specifying unit 23 calculates a mortality rate indicating the proportion of seedlings 8 that have died in the afforestation area 11, a surviving number indicating the total number of seedlings 8 that have not died in the afforestation area 11, and a dead number indicating the total number of seedlings 8 that have died in the afforestation area 11. The mortality rate refers to the proportion of dead seedlings 8 among the multiple seedlings 8 planted in the afforestation area 11 by planting work. The surviving number, indicating the total number of surviving seedlings 8 that have not died, is equal to the number of surviving positions specified by the supplementary planting position specifying unit 23. The dead number, indicating the total number of dead seedlings 8, is equal to the number of supplementary planting positions specified by the supplementary planting position specifying unit 23. The display data displayed on the display device 43 includes the mortality rate, the dead number, and the surviving number. In the example shown in FIG. 10 , numerical data 19A indicating the mortality rate, numerical data 19B indicating the dead number, and numerical data 19C indicating the surviving number are displayed at the top of the display screen of the display device 43.

[0069] [Route of worker performing replanting work] The route calculation unit 413 calculates the route of the worker 102 performing replanting work. The route calculation unit 413 calculates the route of the worker 102 who replants seedlings 8 at each of a plurality of replanting positions based on the replanting positions identified by the replanting position identification unit 23. The route calculation unit 413 calculates the route of the worker 102 based on the replanting positions acquired by the planting position acquisition unit 411 from the replanting position identification unit 23. The display control unit 417 generates display data including the route of the worker 102 calculated by the route calculation unit 413 and displays the data on the display device 43.

[0070] FIG. 11 is a diagram illustrating an example of a route of the worker 102 displayed on the display device 43 of the information terminal 4 according to the embodiment. In the example illustrated in FIG. 11 , the display data displayed on the display device 43 includes multiple planting position symbols 152 indicating planting positions, a work area image 17 indicating the work area set for the worker 102, a worker symbol 14 indicating the position of the worker 102 detected by the position sensor 45, and a route image 16 indicating the route of the worker 102. In the embodiment, the work area image 17 is a linear image along the outer edge of the work area. The route image 16 is, for example, an arrow-shaped image indicating the route and direction of travel of the worker 102. The route image 16 is an image showing a recommended route and recommended direction of travel that will allow the worker 102 to work efficiently by proceeding with the planting work along that route. The route image 16 is displayed, for example, so as to connect adjacent planting position symbols 152. The worker symbol 14 is a circular (dot-like) image.

[0071] The display data displayed on the display device 43 includes a start point symbol 152S indicating the start point of the path and an end point symbol 152E indicating the end point of the path. The start point of the path is set to one of the multiple planting positions belonging to the work area. The end point of the path is set to one of the multiple planting positions belonging to the work area. The path image 16 is displayed connecting the start point symbol 152S to the end point symbol 152E.

[0072] 11 , the display control unit 417 causes the display device 43 to display display data in which a planting position symbol 152 indicating the planting position and a worker symbol 14 indicating the position of the worker 102 are superimposed on a route image 16 indicating the route. The display control unit 417 may also cause the display device 43 to display display data in which the worker symbol 14 and the route image 16 are superimposed on an image (orthoimage) captured by the camera 92.

[0073] The display control unit 417 can display a supplementary planting position symbol 152 based on the supplementary planting position that the planting position acquisition unit 411 has acquired from the supplementary planting position identification unit 23. The display control unit 417 can display a work area image 17 based on the work area that the work area acquisition unit 412 has acquired from the work area setting unit 24. The display control unit 417 can display a worker symbol 14 based on detection data from the position sensor 45 of the information terminal 4. The information terminal 4 is carried by the worker 102. Therefore, the position of the information terminal 4 detected by the position sensor 45 can be considered to be the position of the worker 102.

[0074] The work area setting unit 24 sets the work areas so that one work area includes multiple supplementary planting positions. The work area setting unit 24 sets multiple work areas in the reforestation area 11. Multiple workers 102 are assigned to each of the multiple work areas set by the work area setting unit 24. The workers 102 plant seedlings 8 at the supplementary planting positions in their assigned work areas.

[0075] The work area setting unit 24 can set a work area based on input data from the input device 42 of the information terminal 4. The work area setting unit 24 can set a work area based on input data from the input device 42 operated by, for example, the manager 101. The manager 101 operates the input device 42 of the information terminal 4 so as to set multiple work areas in the tree planting area 11. The manager 101 operates the input device 42 while checking the tree planting area 11 displayed on the display device 43 of the information terminal 4. If the input device 42 includes a touch panel disposed on the display screen of the display device 43, the manager 101 operates the touch panel to draw the outline of the work area with an input tool such as a finger or a pen while checking the tree planting area 11 displayed on the display device 43. By operating the touch panel, the manager 101 can set a work area of ​​any size and shape at any position in the tree planting area 11. The manager 101 may operate the touch panel so that the number of supplementary planting positions in each of the multiple work areas is uniform, or so that the size (area) of each of the multiple work areas is uniform. Input data generated by operating the input device 42 is transmitted from the information terminal 4 of the administrator 101 to the server 2. The work area setting unit 24 sets a work area based on the input data from the input device 42 of the information terminal 4. The display control unit 417 displays a work area image 17 based on the work area set by the work area setting unit 24.

[0076] The work area setting unit 24 may set the work areas based on a specified algorithm. The work area setting unit 24 may set the work areas so that the number of implantation positions belonging to each of the plurality of work areas is uniform.

[0077] The work area setting unit 24 may determine the number of replacement planting positions belonging to each of the multiple work areas based on the distance from the storage area 12 to the work area. The work area setting unit 24 may set the work areas such that the number of replacement planting positions belonging to a work area decreases as the distance from the storage area 12 to the work area increases. In other words, the work area setting unit 24 may set the work areas such that the number of replacement planting positions belonging to a work area increases as the distance from the storage area 12 to the work area decreases. As described above, when performing replacement planting work, the worker 102 picks up the basket 7 stored in the storage area 12 and then moves to the replacement planting position. Because the afforestation area 11 is vast, the worker 102 assigned to a work area that is far from the storage area 12 must travel a long distance from the storage area 12 to the work area. By assigning a work area with a small number of replacement planting positions to the worker 102 who needs to travel a long distance, the burden on the multiple workers 102 is evened out.

[0078] The work area setting unit 24 may determine the number of planting positions belonging to each of the multiple work areas based on the number of seedlings 8 that the worker 102 can carry out from the storage area 12 at one time and the distance from the storage area 12 to the work area. The worker 102 carries the seedlings 8 contained in the baskets 7 out of the storage area 12 and moves them to the assigned work area. The number of seedlings 8 that can be held in a basket 7 is finite. Also, the number of baskets 7 that the worker 102 can carry out at one time is finite. If the number of planting positions belonging to a work area is greater than the number of seedlings 8 that can be held in a basket 7, the worker 102 needs to plant all of the seedlings 8 held in the baskets 7 and then go to the storage area 12 to retrieve new baskets 7 (seedlings 8). In other words, if the number of planting positions belonging to a work area is greater than the number of seedlings 8 that can be held in a basket 7, the worker 102 needs to travel back and forth between the storage area 12 and the work area. When setting a work area whose distance from the storage area 12 is greater than a predetermined distance threshold, the work area setting unit 24 sets the work area so that the number of replacement planting positions belonging to the work area is less than the number of seedlings 8 that can be accommodated in the basket 7. By setting the work area so that the number of replacement planting positions belonging to a work area that is a long distance from the storage area 12 is less than the number of seedlings 8 that can be accommodated in the basket 7, workers 102 assigned to work areas that are a long distance from the storage area 12 do not have to travel a long distance back and forth between the storage area 12 and the work area. When setting a work area whose distance from the storage area 12 is equal to or less than the distance threshold, the work area setting unit 24 sets the work area so that the number of replacement planting positions belonging to the work area is greater than the number of seedlings 8 that can be accommodated in the basket 7. Although workers 102 assigned to work areas that are a short distance from the storage area 12 must travel back and forth between the storage area 12 and the work area, the distance traveled back and forth is short. This evens out the burden on multiple workers 102.

[0079] The work area setting unit 24 may set work areas based on the proficiency levels of multiple workers 102. Proficiency data indicating the proficiency levels of the workers 102 is pre-stored in the storage unit 27. The work area setting unit 24 may set work areas based on the proficiency data stored in the storage unit 27. Proficiency levels include the speed of replanting work. The work area setting unit 24 may set work areas such that the number of replanting positions belonging to a work area assigned to a highly skilled worker 102 is large.

[0080] The path calculation unit 413 calculates a path for the worker 102 assigned to a work area including a plurality of replanting positions. The path calculation unit 413 can calculate the path using a known algorithm.

[0081] The path calculation unit 413 may determine the start point of the path based on the current position of the worker 102 detected by the position sensor 45. For example, the path calculation unit 413 may determine the planting position closest to the current position of the worker 102 as the start point of the path.

[0082] The path calculation unit 413 may determine one or both of the start and end points of the path based on the location of the work area and the location of the storage area 12. As described above, when performing replanting work, the worker 102 picks up the basket 7 stored in the storage area 12 and then moves to the replanting position. Furthermore, if the number of replanting positions belonging to the work area is greater than the number of seedlings 8 that can be accommodated in the basket 7, the worker 102 will need to travel back and forth between the storage area 12 and the work area. For example, the path calculation unit 413 may determine, among multiple replanting positions belonging to the work area, a first replanting position that is closest to the storage area 12 in the work area as the start point of the path, and may determine a second replanting position that is next closest to the storage area 12 after the first replanting position as the end point of the path.

[0083] The path calculation unit 413 may calculate a path that connects multiple replacement planting positions in one work area by the shortest distance. In other words, the path calculated by the path calculation unit 413 may be the shortest path when the worker 102 replaces the seedlings 8 at each of the multiple replacement planting positions in the work area.

[0084] The path calculation unit 413 may calculate the path based on the topography of the work area. The path calculation unit 413 may calculate the path based on the topography of the work area so that the inclination angle of the path along which the worker 102 travels is equal to or less than a predetermined angle threshold. When calculating a path to guide the worker 102 from a first replacement planting position to a second replacement planting position, the path calculation unit 413 may calculate the path based on the topography of the work area so that the difference in elevation between the first replacement planting position and the second replacement planting position is equal to or less than a predetermined height threshold.

[0085] The worker 102 moves according to the route image 16 displayed on the display device 43, and sequentially plants seedlings 8 at each of the plurality of replanting positions. As the worker 102 moves, the worker symbol 14 moves on the display screen of the display device 43. The worker 102 moves through the work area so that the worker symbol 14 moves along the route image 16. The worker 102 can efficiently perform replanting work while moving according to the route image 16 displayed on the display device 43.

[0086] FIG. 12 is a diagram illustrating an example of a worker's route displayed on the display device 43 of the information terminal 4 according to the embodiment. As illustrated in FIG. 12 , the worker symbol 14 moves as the worker 102 moves. In the embodiment, the completion position identification unit 414 identifies, among multiple planting positions belonging to the work area, completed positions indicating planting positions where planting of seedlings 8 has been completed and incomplete positions indicating planting positions where planting of seedlings 8 has not been completed. The display control unit 417 generates display data including the completed positions and the incomplete positions and displays the data on the display device 43. As illustrated in FIG. 12 , the display control unit 417 generates display data including a completed symbol 1522 indicating a completed position and an incomplete symbol 1521 indicating an incomplete position. In the example illustrated in FIG. 12 , the incomplete symbol 1521 has the same display format as the planting position symbol 152. The completed symbol 1522 is a symbol obtained by changing the color of the planting position symbol 152. As shown in FIG. 12, the display control unit 417 generates display data including a completed symbol 1522, an incomplete symbol 1521, and a path image 16 showing a path.

[0087] In the embodiment, the path calculation unit 413 determines a recommended planting position for the next planting work from among multiple planting positions based on the current position of the worker 102 detected by the position sensor 45. The display control unit 417 displays the recommended planting position in a display format different from that of the other planting positions. The display control unit 417 highlights the planting position where the worker 102 should next plant a tree. In the example shown in FIG. 12 , a planting position symbol 152 indicating the planting position recommended for the next planting work is highlighted by an emphasis image 70. In the example shown in FIG. 12 , the emphasis image 70 is a ring-shaped image surrounding the planting position symbol 152. The worker 102 can recognize the next planting position by checking the highlighted planting position symbol 152.

[0088] FIG. 13 is a diagram illustrating an example of a worker's route displayed on the display device 43 of the information terminal 4 according to the embodiment. There is a possibility that the worker 102 may deviate from the route. As shown in FIG. 13 , when the worker 102 deviates from the route, the worker symbol 14 deviates from the route image 16. In the embodiment, the route calculation unit 413 recalculates the route when it determines that the worker 102 has deviated from the route based on the position of the worker 102 detected by the position sensor 45. In the example shown in FIG. 13 , the route calculation unit 413 determines the closest uncompleted position from the current position of the worker 102 as the next planting position where planting work should be performed. The route calculation unit 413 calculates the route from the current position of the worker 102 to the next planting position where planting work should be performed. The display control unit 417 displays the route from the current position of the worker 102 to the next planting position where planting work should be performed. The display control unit 417 also highlights the next planting position where planting work should be performed using an emphasis image 70. The worker 102 who deviates from the route can return to the route to the replanting position by checking the display data displayed on the display device 43.

[0089] FIG. 14 is a diagram illustrating a method for identifying a completion position according to an embodiment. In this embodiment, the completion position identification unit 414 determines whether a determination condition that the worker 102 stays at the replanting position for a specified time or longer is satisfied based on detection data from the position sensor 45 that detects the position of the worker 102. The specified time is a predetermined time, for example, 10 to 20 seconds. If the completion position identification unit 414 determines that the determination condition is satisfied, it identifies the replanting position as the completion position. In other words, if the completion position identification unit 414 determines that the determination condition is satisfied, it determines that the seedling 8 has been replanted at the replanting position.

[0090] The worker 102 uses the tree planting tool 6 to plant the seedling 8 at the replacement planting position. It takes a certain amount of time from the start to the end of the planting work for one seedling 8. Furthermore, the position of the worker 102 (the position of the information terminal 4) does not substantially change during the period in which the planting work for one seedling 8 is being carried out. Therefore, the completion position specifying unit 414 can determine whether the seedling 8 has been planted at the replacement planting position by determining whether the worker 102 has stayed at the replacement planting position for a specified period of time or more, based on the detection data from the position sensor 45 that detects the position of the worker 102.

[0091] If the reforestation tool 6 is provided with a position sensor 61, the completion position specifying unit 414 may determine whether the seedling 8 has been replanted at the replanting position based on detection data from the position sensor 61. The position sensor 61 includes a GNSS receiver and detects the position of the reforestation tool 6. The detection data from the position sensor 61 is transmitted to the controller 41 of the information terminal 4. The position of the reforestation tool 6 does not substantially change during the period in which the reforestation work of one seedling 8 is being performed. The completion position specifying unit 414 determines whether a determination condition that the reforestation tool 6 has stayed at the reforestation position for a specified period of time or longer is satisfied based on the detection data from the position sensor 61 that detects the position of the reforestation tool 6. If the completion position specifying unit 414 determines that the determination condition is satisfied, it can specify the reforestation position as the completion position. The detection data from the position sensor 61 may be transmitted to the server 2.

[0092] In another embodiment, the tree planting tool 6 may have an operating member 62 that is operated when replanting the seedling 8. After the seedling 8 is stored in the space inside the tree planting tool 6 and the lower end of the tree planting tool 6 is inserted into the soil, the operating member 62 is operated to open the opening at the lower end of the tree planting tool 6 and plant the seedling 8 in the soil. An operation signal is generated by operating the operating member 62 and transmitted to the controller 41 of the information terminal 4. The completion position specifying unit 414 may specify the replanting position as the completion position based on the operation signal generated when the operating member 62 is operated. When the completion position specifying unit 414 determines that the tree planting tool 6 is located at the replanting position based on the detection data of the position sensor 45 or the position sensor 61, and then receives an operation signal from the operating member 62, the completion position specifying unit 414 may determine that the seedling 8 has been replanted at the replanting position. The operation signal may be transmitted to the server 2.

[0093] 15 is a flowchart showing a method for supporting the worker 102 according to the embodiment. The planting position acquisition unit 411 identifies a supplementary planting position from the supplementary planting position identification unit 23 of the server 2 (step SB1). The work area acquisition unit 412 acquires a work area from the work area setting unit 24 of the server 2 (step SB2).

[0094] The path calculation unit 413 calculates a path for the worker 102 assigned to a work area including multiple planting positions (step SB3). The display control unit 417 acquires detection data from the position sensor 45 that detects the position of the worker 102 (step SB4). As described with reference to FIG. 11 , the display control unit 417 displays on the display device 43 display data in which the planting position symbol 152 indicating the planting position and the worker symbol 14 indicating the position of the worker 102 detected by the position sensor 45 are superimposed on the path image 16 indicating the path.

[0095] The completion position identification unit 414 determines whether the condition that the worker 102 has stayed at the planting position for a specified period of time or longer is satisfied based on the detection data of the position sensor 45 that detects the worker's position (step SB5).

[0096] If it is determined in step SB5 that the determination condition is satisfied (step SB5: Yes), the completion position specifying unit 414 specifies the replanting position as the completion position (step SB6). As described with reference to FIG. 12 , the display control unit 417 changes the replanting position symbol 152 that satisfies the determination condition from the incomplete symbol 1521 to the completed symbol 1522.

[0097] If it is determined in step SB5 that the determination condition is not satisfied (step SB5: No), the completion position specifying unit 414 specifies the replanting position as an incomplete position. The display control unit 417 does not change the display form of the replanting position symbol 152 that does not satisfy the determination condition.

[0098] The display control unit 417 generates display data according to the determination result in step SB5 and displays it on the display device 43 (step SB7).

[0099] The path calculation unit 413 determines whether the worker 102 has deviated from the path based on the detection data of the position sensor 45 (step SB8). If it is determined in step SB8 that the worker 102 has deviated from the path (step SB8: Yes), the path calculation unit 413 recalculates the path based on the current position of the worker 102 detected by the position sensor 45. If it is determined in step SB8 that the worker 102 has not deviated from the path (step SB8: No), the path calculation unit 413 does not recalculate the path.

[0100] The completion position specifying unit 414 determines whether seedlings 8 have been planted at all of the planting positions in the work area. That is, the completion position specifying unit 414 determines whether the planting work in the work area is complete (step SB9). If it is determined in step SB9 that the planting work in the work area is not complete (step SB9: No), the process returns to step SB4. If it is determined that the planting work in the work area is complete (step SB9: Yes), support for the worker 102 performing the planting work in the work area ends.

[0101] [Recording and Display of Plant Data] In the embodiment, the afforestation system 1 records plant data related to a dead seedling 8 at the replacement planting position. As shown in Fig. 14 , the worker 102 who has moved to the replacement planting position can observe the dead seedling 8. The worker 102 collects plant data related to the dead seedling 8 at the replacement planting position.

[0102] The plant body data includes image data of the dead seedling 8 captured by the camera 44 of the information terminal 4. The worker 102 captures an image of the dead seedling 8 at the replanting position with the camera 44. The image data of the seedling 8 captured by the camera 44 is transmitted to the server 2 via the communication system 5.

[0103] The plant data also includes text data related to the dead seedling 8 input from the input device 42 of the information terminal 4. The text data includes observation results of the seedling 8. The worker 102 can operate the input device 42 to input text data indicating the observation results of the dead seedling 8 at the replanting position to the controller 41. The text data also includes the reason for the death of the seedling 8. As described above, the seedling 8 may die due to weather, pests such as ants, the surrounding natural environment, soil conditions, or the like. The worker 102 can operate the input device 42 to input text data indicating the reason for the death of the seedling 8 to the controller 41. The text data input from the input device 42 is transmitted to the server 2 via the communication system 5. The plant data may include identification numbers of each of the multiple seedlings 8. The plant data may be associated with the dead seedling 8 based on location data of the information terminal 4 at the time the plant data was input from the input device 42 of the information terminal 4.

[0104] The plant body data may be audio data or video data captured by a video camera.

[0105] As described above, the withering of the seedling 8 includes the unintentional absence of the seedling 8 at the planting position and a situation in which it is difficult for the seedling 8 to grow. The plant body data may be data relating to a replanting position where no seedling 8 is present. That is, the plant body data may include image data of the replanting position where no seedling 8 is present, captured by the camera 44 of the information terminal 4. Furthermore, if the seedling 8 has been run over by a vehicle tire or is submerged in a puddle, the plant body data may include image data of the tire marks or image data of the puddle.

[0106] In addition to the plant body data, position data indicating the position of the dead seedling 8 is transmitted from the information terminal 4 to the server 2 via the communication system 5. The position of the dead seedling 8 is the replanting position, and is detected by the position sensor 45.

[0107] The input data acquisition unit 25 of the server 2 acquires the plant data and position data related to the seedling 8 transmitted from the information terminal 4. The input data acquisition unit 25 stores in the memory unit 27 management data that associates the plant data with the replanting positions detected by the position sensor 45. The memory unit 27 stores a data group that includes a plurality of replanting positions and management data associated with each of the plurality of replanting positions. The management data stored in the memory unit 27 may be data that associates the dead seedling 8 with the plant data. For example, the memory unit 27 may store management data that associates identification information of the seedling 8 at the replanting position or a symbol corresponding to the seedling 8 with the plant data.

[0108] The display data generation unit 26 generates display data including the management data. The display data including the management data is distributed to each of the multiple information terminals 4. The display control unit 417 of the information terminal 4 can display the management data distributed from the server 2 on the display device 43. The worker 100 can check the management data displayed on the display device 43.

[0109] FIG. 16 is a diagram illustrating an example of management data displayed on the display device 43 of the information terminal 4 according to the embodiment. As illustrated in FIG. 16 , when management data for a certain planting position is stored (registered) in the memory unit 27, the display data generation unit 26 displays a registration symbol 71 indicating that the management data has been registered near a planting position symbol 152 indicating the planting position for which the management data has been registered. When the registration symbol 71 is tapped (selected), designation data specifying the planting position corresponding to the registration symbol 71 is generated. The registration symbol 71 is an example of an input device 42. As illustrated in FIG. 16 , the display control unit 417 displays plant data 72 associated with the specified planting position on the display device 43 based on the designation data specifying the planting position. In the example illustrated in FIG. 16 , the plant data 72 displayed on the display device 43 includes image data 73 of a seedling 8 present at the planting position, registration date data 74 indicating the registration date on which the plant data for the seedling 8 was stored (registered) in the memory unit 27, and text data 75 indicating the reason for the death of the seedling 8.

[0110] 17 is a flowchart showing a plant data processing method according to an embodiment. The planting position identification unit 23 identifies a planting position and transmits it to the first information terminal 4 (step SC1). The first information terminal 4 acquires the planting position from the server 2 (step SC2). The worker 102 moves to the planting position while checking the planting position symbol 152 displayed on the display device 43 of the first information terminal 4. After moving to the planting position, the worker 102 uses the camera 44 to capture an image of the dead seedling 8 at the planting position and operates the input device 42 to input text data including the reason for the seedling's death. Plant data including the image data of the seedling 8 captured by the camera 44 and the text data related to the seedling 8 input from the input device 42 are input to the controller 41 (step SC3). The plant data input to the controller 41 of the first information terminal 4 is transmitted to the server 2 via the communication system 5. The input data acquisition unit 25 of the server 2 stores the management data in which the supplementary planting position and the plant body data are associated in the storage unit 27 (step SC4).

[0111] The display data generation unit 26 of the server 2 generates display data including the management data stored in the storage unit 27 and distributes the display data to each of the plurality of information terminals 4 (step SC5). In the example shown in Fig. 17, the display data generation unit 26 distributes the display data including the management data to each of the first information terminal 4 and the second information terminal 4.

[0112] Each of the information terminals 4 acquires display data including the management data (step SC6). As described with reference to FIG. 16 , when the registration symbol 71 is tapped on the display screen of the display device 43, the plant body data 72 is displayed on the display device 43 (step SC7).

[0113] According to the embodiment, multiple workers 102 can share the management data. The management data can be viewed on each of multiple information terminals 4. If a display device is connected to the server 2, the worker 100 may view the management data via the display device connected to the server 2. If an input device is connected to the server 2, the worker 100 may register the management data in the storage unit 27 by operating the input device connected to the server 2.

[0114] [Augmented Reality Image] In the embodiment, the reforestation system 1 uses augmented reality (AR) to support the reforestation work of the worker 102. In the following description, augmented reality will be abbreviated as AR where appropriate.

[0115] As described above, the worker 102 performs supplementary planting work by operating the tree planting tool 6. When the worker 102 operates the tree planting tool 6, an AR image (augmented reality image) for supporting the supplementary planting work using the tree planting tool 6 is displayed on the display device 43 of the information terminal 4. The display device 43 displays a real image of the tree planting area 11 including the seedlings 8 superimposed on the AR image. By displaying the AR image superimposed on the real image, the tree planting work (supplementary planting work) of the worker 102 is supported, and the worker 102 can perform the tree planting work appropriately and efficiently.

[0116] 5 , the controller 41 of the information terminal 4 has a real image acquisition unit 415, an augmented reality processing unit 416, and a display control unit 417. The real image acquisition unit 415 acquires a real image of the afforestation area 11 captured by the camera 44. The augmented reality processing unit 416 generates an AR image (augmented reality image) to support afforestation work in the afforestation area 11. The display control unit 417 displays the AR image on the display device 43 so as to be superimposed on the real image of the afforestation area 11.

[0117] The information terminal 4 includes a sensor system 48. The sensor system 48 detects the reforestation area 11 including at least seedlings 8. The sensor system 48 detects the state of the information terminal 4 (display device 43). The sensor system 48 includes a position sensor 45 and a motion sensor 47. The position sensor 45 detects the position of the information terminal 4. An example of the position sensor 45 is a GNSS receiver that detects the absolute position of the information terminal 4. The motion sensor 47 detects the movement of the information terminal 4. An example of the motion sensor 47 is an inertial sensor (IMU), an acceleration sensor, a gyro sensor, and a geomagnetic sensor. The motion sensor 47 may be a sensor that combines at least two of the inertial sensor (IMU), the acceleration sensor, the gyro sensor, and the geomagnetic sensor.

[0118] The camera 44 captures images of at least objects present in the reforestation area 11. A plurality of cameras 44 are provided on the information terminal 4. The cameras 44 are provided on the left and right sides of the information terminal 4, for example.

[0119] FIG. 18 is a diagram illustrating an example of a real image and an AR image displayed on the display device 43 of the information terminal 4 according to the embodiment. In the example illustrated in FIG. 18 , the AR image includes a survival position symbol 151 indicating the survival position of the seedling 8 and a replacement planting position symbol 152 indicating the replacement planting position of the seedling 8. The survival position symbol 151 is displayed so as to be superimposed on the original planting position of the real image. The replacement planting position symbol 152 is displayed so as to be superimposed on the replacement planting position of the real image. As described above, the afforestation position acquisition unit 411 acquires, from the replacement planting position identification unit 23 of the server 2, the original planting positions indicating the positions of the seedlings 8 planted in the afforestation area 11 and the replacement planting positions indicating the positions of the seedlings 8 that have died among the seedlings 8 planted at the original planting positions. The augmented reality processing unit 416 can generate the survival position symbol 151 and the replacement planting position symbol 152 as AR images based on the original planting positions and replacement planting positions acquired by the afforestation position acquisition unit 411. Note that one of the survival position symbol 151 and the transplantation position symbol 152 may be displayed on the display device 43 as an AR image.

[0120] 19 is a flowchart showing a method for generating display data including an AR image according to the embodiment. The real image acquisition unit 415 acquires a real image of the afforestation area 11 captured by the camera 44 (step SD1).

[0121] The augmented reality processing unit 416 generates an AR image including at least one of the survival position symbol 151 and the replanting position symbol 152 based on the survival position and replanting position acquired by the reforestation position acquisition unit 411 and the position data and orientation data of the information terminal 4 (step SD2).

[0122] Because the information terminal 4 held by the worker 102 is likely to move, the real image captured by the camera 44 is a moving image. The augmented reality processing unit 416 generates an AR image to be superimposed on the real image based on the movement of the information terminal 4 detected by the sensor system 48.

[0123] The display control unit 417 causes the display device 43 to display the display data generated so that the AR image is superimposed on the real image (step SD3).

[0124] The AR image generated by the augmented reality processing unit 416 may include the above-described path image 16. The display control unit 417 may display, on the display device 43, display data in which the path image 16 indicating the path of the worker 102 who plants the seedlings 8 at each of the plurality of planting positions is superimposed on a real image as the AR image. The AR image may include an incomplete symbol 1521 indicating an incomplete position where planting of the seedlings 8 has not been completed, or may include a completed symbol 1522 indicating a completed position where planting of the seedlings 8 has been completed.

[0125] The AR image generated by the augmented reality processing unit 416 may include the above-described emphasized image 70. The display control unit 417 may cause the display device 43 to display, as the AR image, display data in which the emphasized image 70, which emphasizes a recommended replanting position among a plurality of replanting positions, is superimposed on a real image.

[0126] 20 is a diagram schematically illustrating AR glasses 140 according to an embodiment. A worker 102 may wear so-called AR glasses 140 while performing tree planting work. The AR glasses 140 are worn on the head of the worker 102 performing the tree planting work. When the worker 102 performs the tree planting work, AR images (augmented reality images) for supporting the tree planting work are displayed on the AR glasses 140. The AR glasses 140 include a controller 141, a display device 143, a camera 144, and a sensor system 148.

[0127] The sensor system 148 detects objects present in the reforestation area 11. The sensor system 148 detects the state of the AR glasses 140. The sensor system 148 includes a position sensor and a motion sensor. The position sensor detects the position of the AR glasses 140. The motion sensor detects the movement of the AR glasses 140.

[0128] The camera 144 captures images of objects present in the reforestation area 11. A plurality of cameras 144 are provided. The cameras 144 are provided, for example, on the left and right sides of the AR glasses 140.

[0129] The display device 143 is positioned in front of the eyes of the worker. As shown in FIG. 20 , the AR glasses 140 are worn on the head of the worker 102 so that the display device 143 is positioned in front of the eyes of the worker 102. The display device 143 displays a real image including objects present in the reforestation area 11. The display device 143 is a transmissive type. A real image of the front that passes through the transmissive display device 143 is displayed on the display device 143. The worker 102 can view the real image (external world) of the front through the transmissive display device 143. An AR image is projected onto the display device 143. The AR image is displayed on the display device 143 so as to be superimposed on the real image. The worker 102 can view the real image on which the AR image is superimposed.

[0130] The controller 141 generates an AR image for supporting the tree planting work and causes the display device 43 to display the AR image so that the AR image is superimposed on a real image.

[0131] Because the head of the worker 102 wearing the AR glasses 140 moves, the image captured by the camera 144 is a moving image. Based on the movement of the AR glasses 140 detected by the sensor system 148, the controller 141 generates an AR image to be superimposed on the image.

[0132] 21 is a diagram illustrating an example of a real image and an AR image displayed on the display device 143 of the AR glasses 140 according to the embodiment. The AR image may include, for example, an image showing a procedure for tree planting work. The AR image may also include an image showing the hand movements of the worker 102 performing the tree planting work.

[0133] In the example shown in Figure 21, the real image includes a seedling 8 and a reforestation tool 6. The real image also includes an image 103 of the hand of a worker 102 who is performing reforestation work (supplementary planting work) using the reforestation tool 6. The image 103 of the hand is an image of the hand in real space (a real image). The AR image is an image 104 that shows a model hand movement of the worker 102. The image 104 is displayed on the display device 143 so as to be superimposed on the real image. The image 104 is displayed on the display device 43 so as to be superimposed on the image 103.

[0134] In the example shown in FIG. 4 , image 104 is an image showing the hand movements of worker 102 when performing reforestation work in the past. The processor of controller 141 acquires a past image which is an image showing the hand movements of worker 102 when performing reforestation work in the past. The past image is stored in storage of controller 141. The processor of controller 141 acquires the past image from the storage. Note that the past image may be stored in a server 2 arranged outside the AR glasses 140. The controller 141 may acquire the past image from the server 2 via the communication system 5. The controller 141 generates image 104, which is an AR image, based on the past image.

[0135] The content and procedure of the tree planting work in the past image are the same as the content and procedure of the tree planting work performed by the worker 102 in the real space.

[0136] The worker 102 can move his / her hands so that the tree planting work is carried out properly while viewing the image 103, which is a real image, and the image 104, which is an AR image. Since the worker 102 can carry out the tree planting work while referring to his / her past hand movements, the worker 102 can utilize his / her advantages in past tree planting work and find areas for improvement. The image 104, which is an AR image, supports the tree planting work of the worker 102, and the worker 102 can carry out the tree planting work properly and efficiently.

[0137] If the worker 102 is an unskilled worker, the image 104 may be an image showing the hand movements of a skilled worker when performing tree planting work. The processor of the controller 141 acquires a skilled image, which is an image showing the hand movements of a skilled worker when performing tree planting work. The skilled image is stored in the storage of the controller 141. The processor of the controller 141 acquires the skilled image from the storage. Note that the skilled image may be stored in a server 2 arranged outside the AR glasses 140. The controller 141 may acquire the skilled image from the server 2 via the communication system 5. The controller 141 generates the image 104, which is an AR image, based on the skilled image.

[0138] The content and procedure of the tree planting work in the skilled image are the same as the content and procedure of the tree planting work performed by the worker 102 in the real space.

[0139] The worker 102 can move his / her hands so that the tree planting work is carried out properly while viewing the image 103, which is a real image, and the image 104, which is an AR image. Since the worker 102 can carry out the tree planting work while referring to the hand movements of an experienced worker, the worker 102 can find areas for improvement. The image 104, which is an AR image, supports the tree planting work of the worker 102, and the worker 102 can carry out the tree planting work properly and efficiently.

[0140] [Effect] As described above, the processor 10A of the server 2 includes a planting position identification unit 23 that identifies a planting position indicating a position where a seedling 8 should be planted in the reforestation area 11, an input data acquisition unit 25 that acquires plant body data related to the seedling 8 at the planting position, and a memory unit 27 that stores management data that associates the planting position with the plant body data.

[0141] According to the embodiment, plant data associated with the replanting position is registered in the storage unit 27, thereby supporting the replanting work. The worker 102 can recognize the status of the replanting position by viewing the management data in which the replanting position and the plant data are associated. Because the worker 102 can recognize the status of the replanting position, the worker 102 can carry out the replanting work efficiently.

[0142] The display data generating unit 26 generates display data including the management data. The worker 102 who checks the display data can recognize the status of the replanting position.

[0143] As described with reference to FIG. 16 , tapping the registered symbol 71 generates designation data that designates the replanting position corresponding to the registered symbol 71. The display data generation unit 26 causes the display device 43 to display plant data 72 associated with the designated replanting position based on the designation data that designates the replanting position. The designation data includes an identification number for identifying the replanting position (or permanent planting position). The display data generation unit 26 causes the display device 43 to display the plant data 72 associated with the designated replanting position based on the designation data that designates the replanting position and the identification number. By tapping the registered symbol 71, the worker 102 can check the plant data 72 associated with the replanting position.

[0144] The plant body data 72 includes image data of the dead seedling 8 captured by the camera 44. By checking the image data, the worker 102 can visually recognize the status of the replanting position.

[0145] The plant body data includes text data relating to the dead seedling 8 input from the input device 42. By checking the text data, the worker 102 can recognize the status of the replanting position.

[0146] The text data includes the reason for the death of the seedling 8. The worker 102 can recognize the reason for the death of the seedling 8 by checking the text data.

[0147] As described above, the processor of the controller 41 includes a planting position acquisition unit 411 that acquires replacement planting positions indicating the positions of dead seedlings 8 among the multiple seedlings 8 planted in the planting area 11, a route calculation unit 413 that calculates the route of the worker 102 who will plant the seedlings 8 at each of the multiple replacement planting positions based on the replacement planting positions, and a display control unit 417 that generates display data including the route.

[0148] According to the embodiment, the replanting work is supported. Display data including an optimal route for sequentially replanting multiple replanting positions is generated, so that the worker 102 can efficiently perform the replanting work while moving along the route.

[0149] The path calculation unit 413 calculates a path in a work area to which multiple implantation positions belong. The path calculation unit 413 calculates a path in a work area assigned to each worker 102, thereby reducing the calculation load. Furthermore, an optimal path is calculated for each of the multiple workers 102.

[0150] The path calculation unit 413 determines the start point of the path based on start point data that specifies the start point of the path. The start point data includes position data of the worker 102 detected by the position sensor 45. For example, by determining the start point of the path based on the current position of the worker 102, the worker 102 can immediately start planting work from the start point of the path. Note that the start point data may be generated by operating the input device 42 of the information terminal 4. In other words, the start point of the path may be determined by the worker 102 operating the input device 42 of the information terminal 4.

[0151] A storage area 12 in which seedlings 8 for replanting are placed is provided at least partially around the planting area 11. The path calculation unit 413 determines one or both of the start and end points of the path based on the positions of the work area and the storage area 12. For example, by determining the start point of the path to a position in the work area close to the storage area, a worker 102 who has carried out a basket 7 of seedlings 8 from the storage area 12 can immediately start replanting work from the start point of the path after arriving at the work area. Furthermore, by determining the end point of the path to a position in the work area close to the storage area, a worker 102 who has finished replanting work can immediately return to the storage area 12.

[0152] The path calculation unit 413 calculates a path that connects multiple planting positions in the work area by the shortest distance. Because the path is shorter, the travel distance of the worker 102 is reduced. By reducing the travel distance of the worker 102, the workload of the worker 102 is reduced.

[0153] The route calculation unit 413 calculates a route based on the topography of the work area. For example, the route is calculated so as to prevent the worker 102 from climbing a steep slope, thereby reducing the workload of the worker 102.

[0154] The route calculation unit 413 recalculates the route when it determines that the worker 102 has deviated from the route based on the position of the worker 102 detected by the position sensor 45. By recalculating the route, the worker 102 who has deviated from the route can return to the original route.

[0155] The path calculation unit 413 determines a recommended planting position for the next planting work from among the multiple planting positions based on the position of the worker 102 detected by the position sensor 45. The display control unit 417 displays the recommended planting position in a display format different from that of the other planting positions. The planting position where the worker 102 should next plant a tree is highlighted by the highlighted image 70, allowing the worker 102 to recognize the next planting position.

[0156] The display control unit 417 displays on the display device 43 display data in which a planting position symbol 152 indicating the planting position and a worker symbol 14 indicating the position of the worker 102 detected by the position sensor 45 are superimposed on a route image 16 indicating the route. The worker 102, who checks the display data, can smoothly recognize the relationship between his or her own position, the planting position, and the route.

[0157] The processor of the controller 41 includes a planting position acquisition unit 411 that acquires a replacement planting position indicating the position of a dead seedling 8 among the multiple seedlings 8 planted in the planting area 11, and a display control unit 417 that generates display data including a replacement planting position symbol 152 indicating the replacement planting position and a worker symbol 14 indicating the position of the worker 102 detected by the position sensor 35.

[0158] According to the embodiment, the replanting work is supported. By checking the display data, the worker 102 can recognize the relationship between his / her own position and the replanting position, and therefore the replanting work can be carried out efficiently.

[0159] As described above, the processor of the controller 41 includes a planting position acquisition unit 411 that acquires a replacement planting position indicating the position of a dead seedling 8 among the multiple seedlings 8 planted in the planting area 11, a completion position identification unit 414 that identifies a completion position indicating the replacement planting position where the planting of the seedling 8 has been completed, and a display control unit 417 that generates display data including the completion position.

[0160] According to the embodiment, the supplementary planting work is supported. The worker 102 can recognize the progress of the supplementary planting work by checking the display data including the completion position where the supplementary planting was completed. Furthermore, the worker 102 is prevented from mistakenly returning to the completion position or planting the seedling 8 in the wrong completion position even though the supplementary planting work is completed. Therefore, the supplementary planting work is carried out efficiently.

[0161] The completed position identifying unit 414 identifies an incomplete position indicating a planting position where planting of a seedling 8 has not been completed. The display control unit 417 generates display data including a completed symbol 1522 indicating a completed position and an incomplete symbol 1521 indicating an incomplete position. By checking the display data, the worker 102 can recognize each of the completed position and the incomplete position.

[0162] The processor of the controller 41 includes a path calculation unit 413 that calculates a path for the worker 102 to plant the seedlings 8 at each of the plurality of planting positions based on the planting positions. The display control unit 417 generates display data including a completed symbol 1522, an incomplete symbol 1521, and a path image 16 indicating the path. By checking the display data, the worker 102 can recognize the relationship between the completed position, the incomplete position, and the path. The display control unit 417 may also display only the path image 16 for the incomplete symbol 1521 on the display device 43.

[0163] The completion position specifying unit 414 determines whether the worker 102 has stayed at the replacement position for a specified time or longer based on the detection data of the position sensor 45 that detects the position of the worker 102, and if it determines that the determination condition has been satisfied, specifies the replacement position as the completion position. In the replacement work of one seedling 8, the position of the worker 102 does not substantially change for the specified time, so the completion position specifying unit 414 can determine whether the seedling 8 has been replacement planted at the replacement position based on the detection data of the position sensor 45 that detects the position of the worker 102.

[0164] The completion position specifying unit 414 determines whether the criterion that the tree planting tool 6 has stayed at the replacement planting position for a specified time or longer is met based on the detection data of the position sensor 61 that detects the position of the tree planting tool 6, and if it determines that the criterion is met, specifies the replacement planting position as the completion position. In the replacement planting work of one seedling 8, the position of the tree planting tool 6 does not substantially change for the specified time, so the completion position specifying unit 414 can determine whether the seedling 8 has been replacement planted at the replacement planting position based on the detection data of the position sensor 61 that detects the position of the tree planting tool 6.

[0165] The completion position specifying unit 414 specifies the replanting position as the completion position based on an operation signal generated when the operating member 62 of the tree planting tool 6 is operated. Operation of the operating member 62 of the tree planting tool 6 can be considered as planting the seedling 8 in the soil, so the completion position specifying unit 414 can determine whether the seedling 8 has been replanted at the replanting position based on the detection data of the position sensor 61 that detects the position of the tree planting tool 6 and the operation signal from the operating member 62 of the tree planting tool 6.

[0166] As described above, the processor of the controller 41 includes a real-world image acquisition unit 415 that acquires a real-world image of the reforestation area 11 captured by the camera 44, an augmented reality processing unit 416 that generates an AR image to assist reforestation work in the reforestation area 11, and a display control unit 417 that displays the AR image on the display device 43 so that it is superimposed on the real-world image.

[0167] According to the embodiment, an AR image for supporting the tree planting work is displayed on the display device 43 so as to be superimposed on a real image, thereby supporting the tree planting work by the worker 102.

[0168] The afforestation system 1 includes a sensor system 48 that detects the state of the afforestation area 11 and the information terminal 4 (display device 43). The display control unit 417 positions the AR image on the real image based on the relative position so that the AR image is superimposed on the real image. Based on the detection data of the sensor system 48, the real image and the AR image are superimposed and displayed.

[0169] The processor of the controller 41 includes a planting position acquisition unit 411 that acquires surviving positions indicating the positions of surviving seedlings 8 and replacement planting positions indicating the positions of dead seedlings 8 among the seedlings 8 planted at the planting positions in the planting area 11. The AR image includes at least one of a surviving position symbol 151 indicating the surviving position and a replacement planting position symbol 152 indicating the replacement planting position. By checking the display data displayed on the display device 43, the worker 102 can recognize whether the seedlings 8 are surviving in real space.

[0170] The AR image may include a path image 16 showing the path of the worker who will plant the seedlings 8 at each of the multiple planting positions. The AR image may also include an emphasis image 70 that highlights the recommended planting position for the next planting work from the multiple planting positions. The worker 102 can efficiently perform the planting work by checking the display data displayed on the display device 43.

[0171] The AR image may include an image showing the procedure of the tree planting work. The AR image may include an image showing the hand movements of a worker performing the tree planting work. For example, by displaying an AR image showing the procedure of a skilled worker or an AR image showing the hand movements of a skilled worker on the display device 43, even an inexperienced worker 102 can perform the tree planting work properly while looking at the AR image.

[0172] Other Embodiments In the above-described embodiment, the functional units of the server 2 may be configured by separate computers (hardware). The functional units of the controller 41 of the information terminal 4 may be configured by separate computers (hardware).

[0173] In the above-described embodiment, some or all of the functional units of the server 2 may be provided in, for example, the controller 41 of the information terminal 4. Some or all of the functional units of the controller 41 of the information terminal 4 may be provided in, for example, the server 2. The controller 41 (processor) of the information terminal 4 may acquire a replacement planting position indicating a position where a seedling 8 should be replanted in the afforestation area 11, acquire plant body data related to the seedling 8 at the replacement planting position, and store management data in which the seedling 8 and the plant body data are associated with each other.

[0174] The controller 41 (processor) of the information terminal 4 may acquire planting positions indicating the locations where seedlings 8 should be planted in the reforestation area 11, and based on the planting positions, calculate the route of a worker who will plant the seedlings 8 at each of the multiple planting positions, and generate display data including the route.

[0175] The controller 41 (processor) of the information terminal 4 may acquire planting positions indicating the locations where seedlings 8 should be planted in the reforestation area 11, calculate a route for the worker 102 to plant the seedlings 8 at each of the multiple planting positions based on the planting positions, and generate display data including the route.

[0176] The controller 41 (processor) of the information terminal 4 may acquire planting positions indicating the locations where seedlings 8 should be planted in the reforestation area 11, calculate a route for the worker 102 to plant the seedlings 8 at each of the multiple planting positions based on the planting positions, and generate display data including the route.

[0177] The controller 41 (processor) of the information terminal 4 may acquire a planting position indicating the position where the seedling 8 should be planted in the reforestation area 11, identify a completion position indicating the planting position where the seedling 8 has been planted, and generate display data including the completion position.

[0178] The controller 41 (processor) of the information terminal 4 may acquire a real image of the reforestation area 11 captured by the camera 44, generate an augmented reality image to assist reforestation work in the reforestation area 11, and display the augmented reality image on the display device 43 so that it is superimposed on the real image.

[0179] Note that if the communication environment in the afforestation area 11 is poor, communication between the information terminal 4 and the server 2 may be difficult. If communication between the information terminal 4 and the server 2 is difficult, data transmitted from the first information terminal 4 may be received by the second information terminal 4 without going through the server 2. By providing all of the functional units of the server 2 in the controller 41 of the information terminal 4, the information terminal 4 can perform the processing described in the above embodiment. The first information terminal 4 and the second information terminal 4 may communicate via a wireless LAN (Local Area Network) such as Wifi (registered trademark). The first information terminal 4 and the second information terminal 4 may communicate via a wireless PAN (Personal Area Network) such as Bluetooth (registered trademark) or Zigbee (registered trademark).

[0180] 1...Afforestation system, 2...Server, 3...Afforestation machine, 4...Information terminal, 5...Communication system, 6...Afforestation tool, 7...Basket, 8...Sapling (plant body), 9...Mobile object, 10...Computer, 10A...Processor, 10B...Main memory, 10C...Storage, 10D...Input / output interface, 10E...Communication interface, 10F...Computer program, 11...Afforestation area, 12...Storage area, 14...Worker symbol, 15...Symbol, 16...Route image, 17...Work area image, 18A... 1 button, 18B...second button, 19A...numerical data, 19B...numerical data, 19C...numerical data, 20...learning device, 21...planting position acquisition unit, 22...captured image acquisition unit, 23...supplementary planting position identification unit, 24...work area setting unit, 25...input data acquisition unit, 26...display data generation unit, 27...storage unit, 31...vehicle body, 32...traveling device, 33...planting device, 34...controller, 35...position sensor, 36...arm, 37...frame, 38...hydraulic cylinder, 39...planting unit, 39A...plant body holding unit , 39B...main body part, 39C...extension part, 41...controller, 42...input device, 43...display device, 44...camera, 45...position sensor, 47...motion sensor, 48...sensor system, 61...position sensor, 62...operation member, 70...enhanced image, 71...registered symbol, 72...plant body data, 73...image data, 74...registration date data, 75...text data, 91...controller, 92...camera, 93...position sensor, 100...worker, 101...manager, 102...operator, 103...image , 104...image, 140...AR glasses, 141...controller, 143...display device, 144...camera, 148...sensor system, 151...survival position symbol, 152...replanting position symbol, 152S...starting point symbol, 152E...end point symbol, 411...afforestation position acquisition unit, 412...work area acquisition unit, 413...route calculation unit, 414...completion position identification unit, 415...real image acquisition unit, 416...augmented reality processing unit, 417...display control unit, 1521...incomplete symbol, 1522...completion symbol.

Claims

1. A reforestation system comprising a processor, which acquires a replacement planting position indicating a position where a plant should be replanted in a reforestation area, acquires plant body data relating to the plant body at the replacement planting position, and stores management data in which the plant body and the plant body data are associated with each other.

2. The reforestation system according to claim 1, wherein the processor causes a display device to display the plant body data associated with the specified replanting position based on designation data that designates the replanting position.

3. The reforestation system according to claim 1, wherein the plant body data includes image data of the plant body captured by a camera.

4. An information terminal comprising a processor, which acquires a planting position indicating a position where a plant should be planted in a reforestation area, acquires plant data relating to the plant at the planting position, and stores management data in which the plant is associated with the plant data.

5. The information terminal according to claim 4, wherein the processor causes a display device to display the plant body data associated with the specified replanting position based on designation data that designates the replanting position.

6. The information terminal according to claim 4, wherein the plant body data includes image data of the plant body captured by a camera.

7. A reforestation system comprising a processor, which acquires planting positions indicating positions where plants should be planted in a reforestation area, calculates a route for a worker to plant plants at each of a plurality of planting positions based on the planting positions, and generates display data including the route.

8. The reforestation system according to claim 7, wherein the processor recalculates the route when it determines that the worker has deviated from the route based on the position of the worker detected by a position sensor.

9. The reforestation system according to claim 7, wherein the processor determines a recommended replanting position for the next replanting operation from among a plurality of replanting positions based on the position of the worker detected by a position sensor, and displays the recommended replanting position in a display format different from that of the other replanting positions.

10. A reforestation system comprising a processor, which acquires replacement planting positions indicating the positions of dead plants among a plurality of plants planted in a reforestation area, and generates display data including a replacement planting position symbol indicating the replacement planting position and a worker symbol indicating the position of a worker detected by a position sensor.

11. An information terminal comprising a processor, which acquires planting positions indicating positions where plants should be planted in a reforestation area, calculates a route for a worker to plant plants at each of a plurality of planting positions based on the planting positions, and generates display data including the route.

12. A reforestation system comprising a processor that acquires replanting positions indicating positions where plant bodies should be replanted in a reforestation area, identifies completed positions indicating the replanting positions where plant bodies have been replanted and incomplete positions indicating the replanting positions where plant bodies have not been replanted, and generates display data including a completed symbol indicating the completed position and an incomplete symbol indicating the incomplete position.

13. The reforestation system described in claim 12, wherein the processor determines whether a judgment condition that the worker has stayed at the supplementary planting position for a specified period of time or longer is satisfied based on detection data from a position sensor that detects the worker's position, and if it determines that the judgment condition is satisfied, identifies the supplementary planting position as the completion position.

14. The reforestation system described in claim 12, wherein an operator uses a reforestation tool to replant a plant at the replanting position, and the processor determines whether or not a determination condition that the reforestation tool stays at the replanting position for a specified period of time is satisfied based on detection data from a position sensor that detects the position of the reforestation tool, and if it determines that the determination condition is satisfied, identifies the replanting position as the completed position.

15. The reforestation system of claim 12, wherein an operator uses a reforestation tool to replant a plant at the replanting position, the reforestation tool has an operating member that is operated when replanting the plant, and the processor identifies the replanting position as the completed position based on an operating signal generated when the operating member is operated.

16. An information terminal comprising a processor that acquires planting positions indicating positions where plant bodies should be planted in a reforestation area, identifies completed positions indicating the planting positions where plant bodies have been planted and incomplete positions indicating the planting positions where plant bodies have not been planted, and generates display data including a completed symbol indicating the completed position and an incomplete symbol indicating the incomplete position.

17. The information terminal of claim 16, wherein the processor determines whether a judgment condition that the worker has stayed at the planting position for a specified period of time or longer is met based on detection data from a position sensor that detects the worker's position, and if it determines that the judgment condition is met, identifies the planting position as the completed position.

18. An information terminal as described in claim 16, wherein an operator uses a planting tool to replant a plant at the replanting position, and the processor determines whether a determination condition that the planting tool stays at the replanting position for a specified period of time or more is satisfied based on detection data from a position sensor that detects the position of the planting tool, and if it determines that the determination condition is satisfied, identifies the replanting position as the completed position.

19. A reforestation system comprising a processor that acquires a real image of a reforestation area captured by a camera, generates an augmented reality image for supporting reforestation work in the reforestation area, and displays the augmented reality image on a display device so as to be superimposed on the real image.

20. The reforestation system of claim 19, further comprising a sensor system for detecting the state of the display device, and wherein the processor positions the augmented reality image on the real image so that the augmented reality image is superimposed on the real image based on the detection data of the sensor system.

21. The reforestation system described in claim 19, wherein the processor acquires surviving positions indicating the positions of surviving plants among the plants planted at the planting positions in the reforestation area and replacement planting positions indicating the positions of dead plants, and the augmented reality image includes at least one of a surviving position symbol indicating the surviving position and a replacement planting position symbol indicating the replacement planting position.

22. The reforestation system according to claim 21, wherein the augmented reality image includes a path image showing a path of a worker who will replant plants at each of a plurality of replanting positions.

23. The reforestation system according to claim 21, wherein the augmented reality image includes an enhanced image that highlights a recommended replanting position for the next replanting work from among a plurality of replanting positions.

24. AR glasses comprising a processor that acquires a real image of a reforestation area, generates an augmented reality image for supporting reforestation work in the reforestation area, and displays the augmented reality image on a display device so as to be superimposed on the real image.

25. AR glasses as described in claim 24, further comprising a sensor system for detecting a state of the display device, and the processor positions the augmented reality image on the real image so that the augmented reality image is superimposed on the real image based on detection data from the sensor system.

26. The AR glasses described in claim 24, wherein the processor acquires surviving positions indicating the positions of surviving plants among the plants planted at the planting positions in the reforestation area and replacement planting positions indicating the positions of dead plants, and the augmented reality image includes at least one of a surviving position symbol indicating the surviving position and a replacement planting position symbol indicating the replacement planting position.

27. The AR glasses according to claim 26, wherein the augmented reality image includes a path image showing a path of a worker planting a plant body at each of a plurality of planting positions.

28. The AR glasses according to claim 26, wherein the augmented reality image includes an enhanced image that highlights a recommended replanting position for the next replanting work from among a plurality of replanting positions.

Citation Information

Patent Citations

  • Reseeding swing arm type operation seed leakage positioning method and control system

    CN116385711A

  • Work system and work support system

    JP2016162253A

  • Device for automatically detecting damaged forest tree, method for automatically detecting damaged forest tree and program

    JP2023105672A

  • Tree planting planning device, tree planting system, and tree planting planning method

    JP2023158914A

  • Forest management system

    JP2023163149A