Tree management method

Abstract

To more appropriately manage felled trees.SOLUTION: A flight body 900 acquires cut surface information related to the cut surface of respective stumps of a plurality of felled trees and acquires position information of logging areas of the plurality of trees. An information processing device 200 acquires the cut surface information and the position information from the flight body 900, stores the cut surface information and the position information in association with a database, extracts a plurality of pieces of second image information related to the cut surfaces of the stumps facing the cut surfaces related to a plurality of pieces of first image information from the database on the basis of a comparison result between image information (the plurality of pieces of first image information) related to respective cut surfaces of a plurality of trees of transaction objects and cut surface information (the second image information) stored in the database in a physical distribution process of the plurality of trees of transaction objects, and proves that the plurality of trees of transaction objects are felled in the logging area in the case that the position information respectively associated with the plurality of pieces of second image information that are extracted is the same logging area.SELECTED DRAWING: Figure 19

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, and a program for managing felled trees. [Background technology]

[0002] Conventionally, there exists a distribution channel for lumber used in houses and the like. For example, when trees are cut down in a forest, the cut trees are transported to a market that handles lumber. Trees are bought and sold at the market, and the buyer processes the trees into lumber, planks, and the like, and the trees are used for houses and the like. For example, one method of managing distributed lumber is to attach IC tags to lumber distributed in the market, and manage the lumber using these IC tags (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-168664 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned conventional technology, an IC tag is fixed to wood with one screw, so one or more IC tags and screws are required for one tree, which increases the cost of fixing the IC tag. In addition, the work required to fix the IC tag to wood is complicated. Therefore, it is important to reduce the cost of managing felled trees and simplify the work required for the management, thereby managing felled trees more appropriately.

[0005] The present invention aims to more appropriately manage felled trees. [Means for solving the problem]

[0006] One aspect of the present invention is an information processing system that manages felled trees using a first device capable of acquiring image information and a second device capable of handling a database that manages tree information. The first device executes the following: acquiring cut surface information on the cut surface of the tree, acquiring position information on the position of the tree at the time of felling, and transmitting the cut surface information and the position information to the second device. The second device executes the following: acquiring the cut surface information and the position information from the first device, storing the cut surface information and the position information in association with the database, and certifying the tree based on the contents of the database during the distribution process of the tree. Effect of the Invention

[0007] According to the present invention, it is possible to more appropriately manage felled trees. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing a schematic diagram of the process from felling trees in a forest to loading them onto a transport vehicle. [Diagram 2] FIG. 2 is a diagram illustrating an example of a configuration of an information processing system. [Diagram 3] FIG. 3 is a block diagram illustrating an example of a functional configuration of the electronic device. [Figure 4] FIG. 4 is a diagram illustrating an example of the configuration of a tree information DB. [Diagram 5] FIG. 5 is a block diagram illustrating an example of a functional configuration of the information processing device. [Figure 6] FIG. 6 is a diagram showing the tree information DB. [Figure 7] FIG. 7 is a diagram showing an example of transition of information output from an electronic device. [Figure 8] FIG. 8 is a diagram showing an example of transition of information output from an electronic device. [Figure 9] FIG. 9 is a diagram showing an example of transition of information output from an electronic device. [Figure 10]FIG. 10 is a diagram showing an example of the transition of information output from an electronic device. [Figure 11] FIG. 11 is a flowchart showing an example of a process for acquiring information about a tree. [Figure 12] FIG. 12 is a flowchart showing an example of a process for registering information about a tree. [Figure 13] FIG. 13 is a diagram showing a simplified estimation method for estimating the cut surface of a tree for each tree. [Figure 14] FIG. 14 is a simplified diagram showing a method for estimating the cut surface of a tree for each tree. [Figure 15] FIG. 15 is a flowchart showing an example of an acquisition process for acquiring tree information regarding a plurality of trees. [Figure 16] FIG. 16 is a diagram showing an example of acquiring information about trees at a collection location where trees are collected. [Figure 17] FIG. 17 is a diagram showing an example of certifying the felling location of a tree at a collection point where the tree is collected. [Figure 18] FIG. 18 is a flowchart showing an example of a certification process when a tree is distributed. [Figure 19] FIG. 19 is a diagram showing an example of acquiring an image of a tree stump using an aircraft. [Figure 20] FIG. 20 is a diagram illustrating an example of the configuration of a tree information DB. [Figure 21] FIG. 21 is a diagram showing the tree information DB. [Figure 22] FIG. 22 is a flowchart showing an example of a process for acquiring information about trees. [Diagram 23] FIG. 23 is a flowchart showing an example of a certification process when a tree is distributed. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Next, an embodiment of the present invention will be described in detail with reference to the drawings.

[0010] [Example of work involved in cutting down trees] Fig. 1 is a diagram showing a schematic flow of cutting down trees in a forest and loading them onto a transport vehicle TR1. Fig. 1(1) shows a simplified example of a case where a user P0 (e.g., one or more tree-cutting operators) cuts down trees 11 to 15 in a forest 10, and then transports the cut trees 21 in a transport vehicle TR1 (e.g., a truck). Fig. 1(2) shows a simplified cut surface 22 of the cut trees. The example shown in Fig. 1(2) will be described later.

[0011] For example, after trees 11 to 15 in forest 10 are cut down by user P0, stumps 16 to 20 of trees 11 to 15 remain.

[0012] Here, after trees are cut down in the mountains or the like, they are subjected to various processes (e.g., drying, sawing, processing, construction) such as drying (e.g., natural drying, drying after removing leaves, drying logs) and sawing (e.g., sawing at a sawmill, sawing at a construction site) and are used for their final uses such as lumber for housing and furniture, auxiliary building materials, etc. However, in this embodiment, some of the drying processes are omitted for ease of explanation.

[0013] [Example of managing felled trees using electronic devices and information processing devices] Fig. 2 is a diagram showing an example of the configuration of a management system (information processing system TS1) that manages felled trees using an electronic device 100 and an information processing device 200. Fig. 2 shows a simplified example of a flow in which, after a user P0 cuts down a tree 30, information about the tree 30 (for example, an image of the cut surface of the tree) is acquired by the electronic device 100, and the information about the tree 30 is transmitted to and registered by the information processing device 200. Fig. 2 also shows an example in which the felled tree 30 is divided into three parts for transportation.

[0014] The electronic device 100 is, for example, a device (e.g., a smartphone, a tablet terminal) equipped with an image acquisition function capable of acquiring image information, or a device (e.g., a personal computer, a tablet terminal) capable of acquiring image information (e.g., capable of data communication via wired or wireless communication) from a device (e.g., a digital still camera, a digital video camera) equipped with an image acquisition function. For example, the electronic device 100 is an example of a portable information processing device. Note that only electronic devices that have an application (tree management app) installed for using the tree management service provided by the information processing system TS1 may be targeted for use, or the tree management system may be available regardless of whether or not the tree management app is installed.

[0015] As shown in FIG. 2(1), user P0 uses electronic device 100 when cutting down tree 30. Note that, for ease of explanation, FIG. 2(1) shows an example in which user P0 holds electronic device 100, but when user P0 actually cuts down tree 30, it is important to use electronic device 100 with safety in mind. Also, electronic device 100 may be used by another person. Also, the person cutting down tree 30 may be a person other than user P0.

[0016] As shown in Fig. 2(2), after the tree 30 is cut down by the user P0, a stump 31 of the tree 30 remains. Fig. 2(2) also shows an example in which the cut tree 30 is cut and divided into three pieces because the cut tree 30 is long. In Fig. 2, the tree 30 divided into three pieces is shown as cut down trees 32 to 34.

[0017] As shown in Fig. 2(3), after cutting down tree 30, user P0 acquires images of the cut surfaces of cut trees 32 to 34 using electronic device 100. Note that the term "cut surface of a tree" includes the meaning of the cut end of a tree, the end surface of a tree, the cut surface of a tree, etc. Also, the term "image of the cut surface of a tree" includes the meaning of an image of the end surface of a tree, an image including the pattern of the cut end of a tree, an image including the pattern of the end surface of a tree, an image including the annual rings of the end surface of a tree, etc.

[0018] As shown in FIG. 2(4), the user P0 acquires image information of the cut surfaces of the felled trees 32 to 34, and then performs an operation to transmit the acquired image information from the electronic device 100 to the information processing device 200. When the electronic device 100 has a wireless communication function (for example, wireless communication using a mobile phone network, wireless communication using a wireless LAN (Local Area Network)), the electronic device 100 transmits information to the information processing device 200 wirelessly. For example, it is possible to transmit information to the information processing device 200 via a network NW1. The network NW1 is a network such as a public line network or the Internet. When the electronic device 100 does not have a wireless communication function, the electronic device 100 provides information to the information processing device 200 using a wired line (for example, a cable) or a recording medium (various memories). The information transmitted from the electronic device 100 to the information processing device 200 will be described in detail with reference to FIG. 4.

[0019] [Example of electronic device functional configuration] FIG. 3 is a block diagram showing an example of a functional configuration of the electronic device 100. As shown in FIG.

[0020] The electronic device 100 includes a communication unit 101, a position information acquisition unit 102, an image acquisition unit 103, a control unit 104, a storage unit 105, an operation unit 106, a display unit 107, and a sound output unit 108. The electronic device 100 may have a built-in or attached battery and use the battery as a power source, or may not have a built-in battery and use an external power source.

[0021] The communication unit 101 exchanges various information with other devices using wired communication or wireless communication based on the control of the control unit 104. Note that in this embodiment, an example is mainly shown in which the communication unit 101 exchanges various information with other devices using wireless communication. For example, when exchanging various information using wireless communication, the communication unit 101 transmits and receives radio waves via an antenna (not shown). For example, the communication unit 101 can perform at least one of wireless communication of various wireless communication standards such as wireless LAN (e.g., Wi-Fi (Wireless Fidelity)), Bluetooth (registered trademark) (IEEE (Institute of Electrical and Electronics Engineers) 802.15.1), ZigBee (registered trademark) (IEEE 802.15.4), WiMax, and infrared communication. Furthermore, the communication unit 101 may use, for example, a public network (for example, standards such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), 6G (6th Generation), and LTE (Long Term Evolution)) for wireless communication. Note that these are examples of wireless communication, and the present embodiment may be applied to wireless communication of other wireless communication standards. Note that the communication unit 101 may perform wireless communication with communication devices present within a predetermined range, and may also perform wireless communication by connecting to a predetermined network (for example, the Internet) via a base station installed by a communication carrier such as a mobile phone company.

[0022] The location information acquisition unit 102 acquires location information on the location where the electronic device 100 exists, and outputs the acquired location information to the control unit 104. The location information acquisition unit 102 can be realized by, for example, a GPS (Global Positioning System) receiver that receives a GPS signal and calculates location information based on the GPS signal. The calculated location information includes data on the position such as latitude, longitude, and altitude at the time of receiving the GPS signal. A location information acquisition device that acquires location information by other location information acquisition methods may be used. For example, a location information acquisition device that derives location information using access point information by wireless LAN present in the vicinity and acquires this location information may be used. For example, a location information acquisition device that derives location information using location information of a base station used for calls and communications may be used. For example, a location information acquisition device that derives location information using a location estimation technique by a navigation device and acquires this location information may be used. For example, the location of the device itself can be estimated based on sensor information by various sensors (for example, an acceleration sensor, a gyro sensor) and map information.

[0023] The image acquisition unit 103 captures an image of a subject and generates an image (image data) based on the control of the control unit 104, and outputs the generated image to the control unit 104. The image acquisition unit 103 is composed of, for example, an imaging element (image sensor) into which light from the subject collected by a lens (for example, a plurality of lenses that collect light from the subject) is incident, and an image processing unit that performs predetermined image processing on the image data generated by the imaging element. For example, a CCD (Charge Coupled Device) type or a CMOS (Complementary Metal Oxide Semiconductor) type imaging element can be used as the imaging element. Note that the lens may be configured such that each part (for example, a zoom lens, a focus lens, and an aperture) is controlled based on the control of the control unit 104.

[0024] The control unit 104 controls each unit of the electronic device 100 based on a control program stored in the storage unit 105. The control unit 104 can obtain and use time information from a clock circuit (e.g., a real time clock (RTC)) that can manage time. The control unit 104 is realized, for example, by a CPU (Central Processing Unit). The CPU is an example of a central processing unit (electronic device) that is composed of a control device (control circuit) and an arithmetic device (arithmetic circuit).

[0025] The storage unit 105 is a memory that stores various information. For example, the storage unit 105 stores various information (for example, a control program, a tree management application, and a tree information DB 110 (see FIG. 4)) required for the electronic device 100 to perform various processes. The storage unit 105 may be a removable storage unit or may be a storage unit built into the electronic device 100. The electronic device 100 may be provided with both a removable storage unit and a built-in storage unit. For example, a read only memory (ROM), a random access memory (RAM), a static random access memory (SRAM), a hard disk drive (HDD), a solid state drive (SSD), or a combination of these may be used as the storage unit 105.

[0026] The operation unit 106 receives operation input for operating the electronic device 100. For example, the operation unit 106 can be a user interface such as various operating members (for example, switches and buttons) or a touch panel.

[0027] The display unit 107 is a display unit that outputs various information based on the control of the control unit 104. For example, a display panel such as an organic EL (Electro Luminescence) panel or an LCD (Liquid Crystal Display) panel can be used as the display unit 107. The operation unit 106 and the display unit 107 can be integrally configured using a touch panel that allows a user to perform an operation input by touching or approaching the display surface with his / her finger. However, the operation unit 106 and the display unit 107 may be configured separately, and the operation unit 106 may receive an operation by an operation member. Also, an operation member separate from a user interface such as a touch panel may be provided, and the operation may be received by this operation member. Also, an image corresponding to the operation unit may be projected onto a wall or the like, and the user interface may be configured to allow an operation (for example, a pointing action with a user's finger) to be performed using the image.

[0028] The sound output unit 108 is a sound output unit (for example, a speaker) that outputs various sounds based on the control of the control unit 104.

[0029] [Example of tree information DB configuration] FIG. 4 is a diagram showing an example of the configuration of a database (tree information DB110) that stores information acquired by electronic device 100 (information about felled trees). FIG. 4 mainly shows an example of a case where information about tree 30 shown in FIG. 2 is stored. Each piece of information shown in FIG. 4 is stored in tree information DB110 of storage unit 105 under the control of control unit 104. Note that the tree information stored in tree information DB110 can also be referred to as felling information, since it is information about felled trees. Similarly, the tree information described below can also be referred to as felling information.

[0030] The tree information DB 110 stores tree identification information 111, cut surface identification information 112, image information 113, position information 114, and time information 115 in an associated manner.

[0031] The tree identification information 111 is information for identifying a felled tree. For example, a combination of numbers (e.g., serial numbers), letters, symbols, etc. can be used as the tree identification information 111. For example, a sufficient number of pieces of information (e.g., a combination of numbers, letters, symbols, etc.) can be used to identify each tree that exists in the world.

[0032] The cut surface identification information 112 is information for identifying an image of a cut surface of a felled tree. For example, the cut surfaces of a felled tree can be identified by numbers (for example, serial numbers) that are assigned in order from the lower side of the felled tree (the side facing the ground before felling). For example, referring to FIG. 2, the lowest cut surface 31a (cut surface of the stump) of the felled tree 30 is assigned the number 0. Furthermore, the second cut surface 32a (end surface facing the cut surface of the stump) of the felled tree 30 is assigned the number 1, and the third cut surface 32b (end surface facing the cut surface 32a) from the bottom is assigned the number 2. Similarly, the fourth cut surface 33a from the bottom is assigned the number 3, the fifth cut surface 33b from the bottom is assigned the number 4, the sixth cut surface 34a from the bottom is assigned the number 5, and the seventh cut surface 34b from the bottom is assigned the number 6. In this way, among the cut surfaces of a felled tree, the Nth cut surface from the bottom is given the number "N-1."

[0033] Here, for example, when a felled tree is not divided, two cut surfaces are formed. The two cut surfaces are the cut surface of the stump and the cut surface opposite thereto (the cut surface on the felled tree side). When a felled tree is divided into two, four cut surfaces are formed. The four cut surfaces are the cut surface of the stump, the cut surface opposite thereto (the cut surface on the felled tree side), and the cut surfaces of each tree divided into two (two sets of cut surfaces opposite thereto). When a felled tree is divided into three, six cut surfaces are formed. The six cut surfaces are the cut surface of the stump, the cut surface opposite thereto (the cut surface on the felled tree side), and the cut surfaces of each tree divided into three (two sets of cut surfaces opposite thereto). Referring to FIG. 2, since a felled tree 30 is divided into three or more, seven or more cut surfaces 31a, ..., 34b are formed.

[0034] The image information 113 is image information (cut surface information related to the cut surface of a tree) acquired by the image acquisition unit 103. For example, information related to an image including the cut surface of a cut tree is stored as the image information 113. In FIG. 4, for ease of explanation, only the cut surface of the cut tree is shown as the simplified image information 113. In this embodiment, an example is shown in which image information is used as the cut surface information, but other information capable of identifying the cut surface of a tree may be used as the cut surface information. For example, only the tree ring pattern included in the image of the cut surface may be extracted, and information on this tree ring pattern (for example, image information only of the tree ring pattern) may be used as the cut surface information. In addition, a known image recognition technique (for example, contour extraction, edge detection) may be used as a method for extracting the tree ring pattern. In addition, the image acquired by the image acquisition unit 103 (including an image related to the cut surface of a tree) may be three-dimensionally imaged by three-dimensional imaging processing, and the three-dimensionally imaged image information may be used as the cut surface information. In addition, various devices such as various imaging devices, image processing devices, cameras (e.g., infrared cameras, far-infrared cameras) and the like (e.g., devices that can acquire images and various other information by utilizing wave information such as electromagnetic waves and sound waves) can be used as devices for acquiring cross-section information.

[0035] The position information 114 is position information (e.g., latitude, longitude, and altitude) acquired by the position information acquisition unit 102 when the image information 113 was acquired. In addition, in Fig. 4, the latitude, longitude, and altitude are simplified and shown by circles, etc., for ease of explanation.

[0036] The time information 115 is information (e.g., date and time) about the time when the image information 113 and the position information 114 were acquired. For example, when the image information 113 and the position information 114 are acquired, the control unit 104 stores the time acquired from the clock circuit as the time information 115 in the tree information DB 110.

[0037] [Example of functional configuration of information processing device] FIG. 5 is a block diagram showing an example of a functional configuration of the information processing device 200. As shown in FIG.

[0038] The information processing device 200 includes a communication unit 201 , a control unit 202 , a storage unit 203 , an operation unit 204 , a display unit 205 , and a sound output unit 206 .

[0039] The communication unit 201, under the control of the control unit 202, exchanges various types of information with other devices using wired communication or wireless communication.

[0040] The control unit 202 controls each unit of the information processing device 200 based on a control program stored in the storage unit 203. The control unit 202 can also obtain and use time information from a clock circuit (e.g., an RTC) that can manage time. The control unit 202 is realized by, for example, a CPU.

[0041] The storage unit 203 is a memory that stores various types of information. For example, the storage unit 203 stores various types of information (for example, a control program, a tree information DB 210 (see FIG. 6)) required for the information processing device 200 to perform various processes. The storage unit 203 may be a removable storage unit, or may be a storage unit built into the information processing device 200. The information processing device 200 may be provided with both a removable storage unit and a built-in storage unit. For example, a ROM, a RAM, an SRAM, a HDD, an SSD, or a combination of these may be used as the storage unit 203.

[0042] The operation unit 204 receives operation input for operating the information processing device 200. For example, the operation unit 204 can be a user interface such as various operating members (for example, switches and buttons) or a touch panel.

[0043] The display unit 205 is a display unit that outputs various information based on the control of the control unit 202. For example, a display panel such as an organic EL panel or an LCD panel can be used as the display unit 205. The operation unit 204 and the display unit 205 can be integrally configured using a touch panel that allows a user to perform an operation input by touching or approaching the display surface with his / her finger. However, the operation unit 204 and the display unit 205 may be configured separately, and the operation unit 204 may be configured to accept an operation by an operation member. Also, an operation member separate from a user interface such as a touch panel may be provided, and the operation may be accepted by this operation member. Also, an image corresponding to the operation unit may be projected onto a wall or the like, and a user interface may be configured in which the image can be used to perform an operation (for example, a user's finger pointing action).

[0044] The sound output unit 206 is a sound output unit (for example, a speaker) that outputs various sounds based on the control of the control unit 202.

[0045] [Example of tree information DB configuration] FIG. 6 is a diagram showing an example (tree information DB210) of information (information about felled trees) stored in the information processing device 200. The information shown in FIG. 6 is information acquired by one or more electronic devices (including the electronic device 100), and is transmitted from each electronic device to the information processing device 200 periodically or irregularly (for example, in response to a user operation). FIG. 6 mainly shows an example of a case where information about the tree 30 shown in FIG. 4 is stored. Each piece of information shown in FIG. 6 is stored in the tree information DB210 of the storage unit 203 based on the control of the control unit 202.

[0046] The tree information DB 210 stores transmitting device identification information 211, tree identification information 212, cut surface identification information 213, image information 214, position information 215, image acquisition time information 216, and reception time information 217 in an associated manner.

[0047] 6 correspond to the tree identification information 111, cut plane identification information 112, image information 113, position information 114, and time information 115 shown in Fig. 4, and therefore a description thereof will be omitted here. When performing tree proofing as described with reference to Figs. 16 to 18, of the image information stored in the image information 214, the image information corresponding to the cut plane identification information 213 "0" is not used. Therefore, of the image information stored in the image information 214, the storage of the image information corresponding to the cut plane identification information 213 "0" may be omitted.

[0048] The transmitting device identification information 211 is information for identifying a device (e.g., the electronic device 100) that transmitted the information on the felled tree. For example, information capable of identifying each device can be used as the transmitting device identification information 211. For example, device-specific information such as terminal identification information, an International Mobile Equipment Identity (IMEI), or a Media Access Control address (MAC) address can be used. Furthermore, this information is included in the information to be transmitted (information on the tree) by each electronic device and transmitted to the information processing device 200. Note that, in FIG. 6, for ease of explanation, the transmitting device identification information on the electronic device 100 is indicated as "ABCD", and other transmitting device identification information is indicated as "EFGH", etc.

[0049] The reception time information 217 is information (eg, date and time) about the time when the information processing device 200 received the information about the tree.

[0050] Although FIG. 6 shows an example of information about trees stored in the tree information DB 210, other information about each tree may be stored in the tree information DB 210. For example, information about the owner of the felled tree (e.g., producer name, address), information about the land of the felling site (e.g., soil information, slope information, information about sunlight, information about altitude, information about weather), information about the felled tree (variety, cultivation method, felling date, information about quality (shape of the tree, etc.), information about drying, etc.), and information about distribution of the tree (e.g., shipping date, cutting date) may be stored in the tree information DB 210. When generating certification information about the tree, at least a part of each of these pieces of information can be included in the certification information. Each of these pieces of information may be stored by manual operation by the user or automatically. For example, when information about the owner of the felled tree, information about the land of the felling site, information about the felled tree, etc. can be obtained based on a database (e.g., topographical information DB, map information DB) to which various information is associated, it is possible to automatically obtain and store the necessary information from the database, etc. Moreover, each piece of information acquired by the electronic device 100 may be acquired and stored by the information processing device 200.

[0051] [About tree rings] Here, in the cut surface of a felled tree, there are annual rings that spread out concentrically from the center (or approximately center) of the round (or approximately round) shape. It is known that there are certain rules for these concentric annual rings depending on the growing environment of the tree. For example, in the cut surface of a round (or approximately round) shape, the annual rings in a certain direction are often dense, and the annual rings in the opposite direction are often wide. Therefore, it is preferable to use these rules to make the image information stored in the tree information DB 110, 210 easy to use for judgment. For example, in the example shown in FIG. 1(2), in the cut surface 22 of the round (or approximately round) shape, as shown by the dotted ellipse EL1, the annual rings on the upper side of the arrow direction SD1 are dense, and as shown by the dotted ellipse EL2, the annual rings on the lower side of the arrow direction SD1 are wide.

[0052] For example, a known image recognition technique (e.g., edge detection) can be used to extract the outline of each tree included in the image of each cut surface. This makes it possible to obtain the round shape (or approximately round shape) of each tree included in the image of each cut surface. In addition, concentric annual rings exist from the center (or approximately center) of the round shape (or approximately round shape) on the cut surface of each tree. For these concentric annual rings, a known image recognition technique can also be used to extract the shape (pattern) of each concentric annual ring. As described above, the shape of these annual rings is often such that the annual rings are dense in a certain direction and the annual rings are wide in the opposite direction. Therefore, a rotation process is performed on the image of the cut surface so that the direction in which the annual rings are dense is the first specific direction (e.g., the upper side of the arrow direction SD1 shown in FIG. 1(2)) and the direction in which the annual rings are wide is the second specific direction (e.g., the opposite direction to the first specific direction (e.g., the lower side of the arrow direction SD1 shown in FIG. 1(2))). Similarly, it is preferable to perform the determination process after rotating the image of the cut surface of the tree to be determined so that the direction in which the tree rings are dense is the first specific direction and the direction in which the tree rings are wide is the second specific direction. This makes it possible to improve the determination accuracy of the image matching process. It is also assumed that the above-mentioned rule does not hold true depending on the tree's growing environment and other factors. In such a case, it is possible to perform either a rotation process in which the direction in which the tree rings are dense is the first specific direction or a rotation process in which the direction in which the tree rings are wide is the second specific direction.

[0053] [Examples of extracting features from tree information, and using those features to determine whether trees are identical or similar] Next, a method for determining the identity of a tree using image information 214 stored in tree information DB 210 will be described. Specifically, a method for determining whether a tree is identical to a tree whose image information 214 is stored in tree information DB 210 during the course of distribution of the tree after it has been felled will be described.

[0054] When determining that a tree in the distribution process is the same as a tree whose image information 214 is stored in the tree information DB 210, an image of the cut surface of the tree in the distribution process is acquired. For example, as shown in Fig. 16(2), an image of the cut surface of a tree in the distribution process can be acquired using an imaging device 300. Here, the image of the cut surface of the tree whose image information 214 is stored in the tree information DB 210 is referred to as a first image, and the image of the cut surface of the tree in the distribution process is referred to as a second image.

[0055] For example, by using a known image recognition technique (e.g., edge detection) for searching for the same or similar images, it is possible to extract the round shape (or approximately round shape) of each tree contained in the image of each cut surface and the shape (pattern) of each concentric annual ring. Note that, in order to make it easier to compare each image, a rotation process may be performed on each image based on the density of the annual rings contained in the extracted round shape (or approximately round shape) of the tree, similar to the rotation process described above.

[0056] Using these techniques, the round shape (or nearly round shape) of each tree and the shape (pattern) of each concentric annual ring are extracted for each first image stored in the tree information DB 210 and for each second image of the tree to be determined. Then, the round shape (or nearly round shape) of each tree and the shape (pattern) of each concentric annual ring in each first image and each second image are compared, and a first image determined to be identical (or similar) to the second image is extracted from the tree information DB 210. For this image identity determination process, known image recognition techniques can be used. For example, image search techniques such as identical image search by hash value, similar image search by color comparison, and similar image search that extracts and compares image features can be used.

[0057] For example, the round (or approximately round) shape of a tree included in a first image is compared with the round (or approximately round) shape of a tree included in a second image to determine the degree of match between them. Note that it is assumed that the image sizes are different. Therefore, when making this comparison, the size of the round (or approximately round) shape of a tree included in one image is used as a reference, and the size of the round (or approximately round) shape of a tree included in the other image is changed and compared.

[0058] If the degree of coincidence is less than a predetermined value, it is determined that these images do not match. On the other hand, if the degree of coincidence is equal to or greater than a predetermined value, the shape (pattern) of the tree rings included in each image is compared in a state where the round shape (or approximately round shape) of the tree included in the first image and the round shape (or approximately round shape) of the tree included in the second image are combined, and the degree of coincidence between them is determined. If the degree of coincidence is less than a predetermined value, it is determined that these images do not match. On the other hand, if the degree of coincidence is equal to or greater than a predetermined value, it is determined that these images match. Regarding the method of determining the degree of coincidence, it is possible to calculate the degree of coincidence of the shape (pattern) of the tree rings included in each image, and determine that they match on the condition that this degree of coincidence is equal to or greater than a predetermined value (for example, 90% to 95%). Alternatively, it is possible to calculate the mismatched portion of the shape (pattern) of the tree rings included in each image as a difference value, and determine that they match on the condition that this difference value is less than a predetermined value (for example, 5% to 10%). Note that the above-mentioned predetermined values ​​are examples for ease of explanation, and the values ​​actually used can be appropriately set based on experiments, simulations, etc.

[0059] The matching of trees may be determined using other image features. For example, a fingerprint collation technique may be applied to perform authentication using the end points of ridges, the positions and directions of branching points, etc. of fingerprints as feature points, and a matching determination process of trees may be performed using the lines of annual rings, etc. as feature points. Also, for example, an image recognition technique may be used that extracts features from an image of a round shape (or an approximately round shape) of a tree included in each image and determines the identity of the images based on the extracted feature amount. For example, the image features may be the brightness value of the image, or feature points (for example, the inflection points, intersections, end points, and center points of lines of a binarized image). Also, for example, an image recognition technique using AI (Artificial Intelligence) that extracts features from an image of a round shape (or an approximately round shape) of a tree included in each image and determines the identity of the images based on the extracted feature amount may be used.

[0060] In addition, when a tree is actually felled or cut, it is assumed that the cut surface of the tree will not necessarily be flat. For example, it is assumed that steps will be formed on the cut surface of the tree or that some parts will protrude due to cutting from multiple directions. In such a case, only the flat part of the cut surface may be used as the image to be determined, or the entire cut surface including the part with the steps may be used as the image to be determined.

[0061] It is also assumed that a part or the whole of a cut surface of a tree may be deformed by various processes such as drying and sawing. In these cases, for example, artificial intelligence (AI) can be used to determine the identity or similarity. For example, artificial intelligence is used to learn images of the cut surface before and after deformation, and this learning data is used for the determination. In this case, an evaluation value for determining the degree of agreement between the cut surface after deformation and the cut surface before the change is calculated using the learning data, and the cut surface after deformation can be extracted based on the evaluation value. Note that these extraction methods are merely examples, and the cut surface after deformation may be extracted using other image processing methods, statistical methods, learning methods, etc.

[0062] [Example of extraction of opposing cut surfaces] Next, a method for extracting another cut surface opposite the cut surface of the tree from an image will be described. Here, when cutting a tree, some kind of tool (for example, a chainsaw) is often used to cut the tree. For example, when cutting a tree using a chainsaw, two cut surfaces are formed at positions separated by about the width of the chainsaw. That is, the two cut surfaces do not have completely identical patterns (annual rings), but often have slightly different patterns (annual rings) due to the distance of about the width of the chainsaw. Therefore, it is preferable to extract another cut surface opposite the cut surface of the tree from an image, taking these differences into consideration.

[0063] For example, it is possible to extract other cut surfaces opposite to the cut surface of the tree from the image by using a known image recognition technique for searching for the same or similar image described above. Note that, in order to make it easier to compare the images, a rotation process may be performed on each image based on the density of annual rings included in the extracted round (or nearly round) shape of the tree, similar to the rotation process described above.

[0064] It is also possible to use image recognition technology using AI that extracts features from the image of the inside of the circular (or nearly circular) shape of the tree included in each image and judges the identity of the images based on the extracted features. For example, an image of a cut surface of a tree and an image of an opposing cut surface are learned in advance, and this learning data is used for the judgment. Then, for the image of the cut surface of the target tree and the image of the other cut surface, the learning data is used to calculate an evaluation value of the other cut surface with respect to the cut surface of the target tree, and the cut surface opposing the cut surface of the target tree can be extracted based on the evaluation value. Note that these extraction methods are merely examples, and the opposing cut surface may be extracted using other image processing methods, statistical methods, learning methods, etc.

[0065] [Example of information output to the user when getting information about a tree] 7 to 10 are diagrams showing examples of transitions of information (image information, sound information) output from the electronic device 100. Figs. 7 to 10 show an example in which information on a felled tree is transmitted to the information processing device 200 and registered each time a tree is felled. Note that information on multiple felled trees may be transmitted to the information processing device 200 and registered each time multiple trees are felled. Information on multiple trees felled within a predetermined period (for example, one day) may be transmitted collectively to the information processing device 200 and registered.

[0066] 7 to 10 show an example in which the operation unit 106 and the display unit 107 are configured with a touch panel. Each screen shown in FIG. 7 to 10 is displayed on the display unit 107 by the control unit 104 based on a program stored in the storage unit 105. Each screen shown in FIG. 7 to 10 is displayed on the display unit 107 by the control unit 104 sequentially based on a user operation accepted on the touch panel (operation unit 106 and display unit 107). Similarly, each piece of audio information shown in FIG. 7 to 10 is output from the sound output unit 108 by the control unit 104 based on a program stored in the storage unit 105. Each piece of audio information shown in FIG. 7 to 10 is output from the sound output unit 108 by the control unit 104 sequentially based on a user operation accepted on the touch panel (operation unit 106 and display unit 107). Although FIG. 7 to FIG. 10 show an example in which a user operation is performed using a finger or the like, the user operation (for example, an operation by eye movement, an operation by voice) may be performed using another part of the body.

[0067] First, the user performs an operation to start a registration process for registering information about a tree in electronic device 100. When this operation is performed, a screen shown in Fig. 7(1) is displayed on display unit 107, and sound information shown in Fig. 7(1) is output from sound output unit 108.

[0068] The screen shown in FIG. 7(1) is a screen that is displayed when a user who is about to start felling a tree performs an operation for starting a registration process for registering information about the tree in the electronic device 100 (for example, an operation for starting a tree management application). On the screen shown in FIG. 7(1), for example, a start button 51 and a back button 52 are displayed together with text information corresponding to the sound information output from the sound output unit 108. The back button 52 is a button that is pressed to return to the previous screen. Similarly to the back button 52, each back button shown hereinafter is also a button that is pressed to return to the previous screen.

[0069] When the user presses the start button 51 on the screen shown in Fig. 7(1), the screen shown in Fig. 7(2) is displayed on the display unit 107. Since tree felling work often takes a long time, sound information is not output when the screen shown in Fig. 7(2) is displayed on the display unit 107 so that the tree felling work can be performed efficiently. However, in order to prompt the user to perform the registration work, sound information corresponding to the text information displayed on the screen shown in Fig. 7(2) may be output from the sound output unit 108 on a regular or irregular basis.

[0070] The screen shown in Fig. 7(2) is a screen displayed for a user who has cut down one or more trees to start a registration operation for registering information about the trees in the electronic device 100. The screen shown in Fig. 7(2) displays, for example, an end button 53 and a stop button 54 together with text information that prompts the user to start the registration operation. The stop button 54 is a button that is pressed to stop the registration process for registering information about the trees and return to the initial screen.

[0071] When the user presses the end button 53 on the screen shown in Figure 7(2), the screen shown in Figure 7(3) is displayed on the display unit 107, and the sound information shown in Figure 7(3) is output from the sound output unit 108.

[0072] The screen shown in Fig. 7(3) is a screen displayed when a user who has cut down one or more trees starts a registration operation for registering information about the trees in the electronic device 100. The screen shown in Fig. 7(3) displays, for example, a button 55 for acquiring stump image and a button 56 for returning, together with text information to the effect that an image of the stump of the cut tree will be acquired.

[0073] When the user presses the “Get stump image” button 55 on the screen shown in FIG. 7(3), the screen shown in FIG. 8(1) is displayed on the display unit 107, and the sound information shown in FIG. 8(1) is output from the sound output unit 108.

[0074] The screen shown in Fig. 8(1) is a screen displayed for a user to perform a photographing operation for photographing an image of a stump of a felled tree using the electronic device 100. The screen shown in Fig. 8(1) displays, for example, a display area DA1 that displays an image acquired by the image acquisition unit 103 (an image of a subject incident on the lens of the image acquisition unit 103), a photograph button 61, and a back button 62 together with text information indicating that an image of the stump of a felled tree will be acquired. Note that Fig. 8(1) shows a simplified example in which an image of the stump of a felled tree is displayed as an image acquired by the image acquisition unit 103.

[0075] When the screen shown in FIG. 8(1) is displayed on the display unit 107, the user aims the lens of the image acquisition unit 103 at the cut surface of the stump so that the image of the cut surface of the stump is displayed in the display area DA1. Then, when the image of the cut surface of the stump is displayed in the display area DA1, the user performs a photographing operation by pressing the photographing button 61. When the photographing operation of pressing the photographing button 61 is performed, the control unit 104 acquires an image acquired by the image acquisition unit 103 at the timing when the photographing operation is performed. Then, the control unit 104 determines whether or not the cut surface of the tree is included in the acquired image.

[0076] It is possible to determine whether the image acquired by the image acquisition unit 103 includes a cut surface (annual rings) of a tree by using a known image recognition technique. For example, as described above, it is possible to extract the round shape (or approximately round shape) of each tree and the shape (pattern) of the annual rings included in the image acquired by the image acquisition unit 103 by using a known image recognition technique. Therefore, it is possible to determine that the image acquired by the image acquisition unit 103 includes a cut surface (annual rings) of a tree, provided that the image acquired by the image acquisition unit 103 includes a round shape (or approximately round shape) of a tree and the sharpness of the image of the shape (pattern) of the annual rings included in the round shape is equal to or greater than a threshold (i.e., the degree of blur is less than a threshold). It is possible to calculate the sharpness of the image by using a known image recognition technique.

[0077] In this way, when the user performs a photographing operation by pressing the photographing button 61 on the screen shown in Fig. 8(1), the control unit 104 judges whether or not the cut surface of the tree is included in the image acquired based on the photographing operation. If the cut surface of the tree is not included in the acquired image, the screen shown in Fig. 8(2) is displayed on the display unit 107, and the sound information shown in Fig. 8(2) is output from the sound output unit 108. On the other hand, if the cut surface of the tree is included in the acquired image, the screen shown in Fig. 8(3) is displayed on the display unit 107, and the sound information shown in Fig. 8(3) is output from the sound output unit 108.

[0078] The screen shown in FIG. 8(2) is a screen that is displayed when the acquisition of an image based on the pressing operation (photographing operation) of the photographing button 61 shown in FIG. 8(1) has failed. In this embodiment, the term "pressing operation" includes a selection operation for selecting an operation sign (e.g., an icon, a button) displayed on a touch panel, a touch operation, and the like. For example, the control unit 104 determines that the acquisition of an image has failed when the image acquired based on the pressing operation (photographing operation) of the photographing button 61 shown in FIG. 8(1) does not include a cut surface of a tree, when the area of ​​the cut surface of the tree included in the acquired image is small based on an area threshold, when the degree of blur of the cut surface of the tree included in the acquired image is poor based on a blur threshold, and the like. In addition, a publicly known technique for photographing a target object may be used to determine whether the image acquisition of the target cut surface has been successful, or artificial intelligence (AI) may be used to determine whether the image acquisition of the target cut surface has been successful.

[0079] The area threshold can be set to a value that allows identification of a tree using a cut surface of the tree, which will be described later. This area threshold can be set appropriately based on experiments, simulations, etc. The blur threshold can also be set to a value that allows identification of a tree using a cut surface (annual rings), which will be described later. This blur threshold can also be set appropriately based on experiments, simulations, etc.

[0080] When the screen shown in FIG. 8(2) is displayed on the display unit 107, the user performs the photographing operation again of the image of the stump's cut surface, similar to the example shown in FIG. 8(1). The photographing operation is performed until an appropriate image is acquired as the image of the stump's cut surface. Then, when an appropriate image is acquired as the image of the stump's cut surface, the screen shown in FIG. 8(3) is displayed on the display unit 107, and the sound information shown in FIG. 8(3) is output from the sound output unit 108.

[0081] The screen shown in FIG. 8(3) is a screen that is displayed when the image acquisition based on the pressing operation (photographing operation) of the photographing button 61 shown in FIG. 8(1) is successful. For example, an OK button 65 and a back button 66 are displayed on the screen shown in FIG. 8(3) together with a message indicating that the image of the cut surface of the stump has been successfully acquired. The OK button 65 is a button for performing an operation to proceed to the next photographing after confirming the contents of the screen shown in FIG. 8(3). When the user performs a pressing operation to press the OK button 65 on the screen shown in FIG. 8(3), the control unit 104 causes the display unit 107 to display the screen shown in FIG. 9(1). In addition, when the OK button 65 is pressed, information about the image based on the pressing operation (photographing operation) of the photographing button 61 is stored in the tree information DB 110 of the storage unit 105. For example, as shown in FIG. 4, information about the tree is stored.

[0082] From this point on, the user repeatedly photographs the cut surfaces of the tree, starting from the cut surface of the tree opposite the cut surface of the stump toward the top of the tree, while referring to the screens shown in Figures 9(1) to (3). When all cut surfaces of the felled tree have been photographed, the user presses the end button 76 on the screen shown in Figure 9(3). When the OK button 75 (see Figure 9(3)) is pressed, information about the image based on the pressing operation (photographing operation) of the capture button 71 (see Figure 9(1)) is stored in the tree information DB 110 of the storage unit 105. For example, information about the tree is stored as shown in Figure 4.

[0083] It is also assumed that the same cut surface may be photographed multiple times due to a user's erroneous operation, mistake, or the like. In order to prevent the same cut surface from being photographed multiple times, when it is detected that the same cut surface has been photographed, a warning display or warning sound may be output to prompt the user to photograph the correct cut surface again. For example, it is possible to detect that the same cut surface has been photographed based on an image identity judgment (identity judgment or similarity judgment of the annual rings of the cut surface). For this image identity judgment (or similarity judgment), each of the image processing techniques described above can be used.

[0084] Also, each sensor may be used to detect that the same cut surface has been photographed multiple times. For example, if the cut surface is photographed multiple times while the electronic device 100 is hardly moved, there is a possibility that the same cut surface has been photographed multiple times. Therefore, it is possible to determine whether the electronic device 100 has moved a predetermined amount or more by using various sensors (e.g., acceleration sensor, gyro sensor) provided in the electronic device 100. Then, it is determined whether the electronic device 100 has moved a predetermined amount or more each time the cut surface is photographed, and if the electronic device 100 has moved less than the predetermined amount each time the cut surface is photographed, it can be determined that the same cut surface has been photographed multiple times. On the other hand, if the electronic device 100 has moved a predetermined amount or more each time the cut surface is photographed, it can be determined that a different cut surface has been photographed.

[0085] Also, the patterns of the cut surfaces of opposing trees are often the same or approximately the same. For example, the cut surface 31a of the stump and the cut surface 32a of the tree, the cut surface 32b of the stump and the cut surface 33a of the tree, and the cut surface 33b of the stump and the cut surface 34a of the tree shown in FIG. 2(2) have the same or approximately the same patterns. Therefore, based on these relationships, it may be determined whether or not an appropriate image has been acquired. For example, the similarity of the image between the cut surface of the stump and the cut surface of the tree photographed next may be determined, and if the similarity is higher than a standard, it may be determined that the cut surface of the tree photographed next to the cut surface of the stump was photographed in a different order, and a warning display or warning sound may be output to that effect, urging the user to photograph the correct cut surface. It should be noted that the similarity of the images can be determined using a known image recognition technology.

[0086] It is also assumed that a felled tree is divided into a plurality of pieces and each of the pieces is piled up. In this case, a plurality of cut surfaces may be acquired by one shot. In this case, an image (including a plurality of cut surfaces) shot at one time is displayed on the display unit 107, and the user can manually specify the order from the stump in sequence while viewing the plurality of cut surfaces included in the image. It is also assumed that a felled tree is divided into a plurality of pieces and each of the pieces is piled up. In this case, each of the cut surfaces of the plurality of trees may be acquired by one shot. In this case, an image (including each of the cut surfaces of the plurality of trees) shot at one time is displayed on the display unit 107, and the user can manually specify the order from the stump of the same tree in sequence for each felled tree while viewing the plurality of cut surfaces included in the image. In this way, a plurality of cut surfaces may be acquired by one shot, and an image of each cut surface may be acquired by a user operation, or may be acquired automatically. Examples of automatic acquisition are shown in Figs. 13 to 15, etc.

[0087] When the end button 76 shown in FIG. 9(3) is pressed, the screen shown in FIG. 10(1) is displayed on the display unit 107. The screen shown in FIG. 10(1) displays a message indicating that the acquisition of the images of the cut surfaces of the felled trees has been completed, a message indicating that the images should be confirmed, and a display button 81 and a back button 82. In addition, together with the message displayed on the screen shown in FIG. 10(1), a sound corresponding to the message may be output from the sound output unit 108. Note that, if the image capturing of all the images of the cut surfaces of the felled trees has not been completed, the back button 82 can be pressed to display the screen shown in FIG. 9(1). On the other hand, if the image capturing of all the images of the cut surfaces of the felled trees has been completed, the display button 81 can be pressed to display the screen shown in FIG. 10(2).

[0088] The screen shown in Fig. 10(2) is a screen that displays a list of images (images of the cut surfaces of felled trees) acquired using the screens shown in Fig. 8(1) to Fig. 9(3). This screen also displays a confirmation button 83 and a take-image-again button 84. Note that, although this example shows an example in which a list of images of the cut surfaces of felled trees is displayed on the same screen, only some of the images of the cut surfaces of felled trees may be displayed in sequence by user operation.

[0089] The user visually compares the multiple images (images of the cut surfaces of the felled tree) displayed on the screen shown in FIG. 10(2) with the actual cut surfaces of the felled tree. If the multiple images displayed on the screen shown in FIG. 10(2) match the actual cut surfaces of the felled tree as a result of the visual check, it can be determined that the images of the cut surfaces of the felled tree have been properly acquired. In this case, the user presses the confirmation button 83. When the confirmation button 83 is pressed, a screen shown in FIG. 10(3) is displayed. On the other hand, if the two do not match as a result of the visual check, it can be determined that the images of the cut surfaces of the felled tree have not been properly acquired. In this case, the user presses the capture button 84 again. When the capture button 84 is pressed again, a screen for acquiring the cut surfaces of the felled tree (for example, a screen shown in FIG. 8(1) or FIG. 9(1)) is displayed. Using this screen, the user sequentially performs an operation to acquire the images that were not successfully captured or all the images.

[0090] The screen shown in FIG. 10(3) is a screen for registering an image (an image of a cut surface of a felled tree) acquired using each screen shown in FIG. 8(1) to FIG. 9(3). In addition, a registration button 85 and a back button 86 are displayed on this screen. When the registration button 85 is pressed, information about each image displayed on the screen shown in FIG. 10(2) is stored in the tree information DB 110 of the storage unit 105. In addition, the information stored in the tree information DB 110 of the storage unit 105 (information about each image displayed on the screen shown in FIG. 10(2)) is transmitted from the electronic device 100 to the information processing device 200. Then, the information processing device 200 stores the information transmitted from the electronic device 100 in the storage unit 203. For example, information about trees is stored as shown in FIG. 6.

[0091] [Example of electronic device operation during tree felling] Fig. 11 is a flow chart showing an example of a process for acquiring information about trees in electronic device 100. This process is executed by control unit 104 based on a control program stored in storage unit 105. This process is started based on an operation for starting a tree cutting operation. This process will be described with reference to Figs. 1 to 10 as appropriate.

[0092] In step S501, the control unit 104 executes an output process to output an instruction to acquire an image of a stump of a felled tree. For example, the instruction is output by displaying characters or images on the display unit 107, or by outputting audio from the audio output unit 108. For example, the screens shown in Figs. 7(1) to (3) are displayed on the display unit 107, and the audio shown in Figs. 7(1) to (3) are output from the audio output unit 108. Then, when the acquire stump image button 55 shown in Fig. 7(3) is pressed, the display screen shown in Fig. 8(1) is displayed on the display unit 107, and the audio information shown in Fig. 8(1) is output from the audio output unit 108.

[0093] In step S502, the control unit 104 determines whether or not an instruction to acquire information about trees has been given. For example, it is determined whether or not the capture button 61 shown in FIG. 8(1) has been pressed. If the capture button 61 has been pressed, it is determined that an instruction to acquire information about trees has been given, and if the capture button 61 has not been pressed, it is determined that an instruction to acquire information about trees has not been given. If an instruction to acquire information about trees has been given, the image acquisition unit 103 acquires the information about trees, and the process proceeds to step S503. On the other hand, if an instruction to acquire information about trees has not been given, the process returns to step S501.

[0094] In step S503, the control unit 104 acquires and analyzes information (images) about the tree acquired by the image acquisition unit 103. For example, as shown in Figs. 8(1) to (3), it is possible to analyze images (cut surfaces) about the tree.

[0095] In step S504, the control unit 104 judges whether or not a suitable image of the stump has been acquired. If a suitable image of the stump has been acquired, the process proceeds to step S506. On the other hand, if a suitable image of the stump has not been acquired, the process proceeds to step S505.

[0096] In step S505, the control unit 104 outputs an instruction to acquire an image of the same stump again, and the process returns to step S502. For example, the screen shown in FIG. 8(2) is displayed on the display unit 107, and the sound shown in FIG. 8(2) is output from the sound output unit 108.

[0097] In step S506, the control unit 104 acquires location information indicating the current location of the electronic device 100. This location information is acquired by the location information acquisition unit 102 and output to the control unit 104.

[0098] In step S507, the control unit 104 associates the image of the stump acquired in step S503 with the position information acquired in step S506, and stores them in the tree information DB 110 (see FIG. 4) of the storage unit 105. For example, the image of the stump acquired in step S503 is stored in the image information 113 in association with the cut surface identification information 112 "0", the position information acquired in step S506 is stored in the position information 114, and the acquisition times of these are stored in the time information 115. Note that the image of the stump acquired in step S503 may be stored after undergoing various image processing (e.g., resizing, cutting) so that the round shape (or approximately round shape) of the cut surface has a predetermined size, or the image may be stored after performing the above-mentioned rotation processing.

[0099] In step S508, the control unit 104 outputs an instruction to sequentially acquire images of the cut surface of the felled tree from the bottom. For example, the screen shown in Fig. 8(3) is displayed on the display unit 107, and the sound shown in Fig. 8(3) is output from the sound output unit 108. Then, when the OK button 65 is pressed, the screen shown in Fig. 9(1) is displayed on the display unit 107, and the sound shown in Fig. 9(1) is output from the sound output unit 108.

[0100] Each process of steps S509 to S514 is a process for acquiring an image of a stump surface other than a stump, and corresponds to each process of steps S502 to S507 in terms of acquiring an image of a stump surface. Therefore, the description here is omitted. For example, when the photographing button 71 (see FIG. 9(1)) is pressed in step S509 and an appropriate image of the cut surface is not acquired, a screen shown in FIG. 9(2) is displayed on the display unit 107 in step S512, and a sound shown in FIG. 8(2) is output from the sound output unit 108. Also, for example, when the photographing button 71 (see FIG. 9(1)) is pressed in step S509 and an appropriate image of the cut surface is acquired, a screen shown in FIG. 9(3) is displayed on the display unit 107, and a sound shown in FIG. 9(3) is output from the sound output unit 108.

[0101] In step S515, the control unit 104 judges whether or not an end instruction has been given. For example, if the end button 76 is pressed on the screen shown in Fig. 9(3), it is judged that an end instruction has been given. If an end instruction has been given, the process proceeds to step S516. On the other hand, if an end instruction has not been given, the process returns to step S508.

[0102] In step S516, the control unit 104 causes the display unit 107 to display each image (an image of the cut surface of the felled tree) acquired in each process up to step S515. In this case, the control unit 104 can display each image (an image of the cut surface of the felled tree) based on the image information stored in the image information 113 of the tree information DB 110 (see FIG. 4). For example, the screen shown in FIG. 10(2) is displayed on the display unit 107.

[0103] In step S517, the control unit 104 judges whether or not a confirmation operation has been performed after checking each image displayed on the display unit 107. For example, if a pressing operation of pressing the confirmation button 83 has been performed on the screen shown in Fig. 10(2), it is judged that a confirmation operation has been performed. If a confirmation operation has been performed, the process proceeds to step S519. On the other hand, if a confirmation operation has not been performed, the process proceeds to step S518.

[0104] In step S518, the control unit 104 judges whether or not a re-shooting operation has been performed after checking each image displayed on the display unit 107. This re-shooting operation is an operation that is performed when the user who has checked each image displayed on the display unit 107 judges that it is necessary to re-shoot at least a part of each image. For example, when a pressing operation is performed to press the shooting button 84 again on the screen shown in FIG. 10(2), it is judged that a re-shooting operation has been performed. If a re-shooting operation has been performed, the process returns to step S501. On the other hand, if a re-shooting operation has not been performed, the process returns to step S516.

[0105] In step S519, the control unit 104 transmits tree information (tree information DB 110 of the storage unit 105) related to each image displayed in step S516 to the information processing device 200. In this case, the information transmitted to the information processing device 200 includes transmitting device identification information for identifying the electronic device 100. Note that, although not described in FIG. 11, a screen shown in FIG. 10(3) (a screen for registering an image of a cut surface of a felled tree) may be displayed on the display unit 107, and the process of step S519 may be executed on the condition that the registration button 85 is pressed on this screen.

[0106] [Example of operation of information processing device when registering tree information] Fig. 12 is a flow chart showing an example of a registration process of tree-related information in the information processing device 200. This registration process is executed by the control unit 202 based on a control program stored in the storage unit 203. This registration process is also executed constantly for each control cycle. This registration process will be described with appropriate reference to Figs. 1 to 11.

[0107] In step S521, the control unit 202 executes a monitoring process for monitoring the reception of tree information transmitted from the electronic device. That is, the control unit 202 monitors whether the communication unit 201 has received tree information about a cut tree.

[0108] In step S522, the control unit 202 determines whether or not tree information has been received. If tree information has been received, the process proceeds to step S523. On the other hand, for example, if tree information has not been received, the operation of the registration process is terminated.

[0109] In step S523, the control unit 202 associates the tree information received in steps S521 and S522 with the electronic device that transmitted the tree information, and stores the tree information in the tree information DB 210 (see FIG. 6) of the storage unit 203. For example, when the tree information is received from the electronic device 100, the control unit 202 stores the transmission device identification information for identifying the electronic device 100 in the transmission device identification information 211 (see FIG. 6), and stores each piece of information included in the tree information received from the electronic device 100 in the tree identification information 212, the cut surface identification information 213, the image information 214, the position information 215, and the image acquisition time information 216 (see FIG. 6). Then, the control unit 202 stores the time when the tree information was received from the electronic device 100 in the reception time information 217 (see FIG. 6). This completes the process of registering the tree information received from the electronic device 100 in the tree information DB 210.

[0110] [Example of estimating the cutting surface of a felled tree] In the above, an example has been shown in which the cut surfaces of felled trees are photographed for each cut surface to obtain an image of each cut surface. Here, the task of photographing each cut surface of felled trees may increase the burden on the worker. Therefore, here, an example will be described in which images of each cut surface of multiple trees that have been felled and piled are obtained, and the cut surfaces of each tree are estimated based on the images of each cut surface.

[0111] 13 and 14 are diagrams showing a simplified estimation method for estimating the cut surface of each felled tree.

[0112] 13(1) shows an example of the configuration of trees 700, 710, ..., 740 of stumps 701, 711, 721, 731, 741. Note that the configurations of the trees 700, 710, 740 of the stumps 721 and 731 are the same as those of the trees 700, 710, 740, and therefore are not shown here.

[0113] A tree 700 cut from a stump 701 is cut into four trees 702 to 705 using four cut surfaces. The cut surfaces of the trees 702 to 704 are indicated as cut surfaces A1 to A6. The tree 705 is excluded from the distribution of trees. Cut surface A of the stump 701, cut surfaces A1 and A2 at both ends of the tree 702, cut surfaces A3 and A4 at both ends of the tree 703, and cut surfaces A5 and A6 at both ends of the tree 704 are recorded as images for managing the trees. In addition, the cut surface opposite cut surface A of stump 701 is cut surface A1 of tree 702, the cut surface opposite cut surface A2 of tree 702 is cut surface A3 of tree 703, the cut surface opposite cut surface A4 of tree 703 is cut surface A5 of tree 704, and the cut surface opposite cut surface A6 of tree 705 is cut surface A7 of tree 705.

[0114] The same applies to the configurations and the relationship between the cut surfaces of the trees 710 and 740. In the example shown in Fig. 13, for ease of explanation, a felled tree is cut in four places and the tree to be traded is divided into three pieces, but the cut locations and the number of divisions are not limited to this.

[0115] Fig. 13(2) shows an example of an image 610 including stumps 701, 711, 721, 731, and 741 of felled trees. However, for ease of explanation, the same reference numerals as those for the cross sections A to E shown in Fig. 13(1) are attached within the circles corresponding to the stumps shown in the image 610 shown in Fig. 13(2). The image 610 may be captured by the user U0 from a high position using the electronic device 100, or may be captured using another device (for example, an aircraft such as a drone).

[0116] Also, for example, as shown by dotted frames 611 to 615, it is possible to extract and use images of tree stumps 701, 711, 721, 731, and 741 included in image 610. As for the method for extracting the images of tree stumps 701, 711, 721, 731, and 741, as described above, a known image extraction method can be used.

[0117] Fig. 14(1) shows a state where a plurality of felled trees 650 are piled up. In this example, instead of photographing each cut surface of the felled trees, the cut surfaces of the felled trees 650 are photographed collectively after the felled trees 650 are piled up in one place. Specifically, as shown in Fig. 14(1), images of both sides of each cut surface of the felled and piled trees 650 are acquired by the image acquisition unit 103 of the electronic device 100. Images 660, 670 thus acquired are shown in Fig. 14(2).

[0118] FIG. 14(2) shows images 660 and 670 including both ends of each cut surface of a plurality of trees 700, 710, ..., 740. Note that image 660 is an image captured so as to include one end of each cut surface of a plurality of trees 700, 710, ..., 740 that have been cut down and piled up in one place. Image 670 is an image captured so as to include the other end of each cut surface of a plurality of trees 700, 710, ..., 740 that have been cut down and piled up in one place. These images 660 and 670 are generated using electronic device 100. Images 660 and 670 generated in this manner are stored in storage unit 105 in association with each other.

[0119] In addition, in the circles corresponding to the cut surfaces shown in the images 660 and 670 shown in FIG. 14(2), the same reference numerals as those of the cut surfaces A1 to A5, B1 to B5, ..., E1 to E5 shown in FIG. 13(1) are used for ease of explanation. In addition, the images 660 and 670 include a plurality of trees stacked in three tiers, similar to the state shown in FIG. 14(1). Specifically, six trees are stacked in the lower tier, five trees are stacked in the middle tier, and four trees are stacked in the upper tier. In addition, in FIG. 14(1)(2), the gaps between the trees are simplified for ease of explanation.

[0120] As described above, the cut surface A and the cut surface A1 of the stump are substantially the same. Similarly, the relationship between the cut surfaces B to E of the stump and the cut surfaces B1 to E1 is similar. Therefore, the control unit 104 of the electronic device 100 extracts cut surfaces substantially the same as the cut surfaces A to E of the stump, that is, the cut surfaces A1 to E1, from the images 660 and 670. For example, as described above, it is possible to extract the cut surfaces A1 to E1 from the images 660 and 670 using a known image recognition technique. For example, the control unit 104 of the electronic device 100 extracts the cut surface A1 substantially the same as the cut surface A of the stump from the image 660. Similarly, the control unit 104 of the electronic device 100 extracts the cut surfaces B1 to E1 substantially the same as the cut surfaces B to E of the stump from the images 660 and 670. For ease of explanation, a method for identifying the cut surface of the tree 710 will be described below, but the methods for identifying the cut surfaces of the trees 720, 730, 740, and 750 are similar.

[0121] Next, another cut surface A2 of tree 702 having cut surface A1 is extracted from images 660 and 670. In this example, since cut surface A1 is included in image 660, cut surface A2 on the opposite side of cut surface A1 is included in image 670. Therefore, control unit 104 of electronic device 100 extracts cut surface A2 from image 670 different from image 660 from which cut surface A1 was extracted. Here, the relationship between trees 702 to 704, trees 712 to 714, ..., trees 742 to 744 included in images 660 and 670 is symmetrical.

[0122] For example, tree 702 is placed at the left end (cutting plane A1) of the bottom row in image 660, and at the right end (cutting plane A2) of the bottom row in image 670. Furthermore, for example, tree 703 is placed at the right end (cutting plane A3) of the bottom row in image 660, and at the left end (cutting plane A4) of the bottom row in image 670. Furthermore, for example, tree 704 is placed at the left end (cutting plane A6) of the top row in image 660, and at the right end (cutting plane A5) of the top row in image 670. The same applies to the other trees.

[0123] Next, the control unit 104 of the electronic device 100 extracts a cut surface that is substantially the same as the cut surface A2, i.e., the cut surface A3, from the images 660 and 670. In the example shown in FIG. 14(2), the cut surface A3 is located at the right end of the bottom row of the image 660, so the control unit 104 of the electronic device 100 extracts the cut surface A3 from the image 660.

[0124] Next, another cut surface A4 of tree 703 having cut surface A3 is extracted from images 660 and 670. In this example, since cut surface A3 is included in image 660, cut surface A4 is included in image 670. Therefore, control unit 104 of electronic device 100 extracts cut surface A4 from image 670 that is different from image 660 from which cut surface A3 was extracted.

[0125] Next, the control unit 104 of the electronic device 100 extracts a cut surface that is substantially the same as the cut surface A4, i.e., the cut surface A5, from the images 660 and 670. In the example shown in FIG. 14(2), the cut surface A5 is located at the right end of the top row of the image 670, so the control unit 104 of the electronic device 100 extracts the cut surface A5 from the image 670.

[0126] Next, another cut surface A6 of tree 704 having cut surface A5 is extracted from images 660 and 670. In this example, since cut surface A5 is included in image 670, cut surface A6 is included in image 660. Therefore, control unit 104 of electronic device 100 extracts cut surface A6 from image 660 different from image 670 from which cut surface A5 was extracted.

[0127] Next, the control unit 104 of the electronic device 100 extracts a cut surface that is substantially the same as the cut surface A6, i.e., the cut surface A7, from the images 660 and 670. However, in the example shown in FIG. 14(2), the tree 705 having the cut surface A7 is excluded from the distribution of trees, and is therefore not included in the images 660 and 670. In this case, the control unit 104 of the electronic device 100 can determine that the trees cut from the stump 701 are the trees 702 to 704, and that the cut surfaces of the trees 702 to 704 are the cut surfaces A1 to A6. Therefore, the control unit 104 of the electronic device 100 stores the extracted cut surfaces A1 to A6 in the storage unit 105 in association with the cut surface A of the stump.

[0128] [Example of operation when obtaining tree information about multiple felled trees] Fig. 15 is a flow chart showing an example of an acquisition process for acquiring tree information on a plurality of felled trees. The acquisition process is executed by the control unit 104 based on a control program stored in the storage unit 105. The acquisition process is started when a predetermined operation is performed after the tree felling operation is completed. Although this acquisition process shows an example of acquiring tree information using two images including the cut surfaces at both ends of the tree, it is also applicable to a case where tree information is acquired using four or more images (however, an even number of images) including the cut surfaces at both ends of the tree.

[0129] In step S531, the control unit 104 acquires position information and images of stumps of multiple felled trees. For example, an image of a stump photographed using the screen shown in Fig. 8(1) and position information at the time of photographing can be stored in the storage unit 105 in association with each other, and the image of each stump and each position information can be acquired from the storage unit 105. Also, for example, as shown in Fig. 13(2), the stumps of multiple felled trees may be photographed as one image, or one or multiple stumps may be photographed as one image, and the images may be synthesized and used.

[0130] In step S532, the control unit 104 acquires two images of the cut surfaces at both ends of the multiple trees that have been felled and piled. For example, as shown in FIG. 14(1), two images taken using the electronic device 100 (two images acquired by the image acquisition unit 103) can be stored in the storage unit 105 in association with each other, and these images can be acquired from the storage unit 105.

[0131] In step S533, the control unit 104 specifies the up-down direction of each of the two images acquired in step S532 at the time of capturing the images. For example, imaging devices such as smartphones are often provided with a sensor (for example, a gyro sensor, an acceleration sensor) that detects the movement and state of the device. Using this sensor, the up-down direction of the image at the time of capturing the image is recorded as attribute information of the image, and the up-down direction of the image can be acquired based on this attribute information. For example, the up-down direction of the images 660 and 670 is specified as shown by arrows AR1 and AR2 in FIG. 14(2). In addition, the left-right direction of the images 660 and 670 is specified in response to the up-down direction of the images 660 and 670 being specified as shown by arrows AR3 and AR4 in FIG. 14(2).

[0132] In step S534, the control unit 104 determines whether or not each tree has symmetry based on the configuration of each tree included in the two images acquired in step S532. For example, when multiple felled trees are piled and their cut surfaces are photographed, the configuration of the piled trees is expected to be symmetrical (or approximately symmetrical).

[0133] For example, it is possible to extract the contours of each tree included in the two images using a known image recognition technique (for example, edge detection). This makes it possible to obtain the circular shape (or approximately circular shape) of each tree included in the two images. Therefore, it is possible to compare the configuration of trees included in one of the two images with the configuration of trees included in an image obtained by flipping the other of the two images horizontally, and determine that each tree has symmetry on the condition that the number of trees in the vertical and horizontal directions is the same. Alternatively, in addition to the match in number, a difference value of the image of the contour of each tree included in the two images to be compared may be calculated, and it may be determined that each tree has symmetry on the condition that the difference value is within a threshold value. In this way, when it is determined that each tree has symmetry, the control unit 104 associates each target tree with each tree included in the two images and stores it.

[0134] For example, the images 660 and 670 shown in FIG. 14(2) include a plurality of trees stacked in three layers, with six trees stacked in the lower layer, five trees stacked in the middle layer, and four trees stacked in the upper layer. Therefore, when the configuration of trees included in one image 660 is compared with the configuration of trees included in an image obtained by flipping the image 670 from side to side, the number of trees in the vertical and horizontal directions will match. In addition, the arrangement of each tree included in the two images to be compared is approximately the same, so the difference value of the image of the contour of each tree included in the two images to be compared is within a threshold value. Therefore, it is determined that there is symmetry between each tree included in the images 660 and 670. In this case, the control unit 104 associates each target tree with each tree included in the images 660 and 670 and stores it. For example, the tree B5 included in the image 660 and the tree B6 included in the image 670 that exists at a position corresponding to it are associated and stored. Similarly, combinations of corresponding trees are stored for the other trees.

[0135] In step S535, the control unit 104 judges whether or not it is judged in step S534 that each tree has symmetry. For example, if the number of trees included in the two images acquired in step S532 is different, or the configuration of the trees included in the two images is significantly different, it is judged that each tree does not have symmetry. If it is judged that each tree has symmetry, the process proceeds to step S536. On the other hand, if it is judged that each tree does not have symmetry, the process proceeds to step S546.

[0136] In step S546, the control unit 104 determines that the two images acquired in step S532 contain different trees. In this case, in step S549, the control unit 104 notifies the user of the determination result. For example, instruction information may be output to instruct the user to acquire two images containing the same tree.

[0137] In step S536, the control unit 104 selects one stump from among the stumps included in the image of the stump acquired in step S531 as a target stump, and extracts a cut surface opposite to the cut surface of the target stump from the two images acquired in step S532. For example, when the image of the stump 701 shown in FIG. 13(1) is selected as the target stump, the cut surface A1 of the tree 702 is extracted from the image 660 (see FIG. 14(2)) as the cut surface opposite to the cut surface A of the target stump. The control unit 104 also holds the position of the extracted cut surface A1 in the image 660. Note that the extraction method described above can be used as a method for extracting the opposite cut surface.

[0138] In step S537, the control unit 104 determines whether or not a cut surface opposite to the cut surface of the target stump was extracted in step S536. If a cut surface opposite to the cut surface of the target stump was extracted, the process proceeds to step S538. On the other hand, if a cut surface opposite to the cut surface of the target stump was not extracted, the process proceeds to step S547.

[0139] In step S547, the control unit 104 determines that the two images acquired in step S532 do not include the target stump included in the stump image acquired in step S531. In this case, in step S549, the control unit 104 notifies the user of the determination result. For example, the control unit 104 may output the image of the stump and instruction information instructing the user to acquire the correct combination of the two images.

[0140] In step S538, the control unit 104 identifies the cut surface of the other end surface of the cut surface (the cut surface opposite to the cut surface of the target stump) extracted in step S536 from the other image. As described above, when it is determined in step S534 that there is symmetry between the trees included in the two images, the target trees are associated and stored for each tree included in the two images. Thus, it is possible to identify the cut surface of the other end surface using this stored information. For example, a tree included in the image 660 (cut surface A1) and a tree included in the image 670 that exists at a corresponding position thereto (cut surface A2) are associated and stored. Therefore, it is possible to identify the cut surface A2 of the other end surface of the cut surface A1 extracted in step S536 from the image 670.

[0141] In step S539, the control unit 104 extracts a cut surface opposite to the cut surface identified in step S538 from the two images acquired in step S532. For example, when the cut surface A2 included in the image 670 is identified in step S538, the cut surface A3 of the tree 703 is extracted from the image 660 (see FIG. 14(2)) as the cut surface opposite to the cut surface A2. The control unit 104 also holds the position of the extracted cut surface A3 in the image 660. The method of extracting the opposite cut surface is the same as the extraction method shown in step S536.

[0142] In step S540, the control unit 104 judges whether or not a cut surface was extracted in step S539. If a cut surface was extracted, other end surface cut surfaces also exist, so the process returns to step S538 and executes the extraction process of the other end surface cut surfaces. On the other hand, if a cut surface was not extracted, the process judges that the extraction process of the cut surfaces included in the two images acquired in step S532 has ended, and the process proceeds to step S541.

[0143] In step S541, the control unit 104 associates the target stump with each of the cut surfaces extracted (or identified) in steps S536, S538, and S539, and stores them in the storage unit 105. Each of these pieces of information is recorded in the tree information DB 110 (see FIG. 4) in step S544.

[0144] In step S542, the control unit 104 judges whether or not all stumps included in the stump image acquired in step S531 have been set as target stumps. If all stumps have not been set as target stumps, the process returns to step S536 to execute the above-mentioned processes for the other stumps. On the other hand, if all stumps have been set as target stumps, the process proceeds to step S543 since the above-mentioned processes for all stumps have been completed.

[0145] In step S543, the control unit 104 determines whether or not there is a cut surface that has not been extracted (or identified) in steps S538 and S539 in the two images acquired in step S532. If there is no such cut surface in the two images, the process proceeds to step S544. On the other hand, if there is such a cut surface in the two images, the process proceeds to step S548.

[0146] In step S544, the control unit 104 associates all stumps included in the stump image acquired in step S531, each cut surface extracted (or identified) in steps S536, S538, and S539, and position information, and stores them in the tree information DB 110. For example, for all stumps included in the stump image acquired in step S531, each piece of information is recorded in the tree information DB 110 (see FIG. 4). In this case, the tree identification information 111 stores identification information for the number of stumps to be recorded. Furthermore, the cut surface identification information 112 stores identification information for the total number of stumps and each cut surface extracted (or identified) in steps S536, S538, and S539. For example, referring to FIG. 14(2), the cut surface A of the stump is associated and stored with the cut surfaces A1 to A6 included in the images 660 and 670. In this case, the image information 113 stores an image of the cut surface A of the stump and images of the cut surfaces A1 to A6 extracted from the images 660 and 670. A known image processing technique can be used for extracting the images. The position information 114 stores position information associated with the image of the stump acquired in step S531. The time information 115 stores time information associated with the image of the stump acquired in step S531, the time when the above-mentioned extraction process was completed, etc.

[0147] In step S545, the control unit 104 transmits each piece of information stored in the tree information DB 110 to the information processing device 200. This transmission is similar to the transmission process in step S519 shown in FIG.

[0148] In step S548, the control unit 104 determines that the two images acquired in step S532 include a tree other than the tree included in the stump image acquired in step S531. In this case, in step S549, the control unit 104 notifies the user of the determination result. For example, the control unit 104 may output the image of the stump and instruction information instructing the user to acquire the correct combination of the two images.

[0149] [Example of obtaining information about trees at a collection point for felled trees] FIG. 16 is a diagram showing an example of acquiring information about the felled trees 32 to 34 (see FIG. 2) at a collection point where the felled trees 32 to 34 are collected.

[0150] Fig. 16(1) shows the state where trees 32 to 34 loaded onto a transport vehicle TR1 have arrived at a timber collection point. Fig. 16(2) shows an example in which the cut surfaces of the trees 32 to 34 are photographed by an imaging device 300 to obtain images.

[0151] As shown in FIG. 16(1), when felled trees 32 to 34 arrive at a timber collection point, information about the trees 32 to 34 is acquired in order to prove where the trees 32 to 34 were felled. For example, as shown in FIG. 16(2), each cut surface of the trees 32 to 34 can be photographed by the imaging device 300 to acquire images. Note that the imaging of each cut surface of the trees 32 to 34 may be performed while the trees are loaded on the transport vehicle TR1, or may be performed after the trees are unloaded from the transport vehicle TR1. The imaging device 300 is a device (e.g., a digital still camera, a digital video camera, a smartphone) capable of transmitting images to the information processing device 200 by using wired or wireless communication. Note that the images generated by the imaging device 300 may be transferred to the information processing device 200 by using a recording medium.

[0152] The information processing device 200 certifies the identity of the trees 32 to 34 by using the image acquired from the imaging device 300. Specifically, as shown in Fig. 16(3), the control unit 202 performs the certification by comparing the image acquired from the imaging device 300 with image information stored in the tree information DB 210 of the storage unit 203. This certification method will be described in detail with reference to Fig. 17.

[0153] [Example of tree certification at a collection point for felled trees] FIG. 17 is a diagram showing an example of certifying the felling locations of the felled trees 32 to 34 (see FIG. 2) at a collection point where the felled trees 32 to 34 are collected.

[0154] FIG. 17(1) shows an example of certification when the felling site is specified. As shown in FIG. 16(3), the image acquired from the imaging device 300 is compared with the image information stored in the tree information DB 210 of the storage unit 203, and when it is confirmed based on the comparison result that each tree included in the image acquired from the imaging device 300 is identical to the tree whose tree information is stored in the tree information DB 210 of the storage unit 203, the control unit 202 generates certification information that certifies the felling site of each tree included in the image acquired from the imaging device 300. For example, the control unit 202 generates a file in which information about the felling site is added to the image file acquired from the imaging device 300. For example, image files 811 and 812 are generated in which certification information such as text information about the felling site "This certifies that these trees were felled in ▽, □-machi, □-gun, Gunma Prefecture" is added to the images of the trees 32 to 34. Note that these certification information are merely examples, and certification information may be generated by other methods.

[0155] FIG. 17(2) shows an example of proof when the felling site is not specified. As shown in FIG. 16(3), when the image acquired from the imaging device 300 is compared with the image information stored in the tree information DB 210 of the storage unit 203, and the control unit 202 is unable to confirm the identity of each tree included in the image acquired from the imaging device 300 with the tree whose tree information is stored in the tree information DB 210 of the storage unit 203 based on the comparison result, the control unit 202 generates proof information that proves that the felling site of each tree included in the image acquired from the imaging device 300 is unknown. For example, the control unit 202 generates a file in which information indicating that the felling site is unknown is added to the image file acquired from the imaging device 300. For example, the control unit 202 generates image files 821 and 822 in which proof information such as text information indicating that the felling site is unknown, such as "This proves that the felling site of these trees is unknown," is added to the images of the trees 32 to 34. Note that these proof information are merely examples, and proof information may be generated by other methods.

[0156] [Example of operation during distribution of wood] FIG. 18 is a flowchart showing an example of a certification process in the information processing device 200 when trees are distributed. The certification process is executed by the control unit 202 based on a control program stored in the memory unit 203. The certification process is started based on a predetermined operation for starting the tree certification work. This certification process shows an example of a case where trees cut in the same felling area are traded. This certification process shows an example of a case where the felling area of ​​a tree is certified using two images including the cut surfaces at both ends of the tree, but it is also applicable to a case where four or more images (however, an even number of images) including the cut surfaces at both ends of the tree are used to certify the felling area of ​​a tree.

[0157] In step S561, the control unit 202 acquires an image of the cut surface of the tree to be traded. For example, as shown in Fig. 16(2), it is possible to acquire an image (an image of the cut surface of the tree) generated by an imaging device 300, which is an external device. Note that, if the information processing device 200 is equipped with an imaging device, it may acquire an image (an image of the cut surface of the tree) generated by the imaging device.

[0158] In step S562, control unit 202 compares the image of the cut surface acquired in step S561 with image information 214 in tree information DB 210 (see FIG. 6) in storage unit 203, and extracts the acquired image of the cut surface from image information 214. This extraction process can use the image search technique described above.

[0159] In step S563, the control unit 202 determines whether or not images of all the cut surfaces extracted in step S562 have been extracted from the image information 214. If images of all the extracted cut surfaces have been extracted from the image information 214, the process proceeds to step S564. On the other hand, if images of all the extracted cut surfaces have not been extracted from the image information 214, the process proceeds to step S568. Note that, for the image information of a stump (cut surface identification information 213 "0") among the image information stored in the image information 214, images of opposing cut surfaces exist among the images of the cut surfaces extracted in step S562, but no identical images exist. Therefore, image information other than the cut surface identification information 213 "0" among the image information stored in the image information 214 is subject to extraction.

[0160] In step S564, the control unit 202 determines whether the position information of all the images of the cut surfaces extracted in step S562 is the same felling site. If the position information of all the images of the extracted cut surfaces is the same felling site, the process proceeds to step S565. On the other hand, if the position information of all the images of the extracted cut surfaces is not the same felling site, the process proceeds to step S568.

[0161] For example, the control unit 202 acquires the position information 215 (see FIG. 6) corresponding to all the cut surface images extracted in step S562, and can determine whether the position information of the cut surface images is the same felling site based on this position information. For example, when each position specified by the position information acquired from the position information 215 is within a predetermined range (for example, a range that specifies the felling site), it can be determined that the position information of the cut surface images is the same felling site. On the other hand, when each position specified by the position information acquired from the position information 215 is not within a predetermined range (for example, a range that specifies the felling site) (for example, when each position is significantly different (for example, when it is different by about tens to hundreds of kilometers)), it can be determined that the position information of the cut surface images is not the same felling site. Here, for a tree whose stump position can be determined to be the same felling site, it can be estimated that the other cut surface trees of that tree are also the same felling site. Therefore, from the position information 215 corresponding to all the cut surface images extracted in step S562, only the position information corresponding to the stump (cut surface identification information 213 (see Figure 6) is "0") is obtained, and based on this position information corresponding to the stump, it may be determined whether the position information of the cut surface images is for the same felling site.

[0162] In step S565, the control unit 202 identifies the felling site of the tree to be traded based on the location information of the extracted registered image. For example, as described above, the felling site of the tree to be traded can be identified based on the location information associated with each stump image. For example, map information can be stored in the storage unit 203, and an address corresponding to the location information can be identified based on this map information and the location information associated with each stump image.

[0163] In step S566, the control unit 202 generates certification information related to the felling site of the tree to be traded identified in step S565. For example, information that associates the image of the cut surface acquired in step S561 with the felling site of the tree to be traded identified in step S565 is generated as the certification information. For example, as shown in FIG. 17(1), a file (e.g., an image file) is generated that describes the felling site of the tree to be traded identified in step S565 in the image of the cut surface acquired in step S561. Note that, although FIG. 17(1) shows an example of generating an image file, other information files (e.g., a text information file) may be generated.

[0164] In step S567, the control unit 202 executes an output process to output the file generated in step S566. For example, the control unit 202 can display the file generated in step S566 on the display unit 205, output audio information corresponding to the file from the sound output unit 206, or print and output the file from a printing device. The control unit 202 can also output the file information to an external device (for example, a portable device (for example, a smartphone or tablet terminal), or a fixed device (for example, a personal computer)) via the communication unit 201, and cause the file information to be output from a display unit or sound output unit of the external device.

[0165] In step S568, the control unit 202 determines that the felling site of the tree to be traded is unknown. That is, the felling site of the tree included in the image of the cut surface acquired in step S561 is determined to be unknown. Note that the felling sites of only a part of the trees to be traded may be identified. For example, the felling site of the tree corresponding to the image extracted from the image information 214 among the images of the cut surface extracted in step S562 may be identified, and the felling sites of the trees corresponding to the other images may be determined to be unknown. In this case, it is possible to generate certification information regarding the felling site for each tree.

[0166] In step S569, the control unit 202 generates certification information indicating that the felling site of the tree to be traded is unknown. For example, certification information is generated by adding information indicating that the felling site is unknown to the image of the cut surface acquired in step S561. For example, as shown in FIG. 17(2), a file (e.g., an image file) is generated in which information indicating that the felling site is unknown is added to the image of the cut surface acquired in step S561. This file is output in step S567.

[0167] In this way, the control unit 202 can compare the cut surface image acquired in step S561 with the image information 214 in the tree information DB 210 (see FIG. 6) in the storage unit 203, and perform multiple image searches in a single search process. In this case, the location where a tree was cut down may be certified on the condition that the cut surface images acquired in step S561 include all the cut surface images corresponding to the tree. Note that these certification processes are merely examples, and trees may be certified by other certification methods. For example, instead of a single search process, image searches may be performed sequentially for each cut surface.

[0168] [Example of acquiring images of stumps using an aircraft] As described above, it is possible to acquire images of one or more stumps from above a felled area using an aircraft. Hereinafter, an example of acquiring images of one or more stumps from above a felled area using an aircraft will be described.

[0169] [Example of acquiring images of stumps from above felled areas using an aerial vehicle] FIG. 19 is a simplified diagram illustrating an example of capturing images of stumps 911 to 915 of felled trees using an air vehicle 900.

[0170] The flying object 900 is an flying object that flies using wireless communication or an flying object that flies autonomously using artificial intelligence (AI). For example, a wireless airplane, a wireless helicopter, a wireless balloon, a drone, etc. can be used as the flying object 900. FIG. 19 shows an example in which a user P0 operates the flying object 900 using a remote control device 901. The remote control device 901 is a device for operating the flying object 900 using wireless communication. Note that the flying object 900 may be operated using an electronic device 100 (for example, a smartphone).

[0171] The flying object 900 includes an image acquisition unit 902 capable of acquiring images of the ground from the air during flight. The image acquisition unit 902 includes a camera device, an image sensor, and the like.

[0172] As shown in FIG. 19(1), after the felling of the trees is completed, the user P0 uses the remote control device 901 to operate the flying object 900 so as to fly over the stumps 911 to 915 of the felled trees. Then, the user P0 makes the flying object 900 wait in the sky so that all of the stumps 911 to 915 of the felled trees are included in the imaging range, and performs an operation to acquire images of the stumps 911 to 915 of the felled trees using the remote control device 901. The image 920 thus acquired is shown in FIG. 19(2). Note that, instead of acquiring an image in which all of the tree stumps 911 to 915 are included in the imaging range, images in which at least a part of the tree stumps 911 to 915 are included in the imaging range may be acquired sequentially, and the images of the tree stumps 911 to 915 may be acquired using each of these images. For example, a composite image including the tree stumps 911 to 915 may be generated by synthesizing a plurality of images.

[0173] As shown in FIG. 19(2), the image acquisition unit 902 of the flying object 900 acquires an image 920 including stumps 911 to 915 of felled trees. The image 920 acquired in this manner is transmitted to the electronic device 100. The control unit 104 of the electronic device 100 then performs a predetermined image processing on the image 920 and extracts images of the tree stumps 911 to 915 for each stump. For example, the images of the tree stumps 911 to 915 are extracted as shown by dotted rectangles 921 to 925. Note that a known image extraction technique can be used as a method for extracting the images of the tree stumps 911 to 915.

[0174] Then, the control unit 104 of the electronic device 100 associates the extracted images of the tree stumps 911 to 915 (indicated by dotted rectangles 921 to 925) with the location information acquired by the location information acquisition unit 102, and stores them in the storage unit 105. An example of this storage is shown in FIG. 20. Furthermore, the control unit 104 of the electronic device 100 transmits the information to the information processing device 200. Then, the control unit 202 of the information processing device 200 stores the received information in the storage unit 203. An example of this storage is shown in FIG. 21. Here, it is assumed that the electronic device 100 is located at a location away from the flying object 900. In such a case, instead of the location information acquired by the location information acquisition unit 102, the location information acquired by the location information acquisition unit of the flying object 900 may be used.

[0175] [Example of tree information DB configuration] Fig. 20 is a diagram showing an example of the configuration of a database (tree information DB 930) that stores information (information about cut trees) acquired by electronic device 100. Fig. 20 shows an example of storing information about tree stumps 911 to 915 shown in Fig. 19. Each piece of information shown in Fig. 20 is stored in tree information DB 930 of storage unit 105 under the control of control unit 104.

[0176] The tree information DB 930 stores felling site identification information 931, stump identification information 932, image information 933, location information 934, and time information 935 in an associated manner.

[0177] The felling site identification information 931 is information for identifying a site where multiple trees have been felled. For example, a combination of numbers (e.g., serial numbers), letters, symbols, etc. can be used as the felling site identification information 931. For example, a sufficient number of pieces of information (e.g., a combination of numbers, letters, symbols, etc.) that can identify each tree that exists in the world can be used.

[0178] The stump identification information 932 is information for identifying an image of a cut surface of a stump of a felled tree. For example, a number (for example, a serial number) that is assigned to the stumps of felled trees in order based on a predetermined rule can be used as the identification information. For example, the upper left stump included in the image can be numbered 1, and numbers can be assigned clockwise from the stump number 1 as a predetermined rule. For example, referring to FIG. 19, among the stumps 911 to 915 of felled trees, the upper left stump 911 (dotted rectangle 921) in the image 920 can be numbered 1, and numbers can be assigned clockwise from the stump 911 in the image 920. Specifically, the stump 912 (dotted rectangle 922) can be numbered 2, the stump 913 (dotted rectangle 923) can be numbered 3, the stump 915 (dotted rectangle 925) can be numbered 4, and the stump 914 (dotted rectangle 924) can be numbered 5. It should be noted that this predetermined rule is merely an example, and the identification information may be assigned based on other rules, or may be assigned randomly.

[0179] The image information 933 is image information acquired by the image acquisition unit 902 (see FIG. 19). For example, information on an image including a cut surface of a stump of a felled tree is stored as the image information 933. Note that the above-mentioned extraction method can be used to extract the image of the cut surface of the stump. Also, in FIG. 20, for ease of explanation, only the cut surface of the stump is shown as the simplified image information 933.

[0180] The position information 934 is position information (e.g., latitude, longitude, altitude) acquired by the position information acquisition unit 102 (or the position information acquisition unit of the flying object 900) when the image information 933 was acquired. Note that in Fig. 20, the latitude, longitude, and altitude are simplified and indicated by circles, etc., for ease of explanation.

[0181] The time information 935 is information (e.g., date and time) about the time when the image information 933 and the position information 934 were acquired. For example, when the image information 933 and the position information 934 are acquired, the control unit 104 stores the time acquired from the clock circuit as the time information 935 in the tree information DB 930.

[0182] [Example of tree information DB configuration] FIG. 21 is a diagram showing an example (tree information DB 940) of information (information on felled trees) stored in the information processing device 200. The information shown in FIG. 21 is information acquired by one or more electronic devices (including the electronic device 100), and is transmitted from each electronic device to the information processing device 200 periodically or irregularly (for example, in response to a user operation). FIG. 21 mainly shows an example of a case where information on the tree stumps 911 to 915 shown in FIG. 19 is stored. Each piece of information shown in FIG. 21 is stored in the tree information DB 940 of the storage unit 203 under the control of the control unit 202.

[0183] The tree information DB 940 stores transmission device identification information 941, felling site identification information 942, stump identification information 943, image information 944, location information 945, image acquisition time information 946, and reception time information 947 in an associated manner.

[0184] It should be noted that the transmitting device identification information 941 and the receiving time information 947 shown in Fig. 21 correspond to the transmitting device identification information 211 and the receiving time information 217 shown in Fig. 6. Also, the felling site identification information 942, the stump identification information 943, the image information 944, the position information 945, and the image acquisition time information 946 shown in Fig. 21 correspond to the felling site identification information 931, the stump identification information 932, the image information 933, the position information 934, and the time information 935 shown in Fig. 20, and therefore a description thereof will be omitted here.

[0185] 21 shows an example of information about trees stored in tree information DB 940, but similar to tree information DB 210 (see FIG. 6), other information about each tree may be stored in tree information DB 940. For example, as described above, information about the owner of a felled tree, information about the land where the tree was felled, information about the felled tree, and information about distribution of the tree may be stored in tree information DB 940. Then, when generating certification information for a tree, at least some of these can be included in the certification information.

[0186] [Example of electronic device operation during tree felling] Fig. 22 is a flowchart showing an example of a process for acquiring information about trees in the electronic device 100. Fig. 22 shows an example of a case where the flying object 900 is operated using the electronic device 100 (e.g., a smartphone). This acquisition process is executed by the control unit 104 based on a control program stored in the storage unit 105. This acquisition process is started based on an operation for starting a tree cutting operation. This acquisition process will be described with appropriate reference to Figs. 19 to 21, etc.

[0187] In step S571, the control unit 104 executes a setting process to set the number of stumps of the felled trees. This setting process may be executed based on a manual operation by the user U0 (for example, a numerical input operation) or may be executed automatically. For example, based on an image of the felling site acquired by the image acquisition unit 103 (an image including stumps after felling), the number of stumps included in the image can be estimated, and based on this estimation result, the number of stumps of the felled trees can be automatically set.

[0188] In step S572, the control unit 104 acquires an image of the stump of the felled tree from the flying object 900. In this case, the user U0 may operate the flying object 900 based on the manual operation of the user U0, or may fly the flying object 900 autonomously. Then, as shown in FIG. 19(1), the user U0 operates the image acquisition unit 902 of the flying object 900 flying above the stumps 911 to 915 of the felled tree to acquire an image 920 in which all of the tree stumps 911 to 915 are included in the imaging range. Next, the user U0 transmits the image 920 acquired by the image acquisition unit 902 from the flying object 900 to the electronic device 100. Note that, if the image acquired by the image acquisition unit 902 can be displayed on the display unit 107 of the electronic device 100 as a moving image in real time, the user U0 can perform a shooting operation while checking the display contents of the display unit 107. In addition, an aircraft capable of automatically photographing a specified area may be used to automatically photograph images of the stumps of felled trees.

[0189] In step S573, the control unit 104 analyzes the image of tree stumps transmitted from the flying object 900, and determines whether the number of stumps included in this image is the same as the set value set in step S571. If the number of stumps included in the image is the same as the set value, the process proceeds to step S575. On the other hand, if the number of stumps included in the image is not the same as the set value, the process proceeds to step S574. The method of extracting stumps included in the image is the same as the extraction method described above.

[0190] In step S574, the control unit 104 outputs an instruction to acquire an image of the same stump again, and returns to step S572. For example, it is possible to display a message such as "Failed to acquire an image of the cut surface of the stump. Please operate the flying object 900 to capture the image again so that all the stumps are included" on the display unit 107, or to output a message to that effect from the sound output unit 108.

[0191] In step S575, the control unit 104 judges whether or not an appropriate image of the stump has been acquired. If an appropriate image of the stump has been acquired, the process proceeds to step S576. On the other hand, if an appropriate image of the stump has not been acquired, the process proceeds to step S574. The method of judging the image of the stump is the same as that of step S504 (see FIG. 11).

[0192] In step S576, the control unit 104 acquires location information indicating the current location of the electronic device 100. This location information is acquired by the location information acquisition unit 102 and output to the control unit 104. As described above, it is assumed that the electronic device 100 is located at a location away from the flying object 900. In such a case, the control unit 104 may acquire and use location information acquired by a location information acquisition unit of the flying object 900 instead of the location information acquired by the location information acquisition unit 102.

[0193] In step S577, the control unit 104 associates the image of the stump acquired in step S572 with the location information acquired in step S576, and stores them in the tree information DB 930 (see FIG. 20) of the storage unit 105. For example, the image of the stump acquired in step S572 is stored in image information 933 in association with the felling site identification information 931 "LC1", the location information acquired in step S576 is stored in location information 934, and the acquisition times of these are stored in time information 935. Note that the image of the stump acquired in step S572 may be stored after undergoing various image processing (e.g., resizing, cutting) so that the round shape (or approximately round shape) of the cut surface has a predetermined size, or the image may be stored after performing the above-mentioned rotation processing.

[0194] In step S578, the control unit 104 transmits each piece of tree information stored in the tree information DB 930 in step S577 to the information processing device 200. In this case, the information transmitted to the information processing device 200 includes transmission device identification information for identifying the electronic device 100.

[0195] The registration process in which the information processing device 200 registers the tree information transmitted from the electronic device 100 is substantially similar to the registration process shown in FIG. 12, and therefore will not be described here.

[0196] [Example of operation during distribution of wood] FIG. 23 is a flowchart showing an example of the certification process in the information processing device 200 when trees are distributed. FIG. 23 shows an example of the certification process when trees are distributed in a case where tree information on an image (including multiple stumps) acquired by the flying object 900 is stored in the tree information DB 940 (see FIG. 21) as shown in FIG. 19 to FIG. 22. This certification process is executed by the control unit 202 based on a control program stored in the storage unit 203. This certification process is started based on a predetermined operation for starting the certification work of the tree. This certification process shows an example of a case where trees cut in the same felling area are traded. This certification process shows an example of a case where the felling area of ​​a tree is certified using two images including the cut surfaces at both ends of the tree, but it can also be applied to a case where the felling area of ​​a tree is certified using four or more images (however, an even number of images) including the cut surfaces at both ends of the tree.

[0197] In step S581, the control unit 202 acquires two images of the cut surface of the tree to be traded. For example, as shown in Fig. 16(2), it is possible to acquire images (images of the cut surface of the tree) generated by an imaging device 300, which is an external device. Note that, if the information processing device 200 is equipped with an imaging device, it may acquire images (images of the cut surface of the tree) generated by the imaging device.

[0198] Steps S582 to S584 correspond to steps S533 to S535 shown in FIG. 15, and therefore a description thereof will be omitted here.

[0199] In step S585, the control unit 104 selects one stump image from among the stump images (registered images) stored in the tree information DB 940 (see FIG. 21) as a target stump, and extracts a cut surface opposite to the cut surface of the target stump from the two images acquired in step S581. This extraction method corresponds to the extraction method shown in step S536 in FIG. 15. The control unit 202 also holds the position of the extracted cut surface (the position in the image including this cut surface).

[0200] Steps S586 to S589 correspond to steps S537 to S540 shown in FIG. 15, and therefore a description thereof will be omitted here.

[0201] In step S590, the control unit 202 determines whether or not all stumps included in the two images acquired in step S581 have been set as target stumps. If all stumps have not been set as target stumps, the process returns to step S585 to execute the above-mentioned processes for the other stumps. On the other hand, if all stumps have been set as target stumps, the process proceeds to step S591 since the above-mentioned processes for all stumps have been completed.

[0202] In step S591, the control unit 202 determines whether or not there is a cut surface that has not been extracted (or identified) in steps S585, S587, or S588 in the two images acquired in step S581. If there is no such cut surface in the two images, the process proceeds to step S592. On the other hand, if there is such a cut surface in the two images, the process proceeds to step S596.

[0203] In step S592, the control unit 202 determines whether the location information associated with the image of the stump from which a cut surface other than the stump was extracted (or identified) in steps S585, S587, and S588 is the same felling site. If the location information associated with the extracted (or identified) image of the stump is the same felling site, the process proceeds to step S593. On the other hand, if the location information associated with the extracted (or identified) image of the stump is not the same felling site, the process proceeds to step S596.

[0204] For example, the control unit 202 acquires the position information 945 (see FIG. 21) corresponding to the extracted (or identified) stump image, and can determine whether the position information of the cut surface image is the same felling site based on this position information. For example, when each position identified by the position information acquired from the position information 945 is within a predetermined range (for example, a range that identifies the felling site), it can be determined that the position information corresponding to the stump image is the same felling site. On the other hand, when each position identified by the position information acquired from the position information 945 is not within a predetermined range (for example, a range that identifies the felling site) (for example, when each position is significantly different (for example, when it is different by about tens to hundreds of kilometers)), it can be determined that the position information corresponding to the stump image is not the same felling site. Here, for a tree for which it can be determined that the positions corresponding to the stump image are the same felling site, it can be estimated that the other cut surface trees of that tree are also the same felling site.

[0205] Steps S593 to S597 correspond to steps S565 to S569 shown in FIG. 18, and therefore a part of the description thereof will be omitted here.

[0206] In step S593, the control unit 202 identifies the felling site of the tree to be traded based on the location information associated with the image of the stump (registered image) from which the cut surface other than the stump has been extracted (or identified) in steps S585, S587, and S588. For example, as described above, the felling site of the tree to be traded can be identified based on the location information associated with each image of the stump. For example, map information is stored in the storage unit 203, and an address corresponding to the location information can be identified based on this map information and the location information associated with each image of the stump.

[0207] In this embodiment, an example is shown in which an image of the end grain (so-called tree rings (grain)) is used as identification information (image information) to certify the tree, but this embodiment can also be applied to cases in which images of other surfaces (for example, an image of the straight grain surface, an image of the cross grain surface) are used as identification information (image information) to certify the tree.

[0208] [Example of executing processing on other devices or systems] In the above, an example has been shown in which the process of registering tree information is executed using the electronic device 100, and the information processing device 200 is used to verify the tree, but all or part of each process may be executed in other devices. In this case, an information processing system is configured by each device that executes part of each process. For example, at least part of each process can be executed using in-vehicle devices (e.g., IVI (In-Vehicle Infotainment), control devices) of the transport vehicle TR1, devices available to the user (e.g., wearable terminals, smartphones, tablet terminals, personal computers), various information processing devices such as servers that can be connected via a predetermined network such as the Internet, and various electronic devices.

[0209] In addition, a part (or the whole) of the information processing system capable of executing each function of the electronic device 100, the information processing device 200, etc. may be provided by an application that can be provided via a predetermined network such as the Internet. This application is, for example, SaaS (Software as a Service).

[0210] [Examples of Effects of This Embodiment] Here, in recent years, it has become a problem that forests are cut down without the permission of the forest owner, and the cut trees are bought and sold without permission. In order to prevent such a thing from happening, it is important to properly manage the cut trees. Therefore, in this embodiment, when the tree is cut down, image information of the cut surface of the tree is associated with position information and stored in the tree information DB 210 (see FIG. 6) and the tree information DB 940 (see FIG. 21), and the tree is managed using the contents of the tree information DB 210 and 940. For example, when the tree is distributed, it is possible to prove the felling site of the tree to be traded using the image information stored in the tree information DB 210 and the tree information DB 940. This makes it easy to identify the felling site of the tree, and it is possible to increase the reliability of the proof. In other words, it is possible to more appropriately manage the cut trees.

[0211] Here, it is considered that felled trees are managed using equipment such as IC tags. In this case, one or more IC tags and attachment members are required for each target tree, and the cost of fixing the IC tags increases. In addition, since the work of fixing the IC tags to the wood is required, the work becomes complicated. In contrast, in this embodiment, when felling a tree, it is only necessary to use the electronic device 100 or the like to obtain an image of the cut surface of the tree, and therefore it is possible to suppress the cost of managing felled trees. In addition, in this embodiment, when felling a tree, it is only necessary to use the electronic device 100 or the like to obtain an image of the cut surface of the tree, and therefore it is not necessary to attach an IC tag or the like to each felled tree. This makes it possible to more appropriately manage felled trees.

[0212] [Configuration Example of This Embodiment and Its Effects] The information processing system TS1 is an information processing system that manages felled trees using an electronic device 100 (an example of a first device) capable of handling tree information, and an information processing device 200 (an example of a second device) capable of handling tree information DBs 210 and 940 (an example of a database) that manage tree information. The electronic device 100 executes the following: acquiring image information (an example of cut surface information) related to the cut surface of the tree, acquiring position information related to the position of the tree when it was felled, and transmitting the image information and the position information to the information processing device 200. The information processing device 200 executes the following: acquiring the image information and the position information from the electronic device 100, storing the image information and the position information in association with the tree information DBs 210 and 940, and certifying the tree based on the contents of the tree information DBs 210 and 940 in the distribution process of the tree. Note that in this embodiment, an example is shown in which the electronic device 100 is used as the first device and the information processing device 200 is used as the second device, but the first device and the second device may be configured as the same device. Furthermore, each process executed by the first device and the second device may be executed by three or more devices.

[0213] According to this configuration, when a tree is cut, image information and location information of the cut surface of the tree are associated with each other and stored in the tree information DB 210, 940, and the contents of the tree information DB 210, 940 can be used to manage the tree. For example, when a tree is distributed, the image information stored in the tree information DB 210, 940 can be used to certify the felling site of the tree being traded. This makes it easy to identify the felling site of the tree and increases the reliability of the certification. In other words, felled trees can be managed more appropriately.

[0214] In addition, in the information processing system TS1, the information processing device 200 certifies the tree by outputting certification information that certifies that the tree related to the first image information was felled at a location corresponding to the location information associated with the second image information when second image information corresponding to the first image information is extracted from the tree information DB210, 940 based on the results of a comparison between image information (first image information) regarding the cut surface of the tree acquired by the imaging device 300 (an example of an image acquisition device) during the distribution process of the tree and image information (an example of cut surface information) (second image information) stored in the tree information DB210, 940 (an example of a database).

[0215] According to this configuration, when second image information corresponding to the first image information is extracted from the tree information DB 210, 940 during the distribution process of trees, it is possible to certify the felling site of the tree related to the first image information. This makes it easy to identify the felling site of the tree, and makes it possible to increase the reliability of the certification. In other words, it becomes possible to more appropriately manage felled trees.

[0216] In the information processing system TS1, a plurality of pieces of image information relating to a plurality of cut surfaces of a tree divided into a plurality of pieces is stored in the tree information DB210 (an example of a database). In the process of certifying a tree by the information processing device 200, a plurality of pieces of first image information relating to a plurality of cut surfaces of a tree divided into a plurality of pieces is acquired in the distribution process of the tree (step S561), and certification information is output based on a comparison result between the plurality of pieces of first image information and the plurality of pieces of second image information (steps S562 to S567).

[0217] According to this configuration, it is possible to certify the felling location of a tree during the distribution process of the tree by using multiple pieces of image information relating to multiple cut surfaces of the tree divided into multiple pieces, thereby increasing the reliability of the certification of the felling location of the tree.

[0218] In the information processing system TS1, the electronic device 100 (an example of a first device) acquires image information on a cut surface of a tree stump as cut surface information. In the process (steps S581 to S595) in which the information processing device 200 certifies the tree, when second image information on a cut surface opposite to the cut surface of the stump related to the first image information is extracted from the tree information DB940 (an example of a database) based on a comparison result between image information (first image information) on a cut surface of a tree acquired by the imaging device 300 (an example of an image acquisition device) and image information (an example of cut surface information: second image information) stored in the tree information DB940 (an example of a database), certification information is output that certifies that the tree related to the first image information was felled at a position corresponding to the position information associated with the second image information.

[0219] According to this configuration, in the distribution process of trees, it is possible to certify the felling location of trees using image information on the cut surface of the stump of the tree at the time of felling. This makes it possible to obtain image information on multiple stumps at once, making the task of obtaining image information easy. It also makes it possible to increase the reliability of the certification of the felling location of trees.

[0220] Moreover, in the information processing system TS1, the electronic device 100 (first device) includes an image acquisition unit 103 that captures an image of a subject and generates image information, and a position information acquisition unit 102 that acquires position information related to the position where the electronic device 100 is located. The electronic device 100 acquires image information including a cut surface of the tree generated by the image acquisition unit 103 after the tree is cut down as cut surface information, and acquires the position information acquired by the position information acquisition unit 102 at the timing when the image information is generated by the image acquisition unit 103 as position information related to the position at the time the tree was cut down.

[0221] According to this configuration, it is possible to acquire image information (cut surface information) including the cut surface of the tree and location information regarding the location at the time of felling of the tree at an appropriate timing using the portable electronic device 100. This makes it easy to acquire information used to identify the felling site of the tree, and the information can be easily transmitted to the information processing device 200. In other words, it becomes possible to more appropriately manage felled trees.

[0222] Also, in the information processing system TS1, the electronic device 100 and the flying object 900 (an example of a first device) include image acquisition units 103, 902 that capture an image of a subject and generate image information, and a position information acquisition unit 102 that acquires position information related to the position where the electronic device 100 is located. The electronic device 100 and the flying object 900 acquire image information (cut surface information) including cut surfaces of the stumps of the multiple trees generated by the image acquisition units 103, 902 after the multiple trees are cut down, and acquire the position information acquired by the position information acquisition unit 102 at the time the image information is generated by the image acquisition unit 103 as position information related to the positions of the multiple trees at the time of cutting down.

[0223] According to this configuration, it is possible to acquire image information (cut surface information) including the cut surfaces of the stumps of multiple trees and position information regarding the positions of the multiple trees at the time of felling at an appropriate timing using the portable electronic device 100 or the flying object 900. Furthermore, when acquiring image information including the cut surfaces of the stumps of multiple trees using the flying object 900, it is possible to acquire the information by a single imaging operation. This makes it easy to acquire information used to identify the felling site of the trees, and the information can be easily transmitted to the information processing device 200. In other words, it is possible to more appropriately manage felled trees.

[0224] An information processing device 200 capable of handling tree information DB210, 940 (an example of a database) that manages tree information is provided with a control unit 202 that acquires image information (an example of cut surface information) relating to the cut surface of a felled tree and location information relating to the location of the tree at the time of felling, associates and stores the image information and location information in the tree information DB210, 940, and controls the certification of trees based on the contents of the tree information DB210, 940 during the distribution process of trees.

[0225] According to this configuration, when a tree is cut, image information and location information of the cut surface of the tree are associated with each other and stored in the tree information DB 210, 940, and the contents of the tree information DB 210, 940 can be used to manage the tree. For example, when a tree is distributed, the image information stored in the tree information DB 210, 940 can be used to certify the felling site of the tree being traded. This makes it easy to identify the felling site of the tree and increases the reliability of the certification. In other words, felled trees can be managed more appropriately.

[0226] This is a program that causes a computer to execute an information processing method for managing felled trees, using an electronic device 100 (an example of a first device) capable of handling tree information, and an information processing device 200 (an example of a second device) capable of handling tree information DB210, 940 (an example of a database) that manages tree information. In this information processing method, the electronic device 100 executes the following: acquiring image information (an example of cut surface information) on the cut surface of the tree, acquiring position information on the position at the time of felling the tree, and transmitting the image information and the position information to the information processing device 200, and the information processing device 200 executes the following: acquiring the image information and the position information from the electronic device 100, storing the image information and the position information in association with the tree information DB210, 940, and certifying the tree based on the contents of the tree information DB210, 940 during the distribution process of the tree.

[0227] According to this configuration, when a tree is cut, image information and location information of the cut surface of the tree are associated with each other and stored in the tree information DB 210, 940, and the contents of the tree information DB 210, 940 can be used to manage the tree. For example, when a tree is distributed, the image information stored in the tree information DB 210, 940 can be used to certify the felling site of the tree being traded. This makes it easy to identify the felling site of the tree and increases the reliability of the certification. In other words, felled trees can be managed more appropriately.

[0228] Note that each processing procedure shown in this embodiment is an example for realizing this embodiment, and the order of some of the processing procedures may be changed within the scope that allows the realization of this embodiment, and some of the processing procedures may be omitted or other processing procedures may be added.

[0229] Each control operation shown in each of the above-mentioned embodiments is executed based on a program for making a computer execute each processing procedure. Therefore, this embodiment can also be understood as an embodiment of a program for implementing the function of executing each of those processes, and a recording medium for storing the program. That is, the program related to each control operation shown in each of the above-mentioned embodiments is stored in a storage medium of an information processing device such as an electronic device or a server, and the program is read from the storage medium, and the read program is executed by the information processing device, thereby realizing each control operation shown in each of the above-mentioned embodiments. In addition, the program may be stored in an external storage medium (e.g., a CD (Compact Disc), a DVD (Digital Versatile Disc), a memory card), etc. of those devices, and used. In addition, for example, the program can be stored in the storage device of the computer by an update process for adding a new function to the computer. This makes it possible to execute each process shown in this embodiment on the updated computer.

[0230] It should be noted that each of the above-described embodiments shows an example for realizing the invention described in the claims, and is not limited to these, and various modifications can be made without departing from the spirit of the invention.

[0231] For example, the following configurations (configuration examples 1 to 8) can be adopted. For example, the present invention can be configured as an information processing system, an information processing device, an information processing method, and a program. [Configuration example 1] An information processing system for managing felled trees using a first device capable of handling tree information and a second device capable of handling a database for managing the tree information, The first device is obtaining cut surface information relating to a cut surface of the tree; obtaining location information relating to a location at the time of felling of the tree; transmitting the cutting plane information and the position information to the second device; The second device is acquiring the cutting surface information and the position information from the first device; storing the cutting surface information and the position information in the database in association with each other; and certifying the tree based on the contents of the database during the distribution process of the tree. Information processing system. [Configuration example 2] The information processing system according to configuration example 1, Certifying the tree means, based on a comparison result between first image information, which is image information on the cut surface of the tree acquired by an image acquisition device during the distribution process of the tree, and second image information, which is the cut surface information stored in the database, when second image information corresponding to the first image information is extracted from the database, outputting certification information that certifies that the tree related to the first image information was felled at a location corresponding to the location information associated with the second image information. Information processing system. [Configuration example 3] The information processing system according to configuration example 2, The database stores a plurality of pieces of image information relating to a plurality of cut surfaces of the tree divided into a plurality of pieces, The certification of the tree includes acquiring a plurality of the first image information related to a plurality of cut surfaces of the tree divided into a plurality of pieces during a distribution process of the tree, and outputting the certification information based on a comparison result between the plurality of the first image information and the plurality of the second image information. Information processing system. [Configuration example 4] The information processing system according to configuration example 1, The first device acquires image information relating to a cut surface of the tree stump as the cut surface information, Certifying the tree means, based on a comparison result between first image information, which is image information on the cut surface of the tree acquired by an image acquisition device during the distribution process of the tree, and second image information, which is the cut surface information stored in the database, when second image information on a cut surface opposite to the cut surface of the stump related to the first image information is extracted from the database, outputting certification information that certifies that the tree related to the first image information was felled at a location corresponding to the location information associated with the second image information. Information processing system. [Configuration example 5] The information processing system according to any one of configuration examples 1 to 4, the first device includes an image acquisition unit that captures an image of a subject and generates image information, and a position information acquisition unit that acquires position information relating to a position where the first device is located; the first device acquires, as the cut surface information, image information including a cut surface of the tree generated by the image acquisition unit after the tree is cut down, and acquires, as the position information relating to the position of the tree at the time of cutting down, position information acquired by the position information acquisition unit at the time the image information was generated by the image acquisition unit; Information processing system. [Configuration example 6] The information processing system according to any one of configuration examples 1 to 4, the first device includes an image acquisition unit that captures an image of a subject and generates image information, and a position information acquisition unit that acquires position information relating to a position where the first device is located; the first device acquires, as the cut surface information, image information including cut surfaces of stumps of the plurality of trees generated by the image acquisition unit after the plurality of trees are cut down, and acquires, as the cut surface information, location information acquired by the location information acquisition unit at the time when the image information was generated by the image acquisition unit, as location information relating to the locations of the plurality of trees at the time of cutting down; Information processing system. [Configuration example 7] An information processing device capable of handling a database for managing tree information, obtaining cut surface information relating to a cut surface of a felled tree and position information relating to a position of the tree at the time of felling; storing the cutting surface information and the position information in the database in association with each other; a control unit for controlling the certification of the tree based on the contents of the database during the distribution process of the tree; An information processing device comprising: [Configuration example 8] A program for causing a computer to execute an information processing method for managing felled trees using a first device capable of handling tree information and a second device capable of handling a database for managing the tree information, the program comprising: The information processing method includes: The first device, obtaining cut surface information relating to a cut surface of the tree; obtaining location information relating to a location at the time of felling of the tree; transmitting the cutting plane information and the position information to the second device; The second device, acquiring the cutting surface information and the position information from the first device; storing the cutting surface information and the position information in the database in association with each other; and certifying the tree based on the contents of the database during the distribution process of the tree. program.

[0232] For example, the following configurations (configuration examples 1 to 6) can be adopted. For example, the present invention can be configured as an information processing system, an information processing device, an information processing method, and a program. [Configuration example 1] An information processing system for managing trees using a first device capable of handling tree information and a second device capable of handling a database for managing the tree information, comprising: The first device is obtaining cut surface information regarding a cut surface of a stump of each of a plurality of felled trees; obtaining location information for identifying a felling site where the plurality of trees were felled; transmitting the cutting plane information and the position information to the second device; The second device is acquiring the cutting surface information and the position information from the first device; storing the cutting surface information and the position information in the database in association with each other; During a distribution process of a plurality of trees to be traded, a plurality of first image information, which is image information relating to the cut surfaces of the plurality of trees to be traded acquired by an image acquisition unit, is compared with a second image information, which is the cut surface information stored in the database, to extract from the database a plurality of second image information relating to cut surfaces of a stump opposite the cut surfaces related to the plurality of first image information, and if location information associated with each of the extracted plurality of second image information refers to the same felling site, outputting certification information certifying that the plurality of trees to be traded were felled in the felling site. Information processing system. [Configuration example 2] The information processing system according to configuration example 1, the plurality of first image data include third image data which is image data including one cut surface of each of the plurality of trees to be traded, and fourth image data which is image data including the other cut surface of each of the plurality of trees; The second device is executing an extraction process for sequentially extracting, from among a plurality of cut surfaces included in the third image information and the fourth image information, a first cut surface that faces the cut surface of the stump related to the second image information, other cut surfaces of the tree having the first cut surface, and, when a single tree having the first cut surface is divided into a plurality of pieces, each cut surface of each divided tree; When all cut surfaces included in the third image information and the fourth image information are extracted in the extraction process, and when location information associated with each of the plurality of second image information related to the first cut surfaces is the same felling site, outputting the certification information that certifies that the plurality of trees to be traded were felled in the felling site. Information processing system. [Configuration example 3] The information processing system according to configuration example 1 or 2, the first device includes an image acquisition unit that captures an image of a subject and generates image information, and a position information acquisition unit that acquires position information relating to a position where the first device is located; The first device is The image information generated by the image acquisition unit is image information related to a cut surface of each of the stumps of the felled trees, and the cut surface information is acquired; acquiring location information acquired by the location information acquisition unit at the timing when the image information is generated by the image acquisition unit as location information for identifying a felling site of the plurality of felled trees; Information processing system. [Configuration example 4] An information processing device capable of handling a database in which cut surface information on the cut surfaces of the stumps of a plurality of felled trees and location information for identifying the felling site where the plurality of trees were felled are stored in association with each other, a control unit that, based on a comparison result between a plurality of first image information, which is image information relating to the cut surfaces of the plurality of trees to be traded acquired by an image acquisition unit, and a second image information, which is the cut surface information stored in the database, extracts a plurality of second image information relating to cut surfaces of a stump opposite to the cut surfaces relating to the plurality of first image information from the database during a distribution process of the plurality of trees to be traded, and, if location information associated with each of the extracted plurality of second image information is the same felling site, outputs certification information certifying that the plurality of trees to be traded were felled at the felling site. An information processing device comprising: [Configuration example 5] An information processing method for managing trees using a first device capable of handling tree information and a second device capable of handling a database that manages the tree information, comprising: The first device, obtaining cut surface information regarding a cut surface of a stump of each of a plurality of felled trees; obtaining location information for identifying a felling site where the plurality of trees were felled; transmitting the cutting plane information and the position information to the second device; The second device, acquiring the cutting surface information and the position information from the first device; storing the cutting surface information and the position information in the database in association with each other; During a distribution process of a plurality of trees to be traded, a plurality of first image information, which is image information relating to the cut surfaces of the plurality of trees to be traded acquired by an image acquisition unit, is compared with a second image information, which is the cut surface information stored in the database, to extract from the database a plurality of second image information relating to cut surfaces of a stump opposite the cut surfaces related to the plurality of first image information, and if location information associated with each of the extracted plurality of second image information refers to the same felling site, outputting certification information certifying that the plurality of trees to be traded were felled in the felling site. Information processing methods. [Configuration example 6] A program for causing a computer to execute an information processing method for managing trees using a first device capable of handling tree information and a second device capable of handling a database for managing the tree information, the program comprising: The information processing method includes: The first device, obtaining cut surface information regarding a cut surface of a stump of each of a plurality of felled trees; obtaining location information for identifying a felling site where the plurality of trees were felled; transmitting the cutting plane information and the position information to the second device; The second device, acquiring the cutting surface information and the position information from the first device; storing the cutting surface information and the position information in the database in association with each other; During a distribution process of a plurality of trees to be traded, based on a comparison result between a plurality of first image information, which is image information relating to the cut surfaces of the plurality of trees to be traded acquired by an image acquisition unit, and a second image information, which is the cut surface information stored in the database, a plurality of second image information relating to cut surfaces of a stump opposite to the cut surfaces related to the plurality of first image information is extracted from the database, and if location information associated with each of the extracted plurality of second image information is the same felling site, outputting certification information certifying that the plurality of trees to be traded were felled in the felling site. program. [Explanation of symbols]

[0233] 100 Electronic equipment 101, 201 Communications Department 102 Location information acquisition unit 103, 902 Image acquisition unit 104, 202 Control unit 105, 203 Storage section 106, 204 Operation section 107, 205 Display section 108, 206 Sound output section 110, 210, 930, 940 Tree Information DB 200 Information processing device 300 Imaging device 900 Flying Objects 901 Remote control equipment

Claims

1. An information processing system for managing trees using an information processing device capable of handling a database for managing tree information acquired by an aircraft, comprising: The flying object is obtaining cut surface information regarding a cut surface of a stump of each of a plurality of felled trees; obtaining location information for identifying a felling site where the plurality of trees were felled; The information processing device includes: acquiring the cutting surface information and the position information; storing the cutting surface information and the position information in the database in association with each other; During a distribution process of a plurality of trees to be traded, a plurality of first image information, which is image information relating to the cut surfaces of the plurality of trees to be traded acquired by an image acquisition unit, is compared with a second image information, which is the cut surface information stored in the database, to extract from the database a plurality of second image information relating to cut surfaces of a stump opposite the cut surfaces related to the plurality of first image information, and if location information associated with each of the extracted plurality of second image information is the same felling site, outputting certification information certifying that the plurality of trees to be traded were felled at the felling site. Information processing system.

2. 2. The information processing system according to claim 1, the plurality of first image data include third image data which is image data including one cut surface of each of the plurality of trees to be traded, and fourth image data which is image data including the other cut surface of each of the plurality of trees; The information processing device includes: executing an extraction process for sequentially extracting, from among a plurality of cut surfaces included in the third image information and the fourth image information, a first cut surface that faces the cut surface of the stump related to the second image information, other cut surfaces of the tree having the first cut surface, and, when a single tree having the first cut surface is divided into a plurality of trees, each cut surface of each divided tree; When all cut surfaces included in the third image information and the fourth image information are extracted in the extraction process, and when location information associated with each of the plurality of second image information related to the first cut surfaces is the same felling site, outputting the certification information that certifies that the plurality of trees to be traded were felled in the felling site. Information processing system.

3. 3. The information processing system according to claim 1, The flying object includes an image acquisition unit that captures an image of a subject and generates image information, and a position information acquisition unit that acquires position information regarding a position where the flying object is located, The flying object is The image information generated by the image acquisition unit is image information related to a cut surface of each of the stumps of the felled trees, and the cut surface information is acquired; acquiring location information acquired by the location information acquisition unit at the timing when the image information is generated by the image acquisition unit as location information for identifying a felling site of the plurality of felled trees; Information processing system.

4. An information processing device capable of handling a database in which cut surface information regarding the cut surfaces of the stumps of a plurality of felled trees, which is acquired by an aircraft, and location information for identifying a felling site where the plurality of trees were felled are stored in association with each other, A control unit that, based on a comparison result between a plurality of first image information, which is image information relating to the cut surfaces of the plurality of trees to be traded acquired by an image acquisition unit, and a second image information, which is the cut surface information stored in the database, in a distribution process of the plurality of trees to be traded, extracts a plurality of second image information relating to cut surfaces of a stump opposite to the cut surfaces related to the plurality of first image information from the database, and, if location information associated with each of the extracted plurality of second image information is the same felling site, outputs certification information certifying that the plurality of trees to be traded were felled at the felling site. An information processing device comprising:

5. An information processing method for managing trees using an information processing device capable of handling a database for managing tree information acquired by an aircraft, comprising: The flying object, obtaining cut surface information regarding a cut surface of a stump of each of a plurality of felled trees; obtaining location information for identifying a felling site where the plurality of trees were felled; The information processing device, acquiring the cutting surface information and the position information; storing the cutting surface information and the position information in the database in association with each other; During a distribution process of a plurality of trees to be traded, a plurality of first image information, which is image information relating to the cut surfaces of the plurality of trees to be traded acquired by an image acquisition unit, is compared with a second image information, which is the cut surface information stored in the database, to extract from the database a plurality of second image information relating to cut surfaces of a stump opposite the cut surfaces related to the plurality of first image information, and if location information associated with each of the extracted plurality of second image information is the same felling site, outputting certification information certifying that the plurality of trees to be traded were felled at the felling site. Information processing methods.

6. A program for causing a computer to execute an information processing method for managing trees using an information processing device capable of handling a database for managing tree information acquired by an aircraft, the program comprising: The information processing method includes: The flying object, obtaining cut surface information regarding a cut surface of a stump of each of a plurality of felled trees; obtaining location information for identifying a felling site where the plurality of trees were felled; The information processing device, acquiring the cutting surface information and the position information; storing the cutting surface information and the position information in the database in association with each other; During a distribution process of a plurality of trees to be traded, a plurality of first image information, which is image information relating to the cut surfaces of the plurality of trees to be traded acquired by an image acquisition unit, is compared with a second image information, which is the cut surface information stored in the database, to extract from the database a plurality of second image information relating to cut surfaces of a stump opposite the cut surfaces related to the plurality of first image information, and if location information associated with each of the extracted plurality of second image information is the same felling site, outputting certification information certifying that the plurality of trees to be traded were felled at the felling site. program.

Images