Harvest work support system, and harvest work support system server

Abstract

To provide a harvest work support system and a harvest work support system server which can increase accuracy in rough selection based on harvest reference.SOLUTION: A server 10 has an operation information storage unit 121 for storing information regarding an operation at a crop selection place, and a harvest reference computing unit 111 for calculating harvest reference based on the operation information. The harvest reference computing unit transmits the calculated harvest reference to an operator terminal 20. The operator terminal 20 has an imaging unit 21, a display unit 22 for displaying an image captured by the imaging unit 21, and a harvest determination unit 231 for determining, with respect to the image data obtained by capturing a crop, the crop as a harvest target based on the harvest reference, and thus displays, on the display unit 22, a support representation for giving instructions as to the crop determined as the harvest target to the operator.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a harvesting operation support system and a harvesting operation support system server that support the harvesting of agricultural crops. [Background technology]

[0002] Many agricultural products are harvested at each farmland (harvesting site) within a given region, and then further sorted at a common sorting site (hereinafter referred to as sorting site) before being shipped. Furthermore, at the harvesting site, workers perform rough sorting (selecting and harvesting agricultural products that meet harvesting standards). Patent Document 1 describes a technology that enables even inexperienced workers (beginners, low-skilled workers, etc.) with low work skills and experience, rather than skilled workers, to perform harvesting and shipping work according to work support (which agricultural products should be harvested and shipped). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7039766 Summary of the Invention [Problem to be solved by the invention]

[0004] Farmland is widely dispersed within a region, making it difficult for each farmland (each farmer) to share information. For example, harvesting standards for rough sorting at harvest sites are fine-tuned according to the situation and are not always consistent. Traditionally, adjusted harvesting standards are notified to each harvesting site, but it is difficult for each worker to perform rough sorting in the same way according to the notified harvesting standards, which can lead to differences in the degree of sorting of harvested crops at each farmland (decreased accuracy of rough sorting). If the accuracy of rough sorting at harvest sites decreases in this way, the proportion of crops unsuitable for shipment (that do not meet the harvesting standards) at the sorting site increases, resulting in an increased burden of sorting at the sorting site. Patent Document 1 does not mention adjusting harvesting standards and does not consider improving the accuracy of rough sorting in accordance with the harvesting standards.

[0005] The present disclosure has been made in consideration of the above-mentioned problems, and aims to provide a harvesting operation support system and a harvesting operation support system server that can improve the accuracy of rough sorting in accordance with harvesting standards. [Means for solving the problem]

[0006] In order to solve the above problems, a harvesting support system that is a first aspect of the present disclosure is a harvesting support system that supports the harvesting of agricultural crops, and includes a harvesting support system server and a worker terminal that is capable of communicating with the harvesting support system server. The harvesting support system server is equipped with an operation information storage unit that stores operation information at a sorting site, and a harvesting standard calculation unit that calculates a harvesting standard based on the operation information stored in the operation information storage unit. The harvesting standard calculated by the harvesting standard calculation unit is capable of being transmitted to the worker terminal. The worker terminal is equipped with a photographing unit, a display unit that displays images captured by the photographing unit, and a harvest determination unit that determines which agricultural crops are to be harvested based on the harvesting standard transmitted from the harvesting support system server for image data of the agricultural crops photographed by the photographing unit. The display unit is capable of displaying support information to instruct the worker about which agricultural crops are to be harvested.

[0007] According to the above configuration, the worker terminal displays support based on the harvesting standards adjusted by the harvesting work support system server, thereby making it possible to unify the harvesting standards at each harvesting site. This can improve the accuracy of the rough sorting that is carried out at each harvest site.

[0008] In order to solve the above problems, a harvesting support system according to a second aspect of the present disclosure is a harvesting support system that supports the harvesting of agricultural products, and includes a harvesting support system server and a worker terminal capable of communicating with the harvesting support system server. The harvesting support system server includes an operation information storage unit that stores operation information at a sorting site, a harvesting standard calculation unit that calculates harvesting standards based on the operation information stored in the operation information storage unit, and a harvest determination unit that determines which agricultural products are to be harvested based on the harvesting standards for image data of the agricultural products. The worker terminal includes a photographing unit and a display unit that displays images photographed by the photographing unit. The worker terminal transmits the image data of the agricultural products photographed by the photographing unit to the harvesting support system server. The harvesting support system server determines which agricultural products are to be harvested based on the image data transmitted from the worker terminal using the harvest determination unit and transmits the determination result to the worker terminal. The worker terminal is capable of displaying a support display on the display unit to instruct the worker about which agricultural products are to be harvested based on the determination result of the harvesting support system server.

[0009] According to the above configuration, the worker terminal displays support based on the harvesting standards adjusted by the harvesting work support system server, thereby making it possible to unify the harvesting standards at each harvesting site and improving the accuracy of the rough sorting performed at each harvesting site.

[0010] In addition, in the above-mentioned harvesting support system, the worker terminal can be configured to transmit growth information of agricultural crops at the harvesting site to the harvesting support system server, and to request adjustment of harvesting standards in the harvesting support system server based on the transmitted growth information.

[0011] According to the above configuration, by using the growth information transmitted from the worker terminal in addition to the operation information of the sorting facility, it is possible to adjust the harvesting standards more appropriately.

[0012] In the harvesting operation support system, the worker terminal may be configured as a glasses-type wearable terminal.

[0013] In addition, in the above-described harvesting support system, the harvesting support system server can be configured to manage the quantity of agricultural products determined to be harvested for each predetermined period.

[0014] In the above-described harvesting support system, the harvesting support system server can be configured by connecting servers installed in a plurality of facilities via a network.

[0015] Furthermore, in the above-mentioned harvesting support system, the harvest assessment unit includes, as an assessment item, dimensional information of the crop obtained from image data of the crop photographed by the photographing unit, and the dimensional information can be calculated by calculating a circumscribing rectangle line relative to the contour line of the crop extracted from the image data and rotating the circumscribing rectangle line in a predetermined direction.

[0016] Furthermore, in the above-described harvesting operation support system, the harvesting operation support system server can be configured to be able to set harvesting standards for each of a plurality of sorting sites.

[0017] In addition, in the above-mentioned harvesting work support system, the worker terminal can be configured to be able to select a sorting site and to be able to check the harvest amount at his or her own harvesting site against the harvesting standards of the selected sorting site.

[0018] In the above harvesting operation support system, the harvest determination unit determines the crops to be harvested. The judgment items for determining the quality of the crop can be automatically changed depending on the type of crop.

[0019] The harvesting operation support system may be configured to infer user attributes from images captured by the worker terminal, and to change the support display in accordance with the inferred user attributes.

[0020] The harvesting operation support system can also be configured to estimate the user attributes using image recognition from images captured by the worker terminal.

[0021] The harvesting operation support system may be configured to be capable of estimating the proficiency of a worker as the user attribute.

[0022] The harvesting operation support system may be configured to be capable of determining the role of a user as the user attribute.

[0023] In order to solve the above problems, the harvesting work support system server, which is a third aspect of the present disclosure, is a harvesting work support system server that is communicatively connected to a worker terminal to form a harvesting work support system that supports the harvesting of agricultural crops, and is characterized by having an operation information storage unit that stores operation information at the sorting site, and a harvesting standard calculation unit that calculates a harvesting standard based on the operation information stored in the operation information storage unit, and being able to transmit the harvesting standard calculated by the harvesting standard calculation unit to the worker terminal.

[0024] In order to solve the above problems, the harvesting support system server, which is a fourth aspect of the present disclosure, is a harvesting support system server that constitutes a harvesting support system that supports the harvesting of agricultural crops by being communicatively connected to a worker terminal, and is characterized in that it comprises an operation information storage unit that stores operation information at the sorting site, a harvesting standard calculation unit that calculates harvesting standards based on the operation information stored in the operation information storage unit, and a harvest determination unit that determines the agricultural crops to be harvested based on the harvesting standards from image data of the agricultural crops, and is capable of determining the agricultural crops to be harvested from image data of the agricultural crops sent from the worker terminal by the harvest determination unit and sending the determination result to the worker terminal. [Effects of the Invention]

[0025] The harvesting support system and harvesting support system server disclosed herein have the effect of enabling the worker terminal to display support based on the harvesting standards adjusted by the harvesting support system server, thereby unifying the harvesting standards at each harvesting site and improving the accuracy of the rough sorting performed at each harvesting site. [Brief explanation of the drawings]

[0026] [Figure 1] 1 is a schematic configuration diagram of a harvesting operation support system according to an embodiment of the present disclosure. [Figure 2] This is a functional block of the server. [Figure 3] 1 is a functional block diagram of a worker terminal. [Figure 4] FIG. 10 is a diagram showing an example of a support display indicating a harvest target. [Figure 5] 10 is an example of a UI screen on the display unit of an operator terminal for providing a user with operational information about a fruit sorting facility. [Figure 6] 10 is another example of a UI screen on the display unit of the operator terminal for providing the user with operational information about the sorting facility. [Figure 7A] This is an example of a cucumber sorting standard table used at a sorting facility. [Figure 7B] 1 is an example of a photographed image of agricultural crops before harvesting. [Figure 7C] 7C is an example of an image of a crop extracted from the photographed image of FIG. 7B. [Figure 7D] 7D is an example of an image obtained by aligning the extracted image of FIG. 7C with the orientation in the fruit selection criteria table. [Figure 8] FIG. 10 is a diagram showing a display example of an image in which agricultural products are aligned in a predetermined direction. [Figure 9] 10 is an example of a UI screen on the display unit of an operator terminal for providing a user with information on fluctuations in harvest yield based on harvest standards. [Figure 10A] 10 is an example of a UI screen on a display unit of a worker terminal. [Figure 10B] 10B is another display example in the judgment item display window of FIG. 10A. [Figure 10C] 10B is a further example of display in the judgment item display window of FIG. 10A. [Figure 11] FIG. 10 is a diagram showing an example of a support display on the worker's field of view screen of the worker terminal to prevent overlooking of agricultural products. [Figure 12A] 10 is an example of a worker's field of view screen on the worker terminal. [Figure 12B] 12B is an example of a UI screen in which only the crops that are the target of the action are extracted and displayed from the field of view screen of FIG. 12A. [Figure 13] 10 is an example of a worker's field of view screen on the worker terminal in an image collection mode. [Figure 14] This is an example of a captured image whose behavioral history is determined to be "harvesting" by image recognition AI. [Figure 15] This is an example of a captured image whose behavioral history is determined to be "sorting fruit" by image recognition AI. [Figure 16] This is an example of a captured image whose behavioral history is determined to be "on the move" by image recognition AI. [Figure 17] FIG. 10 is an explanatory diagram showing an example of a support display screen for beginners. [Figure 18] FIG. 10 is an explanatory diagram showing an example of a support display screen for veterans. [Figure 19] 10 is a flowchart showing switching of display settings based on estimation of user attributes. [Figure 20] 10 is a flowchart showing switching of display settings based on periodic estimation of user attributes. [Figure 21] 10 is a display example of a function list when the user is estimated or set to be a worker. [Figure 22] 10 is a display example of a function list when the user is presumed or set to be an administrator. DETAILED DESCRIPTION OF THE INVENTION

[0027] [First embodiment] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of a harvesting operation support system according to this embodiment (hereinafter referred to as the present system). As shown in FIG. 1, the present system is broadly composed of a server (harvesting operation support system server) 10 and worker terminals 20 capable of communicating with the server 10. A large number of worker terminals 20 can be connected to the server 10 simultaneously. Communication between the server 10 and the worker terminals 20 is performed via a network line 30 such as the Internet, for example.

[0028] Server 10 may be a dedicated server installed in a fruit sorting facility (facility), or may be a cloud server. When server 10 is a dedicated server installed in a fruit sorting facility, the server 10 may be configured by installing dedicated servers in multiple fruit sorting facilities and connecting the multiple installed dedicated servers to a network to link with each other. Alternatively, the server 10 may be configured by using a dedicated server installed in a fruit sorting facility as a database (storage unit 12, described later) and linking the dedicated server with a cloud server.

[0029] 2 is a functional block diagram of the server 10. As shown in FIG. 2, the server 10 includes a calculation unit 11, a storage unit 12, and a communication unit 13. The calculation unit 11 performs various calculation processes required for controlling the server 10, and may be implemented as a CPU (Central Processing Unit) or includes a processor such as an ASIC (Application Specific Integrated Circuit) and performs calculations based on a computer program. The calculation unit 11 has functional units such as a harvesting standard calculation unit 111 according to the functions of the system, which will be described later. The storage unit 12 is, for example, a memory that stores data and computer programs required for each process of the calculation unit 11. The storage unit 12 has memory areas such as an operation information storage unit 121 and a harvesting standard storage unit 122 according to the functions of the system, which will be described later. The communication unit 13 is a communication device for communicating with the worker terminal 20.

[0030] The worker terminal 20 is carried or worn by a worker who harvests crops at the harvesting site, and is preferably a wearable eyeglass-type terminal (so-called smart glasses). Figure 3 shows the functional blocks of the worker terminal 20.

[0031] As shown in Fig. 3, worker terminal 20 includes a photographing unit 21, a display unit 22, a calculation unit 23, a storage unit 24, and a communication unit 25. The photographing unit 21 is a photographing device such as a camera, and when worker terminal 20 is a wearable eyeglasses-type terminal, it can photograph a field of view screen that is substantially the same as the field of view of the worker wearing it. The display unit 22 is a device that displays harvesting work support information to the worker, and when worker terminal 20 is a wearable eyeglasses-type terminal, it can display the harvesting work support information superimposed on the field of view screen of the worker.

[0032] The calculation unit 23 performs various calculations necessary for controlling the operator terminal 20. It includes a processor, such as a CPU (Central Processing Unit) or an ASIC (Application Specific Integrated Circuit), and performs calculations based on a computer program. The calculation unit 23 includes functional units, such as a harvest assessment unit 231, a display control unit 232, and a growth information acquisition unit 233, depending on the functions of the system; these functional units will be described later. Furthermore, a computer program for running the calculation unit 23 of the operator terminal 20 can be implemented by installing a specific application program. The storage unit 24 is a memory that stores, for example, data and computer programs required for each process of the calculation unit 23. The storage unit 24 has storage areas, such as a harvest standard storage unit 241 and a growth information storage unit 242, depending on the functions of the system; these storage areas will be described later. The communication unit 25 is a communication device for communicating with the server 10.

[0033] Each worker terminal 20 may be composed of one device or multiple devices. For example, the worker terminal 20 may be composed of two devices: a glasses-type wearable terminal worn by the worker and a smartphone carried by the worker. In this case, the image capturing unit 21 and the display unit 22 may be provided in the glasses-type wearable terminal, and the calculation unit 23, storage unit 24, and communication unit 25 may be provided in the smartphone. Alternatively, the function of the display unit 22 may be provided in both the glasses-type wearable terminal and the smartphone, and they may be used separately depending on the content to be displayed. It is preferable that data communication between the glasses-type wearable terminal and the smartphone be performed via wired communication or short-range wireless communication such as Bluetooth.

[0034] [Harvesting work support function] This system has a harvesting operation support function that ensures that the harvesting of crops in each farmland is carried out in accordance with the harvesting standards at that time. This harvesting operation support function will be explained below.

[0035] As mentioned above, the harvesting standards for rough sorting at the harvesting site are fine-tuned depending on the situation. For example, the harvesting standards at the harvesting site can be adjusted according to the operation information (delivery record) of the sorting facility. In this case, it is possible to adjust the harvesting standards so that when the amount of fruit brought into the sorting facility is high, the amount of fruit shipped is limited, and when the amount of fruit brought into the sorting facility is low, the harvesting standards are relaxed so that the amount of fruit shipped is increased.If there are multiple sorting facilities within a specified area supported by this system (hereinafter referred to as the support area), the harvesting standards can be set for each sorting facility.

[0036] To realize the harvesting operation support function, the server 10 has a harvesting standard calculation unit 111 in the calculation unit 11, and has an operation information storage unit 121 and a harvesting standard storage unit 122 in the storage unit 12.

[0037] First, the operation information storage unit 121 stores the latest operation information for the sorting facility. The operation information includes the amount of agricultural produce delivered to the sorting facility and quality information for the delivered agricultural produce. The quality information of agricultural produce delivered to the sorting facility is determined during the sorting process at the sorting facility, and the determined quality information can be used as operation information. While quality information generally includes information on the class of the agricultural produce, the quality information used in the harvesting support function of this system is parameter information (size, shape, color, etc.) that can be determined from photographed images of the agricultural produce through image processing. The quality information stored in the operation information storage unit 121 is preferably divided into multiple ranks for each parameter information, and the number or ratio of agricultural produce for each rank is indicated. If there are multiple sorting facilities within the support area, the operation information storage unit 121 can store operation information for each sorting facility. The operation information in the operation information storage unit 121 is updated as needed, for example, in response to the delivery of new agricultural produce to the sorting facility and the progress of the sorting process at the sorting facility.

[0038] The harvesting standard calculation unit 111 determines (calculates) the harvesting standard based on the operation information stored in the operation information storage unit 121. At this time, the harvesting standard can be set for each piece of parameter information. For example, the harvesting standard can be set in the form of ○ rank or higher for size, △ rank or higher for shape, and □ rank or higher for color. If there are multiple sorting sites within the support area and operation information for each sorting site is stored in the operation information storage unit 121, the harvesting standard calculation unit 111 can determine the harvesting standard for each sorting site.

[0039] The harvesting standard determined by the harvesting standard calculation unit 111 is stored in the harvesting standard storage unit 122. It is preferable that the harvesting standard in the harvesting standard storage unit 122 is updated as the operation information is updated.

[0040] To realize the harvesting work support function, the worker terminal 20 has a harvesting standard memory unit 241 in the memory unit 24, and a harvesting assessment unit 231 and a display control unit 232 in the calculation unit 23. The harvesting standard memory unit 241 temporarily stores harvesting standards. The harvesting assessment unit 231 determines whether or not a crop can be harvested based on the harvesting standards stored in the harvesting standard memory unit 241. The display control unit 232 controls the display on the display unit 22, and in the harvesting work support function controls the display to present the assessment results of the harvesting assessment unit 231 to the worker.

[0041] An example of how to use the harvesting work support function of this system will be described below. In the following example, the worker terminal 20 includes a wearable eyeglasses-type terminal, and the worker harvesting the crops wears the wearable eyeglasses-type terminal while harvesting.

[0042] First, when starting harvesting work, the worker terminal 20 communicates with the server 10 and obtains the current harvest standard (the harvest standard stored in the operation information storage unit 121). If there are multiple sorting sites within the support area and harvest standards are set for each sorting site, the worker can obtain the harvest standard for that sorting site by selecting the sorting site to which the fruit is to be delivered. The obtained harvest standard is stored in the harvest standard storage unit 241 of the worker terminal 20.

[0043] During the harvesting work, the photographing unit 21 in the worker terminal 20 photographs the worker's field of view screen. The harvest judgment unit 231 judges whether or not the crops present on the field of view screen can be harvested based on the images captured by the image capturing unit 21 and the harvest criteria stored in the harvest criteria storage unit 241. A specific judgment procedure is as follows, for example. (1) The harvest assessment unit 231 performs image processing on the image data of the field of view screen and extracts the crops present in the field of view screen. (2) Further image processing of the extracted crops is performed to determine the quality information of the crops. (3) The determined quality information is compared with the harvesting standards to determine whether the crop meets the harvesting standards (crops that meet the harvesting standards are determined to be harvestable, and crops that do not meet the harvesting standards are determined to be unharvestable).

[0044] The crop extraction process in (1) above and the determination process in (2) and (3) above can also be performed by the server 10 rather than the worker terminal 20 (in this case, the server 10 is equipped with a harvest determination unit). That is, the worker terminal 20 can transmit image data of the field of view screen to the server 10, and the server 10 can perform extraction and determination processes on the image data by image processing. The determination results are transmitted from the server 10 to the worker terminal 20.

[0045] With regard to crops (harvesting targets) determined to be harvestable, the display control unit 232 performs support display control. That is, the display control unit 232 performs support display control to instruct the worker on the harvesting targets on the field of view screen of the display unit 22 (for example, the display screen of the eyeglass-type wearable terminal). For example, as shown in FIG. 4, the harvesting targets present on the field of view screen can be indicated to the worker by displaying them in a specific color (for example, blue (shown by diagonal hatching downward to the right in FIG. 4)). The worker can selectively harvest the crops displayed in a specific color on the field of view screen. Furthermore, the display control unit 232 may perform display control (for example, displaying them in a specific color (for example, red (shown by diagonal hatching upward to the right in FIG. 4))) with regard to crops determined to be unharvestable (not to be harvested).

[0046] In this system, the quantity of agricultural products determined to be harvested for each predetermined period (for example, each day) may be stored and managed in the storage unit 12 of the server 10. This allows the system to predict future harvest yields based on the fluctuations in the harvest yield for each managed predetermined period, and to adjust harvest standards based on the predicted harvest yields. This is expected to enable more accurate adjustment of harvest standards.

[0047] In this way, by using the harvesting work support function of this system, it is possible to standardize harvesting standards at each harvesting site within the support area, improving the accuracy of the rough sorting performed at each harvesting site. By improving the accuracy of rough sorting, it is possible to reduce the burden of sorting at the sorting site. Furthermore, since workers do not need to personally determine which crops to harvest, but simply follow the instructions on the display unit 22, the burden of harvesting work on the workers is also reduced.

[0048] It is preferable that the system can provide information useful for selecting a sorting facility when the user (farmer) selects a destination sorting facility. For example, Fig. 5 shows an example of a UI (user interface) screen 221 on the display unit 22 of the operator terminal 20 (for example, a smartphone display screen) for providing the user with operational information about the sorting facility.

[0049] The UI screen 221 in Fig. 5 is provided with a sorting facility selection window 221A, a display information selection window 221B, and an information display window 221C. The user selects the sorting facility for which information is to be checked in the sorting facility selection window 221A, and selects the type of information that is to be checked in the display information selection window 221B. In the example of Fig. 5, confirmation of operation information at sorting facility A is selected. In response to this selection, the operator terminal 20 sends an information request to the server 10. In response to this information request, the operation information storage unit 121 of the server 10 sends the operation information of the sorting facility A to the worker terminal 20. The information sent from the server 10 is displayed in the information display window 221C. In this way, by checking the current operation information of the sorting facility, the user can select a sorting facility with a relatively small amount of incoming goods (short waiting time) as the destination of the delivery.

[0050] Alternatively, the user can select the harvesting standard as display information, as in the example of Figure 6. By checking the harvesting standard at the sorting facility, the user can select the sorting facility that shows the most suitable harvesting standard for the current growth state of the crops on their farmland as the delivery destination.

[0051] [Harvest standard adjustment request function] In the above example, the harvesting standard is adjusted according to the operation information (delivery record) of the sorting facility. However, in order to adjust the harvesting standard more appropriately, the system may have a harvesting standard adjustment request function that allows users (farmers) to request adjustment of the harvesting standard.

[0052] In this system with a harvest standard adjustment request function, information on the growth status of agricultural products at the harvest site (growth information) is acquired by operator terminal 20, and this growth information is sent from operator terminal 20 to server 10 as a request for adjustment of the harvest standard (or together with the request for adjustment of the harvest standard). Server 10 can adjust the harvest standard more appropriately by using the growth information sent from operator terminal 20 in addition to the operation information of the sorting facility.

[0053] To realize the harvesting operation support function, the operator terminal 20 has a growth information acquisition unit 233 (see FIG. 3) in the calculation unit 23, and a growth information storage unit 242 in the storage unit 24. The growth information acquisition unit 233 acquires growth information by performing image processing on the image captured by the imaging unit 21. A specific acquisition procedure is, for example, as follows. (1) The growth information acquisition unit performs image processing on the image data of the field of view screen and extracts the crops present in the field of view screen. (2) Further image processing is performed on the extracted crops to determine the quality information of the crops, and the quality information for all the determined crops is used as growth information.

[0054] In the process (1) above, the worker may wear the worker terminal 20 and only collect images (image collection mode) without performing harvesting work. The acquired growth information is temporarily stored in the growth information storage unit 242 while the images are being collected, and is read out from the growth information storage unit 242 and transmitted to the server 10 when the worker terminal 20 requests the server 10 to adjust the harvest standard.

[0055] In order to adjust harvest standards more appropriately in the above-mentioned harvest standard adjustment request function, it is preferable to collect growth information from as many harvest sites as possible over a wide area. However, in order to realize the above-mentioned harvest standard adjustment request function, it is not necessary to collect growth information from all harvest sites within the support area of ​​this system.

[0056] In the above example, when a request to adjust the harvesting standard is made from the worker terminal 20 to the server 10, information on the growth of the crops at the harvesting site is sent to the server 10, but this is not limited to this, and the harvesting standard desired by the user (a harvesting standard that can optimize the harvesting at the site) itself may be sent to the server 10.

[0057] [Other features] Other preferred features of the system are described below.

[0058] (A) When acquiring quality information on pre-harvest agricultural products, the system preferably obtains quality information that is aligned with the sorting standards at the sorting facility. For example, when the crop is a long crop such as cucumber or eggplant, dimensional information such as the degree of curvature is an important criterion for sorting, and sorting standards regarding the degree of curvature are set at the sorting facility. Figure 7A shows an example of a sorting standard table for cucumbers at the sorting facility. At the sorting facility, an alignment process is performed in advance, such as aligning the orientation of the cucumbers in the sorting machine, in order to evaluate them according to this sorting standard table.

[0059] On the other hand, the orientation of agricultural crops (still on the tree) before harvesting at the harvest site may be at an angle, and may not necessarily match the orientation of the crops on the fruit sorting standard table. Even in such cases, this system can accurately measure the dimensions according to the fruit sorting standard table without requiring workers to take the time to align the orientation of the crops.

[0060] 7B is an example of a photographed image of an agricultural product (a cucumber is shown) before harvest. In this example, the cucumber is oriented at an angle (the long axis direction of the cucumber is tilted relative to the vertical direction of the photographed image).

[0061] In this system, as shown in Figure 7C, the first step is to extract the contour of the crop from the captured image, and then to set (calculate) a circumscribing rectangle for that contour. The rectangle in the circumscribing rectangle is set as the rectangle that circumscribes the contour and has the shortest short side. In this case, the long axis of the crop is set to be parallel to the long side of the circumscribing rectangle.

[0062] Next, as shown in Figure 7D, in the second step, the crop in the image is aligned to a predetermined orientation (such as the orientation in a fruit sorting standard chart). In this example, the long axis of the crop is aligned vertically in the image, and the point where the curvature is measured is on the left side of the image. Then, the dimensional information of the crop is calculated from the image data rotated to the predetermined orientation.

[0063] As shown in Figure 8, the image aligned in a familiar orientation for the producer can be displayed on the display unit 22 of the operator terminal 20 by the operator's specified operation. This displayed image allows the operator to simultaneously see the long and short axis directions of the crop and the display rotation angle from the captured image, allowing the operator to recognize the orientation of the crop being evaluated. This allows the system to accurately evaluate the shape (width, thickness, curvature, etc.) of crops still on the tree before harvesting, without the need to align them in any particular orientation. In addition, the operator can compare the crop with a fruit sorting standard table, making it easier to understand the shape of the crop.

[0064] (B) In the above-mentioned harvesting support function, the user can check the harvesting standards at the sorting facility and select the sorting facility that shows the most suitable harvesting standards for the current growth state of the crops on his / her farmland as the destination. In this case, it is preferable that the user can recognize how the harvest volume will change depending on the harvesting standards.

[0065] 9 is an example of a UI screen 222 on the display unit 22 of the operator terminal 20 (e.g., a smartphone display screen) for providing a user with information about fluctuations in harvest yield based on harvest standards. This UI screen 222 illustrates an example of a case in which a harvest yield (yield) is predicted and displayed based on a harvest standard related to the ripeness of a farm product (e.g., a tomato).

[0066] The UI screen 222 in Fig. 9 is provided with a harvest standard setting window 222A, a quality information distribution display window 222B, and an expected yield display window 222C. The user sets the harvest standard for which the user wants to check the expected yield in the harvest standard setting window 222A. When the harvest standard is set in the harvest standard setting window 222A, the expected yield of the crop for the set harvest standard is displayed in the expected yield display window 222C. This allows the user to easily check the expected yield of the crop, even if the harvest standard is set in the expected yield display window 222C. For example, if the ripeness of agricultural crops can be determined on a scale of 1 to 5, it will be possible to recognize that the expected yield when ripeness level 5 is used as the harvest standard is XX kg, but that if the harvest standard is expanded to 4 (using ripeness levels 4 to 5 as the harvest standard), the expected yield will increase to △△ kg.

[0067] Using the above-mentioned harvest standard adjustment request function, a user can send to the server 10 harvest standards that can optimize the harvest at their own harvest site based on the yield forecast by this function, and request an adjustment of the harvest standard. This makes it possible to optimize the adjustment of the harvest standard on the server 10 side, maximizing profits and reducing the amount of crops that do not meet the harvest standard (reducing losses).

[0068] Note that when using this function to predict agricultural crop yield, it is assumed that growth information (quality information distribution, etc.) of the agricultural crop at the harvest site has been obtained in advance. For example, when predicting yield based on the ripeness of the agricultural crop, the ripeness of the agricultural crop is determined during a pre-harvest inspection, and the ripeness distribution is stored in the worker terminal 20. This storage can be performed using the growth information storage unit 242 in the storage unit 24. The stored ripeness distribution can also be displayed in the quality information distribution display window 222B on the UI screen 222, but displaying the ripeness distribution is not essential for this function.

[0069] When using this function, the distribution of agricultural product quality information obtained in advance may be the distribution over the entire harvest site or the distribution over a portion of the harvest site. For example, if harvesting work is scheduled to be carried out on the day of harvesting, for example, only a portion of the harvest site may be covered by the distribution of quality information obtained over only the planned harvesting area.

[0070] In the above explanation, the harvest standard is set first, and the expected yield for that harvest standard is presented. However, conversely, the target harvest amount (target yield) may be set first, and a recommended value for the harvest standard that will obtain an expected yield close to that target yield may be presented. This can assist the user in determining the harvest standard. In other words, an appropriate harvest standard that meets the necessary collection conditions can be set based on the growth status of the crops at the time of the previous inspection, making it easier for the user to make decisions when determining the harvest standard.

[0071] Furthermore, after a user determines a harvest standard using this function, when performing harvesting work according to that harvest standard, the expected yield for that harvest standard and the corresponding work progress (the actual harvest volume as the harvesting work progresses) may be displayed on the display unit 22 of the worker terminal 20 (for example, the expected yield is XX kg, and the current harvest volume is △△ kg). If there is a discrepancy between the expected yield and the work progress, i.e., if there is a delay in the work progress, the worker terminal 20 may notify the user of the delay in the work progress and prompt them to re-determine the harvest standard. This allows for understanding the work progress and early detection of problems such as delays in the work progress. If a delay in the work progress is detected, measures such as changing the harvest standard before the completion of the harvesting work can be taken to complete the harvesting work while satisfying the required collection conditions.

[0072] While the above description illustrates a case where yield is predicted based on the ripeness of the crop, the quality information used to predict the yield may be changed depending on the type of crop. For example, if the crop is a cucumber, the quality information used to predict the yield may be the weight or size of the crop. In this case, it becomes possible to recognize that, while the predicted yield is XX kg when the harvest standard is weight ○ g and size ○ cm, if the harvest standard is expanded to weight △ g and size △ m, the predicted yield increases to △△ kg.

[0073] (C) In this system, when harvesting work is performed or when a pre-harvest inspection is performed, the judgment items may be displayed on the display screen of the worker terminal 20. For example, FIG. 10A is an example of a UI screen 223 on the display unit 22 of the worker terminal 20 (for example, a display screen of a smartphone) when the agricultural product is a cucumber. The UI screen 223 has a judgment item display window. 10A, the UI screen 223 has a window 223A. The important items for determining whether a cucumber is ready for harvest are weight, length, curvature, etc. Therefore, in the UI screen 223 of FIG. 10A, the determination item display window 223A displays the determination values ​​for weight, length, and curvature. Note that the weight can be estimated by machine learning from the shape values ​​of the cucumber (length, thickness, surface area in the image, etc.).

[0074] The judgment items and display contents displayed in the judgment item display window 223A may be automatically changed depending on the type of crop to be harvested. For example, FIG. 10B is an example of the display of the judgment item display window 223A when the crop is a tomato. In the case of tomatoes, color is one of the important judgment items. For this reason, in the example of FIG. 10B, a judgment value for the color rank is added to the display contents of the judgment item display window 223A. In the case of tomatoes, the weight can also be estimated using machine learning from shape values ​​(diameter, surface area in the image, etc.). The type of crop to be harvested may also be automatically determined from a photographed image of the crop by image processing.

[0075] In this way, this system automatically changes the judgment items and display content in the judgment item display window 223A depending on the type of crop to be harvested, making it possible to switch and use work support functions without requiring the worker to perform any setting operations.

[0076] The evaluation items and display contents displayed in the evaluation item display window 223A may be changed depending on the season and the greenhouse. For example, cucumbers grow rapidly in the summer at their peak, so their length may be emphasized during that time (see FIG. 10C).

[0077] Furthermore, if the crops are grown in greenhouses and the harvest time varies depending on the greenhouse, the judgment items and display contents can be changed depending on the greenhouse. For example, if the crops are tomatoes, color judgment is important for tomatoes that are close to the harvest time, but color judgment is not as important for tomatoes that are further away from the harvest time. For this reason, in greenhouses where the harvest time is far away, "color" may not be added to the judgment items displayed in the judgment item display window 223A, and in greenhouses where the harvest time is close, "color" may be added to the judgment items displayed in the judgment item display window 223A. Note that the location of the greenhouse can be determined from the location of the worker who owns the worker terminal 20 by providing a GPS function or the like in the worker terminal 20.

[0078] (D) In ​​this system, when harvesting or during pre-harvest inspections, a support display may be provided to prevent the worker from overlooking the target crop. Fig. 11 is a diagram showing an example of a support display provided on the worker's field of view screen of worker terminal 20 to prevent the worker from overlooking the crop. As shown in Fig. 11, if there is a crop F1 on the field of view screen that the worker is likely to overlook, the crop F1 can be highlighted to prevent the worker from overlooking it.

[0079] Here, crops that are likely to be overlooked are, for example, crops that are displayed near the edge of the field of view screen, or crops that are only partially visible on the screen due to obstructions such as leaves or stems. Furthermore, crops that are likely to be overlooked can be highlighted, for example, by displaying the crop in a highly visible color. Alternatively, a notification that there is a crop that is likely to be overlooked on the screen may be displayed. Regarding the detection of crops that are likely to be overlooked, whether they are obstructed or not can be determined, for example, by a machine learning model algorithm. Alternatively, for example, if the crop is a cucumber, a crop with a determined aspect ratio close to 1 (a crop that is only partially visible due to obstructions and is therefore determined to have a shape that is not vertically elongated) may be determined to be a crop that is likely to be overlooked. Furthermore, in the case of crops that are likely to be overlooked due to conditions such as sunlight or obstruction, a determination value (a number of confidence levels, etc.) of an AI or the like may be used when determining in the harvest determination unit. Since the threshold (value-based standard) will be lower, a threshold can be set based on this information to issue a notification.

[0080] As another form of support, the worker terminal 20 may trace the worker's field of view to detect whether there is an area that the worker does not see, and if there is an area that the worker does not see, an arrow 224 may be displayed on the field of view screen to guide the worker's line of sight. For example, in the example of FIG. 11, four arrows 224 corresponding to the up, down, left, and right directions are displayed on the field of view screen, and the arrow 224 pointing to the right is highlighted to guide the worker's line of sight (an area that the worker does not see is on the right side of the field of view screen). Note that tracing the worker's field of view can be performed by providing the worker terminal 20 with a triaxial angular velocity sensor or the like and detecting the direction of the field of view of the worker terminal 20 based on the output of this sensor.

[0081] In this way, this system provides support displays to prevent workers from overlooking crops, reducing oversights by workers and reducing losses due to missed harvests, especially during harvesting work.

[0082] (E) In this system, when performing harvesting work, only the information necessary for the worker may be extracted and displayed. Fig. 12A is an example of a worker's field of view screen on the worker terminal 20. In the example of Fig. 12A, multiple (three) crops are shown on the same field of view screen, and the worker is required to determine which crop requires action (for example, harvesting work).

[0083] In such a case, the system can extract and display only the crops that are the target of the action. For example, in the example of FIG. 12A, if crop F2 on the right side is the target of the action and other crops F3 and F4 are not, only crop F2 can be extracted and displayed. FIG. 12B is an example of a UI screen 225 that extracts and displays only crop F2. When extracting and displaying the crops that are the target of the action in this way, for example, an image screen can be created in which the crops are displayed on a white background. Note that the worker terminal 20 can automatically determine the crop that is the target of the action by, for example, determining the largest crop in the field of view screen or the crop closest to the center of the field of view screen.

[0084] In this way, the system simplifies the information provided to workers by displaying only those crops that require action by the worker, eliminating the need for workers to determine which crops require action. This is expected to improve the worker's decision-making speed and work efficiency.

[0085] (F) In the above-described harvesting work support function, when the user uses a glasses-type wearable terminal (worker terminal 20), the support display may be kept to a minimum, and only information necessary for the worker may be displayed.

[0086] For example, in the above description, an example was given of a support display that instructs the worker on which crops to harvest that are present on the field of view screen by displaying them in a specific color (e.g., blue), but such a support display can also be omitted. In this case, instead of providing the support display, the worker terminal 20 can provide work support by constantly recognizing the worker's harvesting work and notifying the worker if the worker performs (or attempts to perform) an illegal operation (e.g., harvesting a crop that is not a target for harvesting). In this case, the notification can be made by an alert sound, vibration, display of a notification message, or the like. By providing such a notification, the worker can become aware of any illegal operation that has been performed (or attempted to be performed).

[0087] In this way, by omitting the support display that indicates what to harvest, the system relieves the worker of the hassle of checking the support display, and depending on the worker's level of proficiency, this is expected to improve work efficiency. For example, experienced workers do not receive unnecessary instructions from the worker terminal 20, so their field of vision is clear and they can more easily concentrate on the harvesting work.

[0088] Additionally, the worker terminal 20 may store images of the worker's harvesting work, allowing the worker to refer to the details of the harvesting work later. This allows the worker to later refer to the images of his or her own fraudulent work and confirm how his or her harvest assessment was incorrect if it turns out to be incorrect. In this case, if the actual evaluation value of the crop that was the subject of the work is also presented, it becomes easier to confirm the details of the harvest assessment error. Of course, when notifying the worker of fraudulent work during harvesting, the actual evaluation value of the crop that was the subject of the work may also be presented.

[0089] Furthermore, notifications such as alerts or vibrations may be sent when the worker overlooks a harvest target crop (such as when the harvest target within the field of view screen is not harvested and the harvest target disappears from the field of view screen after a predetermined time has passed). In this case, after the notification, a display may be displayed to guide the worker's gaze to the overlooked harvest target (using the function (D) above).

[0090] (G) As described above, the present system can have an image collection mode in which the worker wears the worker terminal 20 and only collects images. That is, in the image collection mode, the worker terminal 20 does not perform harvest judgment on the crops, but only takes images. At this time, the worker terminal 20 preferably notifies the worker that images are being taken by, for example, displaying "image collection mode" on the field of view screen of the display unit 22 (see FIG. 13). At the same time, the type of crop being photographed may also be displayed. In the present system, use of such an image collection mode makes it easier to collect data during patrols. Furthermore, image data taken in the image collection mode can also be used as training data for creating AI.

[0091] Furthermore, image data captured in the image collection mode may be transferred from the worker terminal 20 to the server 10, where various inference processes may be performed. For example, the server 10 may infer the harvest yield from the image data or infer the distribution of quality information. In this case, at the harvest site, the worker terminal 20 only captures the image data, thereby reducing the burden on the worker terminal 20, and the server 10 may also obtain various information necessary for adjusting the harvest standard.

[0092] Second Embodiment As described above, this system displays support to the user via the worker terminal 20. In this system, the support displayed by the worker terminal 20 can be changed as appropriate according to the user attributes. Note that the user attributes here refer to the worker's proficiency level, the user's role (job), etc.

[0093] Many people work in agricultural fields, and even within the same organization, each user performs tasks according to various positions and objectives. That is, a user may be a worker who performs harvesting work or a manager who manages the field. In agriculture, a single user often plays multiple roles depending on the situation, and may switch between multiple roles such as worker, manager, or owner.

[0094] When trying to improve the efficiency of each task or work by utilizing information using the worker terminal 20, the information that the user wants to know varies depending on the user's position and purpose. Therefore, in this system, convenience can be further improved by changing the support display (information content, presentation means, etc.) presented to each user according to the user's attributes. This function will be explained below.

[0095] In this system, the user attributes of users within an organization are estimated from the behavioral history (viewed content, functions used, movement trajectory, etc.) of users using the worker terminal 20. As a user attribute, the user's role (job) can be estimated from the viewed content and functions used using the worker terminal 20. For example, if a lot of information about the entire field or the entire organization is viewed using the worker terminal 20, or if harvesting standards are being set using the worker terminal 20, it can be inferred that the user of that worker terminal 20 is a manager. On the other hand, if a lot of support information for harvesting work is displayed using the worker terminal 20, it can be inferred that the user of that worker terminal 20 is a worker.

[0096] In addition, this system can automatically obtain behavioral history information from captured images acquired by the worker terminal 20 using image recognition AI. For example, as shown in FIGS. 14 to 16, by using image recognition AI on captured images, behavioral history related to harvesting work, such as "harvesting," "sorting," and "moving," can be obtained. In this example, if harvesting tools or the back of the hand of a worker performing harvesting work are recognized in the captured image, it can be determined that the worker is "harvesting" (see FIGS. 14(a) and 14(b)). Furthermore, if harvested crops are recognized in the captured image, it can be determined that the worker is "sorting" (see FIG. 15), and if a harvest basket being transported is recognized in the captured image, it can be determined that the worker is "moving" (see FIG. 16).

[0097] The worker's proficiency level can be estimated from the behavioral history information acquired using image recognition AI. For example, the time spent harvesting (harvesting time) can be determined from the start and end times of the behavioral history determined as "harvesting." This harvesting time can be compared with a predetermined time threshold. If the harvesting time is longer than the predetermined time threshold, the worker can be determined to be a beginner with low proficiency. If the harvesting time is shorter than the predetermined time threshold, the worker can be determined to be a veteran with high proficiency. Alternatively, as a more detailed determination method, the number of crops harvested during "harvesting" can be obtained using image recognition AI and divided by the harvesting time to calculate the harvesting pace (number of harvests per unit time). Comparing this harvesting pace with a predetermined threshold can also determine the worker's proficiency level with greater accuracy. Note that the proficiency classification is not limited to two categories, beginner and veteran, but may be three or more categories.

[0098] This system can vary the support display for harvesting work depending on the worker's level of proficiency. Fig. 17 is an explanatory diagram showing an example of a support display screen (UI screen) for beginners. Fig. 18 is an explanatory diagram showing an example of a support display screen for veterans.

[0099] In the support display for beginners, as shown in FIG. 17, it is preferable to display detailed auxiliary information in addition to the judgment information on whether harvesting is possible. The displayed auxiliary information may be quality information on the crops to be harvested or the current harvesting standards. In this case, the worker can easily improve his / her proficiency by performing the harvesting work while checking the quality information and harvesting standards. Alternatively, the support display for beginners may display, as auxiliary information, points to note when performing the work. In this case, the worker can improve the accuracy of the harvesting work (eliminating oversights and forgetting to harvest) by performing the harvesting work while checking the points to note when performing the work.

[0100] On the other hand, it is preferable that the support display for veterans be simpler than that for beginners. For example, as shown in FIG. 18(a), the support display for veterans can be such that only the judgment information on whether harvesting is possible or not is displayed, and no supplementary information is displayed. In this case, the simple display with unnecessary information omitted makes it easier for the worker to see the support display screen, which leads to more efficient harvesting work. Furthermore, even if supplementary information is displayed, it can be more advanced information than that for beginners. For example, as shown in FIG. 18(b), if the crop is smaller than the harvest standard and is judged to be unharvestable, In this case, supplementary information such as how many hours after harvesting is possible may be displayed.

[0101] FIG. 19 is a flowchart showing the switching of display settings based on the estimation of user attributes in this system.

[0102] In switching display settings in this system, the worker terminal 20 acquires user behavior history information (S1). Furthermore, this system allows the user to input their own role into the worker terminal 20 (S2). If no role is input in S2, the worker terminal 20 estimates the user attributes based on the behavior history information acquired in S1, and sets display settings according to the estimated user attributes (S3). If a role is input in S2, the worker terminal 20 sets display settings according to the input role (S4). After processing S3 or S4, the process proceeds to S5.

[0103] In S5, the worker terminal 20 displays a function list that matches the display settings in S3 or S4. The user can select a function that they want to display on the worker terminal 20 from the function list displayed in S5 (S6). After selecting a function in S6, the worker terminal 20 starts displaying support information based on the selected function.

[0104] As mentioned above, a user in agriculture may play multiple roles depending on the situation. For this reason, the present system may periodically estimate user attributes and periodically switch display settings based on the estimation results. Figure 20 is a flowchart showing how the present system switches display settings based on the periodic estimation of user attributes.

[0105] 20, similarly to the example of FIG. 19, the worker terminal 20 acquires user behavior history information (S11). Furthermore, in this system, it is determined whether the accumulated work time of the user using the worker terminal 20 is equal to or longer than a predetermined fixed time (S12). Note that the "accumulated work time" here refers to the work time since the user started work using the worker terminal 20, or, if the display settings on the worker terminal 20 were switched after the user started work, the work time since the last switch of the display settings.

[0106] If the cumulative work time is less than a certain time (NO in S12), the display settings according to the default user attributes are maintained (S13). The "default user attributes" here refer to the user attributes corresponding to the display settings that had been made up until that point. After processing S13, the process proceeds to S14, and then to S15. S14 and S15 are the same as the processes of S5 and S6 in the flow of FIG. 19. That is, the worker terminal 20 displays a function list according to the display settings in S13 (S14), and the user can select a function that he or she wants to display on the worker terminal 20 from the function list displayed in S14 (S15).

[0107] If the cumulative work time is equal to or longer than a certain time (YES in S12), the current display settings are saved (S16), and the user attributes are re-estimated (S17). The re-estimate of the user attributes in S17 is performed based on the behavior history information acquired in S11. After the processing of S17, display settings are made according to the newly estimated user attributes (S18), and a function list according to the display settings in S18 is displayed (S19). Note that the display settings saved in S16 can store multiple settings for each user, and the user can selectively switch between the stored display settings. This makes it possible to easily change the support display according to the work when the user's work content changes.

[0108] After the process of S19, the user is asked to confirm whether or not to change the display settings according to the newly estimated user attributes (S20). When the user confirms the change of the display settings, the user can select a function that the user wants to display on the worker terminal 20 from the function list displayed in S19 (S21). After the function selection in S15 and S21, the worker terminal 20 displays the selected function. Start displaying support information via

[0109] 21 and 22 are examples of display of the function list in S5 of FIG. 19 and S14 and S19 of FIG.

[0110] Figure 21 shows a list of functions (on the left side of the figure) when the user is presumed or set to be a worker. In the example of Figure 21, "harvesting support," "sorting support," "work efficiency review," and "work history" are displayed as functions that the worker can select. When the user selects the function they want to use from these functions (in Figure 21, "work efficiency review" is selected), the display changes to the display corresponding to the selected function (on the right side of the figure).

[0111] Figure 22 shows a list of functions (on the left side of the figure) when the user is presumed or set to be an administrator. In the example of Figure 22, "Work Efficiency Evaluation," "Progress Check," "Quality Information," and "Sorting Plant Information" are displayed as functions that can be selected by the administrator. When the user selects the function they want to use from these functions (in Figure 22, "Progress Check" is selected), the display changes to the display corresponding to the selected function (on the right side of the figure).

[0112] The embodiments disclosed herein are illustrative in all respects and are not intended to be limiting. Therefore, the technical scope of the present disclosure should not be interpreted solely by the above-described embodiments, but should be determined based on the claims. [Explanation of symbols]

[0113] 10 Server (Harvesting Work Support System Server) 11 Arithmetic section 111 Harvest standard calculation unit 12 Storage area 121 Operation information storage unit 122 Harvest Standards Storage Unit 13 Communications Department 20 Worker terminal 21 Photography Department 22 Display section 221 UI screen 221A Fruit sorting facility selection window 221B Display information selection window 221C Information display window 222 UI screen 222A Harvest Standard Setting Window 222B Quality information distribution display window 222C Expected yield display window 223 UI screen 223A Judgment item display window 225 UI screen 23 Arithmetic section 231 Harvest Judgment Department 232 Display control unit 233 Growth information acquisition department 24 Memory section 241 Harvest Standard Memory Unit 242 Growth information storage section 25 Communications Department 30 Internet lines

Claims

1. A harvesting operation support system that supports harvesting of agricultural products, the harvesting operation support system including a harvesting operation support system server and a worker terminal that is capable of communicating with the harvesting operation support system server, The harvesting operation support system server includes an operation information storage unit that stores operation information at the sorting site, and a harvesting standard calculation unit that calculates a harvesting standard based on the operation information stored in the operation information storage unit, and is capable of transmitting the harvesting standard calculated by the harvesting standard calculation unit to the worker terminal; The worker terminal is equipped with a photographing unit, a display unit that displays images captured by the photographing unit, and a harvest assessment unit that determines which crops are eligible for harvesting based on the harvest criteria sent from the harvesting work support system server using image data of the crops photographed by the photographing unit, and is capable of displaying support information on the display unit to instruct the worker about which crops are eligible for harvesting based on the harvest criteria sent from the harvesting work support system server.

2. A harvesting operation support system that supports harvesting of agricultural products, the harvesting operation support system including a harvesting operation support system server and a worker terminal that is capable of communicating with the harvesting operation support system server, The harvesting operation support system server includes an operation information storage unit that stores operation information at the sorting site, a harvesting standard calculation unit that calculates harvesting standards based on the operation information stored in the operation information storage unit, and a harvest determination unit that determines which crops are to be harvested based on the harvesting standards for image data of photographed crops, the worker terminal includes an image capturing unit and a display unit that displays an image captured by the image capturing unit; the worker terminal transmits image data of the agricultural products photographed by the photographing unit to the harvesting work support system server; the harvesting operation support system server determines the crops to be harvested using the harvest determination unit based on the image data transmitted from the worker terminal, and transmits the determination result to the worker terminal; A harvesting support system characterized in that the worker terminal is capable of displaying support information on the display unit to instruct the worker on which crops have been determined to be harvested based on the results of the harvesting support system server's judgment.

3. The harvesting operation support system according to claim 1 or 2, A harvesting support system characterized in that the worker terminal is capable of transmitting information on the growth of agricultural crops at the harvesting site to the harvesting support system server, and requesting adjustment of harvesting standards in the harvesting support system server based on the transmitted growth information.

4. The harvesting operation support system according to claim 1 or 2, A harvesting work support system, wherein the worker terminal is a glasses-type wearable terminal.

5. The harvesting operation support system according to claim 1 or 2, The harvesting support system is characterized in that the harvesting support system server manages the quantity of agricultural products determined to be harvested for each specified period.

6. The harvesting operation support system according to claim 1 or 2, The harvesting support system is characterized in that the harvesting support system server is configured by connecting servers installed in multiple facilities via a network.

7. The harvesting operation support system according to claim 1 or 2, The harvest assessment unit is configured to assess the quality of the crops obtained from the image data of the crops photographed by the photographing unit. Dimensional information is included as a judgment item, A harvesting support system characterized in that the dimension information is evaluated after calculating a circumscribing rectangle line for the outline of the crop extracted from the image data and rotating the circumscribing rectangle line in a predetermined direction.

8. The harvesting operation support system according to claim 1 or 2, The harvesting support system is characterized in that the harvesting support system server is capable of setting harvesting standards for each of a plurality of sorting sites.

9. The harvesting operation support system according to claim 8, A harvesting support system characterized in that the worker terminal can select a sorting site and can check the harvest yield at their own harvesting site against the harvesting standards of the selected sorting site.

10. The harvesting operation support system according to claim 1 or 2, The harvesting operation support system is characterized in that the harvest assessment unit is capable of automatically changing assessment items for determining which crops are to be harvested depending on the type of crop.

11. The harvesting operation support system according to claim 1 or 2, A harvesting operation support system characterized in that user attributes are inferred from images captured by the worker terminal, and the support display is changed in accordance with the inferred user attributes.

12. The harvesting operation support system according to claim 11, A harvesting support system characterized in that the user attributes are estimated using image recognition from images taken by the worker terminal.

13. The harvesting operation support system according to claim 11, A harvesting support system characterized in that the user attribute can be estimated as a worker's level of proficiency.

14. The harvesting operation support system according to claim 11, A harvesting work support system characterized in that the user's role can be determined as the user attribute.

15. a harvesting operation support system server that is communicably connected to a worker terminal and that constitutes a harvesting operation support system that supports harvesting of agricultural crops, an operation information storage unit for storing operation information at the sorting facility; a harvesting standard calculation unit that calculates a harvesting standard based on the operation information stored in the operation information storage unit, A harvesting operation support system server capable of transmitting the harvesting standard calculated by the harvesting standard calculation unit to the worker terminal.

16. a harvesting operation support system server that is communicably connected to a worker terminal and that constitutes a harvesting operation support system that supports harvesting of agricultural crops, an operation information storage unit for storing operation information at the sorting facility; a harvesting standard calculation unit that calculates a harvesting standard based on the operation information stored in the operation information storage unit; a harvest determination unit that determines which crops are to be harvested based on the harvest criteria for image data of captured crops; The harvest determination unit determines which crops are to be harvested based on image data of the captured crops sent from the worker terminal, and the determination result can be sent to the worker terminal. A harvesting work support system server characterized by:

Images