Work support system

Abstract

To provide a work support system capable of displaying work support information for crops in accordance with work necessity to improve ease of viewing the display and workability.SOLUTION: A work support system 1 for supporting work on a crop 101 acquires work support information on the crop 101 included in an area based on an area image 100 photographed by a worker, and switches between normal display and suppression display of the work support information according to a predetermined switching condition when displaying the work support information on a worker terminal 3 of the worker. For example, the work support system 1 displays work necessity information indicating whether work is required or not for the crop 101 as work support information, so as to be superimposed on the crop 101 on the worker terminal 3.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a work assistance system that assists in work on crops. [Background technology]

[0002] In farm fields, which are the site of agricultural work, tasks such as thinning out unnecessary leaves, flowers, and fruits, spraying pesticides on diseased areas, harvesting crops, and sorting are performed. It is desirable for a variety of agricultural workers, including inexperienced workers, low-skilled workers, non-native speakers, and visually impaired people, to be able to make appropriate work decisions regarding work in the field, and it is desirable for experienced workers to be able to make work decisions with less burden and in a shorter time. Therefore, in recent years, systems that support agricultural work using worker devices such as smart glasses and smartphones have been considered.

[0003] As a conventional technology, there is a work support system that supports work by using a worker terminal such as a wearable device to photograph a work target in a field, obtaining work support information based on the captured images, and displaying the work support information on the worker terminal.

[0004] For example, the on-site work support system of Patent Document 1 includes a worker terminal worn or carried by a worker and a server. The worker terminal acquires first data including a first image captured by a camera of a work object including a crop in the field of view of the worker, the worker terminal or the computer system receives the first data as an input, recognizes the state of the work object based on second data reflecting learning of the second image of the work object, and acquires third data for supporting the work based on the recognition result, and the worker terminal outputs to the worker based on the third data as an output for supporting the work, including an output informing the worker that the work object is in the first image associated with the field of view. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 7039766 Summary of the Invention [Problem to be solved by the invention]

[0006] Conventionally, in a work support system that supports work on crops, work support information for the crop is displayed on the screen of the worker's terminal by superimposing it on the crop. However, if the work support information is always superimposed on the screen of the worker's terminal, the worker who sees the crop cannot properly check the crop, and there is a risk of workability being reduced. In addition, even if a certain amount of work support information is always displayed, it is not possible to grasp the tempo, etc., which is a guideline for the work, and it is not possible to know the degree of proficiency of the worker.

[0007] However, when a conventional work support system is applied to the harvesting of vegetables and fruits, it is necessary to search for the work object while picking, so there is a possibility that harvestable fruits will be overlooked. In addition, when a conventional work support system is applied to the patrol work to detect crop diseases, a large amount of work support information is output for a large amount of crops regardless of whether they are diseased or not, so there is a possibility that work support information that requires work will be overlooked. In addition, the conventional work support system can display work support information for crops displayed on the screen of the worker's terminal, but cannot display work support information for crops not displayed on the screen of the worker's terminal, so it is not possible to check the work support information for crops that have been overlooked or missed.

[0008] An object of the present invention is to provide a work support system that can display work support information for crops in accordance with the necessity of the work, thereby improving the visibility of the display and workability. [Means for solving the problem]

[0009] In order to solve the above problems, the work support system of the present invention is a work support system that supports work on crops, and is characterized in that it obtains work support information regarding the crops included in an area based on an area image photographed by a worker, and when displaying the work support information on the worker's worker terminal, switches between normal display and suppressed display of the work support information in accordance with predetermined switching conditions. Effect of the Invention

[0010] According to the present invention, a work support system is provided that can display work support information for crops in accordance with the need for the work, thereby improving the visibility of the display and workability. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a work support system according to an embodiment of the present invention. [Diagram 2] 1 is a front view showing an example of a region image captured by the work support system according to an embodiment of the present invention; [Diagram 3] 1 is a front view showing an example of a setting screen for a dimension threshold of a crop image in the work support system according to an embodiment of the present invention. FIG. [Figure 4] 1 is a front view showing an example of a position marker displayed as work support information in a work support system according to an embodiment of the present invention. FIG. [Diagram 5] 1 is a front view showing an example of a position marker displayed as work support information in a work support system according to an embodiment of the present invention. FIG. [Figure 6] 1 is a table showing switching conditions for work support information in the work support system according to the embodiment of the present invention. [Figure 7] 1 is a front view showing an example of a position marker displayed as work support information in a work support system according to an embodiment of the present invention. FIG. [Figure 8] 13 is a flowchart showing an example of an operation of a work support system according to another embodiment of the present invention. [Figure 9]FIG. 13 is a front view showing an example of a region image captured in a work support system according to another embodiment of the present invention. [Figure 10] 13A and 13B are front views showing examples of an area image captured in a work support system according to another embodiment of the present invention and a template extracted from the area image. [Figure 11] FIG. 13 is a front view showing an example of a directional sign displayed as work support information in a work support system according to another embodiment of the present invention. [Figure 12] FIG. 13 is a front view showing an example of a directional sign displayed as work support information in a work support system according to another embodiment of the present invention. [Figure 13] FIG. 13 is a front view showing an example of a directional sign displayed as work support information in a work support system according to another embodiment of the present invention. [Figure 14] FIG. 13 is a front view showing an example of a directional sign displayed as work support information in a work support system according to another embodiment of the present invention. [Figure 15] FIG. 13 is a front view showing an example of a directional sign displayed as work support information in a work support system according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] A work support system 1 according to an embodiment of the present invention will be described with reference to the drawings. The work support system 1 supports work on crops in a field, which is the site of agricultural work, and provides work support information for the crops to a worker. For example, as shown in FIG. 1, the work support system 1 includes a server 2 and a worker terminal 3. In the field, work such as thinning out unnecessary leaves, flowers, and fruits, patrolling to detect crop diseases, harvesting crops that are suitable for harvesting, and sorting crops is performed. In order to support each of these tasks, the work support system 1 takes an image including the crops in the field, obtains work support information for the crops based on the image, and provides the work support information to the worker via the worker terminal 3.

[0013] The server 2 is configured to be able to communicate with the worker terminal 3 via a network such as the Internet. The server 2 has an information acquisition unit 21 that acquires work support information related to a crop 101 (see FIG. 2) included in a predetermined area of ​​a field based on an area image 100 (see FIG. 2) captured in the area. The information acquisition unit 21 is configured by a program executed by a computer included in the server 2, and constitutes a part of a work support program 30 that executes work support in the field.

[0014] When the information acquiring unit 21 receives the area image 100 from the operator terminal 3, as shown in FIG. 2, the information acquiring unit 21 detects the crop 101 captured in the area image 100. At this time, the information acquiring unit 21 analyzes the area image 100 using artificial intelligence (AI) and compares the received area image 100 with a reference image prepared in advance for the crop 101, thereby extracting an image (crop image 102) of the crop 101 included in the area image 100, thereby detecting the crop 101 included in a predetermined area. For example, the information acquiring unit 21 detects the crop 101 captured in the area image 100 based on a reference image that is a learning model obtained by machine learning the image of the crop 101 using artificial intelligence, and specifically, extracts the crop image 102 included in the area image 100 by comparing a feature amount (feature point or feature vector) extracted from the reference image with a feature amount extracted from the area image 100. When the crop 101 is obliquely captured in the region image 100, the information acquiring unit 21 may extract the crop image 102 using a circumscribing rectangle or the like that takes rotation into consideration. The information acquiring unit 21 may also extract the crop image 102 having a shape that conforms to the contour of the crop 101 by instance segmentation.

[0015] Furthermore, the information acquisition unit 21 uses a reference image corresponding to the crop type and work type for which work support is to be provided, which is specified by the worker terminal 3. For example, when the work type is harvesting work, the information acquisition unit 21 uses a reference image capable of determining whether the crop 101 is suitable for harvesting, specifically, a reference image is prepared and used for each maturity level of the crop 101. When the work type is sorting work, the information acquisition unit 21 uses a reference image capable of determining the quality of the crop 101, specifically, a reference image is prepared and used for each quality and size of the crop 101. When the work type is patrol work, the information acquisition unit 21 uses a reference image capable of determining disease of the crop 101, specifically, a reference image is prepared and used for each disease type and degree of disease (including normal state) of the crop 101.

[0016] Then, the information acquiring unit 21 acquires work support information based on the crop images 102 extracted from the area image 100, and transmits the information to the worker terminal 3. For example, the information acquiring unit 21 counts the number of crop images 102 extracted from the area image 100, that is, the number of crops 101 included in a predetermined area, as the work support information. Furthermore, the information acquiring unit 21 calculates, as the work support information, the position and dimensions (dimensions of a rectangle, circle, or the like that encompasses the crop image 102) in the area image 100 of each crop image 102 extracted from the area image 100.

[0017] Even if the actual sizes of the crops 101 included in a predetermined area are the same, the crops 101 farther from the worker are not the work target, and the crops 101 relatively closer to the worker are the work target. In addition, the crops 101 with a small actual size may not be the work target, and the crops 101 with a large actual size may be the work target. For this reason, the information acquisition unit 21 determines whether the relative dimensions of the crop images 102 in the area image 100 are equal to or greater than a predetermined dimension threshold. Then, the information acquisition unit 21 does not count the crop images 102 with dimensions less than the dimension threshold as not being the work target, but counts only the crop images 102 with dimensions equal to or greater than the dimension threshold as the crops 101 to be worked on. In addition, even if the crops 101 are below the dimension threshold, the crop images 102 whose rectangular positions overlap with the crops 101 with dimensions equal to or greater than the dimension threshold may be the work target. In addition, the dimension threshold is a threshold based on the apparent size of the crop 101 on the area image 100, and may be the thresholds for the vertical and horizontal lengths of the crop images 102. The size threshold may be set in advance according to the type of crop, or may be set according to an arbitrary operation of the worker at the worker terminal 3. Alternatively, the size threshold set at one worker terminal 3 may be reflected at other worker terminals 3 by communication with that one worker terminal 3 or by communication via a predetermined manager terminal (not shown). Alternatively, the size threshold may be set at a predetermined manager terminal (not shown), and the setting contents of the size threshold may be reflected at multiple worker terminals 3 by communication with that manager terminal.

[0018] For example, as shown in FIG. 3, the operator terminal 3 displays a setting screen 110 on the display unit 14 for accepting the setting of a dimension threshold value of the crop image 102. The setting screen 110 displays sample images 111 of areas including various crops 101 with different apparent sizes on the image, and also displays sample images 112 of the crops 101 with various dimensions in parallel in order of size. The setting screen 110 also allows a dimension threshold bar 113 to be set at any of the boundaries of the sample images 112 with various dimensions displayed in parallel, and the dimension threshold value is set based on the set dimension threshold bar 113. Alternatively, the setting screen 110 may display an interface such as a check box or a radio button corresponding to each of the sample images 112 with various dimensions displayed in parallel in a selectable manner. The operator terminal 3 transmits the set dimension threshold value to the server 2. The setting screen 110 may be used in other setting screens, which will be described later.

[0019] The information acquisition unit 21 performs image analysis of each crop image 102 based on the reference image, performs work judgment for each work type (e.g., judgment of suitability for harvesting, quality judgment, disease judgment, etc.) for the crop 101 that is the subject of the work, and acquires the work judgment results as work support information, for example, judges whether work is required for the crop 101 or not, and acquires work necessity information indicating whether work is required or not as the work judgment result.

[0020] Specifically, when the work type is harvesting work, the information acquisition unit 21 determines which maturity level of each crop image 102 corresponds to a reference image as a harvest suitability judgment, and acquires work necessity information indicating whether the crop 101 is suitable for harvesting (work required) or not (work not required) as a work judgment result. When the work type is patrol work, the information acquisition unit 21 acquires work support information indicating the disease type of the crop 101 by determining which disease type of each crop image 102 corresponds to a reference image as a disease judgment, and further acquires work necessity information indicating whether a response to a disease in the crop 101 is required (work required) or not (work not required) as a work judgment result.

[0021] Furthermore, the information acquiring unit 21 detects a task transition of the worker for the crop 101 photographed in the area image 100 by analyzing the area image 100 using artificial intelligence. When the information acquiring unit 21 detects a task transition, the information acquiring unit 21 transmits task transition information to the worker terminal 3, and the task transition information may include a reason for determining the task transition.

[0022] For example, when the work type is harvesting or sorting, the information acquisition unit 21 detects the worker's work transition by comparing the area image 100 with a reference image (a learning model machine-learned by artificial intelligence) prepared in advance about the hands and tools of a human worker performing the work, and extracting an image (work image) of the worker's hands, tools, etc. included in the area image 100. When the work type is patrol work, the information acquisition unit 21 detects the worker's work transition by determining that the worker's field of vision has changed (the head has moved significantly) based on two or more similar area images 100 that are taken in succession in time, and when the captured contents are significantly different between the area images 100 (for example, when the inter-frame difference is greater than a predetermined value).

[0023] Alternatively, when the work type is harvesting work, the information acquisition unit 21 detects the worker's work transition by determining the worker's approach to the crop 101 captured in the area image 100 based on two or more similar area images 100 that are taken before and after in time. For example, the information acquisition unit 21 may determine the worker's approach when a part of an image including the crop 101 captured in the area image 100 is enlarged. When the work type is sorting work, the information acquisition unit 21 detects the worker's work transition by determining that the worker's body has moved based on two or more similar area images 100 that are taken before and after in time. Also, when the work type is patrol work, the information acquisition unit 21 detects the worker's work transition by determining that the worker is walking based on two or more similar area images 100 that are taken before and after in time.

[0024] The worker terminal 3 is a terminal carried or worn by the worker, and in this embodiment, an example will be described in which the worker terminal 3 is configured as a wearable terminal of a head-mounted display type such as smart glasses.

[0025] The worker terminal 3 is equipped with a control unit 10 consisting of a computer such as a CPU, and the control unit 10 is connected to a memory unit 11 such as a ROM, RAM, a hard disk drive, or a flash memory, and a communication unit 12 that communicates with external devices.

[0026] The worker terminal 3 also includes an image capture unit 13 for capturing images of the surroundings, a display unit 14 for displaying the captured images and work support information, and an operation unit 15 for receiving operations by the worker. The worker terminal 3 also includes a speaker 16 for outputting audio, and a microphone 17 for inputting audio. The worker terminal 3 further includes a position detection unit 18 for detecting the position of the worker terminal 3, and a motion detection unit 19 for detecting the motion of the worker terminal 3.

[0027] The memory unit 11 stores programs and data for controlling various components and functions of the worker terminal 3, and the control unit 10 executes calculation processing based on the programs and data stored in the memory unit 11, thereby controlling the various components and functions of the worker terminal 3. The memory unit 11 stores, for example, a work support program 30 that executes work support in a farm field.

[0028] The communication unit 12 is connected to the server 2 via a wireless communication antenna so as to be able to wirelessly communicate with the server 2. The control unit 10 controls the communication unit 12 to perform wireless communication with the server 2 and transmits and receives image data, work support information, and the like to and from the server 2.

[0029] The imaging unit 13 is attached to the worker terminal 3 so as to capture the visual field of the worker wearing the worker terminal 3, and captures images under the control of the control unit 10. The display unit 14 is provided in the glass portion of the smart glasses constituting the worker terminal 3, and displays images under the control of the control unit 10. The glass portion of the display unit 14 may be configured as a transmissive type or a non-transmissive type.

[0030] The operation unit 15 may be provided integrally with the main body of the worker terminal 3, or may be provided separately. When an operation by the worker is input, the operation unit 15 transmits an operation signal corresponding to the operation to the control unit 10. When the operation unit 15 is provided separately from the main body of the worker terminal 3, the control unit 10 controls the communication unit 12 to communicate with the operation unit 15 and transmits and receives operation signals between the operation unit 15. The operation unit 15 provided separately from the main body of the worker terminal 3 may be, for example, a device specific to the worker terminal 3, or may be a portable terminal such as a smartphone or tablet terminal carried by the worker. When the operation unit 15 is configured as a portable terminal, the control unit 10 and the storage unit 11 may be provided in the portable terminal.

[0031] Speaker 16 outputs sound under the control of control unit 10, and microphone 17 inputs sound from outside and transmits it to control unit 10. Position detection unit 18 is composed of a positioning unit that acquires the position of worker terminal 3 using a satellite positioning system such as GNSS, and transmits the acquired position of worker terminal 3 to control unit 10. Movement detection unit 19 is composed of an acceleration sensor and a gyro sensor, and transmits the detected movement of worker terminal 3 to control unit 10.

[0032] The work support program 30 executed by the control unit 10 has an image acquisition unit 31 and an information output unit 32. When the control unit 10 executes the work support program 30 in response to a start operation of work support by the worker, the image acquisition unit 31 and the information output unit 32 are executed in the worker terminal 3. Furthermore, when starting work support, the worker terminal 3 accepts a designation operation for the crop type and work type of the crop 101 for which work support is to be performed, and transmits the designated crop type and work type to the server 2. Alternatively, the worker terminal 3 may transmit the crop type and work type to the server 2 at the same time as transmitting the area image 100 described below. Note that a different server 2 may be prepared in advance for each crop type and work type, and the worker terminal 3 may be configured to communicate with the server 2 corresponding to the designated crop type and work type.

[0033] The image acquisition unit 31 acquires images by photographing the image capturing unit 13 at predetermined time intervals or at predetermined distance intervals after work support is started by the work support program 30. Thus, when a worker working in the field is wearing the worker terminal 3, the image acquisition unit 31 photographs a predetermined area of ​​the field by the photographing unit 13 and acquires an area image 100 of the area. The time intervals or distance intervals at which the photographing unit 13 photographs the area may be set so that the area is photographed in an overlapping manner. The image acquisition unit 31 also transmits the photographed area image 100 to the server 2 in order to acquire work support information related to the crop 101 included in the area.

[0034] The information output unit 32 receives work support information based on the transmitted area image 100 from the server 2, and outputs the received work support information in a format according to the specified crop type and work type by displaying it on the display unit 14. Furthermore, the information output unit 32 may display the specified crop type (crop name) and work type (work name) on the display unit 14, regardless of whether or not the work support information is displayed on the display unit 14.

[0035] For example, as shown in Fig. 4 and Fig. 5, the information output unit 32 displays, as work support information, a position marker 104 of the crop 101, which is indicated by a rectangle or a circle having the position and dimensions of the crop image 102 in the area image 100, superimposed on a position corresponding to the crop image 102 on the screen of the display unit 14. Note that, for a crop 101 obliquely photographed in the area image 100, if the crop image 102 is extracted using a circumscribing rectangle or the like that takes rotation into consideration, the position marker 104 corresponding to the crop image 102 of the circumscribing rectangle or the like may be displayed. Also, if a crop image 102 having a shape that follows the outline of the crop 101 is extracted by instance segmentation, the position marker 104 corresponding to the crop image 102 having the outline shape may be displayed.

[0036] The information output unit 32 may display the area image 100, which is a real-time moving image of a predetermined area, over the entire screen of the display unit 14, and display the work support information superimposed on the area image 100 of the moving image. At this time, the information output unit 32 can smoothly display and update the work support information by using AR (Augmented Reality) technology or the like for the moving image. Alternatively, the information output unit 32 may display the area image 100 of the moving image over the entire screen of the display unit 14, and display the area image 100, which is a predetermined still image, over the moving image in a part of the screen of the display unit 14, and display the work support information superimposed on the area image 100 of the still image. Alternatively, the information output unit 32 may display the area image 100, which is a still image, over the entire screen of the display unit 14, and display the work support information superimposed on the area image 100 of the still image. Furthermore, the information output unit 32 may display the work support information in a display format selected in response to an arbitrary operation of the worker at the worker terminal 3 from among the three display formats described above.

[0037] Furthermore, when displaying the position marker 104, the information output unit 32 displays the position marker 104 in a format based on the type of work and the work determination result indicated by the work support information, and for example, displays the position marker 104 in different formats (line color, background color, etc.) for the crop 101 for which the work necessity information indicates that work is necessary and the crop 101 for which work is not necessary. Specifically, when the work type is harvesting work, the information output unit 32 displays the position marker 104 in different formats for the crop 101 for which the work determination result (work necessity information) of the harvest suitability determination is suitable for harvesting (requires work) and the crop 101 for which work is not suitable for harvesting (no work required), as shown in FIG. 4. For example, the information output unit 32 displays the background color of the position marker 104 for the crop 101 suitable for harvesting in red (illustrated by hatching slanting downwards to the left) and displays the background color of the position marker 104 for the crop 101 not suitable for harvesting in green (illustrated by hatching slanting downwards to the right).

[0038] Alternatively, when the work type is patrol work and the work support information indicates a disease type based on disease determination, the information output unit 32 displays a position indicator 104 in a different format (such as a line color) for each disease type, as well as a notation indicating the disease type, as shown in Fig. 5. For example, the information output unit 32 displays a notation indicating the disease type, such as "irregularly shaped fruit" or "hollow fruit", together with the position indicator 104, and also displays position indicators 104 in different formats for crops 101 that require disease response and crops 101 that do not require disease response (no work required).

[0039] The operator terminal 3 can set maturity criteria for judging whether it is the right time to harvest (work required) or not (work not required) and disease criteria for judging whether disease countermeasures are required (work required) or not (work not required) on a criterion setting screen (not shown) similar to the above-mentioned setting screen 110. For example, on the criterion setting screen, for elements whose state changes continuously, such as the coloring degree and size of the crop 101, the change state is divided into multiple stages, and one of the change states is selected by an interface such as a threshold bar similar to the dimension threshold bar 113, a check box, or a radio button. Also, on the criterion setting screen, when the state is judged by a discontinuous element, whether or not work is required is selectable by an interface such as a check box or an ON / OFF (required / not required) selection button.

[0040] The operator terminal 3 can set the display format of the position marker 104 indicating whether work is required, the degree of maturity, and the disease type on a display format setting screen (not shown) similar to the setting screen 110. For example, the display format setting screen can set the display format of the line color and label (such as the disease type) of the position marker 104. The display format setting screen can display examples of the position marker 104 together with a sample image of the crop 101 for reference, and the display format of the shape of the position marker 104 (rectangle, circle, etc.), line color, background color, label shape, position relative to the position marker 104, font, etc. can be changed while referring to the example of the position marker 104. The display format setting screen can be switched between a mode in which the position marker 104 is displayed regardless of whether work is required or not, and a mode in which only the position marker 104 in which work is required is displayed.

[0041] Regarding the setting of the maturity and disease judgment criteria and the setting of the display format of the position indicator 104, the setting contents at one worker terminal 3 may be reflected to other worker terminals 3 by communication with the one worker terminal 3 or by communication via a predetermined administrator terminal (not shown). Alternatively, the judgment criteria and the display format may be made configurable at a predetermined administrator terminal (not shown), and the setting contents may be reflected to a plurality of worker terminals 3 by communication with the administrator terminal.

[0042] Furthermore, when displaying the work support information on the display unit 14, the information output unit 32 switches between normal display and suppressed display of the work support information in accordance with a predetermined switching condition. The information output unit 32 displays the work support information as described above as normal display. On the other hand, as suppressed display, the information output unit 32, for example, hides the work support information (see FIG. 2), or changes the line type of the work support information format to a thin line, a dotted line, a dashed dotted line, or the like, or lightens the line color or background color.

[0043] The information output unit 32 determines whether the worker has shifted the work for the crop 101 included in the area image 100 based on the movement of the worker terminal 3 and / or the change in the area image 100, and sets the condition for switching the work support information as a case where the work shift has been determined. The switching condition may be set in advance for each crop type or each work type, as shown in FIG. 6. The information output unit 32 switches the normal display of the work support information to the suppressed display according to the switching condition for determining the work shift. In this case, the information output unit 32 may switch to the normal display after a predetermined time has elapsed since switching to the suppressed display.

[0044] The information output unit 32 may determine whether or not the worker has performed a task transition based on the task transition information received from the server 2. For example, when the task type is harvesting or sorting, the information output unit 32 determines, based on the task transition information, that the worker's hands, work tools, or the like are captured in the area image 100 as a first condition. When the task type is patrol work, the information output unit 32 determines, based on the task transition information, that the worker's field of view has been changed as a first condition.

[0045] Furthermore, the information output unit 32 may determine whether or not the worker has performed a task transition based on not only the task transition information but also the result of motion detection of the worker terminal 3 (worker) by the motion detection unit 19. For example, when the task type is harvesting, the second condition is determined to be a case where the information output unit 32 determines, based on the motion detection result or the task transition information, that the worker has approached the crops 101. When the task type is sorting, the second condition is determined to be a case where the information output unit 32 determines, based on the motion detection result or the task transition information, that the worker has moved. When the task type is patrol work, the second condition is determined to be a case where the information output unit 32 determines, based on the motion detection result or the task transition information, that the worker is walking.

[0046] Furthermore, the information output unit 32 sets the third condition as a switching condition for the work support information when a certain time has elapsed since the normal display or suppressed display of the work support information. At this time, the information output unit 32 switches the normal display of the work support information to the suppressed display when a predetermined normal display time has elapsed since the start of the normal display of the work support information, and switches the suppressed display of the work support information to the normal display when a predetermined suppressed display time has elapsed since the start of the suppressed display of the work support information.

[0047] When performing normal display of work support information, the information output unit 32 may display an indication of the normal display time on the display unit 14, and when performing suppressed display of work support information, may display an indication of the suppressed display time on the display unit 14. For example, as shown in Fig. 7, the information output unit 32 displays a timer graphic 105 indicating the suppressed display time on the screen of the display unit 14.

[0048] The information output unit 32 may change the normal display time and the suppressed display time depending on the type of work and the number of crops 101 included in the area. For example, if the total number of crops 101 is n1 and the standard time required to recognize each crop 101 in the area is a1, the information output unit 32 calculates the normal display time by a1×n1. Also, if the number of crops 101 requiring work is n2 and the standard time required to work each crop 101 in the area is a2, the information output unit 32 calculates the suppressed display time by a2×n2.

[0049] The information output unit 32 presets a coefficient a1 for the normal display time and a coefficient a2 for the suppressed display time. For example, when the work type is harvesting, the coefficient a1 is set to 0.5 and the coefficient a2 is set to 1.5, when the work type is sorting, the coefficient a1 is set to 0.5 and the coefficient a2 is set to 1.0, and when the work type is patrol work, the coefficient a1 is set to 1.0 and the coefficient a2 is set to 1.5.

[0050] The worker terminal 3 may store the coefficient a1 of the normal display time and the coefficient a2 of the suppressed display time personalized for each worker. In this case, the worker terminal 3 may calculate the average value of the coefficient a1 of the normal display time and the coefficient a2 of the suppressed display time for each worker based on the work history of each worker, or may calculate the coefficient a1 of the normal display time and the coefficient a2 of the suppressed display time for each worker by machine learning. Alternatively, the worker terminal 3 may set the coefficient a1 of the normal display time and the coefficient a2 of the suppressed display time to perform the work at a slightly faster speed based on the worker's past work performance, thereby promoting familiarity with the work.

[0051] When at least one of the above-mentioned first condition, second condition, and third condition is satisfied, the information output unit 32 determines that the switching condition is satisfied, and switches between normal display and suppressed display of the work support information.

[0052] When it is desired to extend the normal display without switching the work support information from the normal display to the suppressed display or to cancel the switching to the suppressed display, the information output unit 32 may extend the normal display or cancel the switching to the suppressed display by receiving a predetermined operation by the operation unit 15 or a predetermined movement of the worker terminal 3. For example, based on the result of the movement detection of the worker terminal 3 (worker) by the movement detection unit 19, the information output unit 32 can determine that the worker is searching for a work object if the worker terminal 3 moves frequently, and can determine that the work object has been searched for if the movement of the worker terminal 3 has stopped.

[0053] Similarly, when it is desired to extend the suppressed display without switching the work support information from the suppressed display to the normal display or when it is desired to cancel the switching to the normal display, the information output unit 32 may extend the suppressed display or cancel the switching to the normal display by accepting a predetermined operation by the operation unit 15 or a predetermined movement of the worker terminal 3. Furthermore, when it is desired to forcibly switch to the suppressed display when the work support information is in the normal display, the information output unit 32 may forcibly switch to the suppressed display by accepting a predetermined operation by the operation unit 15 or a predetermined movement of the worker terminal 3. Furthermore, when it is desired to forcibly switch to the normal display when the work support information is in the suppressed display, the information output unit 32 may forcibly switch to the normal display by accepting a predetermined operation by the operation unit 15 or a predetermined movement of the worker terminal 3.

[0054] As described above, according to this embodiment, the work support system 1 supports work on a crop 101, and obtains work support information on the crop 101 included in an area based on an area image 100 photographed by a worker, and when displaying the work support information on the worker terminal 3 of the worker, switches between normal display and suppressed display of the work support information according to a predetermined switching condition.

[0055] As a result, the worker terminal 3 performing the work support can not only normally display the work support information but also switch to suppressed display, thereby suppressing the crop 101 from being obscured by the work support information, allowing the crop 101 to be properly confirmed, and improving workability. Furthermore, since the next work support information can be created while the work support information is being suppressed and displayed, the work support information can be smoothly updated and displayed without causing a time lag, and stress on the worker caused by delays in displaying the work support information can be reduced. Therefore, the work support information for the crop 101 can be displayed in accordance with the necessity of the work, improving the visibility of the display and workability.

[0056] Furthermore, according to this embodiment, the work support system 1 displays work necessity information, which indicates whether work is required or not for the crop 101, as work support information on the worker terminal 3 by superimposing it on the crop 101.

[0057] This allows the worker to check whether work is required or not based on the work necessity information, while the worker terminal 3 suppresses the display of the work necessity information, which is work support information, allowing the worker to smoothly perform work on the crops 101 that require work.

[0058] Furthermore, according to this embodiment, the work support system 1 determines a shift in the worker's work for the crop 101 included in the area image 100 based on the movement of the worker terminal 3 and / or a change in the area image 100, and when a shift in work is determined, switches the normal display of the work support information to a suppressed display as a switching condition.

[0059] Alternatively, according to this embodiment, the work support system 1 switches the normal display of the work necessity information to the suppressed display, with the switching condition being that a predetermined normal display time has elapsed since the start of the normal display of the work necessity information, and switches the suppressed display of the work necessity information to the normal display, with the switching condition being that a predetermined suppressed display time has elapsed since the start of the suppressed display of the work necessity information.

[0060] Furthermore, according to this embodiment, the work support system 1 changes the normal display time and / or the suppressed display time depending on the number of crops 101 whose work necessity information indicates that work is necessary among the crops 101 included in the area image 100.

[0061] This allows the work support system 1 to switch and present the display of work support information at appropriate timing for the work of the worker.

[0062] Furthermore, according to this embodiment, the work support system 1 displays the normal display time and / or the suppressed display time on the worker terminal 3.

[0063] This allows the worker to refer to the normal display time and the suppressed display time to grasp the tempo, etc., that serves as a guide for the work, and to know the degree of proficiency in the work.

[0064] In another embodiment of the work support system 1, the worker terminal 3 may display not only work support information related to the crop 101 included in the area, but also work support information related to the crop 101 located outside the area. In this case, the worker terminal 3 receives the work support information of the crop 101 located outside the area from the server 2, and outputs it by displaying it on the display unit 14, etc.

[0065] In another embodiment, the information acquisition unit 21 of the server 2 determines that the crop 101 located outside the range of the area and in which work has been overlooked is an overlooked crop. Then, the information acquisition unit 21 acquires an overlook direction indicating the direction of the overlooked crop relative to the area as work support information and transmits it to the worker terminal 3.

[0066] An example of the operation of the work support system 1 according to the other embodiment will be described with reference to the flowchart of FIG.

[0067] First, a worker performing work in a farm field wears the worker terminal 3, starts up the worker terminal 3, and starts work support by the work support system 1 (work support program 30) (step S1).

[0068] While the worker wearing the worker terminal 3 moves within the farm field, the photographing unit 13 of the worker terminal 3 operates to photograph a plurality of area images 100 for a plurality of areas corresponding to each position during the movement (step S2). At this time, the photographing interval of the photographing unit 13 is set shorter than the expected movement interval of the worker (worker terminal 3), and areas that are located before and after in time partially overlap, that is, they are detected as similar images.

[0069] Then, the worker starts work in the field while the work support system 1 is performing work support (step S3).

[0070] The work support system 1 analyzes the area image 100 captured by the worker terminal 3 of an area including the crop 101 using artificial intelligence (AI) on the server 2, and detects the crop 101 included in the area by extracting an image (crop image 102) of the crop 101 included in the area image 100 (step S4).

[0071] The work support system 1 performs an individual discrimination process for discriminating each crop in the crop image 102 detected from the region image 100 based on the region image 100 (step S5).

[0072] The work support system 1 uses the analysis results of the area image 100 and the individual discrimination processing results to determine whether or not any work has been overlooked for the crop image 102 detected from the area image 100, i.e., the crop 101 contained in the area (step S6).

[0073] If any work has been overlooked (step S6: Yes), the work support system 1 transmits work support information indicating the missed direction of the missed crop from the server 2 to the worker terminal 3, and the worker terminal 3 outputs the work support information indicating the missed direction by displaying it on the display unit 14, etc. (step S7).

[0074] Next, an example of the operation of the work support system 1 will be described in detail.

[0075] In the above-mentioned step S4, the information acquisition unit 21 of the server 2 extracts each of the crop images 102 of the similar area images 100, thereby determining whether or not work has been overlooked for the crop 101 corresponding to the crop image 102, and further determining the overlooked crop and the overlooked direction. When the crop 101 included in the first area image 100 is no longer included in the second area image 100, based on the first area image 100 and the second area image 100 that are temporally successive, the information acquisition unit 21 determines that the crop 101 is located outside the range of the area and determines the overlooked crop.

[0076] The crop image 102 extracted here is an image of the crop 101 that is the target of the work. When the work type is harvesting work, the information acquisition unit 21 sets the crop 101 that is suitable for harvesting as the target of the work. When the work type is patrol work, the information acquisition unit 21 sets the crop 101 (disease crop) that is determined to correspond to any disease type in the disease determination as the target of the work. When it is determined that a diseased crop is being watched during patrol work, for example, when a certain time has passed while the crop image 102 of the diseased crop maintains a certain position and certain dimensions, the information acquisition unit 21 may remove the watched diseased crop from the target of the work.

[0077] For example, the information acquisition unit 21 first groups similar area images 100 (similar images) for the multiple area images 100. At this time, the information acquisition unit 21 determines whether each area image 100 is similar based on feature amounts (feature points and feature vectors) extracted from each area image 100, and groups the area images 100 determined to be similar into a similar image group as similar images. Specifically, the information acquisition unit 21 detects similar feature points between two area images 100 that are temporally adjacent to each other, and if the distance between the similar feature points is within a predetermined distance threshold, determines these two area images 100 as similar images, and similarly performs similarity determination for the multiple area images 100.

[0078] 9, in a plurality of temporally consecutive region images 100a, 100b, and 100c, when the region images 100a and 100b include a common crop image 102, the region images 100a and 100b are determined to be similar images if the feature points of the common crop image 102 and its surrounding images are similar and the distance between the similar feature points is within a predetermined distance threshold. On the other hand, when the region image 100c is photographed by shifting the viewpoint from the region image 100b, it is difficult to detect similar feature points in the region images 100b and 100c, and even if similar feature points are detected, the distance between the similar feature points is not within a predetermined distance threshold, so that the region images are not determined to be similar images.

[0079] In step S5 described above, the information acquisition unit 21 performs individual discrimination between different images in the similar image group. Specifically, the information acquisition unit 21 sets a rectangle or circle surrounding the crop image 102 extracted as the work target in a predetermined similar image included in the similar image group (for example, the first similar image, or a similar image in which the number of crop images 102 to be the work target is the largest) as a template. Note that when two or more crop images 102 are extracted, two or more templates are set. In addition, the information acquisition unit 21 searches for an area matching the template in other similar images included in the similar image group (for example, the second or subsequent similar images).

[0080] Here, the information acquisition unit 21 determines whether the IoU between the crop image 102 extracted as a work target from the other similar images and the crop image 102 matched to the template in the other similar images is equal to or greater than a predetermined threshold. If the IoU is equal to or greater than the threshold, the information acquisition unit 21 determines that the crop 101 included in the other similar images is identical to the template, and does not add a template. On the other hand, if the IoU is less than the threshold, the information acquisition unit 21 determines that the newly detected crop 101 is included in the other similar images, and adds a rectangle or circle surrounding the crop image 102 of the crop 101 as a template. In this way, when the information acquisition unit 21 finishes individual discrimination for all similar images, it determines the final number of templates as the number of unique crops 101 in the group of similar images.

[0081] 10, when crop images 102a, 102b, and 102c corresponding to crops 101a, 101b, and 101c are extracted from a first similar image 100a in the similar image group, the information acquiring unit 21 sets rectangles surrounding the crop images 102a, 102b, and 102c as templates 108a, 108b, and 108c, respectively. Next, the information acquiring unit 21 searches for an area in the second similar image 100b that matches the templates 108a, 108b, and 108c, and extracts the crop images 102a, 102b, and 102c corresponding to the templates 108a, 108b, and 108c from the second similar image 100b. In this case, the information acquisition unit 21 determines that the IoU for the second similar image 100b is greater than or equal to a predetermined threshold, determines that the crop 101 included in the second similar image 100b is identical to the templates 108a, 108b, and 108c, and does not add a template.

[0082] Furthermore, the information acquiring unit 21 searches for an area in the third similar image 100c that matches the templates 108a, 108b, and 108c, extracts the crop images 102a, 102b, and 102c that correspond to the templates 108a, 108b, and 108c from the third similar image 100c, and further extracts the crop image 102d that is different from the templates 108a, 108b, and 108c. In this case, the information acquiring unit 21 determines that the IoU of the third similar image 100c is less than a predetermined threshold value, determines that the third similar image 100c includes the newly detected crop 101d, and adds a template 108d based on the crop image 102d of the newly detected crop 101d.

[0083] Furthermore, the information acquiring unit 21 determines whether or not there has been any oversight of work for the target crop 101 between different images in the similar image group. If template matching of the crop image 102 is not established between the similar images, or if the number of similar images from which unique crop images 102 (crop images 102 for which template matching is established) are extracted is less than a predetermined number, the information acquiring unit 21 determines that there has been no oversight of work for the crop 101 corresponding to the crop image 102.

[0084] On the other hand, if there are similar images extracted from a unique crop image 102 for which template matching was successful for a predetermined number of frames or more and the unique crop image 102 has moved a predetermined distance or more across the similar images for the predetermined number of frames or more, or if there are a predetermined number of similar images extracted from a unique crop image 102 for which template matching was successful, the information acquisition unit 21 determines that work has been overlooked for the crop 101 corresponding to the crop image 102, and determines the crop 101 to be a missed crop.

[0085] Then, the information acquiring unit 21 acquires a direction in which the crop image 102 of the overlooked crop has moved relative to the reference similar image as the overlook direction, using a predetermined similar image (for example, the latest similar image in terms of time) from among the group of similar images as a reference similar image. Note that the information acquiring unit 21 may determine multiple overlooked crops relative to the reference similar image, and may acquire multiple overlook directions respectively corresponding to the multiple overlooked crops. The information acquiring unit 21 transmits information such as the overlook direction related to the overlooked crop to the worker terminal 3 as work support information.

[0086] Incidentally, when a certain crop image 102 is displayed for a long time at the same position among a plurality of temporally consecutive area images 100, it can be determined that the crop 101 corresponding to the crop image 102 has been gazed at for a long time. In this way, when work on the crop 101 gazed at for a long time is overlooked, there may be cases where the worker is unsure of whether to perform the work and chooses to leave it alone. In this case, it is considered that information is collected from a manager or a skilled worker to determine how to respond. Therefore, when the worker terminal 3 determines that the crop 101 gazed at for a long time is an overlooked crop, it may separately record the overlooking result (time, position, and content shown in the area image 100) and transmit it to the server 2 for storage, or notify the manager terminal.

[0087] The information acquiring unit 21 may perform the above-mentioned overlooked determination by treating only the crop 101 near the worker as the work target. In this case, when the information acquiring unit 21 determines that a crop image 102 having a predetermined dimension or more has moved a predetermined distance or more across a predetermined number of frames or more of similar images in a group of similar images, the information acquiring unit 21 may determine that the crop 101 of the crop image 102 is near the worker. The information acquiring unit 21 may also detect the overlooked crop and the overlooked direction by image processing or image analysis other than those described above, and may use, for example, an inter-frame difference method.

[0088] When the information output unit 32 of the worker terminal 3 receives the work support information including the overlooked direction of the overlooked crop from the server 2, the information output unit 32 displays a direction sign 106 indicating the overlooked direction on the screen of the display unit 14 in a format according to the specified crop type and work type, as shown in FIG. 11 and FIG. 12. The information output unit 32 may display the direction sign 106 superimposed on the area image 100, similar to the position sign 104 described above. FIG. 11 illustrates a direction sign 106 indicating the direction of the overlooked crop whose work was overlooked in the example shown in FIG. 9 described above. For example, the information output unit 32 displays, as the direction sign 106, a graphic of an arrow indicating the overlooked direction at the end of the overlooked direction side on the screen of the display unit 14. The information output unit 32 may also display work information regarding the overlooked crop together with the direction sign 106.

[0089] When there are multiple overlooked crops, the information output unit 32 groups the overlooked crops by overlooked direction, and displays one direction sign 106 for the overlooked direction of one group. Note that the information output unit 32 may preset reference directions indicating up, down, left, right, upper right, upper left, lower right, and lower left when viewed from the center of the display unit 14, and convert the overlooked direction to the closest reference direction.

[0090] When the information output unit 32 determines that the line of sight of the worker has moved in the overlook direction corresponding to the directional sign 106, the information output unit 32 suppresses the display of the directional sign 106, for example, makes it invisible. On the other hand, when the information output unit 32 determines that the line of sight of the worker has not moved in the overlook direction corresponding to the directional sign 106, the information output unit 32 makes the directional sign 106 invisible after a certain time has elapsed, or makes the directional sign 106 invisible in response to an arbitrary operation of the worker at the worker terminal 3. For example, the information output unit 32 may determine whether the line of sight of the worker has moved in the overlook direction based on the image processing result of the area image 100 in the server 2 and / or the motion detection result of the worker terminal 3 (worker) by the motion detection unit 19.

[0091] The information output unit 32 may also display on the display unit 14, together with the direction sign 106, a notation regarding the missed work as work information regarding the missed crop. For example, when the work type is harvesting work, the information output unit 32 displays a notation such as "fruit present" together with the direction sign 106 as shown in FIG. 11 to indicate that the harvesting work of the missed crop has been missed. When the work type is patrol work, the information output unit 32 displays a notation indicating the disease type indicated in the work support information by disease judgment together with the direction sign 106 as shown in FIG. 12 to indicate that the disease response of the missed crop has been missed. In FIG. 12, a direction sign 106 indicating the direction in which the "hollow fruit" crop 101 was missed is illustrated for the example shown in FIG. 5 described above. Alternatively, the information output unit 32 may display on the display unit 14, together with the direction sign 106, a notation such as the number of missed crops present in each missed direction as information specific to each missed direction as shown in FIG. 13.

[0092] Furthermore, when displaying a plurality of overlook directions on the display unit 14 of the worker terminal 3, the information output unit 32 may set a priority for each overlook direction based on a predetermined priority condition and display a direction sign 106 that allows the priority to be identified. For example, the information output unit 32 may set the maturity or number of overlooked crops in each overlook direction as a priority condition, and the higher the maturity of the overlooked crop or the greater the number of overlooked crops, the higher the priority of the overlook direction.

[0093] The information output unit 32 displays a notation indicating the priority together with a directional sign 106 as work information related to overlooked crops to which priorities have been assigned, as shown in Fig. 14, or displays the directional sign 106 in a format (such as a line color or background color) according to the priority, as shown in Fig. 15, thereby making the priority identifiable. Note that the information output unit 32 may display a plurality of overlooked directions on the display unit 14 so that they can be selected, and set the priority of each overlooked direction in response to an arbitrary selection operation by the worker at the worker terminal 3.

[0094] Furthermore, the information output unit 32 may update the display of the direction sign 106 on the screen of the display unit 14 according to a predetermined update condition, and for example, the update condition is when a change in the worker's posture or line of sight is detected. The information output unit 32 judges whether the update condition is satisfied at a predetermined interval such as a certain number of images or a certain time. For example, the information output unit 32 detects a change in the worker's posture or line of sight based on the image processing result of the area image 100 in the server 2 and / or the motion detection result of the worker terminal 3 (worker) by the motion detection unit 19, and updates the display of the direction sign 106 by changing the overlooked direction indicating the overlooked crop according to the change in the worker's posture or line of sight. Alternatively, the information output unit 32 may update the display of the direction sign 106 on the screen of the display unit 14 based on other update conditions.

[0095] The information output unit 32 can set a display mode to any one of a position marker display mode that displays the above-mentioned position marker 104, a directional marker display mode that displays the directional marker 106, and a dual display mode that displays both the position marker 104 and the directional marker 106 in response to an arbitrary operation by the worker on the worker terminal 3, and can display the work support information in the set display mode.

[0096] As described above, according to another embodiment, the work support system 1 determines a crop 101 that is located outside the range of the area and in which work has been overlooked as a missed crop, and displays a directional sign 106 indicating the direction of the missed crop relative to the area on the worker terminal 3 as work support information.

[0097] This allows the crops 101 to be worked on to be recognized without fail, improving work accuracy and work speed. Even if a missed crop that was not worked on and is not displayed in the area image 100, information such as the direction of the missed crop can be grasped. For example, during patrol work, important information such as the occurrence of disease can be reliably recognized, improving the workability of cultivation management.

[0098] Furthermore, according to this embodiment, based on the first area image 100 and the second area image 100, which are successive in time, when a crop included in the first area image 100 is no longer included in the second area image 100, the work support system 1 determines that the crop is located outside the range of the area and identifies the crop as a missed crop.

[0099] This makes it possible to more reliably identify overlooked crops that are no longer displayed in the area image 100, and to present information about the overlooked crops to the worker.

[0100] Furthermore, according to this embodiment, the work support system 1 displays, on the worker terminal 3, a direction sign 106 indicating the direction of the overlooked crop, as well as a notation indicating work information related to the overlooked crop.

[0101] This makes it possible to present the worker with various work information regarding missed crops, in addition to the missed direction.

[0102] Furthermore, according to this embodiment, when the work support system 1 determines that there are overlooked crops in multiple directions relative to the area, it sets a priority for each direction according to a predetermined priority condition for the overlooked crops, and displays a directional sign 106 indicating each direction on the worker terminal 3 so that the priority can be identified.

[0103] This makes it possible to identify which crops need to be worked on based on priority order, even when there are many missed crops, thereby improving work efficiency.

[0104] Furthermore, according to this embodiment, the work support system 1 makes it possible to set a priority order for each direction in response to an operation by the worker.

[0105] This allows the worker to set priorities according to their convenience, thereby improving work efficiency.

[0106] Furthermore, according to this embodiment, the work support system 1 determines whether the worker should shift his / her work for the missed crop based on the movement of the worker terminal 3 and / or the change in the area image 100, and switches the normal display of the directional sign 106 to the suppressed display when the shift in work is determined as a switching condition.

[0107] Furthermore, according to this embodiment, the work support system 1 switches the normal display of the directional sign 106 to the suppressed display when a predetermined normal display time has elapsed since the normal display of the directional sign 106 was started, as a switching condition.

[0108] This allows the work assistance system 1 to switch and present the display of the directional signs 106 at appropriate timing for the work of the worker.

[0109] In the above embodiment, an example has been described in which the worker terminal 3 is configured as a wearable terminal using a head-mounted display system such as smart glasses, but the present invention is not limited to this example, and the worker terminal 3 may be configured as a portable terminal such as a smartphone or a tablet terminal. In this case, the control unit 10, the storage unit 11, the communication unit 12, the shooting unit 13, the display unit 14, the operation unit 15, the speaker 16, the microphone 17, the position detection unit 18, and the motion detection unit 19 are mounted on the portable terminal.

[0110] In the above embodiment, an example has been described in which the information acquisition unit 21 that acquires work support information related to the crop 101 based on the area image 100 is provided in the server 2. However, the present invention is not limited to this example, and the information acquisition unit 21 may be provided in the worker terminal 3. That is, the work support system 1 does not include the server 2, and is configured by the worker terminal 3. In this case, the information acquisition unit 21 is configured as a part of the work support program 30 executed by the control unit 10 of the worker terminal 3.

[0111] In addition, the present invention can be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and work support systems involving such modifications are also included in the technical idea of ​​the present invention.

[0112] [Appendix to the invention] The following will provide an overview of the invention extracted from the above-described embodiment. Note that the configurations and processing functions described in the following supplementary notes can be selected and combined as desired.

[0113] <Appendix 1> A work assistance system for assisting work on crops, acquiring work support information related to the crop included in the area based on the area image photographed by the worker; A work support system characterized in that, when displaying the work support information on a worker terminal of a worker in the field, the work support information is switched between normal display and suppressed display in accordance with a predetermined switching condition.

[0114] <Appendix 2> The work support system according to claim 1, characterized in that the work support information is work necessity information indicating whether work is required or not for the crop, which is displayed superimposed on the crop on the worker terminal.

[0115] <Appendix 3> The work support system according to claim 1 or 2, characterized in that a shift in the work of the worker for the crop included in the area image is determined based on a movement of the worker terminal and / or a change in the area image, and when the shift in work is determined, the normal display of the work support information is switched to the suppressed display as the switching condition.

[0116] <Appendix 4> The work support system described in Appendix 2 or 3, characterized in that the normal display of the work necessity information is switched to the suppressed display when a predetermined normal display time has elapsed since the start of the normal display of the work necessity information, and the suppressed display of the work necessity information is switched to the normal display when a predetermined suppressed display time has elapsed since the start of the suppressed display of the work necessity information.

[0117] <Appendix 5> The work support system according to claim 4, characterized in that the normal display time and / or the suppressed display time is changed depending on the number of crops for which the work necessity information indicates that work is required among the crops included in the area image.

[0118] <Appendix 6> The work support system according to claim 4 or 5, wherein the normal display time and / or the suppressed display time are displayed on the worker terminal.

[0119] <Appendix 7> The work support system described in any of Appendices 1 to 6, characterized in that the crop located outside the range of the area and where work has been overlooked is determined to be a missed crop, and a directional sign indicating the direction of the missed crop relative to the area is displayed on the worker terminal as the work support information.

[0120] <Appendix 8> The work support system described in Appendix 7 is characterized in that, based on a first area image and a second area image that are obtained before and after in time, when the crop included in the first area image is no longer included in the second area image, the crop is determined to be located outside the range of the area, and the missed crop is identified.

[0121] <Appendix 9> The work support system described in appendix 7 or 8, characterized in that, together with the directional sign indicating the direction of the overlooked crop, a notation indicating work information regarding the overlooked crop is displayed on the worker terminal.

[0122] <Appendix 10> A work support system as described in any of Appendices 7 to 9, characterized in that when the presence of the overlooked crop is determined in multiple directions relative to the area, a priority is set for each direction according to predetermined priority conditions regarding the overlooked crop, and the directional signs indicating each direction are displayed on the worker terminal so that the priority can be identified.

[0123] <Appendix 11> The work support system according to claim 10, wherein the priority order for each direction can be set in accordance with an operation by the worker.

[0124] <Appendix 12> The work support system according to any one of appendices 7 to 11, characterized in that a shift in the worker's work for the missed crop is determined based on the movement of the worker terminal and / or the change in the area image, and when the shift in work is determined, the normal display of the directional sign is switched to the suppressed display as the switching condition.

[0125] <Appendix 13> The work support system according to any one of appendices 7 to 12, characterized in that the normal display of the directional sign is switched to the suppressed display when a predetermined normal display time has elapsed since the start of the normal display of the directional sign. [Explanation of symbols]

[0126] 1 Management System 1 Work support system 2 Server 3. Worker terminal 10 Control section 11 Storage section 13. Photography Department 14 Display section 15 Control section 18 Position detection unit 19 Motion detection section 21 Information Acquisition Department 31 Image acquisition unit 32 Information output section 100 area images 101 Crops 102 Crop Images 104 Location indicator 105 Timer Shape 106 Directional signs

Claims

1. A work assistance system for assisting work on crops, acquiring work support information related to the crop included in the area based on an area image photographed by a worker; A work support system characterized in that, when displaying the work support information on the worker's worker terminal, the work support information is switched between normal display and suppressed display in accordance with a predetermined switching condition.

2. The work support system according to claim 1, characterized in that the work support information includes work necessity information indicating whether work is necessary or not for the crop, and is displayed on the worker terminal by being superimposed on the crop.

3. The work support system according to claim 1 or 2, characterized in that a shift in the work of the worker for the crop included in the area image is determined based on a movement of the worker terminal and / or a change in the area image, and when the shift in work is determined, the normal display of the work support information is switched to the suppressed display as the switching condition.

4. The work support system according to claim 2, characterized in that the normal display of the work necessity information is switched to the suppressed display when a predetermined normal display time has elapsed since the start of the normal display of the work necessity information, and the suppressed display of the work necessity information is switched to the normal display when a predetermined suppressed display time has elapsed since the start of the suppressed display of the work necessity information.

5. The work support system according to claim 4, characterized in that the normal display time and / or the suppressed display time is changed depending on the number of crops for which the work necessity information indicates that work is required among the crops included in the area image.

6. The work support system according to claim 4, wherein the normal display time and / or the suppressed display time is displayed on the worker terminal.

7. The work support system described in claim 1 or 2, characterized in that the crop located outside the range of the area and in which work has been overlooked is determined to be a missed crop, and a directional sign indicating the direction of the missed crop relative to the area is displayed on the worker terminal as the work support information.

8. The work support system described in claim 7, characterized in that, based on a first area image and a second area image which are successive in time, when the crop included in the first area image is no longer included in the second area image, the crop is determined to be located outside the range of the area, and the missed crop is identified.

9. The work support system according to claim 7, characterized in that, together with the direction sign indicating the direction of the overlooked crop, a notation indicating work information relating to the overlooked crop is displayed on the worker terminal.

10. The work support system described in claim 7, characterized in that when the presence of the overlooked crop is determined in multiple directions relative to the area, a priority is set for each direction according to specified priority conditions regarding the overlooked crop, and the directional signs indicating each direction are displayed on the worker terminal so that the priority can be identified.

11. The work support system according to claim 10, wherein the priority order for each direction can be set in response to an operation by the worker.

12. The work support system described in claim 7, characterized in that a shift in the worker's work for the missed crop is determined based on the movement of the worker terminal and / or the change in the area image, and when the shift in work is determined, the normal display of the directional sign is switched to the suppressed display as the switching condition.

13. 8. The work support system according to claim 7, wherein the normal display of the directional sign is switched to the suppressed display when a predetermined normal display time has elapsed since the start of the normal display of the directional sign.

Images