Work vehicle control method, work vehicle control program, work vehicle control system, and work vehicle
By employing multiple imaging units and switching detection modes, the system effectively addresses false obstacle detections in work vehicles, improving operational efficiency and accuracy.
Patent Information
- Application Number
- JP2023082814
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-19
- Publication Date
- 2024-11-29
AI Technical Summary
Existing work vehicle control systems using lidar sensors can falsely detect extended branches or weeds as obstacles, leading to unnecessary avoidance maneuvers.
The system employs multiple imaging units spaced apart in the width direction to capture images and switches detection modes based on specific conditions, using both two-dimensional and three-dimensional image processing to accurately identify obstacles and avoid false detections.
This approach reduces false obstacle detections, ensuring efficient and accurate operation of the work vehicle by distinguishing between work objects and potential obstacles, thereby enhancing operational reliability.
Smart Images

Figure 2024166609000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a control method for a work vehicle that performs work while moving through a field in which multiple rows of work objects each consisting of a multiple number of work objects are arranged, a control program for a work vehicle, a control system for a work vehicle, and a work vehicle. [Background technology]
[0002] As a related technique, a work vehicle control system (automatic driving system) has been proposed that automatically drives a work vehicle along a target route in a work site (see, for example, Patent Document 1). According to the work vehicle control system according to the related technique, the work vehicle automatically drives in a predetermined row order while performing a predetermined task on work objects arranged in multiple rows in the work site. As the predetermined task, the work vehicle performs a spraying task in which a spray material such as a chemical solution or water is sprayed on the work objects planted in a farm field (work site).
[0003] In the above related technology, the obstacle detection device mounted on the work vehicle has a LIDAR sensor provided on the front left side of the body (car body) of the work vehicle, and a LIDAR sensor provided on the front right side of the body. The work vehicle control system executes an avoidance process to avoid the obstacle when there is a possibility that the work vehicle will collide with the obstacle, based on measurement information related to the obstacle obtained from the obstacle detection device. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2022-183962 A Summary of the Invention [Problem to be solved by the invention]
[0005] The work vehicle control system according to the above-mentioned related technology uses a lidar sensor, so if there are, for example, extended branches or weeds of a work object in front of the work vehicle in the direction of travel, there is a possibility that these will be mistakenly detected as a detection object (obstacle) and avoidance processing will be performed.
[0006] An object of the present invention is to provide a control method for a work vehicle, a control program for a work vehicle, a control system for a work vehicle, and a work vehicle that are less likely to cause erroneous detection of a detection object. [Means for solving the problem]
[0007] A control method for a work vehicle according to one aspect of the present invention is a control method for a work vehicle that performs work while moving through a field in which multiple rows of work objects each consisting of a multiple work object are arranged, and includes acquiring images captured by multiple imaging units that are mounted on the body of the work vehicle and arranged at a distance from one another in a width direction perpendicular to the direction of travel of the work vehicle in a plan view, detecting a detection object based on the images captured by the multiple imaging units, and switching the mode of detection processing for the detection object in accordance with a switching condition.
[0008] A work vehicle control program according to one aspect of the present invention is an automatic driving program for causing one or more processors to execute the work vehicle control method.
[0009] A work vehicle control system according to one aspect of the present invention is used in a work vehicle that performs work while moving through a field in which multiple rows of work objects each consisting of a multiple work object are arranged, and includes an acquisition processing unit, a detection processing unit, and a switching processing unit. The acquisition processing unit is mounted on a body of the work vehicle and acquires images captured by multiple imaging units that are spaced apart in a width direction perpendicular to the traveling direction of the work vehicle in a plan view. The detection processing unit detects the detection object based on the images captured by the multiple imaging units. The switching processing unit switches the mode of detection processing for the detection object in accordance with a switching condition.
[0010] A work vehicle according to one aspect of the present invention includes the work vehicle control system and the vehicle body. Effect of the Invention
[0011] According to the present invention, it is possible to provide a control method for a work vehicle, a control program for a work vehicle, a control system for a work vehicle, and a work vehicle that are less likely to cause erroneous detection of a detection object. [Brief description of the drawings]
[0012] [Figure 1] FIG. 1 is an external view of a sprayer according to a first embodiment, as viewed from the left front side. [Diagram 2] FIG. 2 is a rear external view of the sprayer according to the first embodiment as viewed from the rear side. [Diagram 3] FIG. 3 is a diagram showing an example of a crop row in which the sprayer according to the first embodiment is used. [Figure 4] FIG. 4 is a schematic diagram showing the overall configuration of an automatic operation system using the sprayer according to the first embodiment. [Diagram 5] FIG. 5 is a schematic block diagram showing the main configuration of the automated working system according to the first embodiment. [Figure 6] FIG. 6 is a left side external view of the spreader according to the first embodiment as viewed from the left side. [Figure 7] FIG. 7 is an external view of the right side of the spreader according to the first embodiment as viewed from the right side. [Figure 8] FIG. 8 is an external view of the top surface of the spreader according to the first embodiment as viewed from above. [Figure 9] FIG. 9 is a rear external view of the spreader according to the first embodiment as viewed from the rear side. [Figure 10] FIG. 10 is a schematic diagram showing the spreader according to the first embodiment as viewed obliquely from behind. [Figure 11] FIG. 11 is a schematic plan view showing a monitoring area when the sprayer according to the first embodiment is viewed from above. [Figure 12] FIG. 12 is a schematic diagram illustrating the automatic travel operation of the sprayer according to the first embodiment. [Figure 13] FIG. 13 is a schematic diagram illustrating the detection process in the two-dimensional mode of the spreader according to the first embodiment. [Figure 14] FIG. 14 is a schematic diagram illustrating the detection process in the three-dimensional mode of the spreader according to the first embodiment. [Figure 15] FIG. 15 is a schematic diagram illustrating the operation of the sprayer according to the first embodiment while it is traveling along the work route. [Figure 16] FIG. 16 is a flowchart showing an example of a process, particularly a switching process, in the control method according to the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. The following embodiment is an example of the present invention, and is not intended to limit the technical scope of the present invention.
[0014] (Embodiment 1) [1] Overall structure First, the overall configuration of a spreader 1 according to this embodiment will be described with reference to Figures 1 to 5. In this embodiment, the spreader 1 performs a spreading operation to spread a spreading material such as a chemical solution, water, or fertilizer on a crop V1 (see Figure 2) grown in a field F1. This spreader 1 is an example of a "work vehicle" that performs various works while automatically traveling along a target route in a work area such as the field F1.
[0015] In other words, the sprayer 1 is a work vehicle capable of performing a spraying operation, for example, spraying a chemical solution, water, fertilizer, or other such material. In addition to sprayers, the "work vehicle" in this disclosure includes work vehicles such as tractors, rice transplanters, sprayers, sowing machines, transplanters, and combine harvesters. Furthermore, the "work vehicle" in this disclosure is not limited to agricultural machinery (farm machinery), and may be, for example, construction machinery (construction machinery), etc.
[0016] Further, the "field" in this disclosure is an example of a work site where the work vehicle, the sprayer 1, moves and performs various tasks such as spraying, and includes orchards, pastures, rice fields, and fields where agricultural products are grown. In this case, the crop V1 grown in the field F1 is the agricultural product. Furthermore, when plants are grown in a plantation, the plantation becomes the field F1, and when trees to be used as lumber are grown in a forest, such as in forestry, the forest becomes the field F1. In this case, the crop V1 grown in the field F1 is a plantation or a tree. However, the work site where the work vehicle works is not limited to the field F1, and may be a site other than the field F1. For example, if the work vehicle is a construction machine, the site where the construction machine works is the work site.
[0017] In this embodiment, as an example, the sprayer 1 is a vehicle that moves through a field F1, which is an orchard such as a vineyard or an apple orchard, and sprays a chemical solution on a crop V1 grown in the field F1. In this case, the chemical solution is an example of a sprayed object. The crop V1 is an example of a spray target object onto which the sprayed object (chemical solution) is sprayed, such as a grape tree. The crop V1, which is a spray target object, is also an example of a work target object that is the subject of work by the sprayer 1, which is a work vehicle. The "chemical solution" as a sprayed object here is a pesticide used to improve agricultural efficiency or preserve agricultural crops, and includes herbicides, fungicides, fungicides, insecticides, herbicides, rodenticides, growth promoters and germination inhibitors for the crop V1.
[0018] Crop V1 is arranged in multiple rows at a predetermined interval in field F1. Specifically, as shown in FIG. 3, a plurality of crops V1 are planted linearly side by side in the longitudinal direction A1 in plan view. The plurality of crops V1 arranged linearly in the longitudinal direction A1 constitute crop row Vr1. FIG. 3 illustrates three crop rows Vr1 each including six crops V1 arranged in the longitudinal direction A1. Each crop row Vr1 is arranged at a predetermined pitch W1 in the width direction A2. As a result, a working passage having a width W2 (<W1) corresponding to the interval between adjacent crop rows Vr1 is formed along the longitudinal direction A1. The sprayer 1 sprays a spray (chemical solution) onto the crop V1 while moving (traveling) in the longitudinal direction A1 through this working passage. The crop row Vr1 consists of a plurality of crops V1 (objects to be worked on) and is an example of a plurality of work target rows arranged with respect to the field F1.
[0019] As will be described in detail later, the sprayer 1 traveling in the field F1 includes a machine body 10 having a portal shape. That is, the machine body 10 has a first block 10L and a second block 10R arranged side by side in the left-right direction D2, and a connecting portion 10C connecting the upper end portions of the first block 10L and the second block 10R. As a result, the machine body 10 forms a portal shape surrounding the left, right, and upper sides of the space Sp1 at the first block 10L, the second block 10R, and the connecting portion 10C. That is, a space Sp1 open in the front-rear direction D3 is formed inside the machine body 10.
[0020] Furthermore, the sprayer 1 includes a traveling unit 11 including a pair of crawlers 111L and 111R arranged side by side in the left-right direction D2. The pair of crawlers 111L and 111R are provided at the lower portions of the first block 10L and the second block 10R, respectively, and are located on both sides in the left-right direction D2 with respect to the space Sp1.
[0021] As shown in Fig. 2, the sprayer 1 can run in a position straddling one crop row Vr1 with the machine body 10 formed in a gate shape, and spray the spraying material (chemical solution) on the crop V1 in this crop row Vr1 and the crop V1 in the crop row Vr1 adjacent to this crop row Vr1. In other words, the sprayer 1 can run so that the crop V1, which is the spraying target (work target), passes through the space Sp1 inside the machine body 10 formed in a gate shape. In other words, as illustrated in Fig. 2, when there are three work target rows, Vr11, Vr12, and Vr13, lined up in the left-right direction D2, the sprayer 1 can run with the machine body 10 straddling any of the three crop rows Vr1 of these three crop rows Vr11, Vr12, and Vr13.
[0022] Here, if the machine body 10 straddles the central crop row Vr12, the first block 10L travels on the work path between the leftmost crop row Vr11 and the crop row Vr12, and the second block 10R travels on the work path between the rightmost crop row Vr13 and the crop row Vr12. The sprayer 1 can simultaneously spray the spraying material (chemical solution) on the crop V11 in the crop row Vr11, the crop V12 in the crop row Vr12, and the crop V13 in the crop row Vr13. In this way, the sprayer 1 according to this embodiment can simultaneously spray the spraying material (chemical solution) on three rows of spraying objects (crops V1) while traveling, so the spraying work is more efficient than a configuration in which spraying is done one row at a time.
[0023] Furthermore, in this embodiment, as an example, the sprayer 1 is an unmanned vehicle that operates by automatic driving without being operated (including remote operation) by a person (operator). Therefore, as shown in FIG. 4 and FIG. 5, the sprayer 1 constitutes an automatic operation system 200 together with a first operation terminal 210, a second operation terminal 220, a server 201, a base station 202, and a satellite 203. In other words, the automatic operation system 200 includes the sprayer 1, the first operation terminal 210, the second operation terminal 220, the server 201, the base station 202, and the satellite 203. However, at least one of the first operation terminal 210, the second operation terminal 220, the server 201, the base station 202, and the satellite 203 may not be included as a component of the automatic operation system 200, and for example, the automatic operation system 200 may not include the server 201, the base station 202, and the satellite 203.
[0024] The spreader 1, the first operation terminal 210, the second operation terminal 220, and the server 201 can communicate with each other. In the present disclosure, "communicable" means that information can be exchanged directly or indirectly via a communication network (network) N1 or a repeater, etc., by an appropriate communication method such as wired communication or wireless communication (communication using radio waves or light as a medium). For example, the spreader 1 and the first operation terminal 210 can communicate with each other via a communication network N1 such as the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), a public telephone line, a mobile phone line network, a packet line network, or a wireless LAN. Here, the spreader 1 and the first operation terminal 210 are each wirelessly connected to the communication network N1. Therefore, the communication between the spreader 1 and the first operation terminal 210 includes at least wireless communication. In addition, the spreader 1 and the first operation terminal 210 can also wirelessly communicate with the server 201 via the communication network N1.
[0025] Satellite 203 is a positioning satellite constituting a satellite positioning system such as GNSS (Global Navigation Satellite System), and transmits a GNSS signal (satellite signal). Base station 202 is a reference point (reference station) constituting the satellite positioning system. Base station 202 transmits correction information to sprayer 1 for calculating the current position of sprayer 1, etc.
[0026] The sprayer 1 according to this embodiment is equipped with a positioning device 2 that detects the current position (latitude, longitude, altitude, etc.) and current orientation of the vehicle 10. The positioning device 2 executes a positioning process that identifies (calculates) the current position and current orientation of the vehicle 10 using a GNSS signal transmitted from a satellite 203. The positioning device 2 employs a relatively high-precision positioning method such as RTK (Real Time Kinematic) positioning that performs positioning based on positioning information (GNSS signals, etc.) received by two receivers (base station 202 and antenna 21) and correction information generated by base station 202.
[0027] The first operation terminal 210 is a general-purpose information processing device that can be carried by an operator, such as a smartphone or tablet terminal. The first operation terminal 210 is configured to be able to remotely operate the spreader 1 by outputting (transmitting) to the spreader 1 a stop instruction (temporary stop instruction) for at least stopping the automatic traveling of the spreader 1 in response to an operation by an operator. Here, the first operation terminal 210 can control the spreader 1 even at a distance from the spreader 1, that is, at a remote location of the field F1, as long as the environment is connectable (communicable) to the communication network N1 by wirelessly communicating with the spreader 1 via the communication network N1.
[0028] As shown in Fig. 5, the first operation terminal 210 includes a display unit 211 that displays various information and an operation unit 212 that accepts operations. The display unit 211 includes, for example, a liquid crystal display or an organic EL display. The operation unit 212 includes, for example, a touch panel, a physical switch, a mouse, or a keyboard. In the present embodiment, as an example, the display unit 211 made of a liquid crystal display and the operation unit 212 made of a touch panel are integrated to configure a touch panel display. Therefore, the operator can output, for example, a stop instruction (pause instruction) from the first operation terminal 210 to the sprayer 1 by operating the operation unit 212 on the operation screen displayed on the display unit 211.
[0029] Furthermore, the first operation terminal 210 has a function of setting (registering) various information related to the control of the sprayer 1, such as a target route for the automatic travel of the sprayer 1. That is, the operator can set the target route, etc., by operating the operation unit 212 on the operation screen displayed on the display unit 211. The information on the target route, etc. set here is transmitted to the sprayer 1 directly or indirectly via the server 201, etc., and is used for the automatic travel of the sprayer 1.
[0030] Furthermore, while the spreader 1 is automatically traveling, the first operation terminal 210 can display various information related to the operation of the spreader 1, such as the current position, current orientation, and (spraying) work status of the spreader 1, on the display unit 211. As an example, the first operation terminal 210 displays a monitoring screen on the display unit 211 that displays the current position of the spreader 1, etc., together with a target route on a map that resembles the field F1, making it easier for the operator to visually grasp the status of the spreader 1. Here, it is preferable that the monitoring screen also displays information such as the remaining amount of chemical solution as the object to be spread, the remaining amount of fuel, and the remaining battery power, for example.
[0031] The second operation terminal 220 is a dedicated wireless communication terminal that can be carried by the operator. The second operation terminal 220 is configured to be able to remotely operate the spreader 1 by outputting (transmitting) to the spreader 1 a stop instruction (temporary stop instruction) for at least stopping the automatic travel of the spreader 1 in response to the operation of the operator. Here, the second operation terminal 220 is configured to be able to communicate with the spreader 1 by a communication system separate from that of the first operation terminal 210.
[0032] Specifically, the second operation terminal 220 can operate the spreader 1 even from a position away from the spreader 1, as long as the environment is such that it can connect (communicate) with the spreader 1 by directly communicating wirelessly with the spreader 1 without going through the communication network N1. However, the range in which the second operation terminal 220 can connect with the spreader 1 is limited to a range that is closer to the spreader 1 than the first operation terminal 210, such as within the field F1 or the periphery of the field F1. Therefore, the operator can basically control the spreader 1 by operating the second operation terminal 220, as long as the operator is in a place where the spreader 1 is visible.
[0033] As shown in Figs. 4 and 5, the second operation terminal 220 includes a first operation unit 221, a second operation unit 222, and a third operation unit 223, each of which accepts an operation individually. Each of the first operation unit 221, the second operation unit 222, and the third operation unit 223 includes, for example, a physical switch, a touch panel, a mouse, or a keyboard. In this embodiment, as an example, the first operation unit 221, the second operation unit 222, and the third operation unit 223 are each configured as a momentary push button switch, which is a physical switch (mechanical switch). Therefore, the operator can output, for example, a stop instruction (pause instruction and emergency stop instruction) from the second operation terminal 220 to the sprayer 1 by operating each of the first operation unit 221, the second operation unit 222, and the third operation unit 223.
[0034] Here, different functions are assigned to the first operation unit 221, the second operation unit 222, and the third operation unit 223. Therefore, depending on which of the first operation unit 221, the second operation unit 222, and the third operation unit 223 the operator presses (operates), the second operation terminal 220 outputs (transmits) a different instruction to the sprayer 1. Specifically, "pause" is assigned to the first operation unit 221, "emergency stop" is assigned to the second operation unit 222, and "start traveling" is assigned to the third operation unit 223. Therefore, for example, when the operator operates the first operation unit 221, the second operation terminal 220 outputs a pause instruction, which is a kind of stop instruction for stopping the automatic traveling of the sprayer 1.
[0035] Thus, in this embodiment, the sprayer 1 is capable of wireless communication with multiple types of operation terminals including at least the first operation terminal 210 and the second operation terminal 220, and is controlled in accordance with instructions from each of these multiple types of operation terminals. In other words, the first operation terminal 210 and the second operation terminal 220 each constitute a remote operation device (remote controller) capable of remotely operating the sprayer 1, and the operator can, for example, stop the automatic travel of the sprayer 1 even when in a location away from the sprayer 1.
[0036] The server 201 is an information processing device such as a server device, etc. The server 201 transmits to the sprayer 1 information such as a target route along which the sprayer 1 is to automatically travel.
[0037] Also, in this embodiment, for convenience of explanation, the vertical direction when the spreader 1 is in a usable state is defined as the up-down direction D1 as shown in Figure 1. Furthermore, the left-right direction D2 and the front-rear direction D3 are defined based on the direction seen from the center point of the spreader 1 in a plan view. In other words, the direction of travel of the spreader 1 when moving forward is forward in the front-rear direction D3, and the direction of travel of the spreader 1 when moving backward is rearward in the front-rear direction D3. However, these directions are not intended to limit the direction of use of the spreader 1 (direction during use).
[0038] [2] Details of the sprayer Next, the configuration of the spreader 1 will be described in more detail with reference to Figs. 1, 2, 5 to 11. Fig. 1 is an external view of the spreader 1 as seen from the left front side, and Fig. 2 is an external view of the back of the spreader 1 as seen from the rear side (rear). Fig. 5 is a schematic block diagram showing the main configuration of the spreader 1. Fig. 6 is an external view of the left side of the spreader 1 as seen from the left side, Fig. 7 is an external view of the right side of the spreader 1 as seen from the right side, and Fig. 8 is an external view of the top of the spreader 1 as seen from above. Fig. 9 is an external view of the back of the spreader 1 as seen from the rear side (rear). Fig. 10 is a schematic view showing the spreader 1 as seen from diagonally rearward, with a partially enlarged view shown in the blowout. Fig. 11 is a schematic plan view of the spreader 1 as seen from above, showing the monitoring area Z1.
[0039] The sprayer 1 includes a body 10, a travel section 11, a support frame 3, and a spraying device 4. In this embodiment, as shown in FIG. 5, the sprayer 1 further includes a positioning device 2, a control device 7, a manual operation device 8, an airflow generating section 5, a communication device 60, a user interface 61, an obstacle detection device 62, a power source 63, a tank 64 (see FIG. 7), a display 65, and a sensor device 66. The sprayer 1 further includes a fuel tank and a battery. In this embodiment, the structures of the sprayer 1, such as the body 10 and the support frame 3, are basically made of metal, and the material is selected according to the required strength and weather resistance. However, the structures of the sprayer 1 are not limited to being made of metal, and may be made of, for example, resin or wood, as appropriate.
[0040] The vehicle 10 is the main body of the sprayer 1, and supports most of the components of the sprayer 1, such as the positioning device 2 and the support frame 3. The vehicle 10 has a frame 101 (see FIG. 2) and a cover 102. The frame 101 is a member that constitutes the framework of the vehicle 10, and supports heavy objects such as the power source 63 and the tank 64. The cover 102 is a member that constitutes the outer shell of the vehicle 10, and is attached to the frame 101 so as to cover at least a portion of the frame 101 and the components mounted on the frame 101. The frame 101 is not covered by the cover 102 on the rear surface (back surface) and part of the right side surface of the vehicle 10, and the frame 101 is exposed. The cover 102 is divided into a plurality of parts, and these multiple parts are configured to be individually removable from the frame 101. Therefore, only the parts of the cover 102 that correspond to some of the devices (components), such as the power source 63, can be removed, and this makes it possible to expose some of the devices (components), such as the power source 63.
[0041] As described above, the body 10 has the first block 10L and the second block 10R arranged side by side in the left-right direction D2. The first block 10L and the second block 10R face each other in the left-right direction D2 with a certain distance between them. In the present embodiment, as an example, the first block 10L is located on the left side, and the second block 10R is located on the right side. Therefore, the left side of the body 10 is composed of the first block 10L, and the right side of the body 10 is composed of the second block 10R. Furthermore, the body 10 has a connecting portion 10C that connects the first block 10L and the second block 10R. In a front view (viewed from the front), the connecting portion 10C has a length along the left-right direction D2, and the first block 10L and the second block 10R each have a length along the up-down direction D1.
[0042] Here, the connecting portion 10C connects the upper ends of the first block 10L and the second block 10R to each other, in other words, the first block 10L and the second block 10R protrude downward from both ends (in the left-right direction D2) of the connecting portion 10C. As a result, the first block 10L, the second block 10R, and the connecting portion 10C form a gate-shaped body 10 that is open downward as well as on both sides in the front-rear direction D3. Inside the body 10, a space Sp1 is formed that is surrounded on three sides by the first block 10L, the second block 10R, and the connecting portion 10C and is open in the front-rear direction D3.
[0043] In short, as shown in FIG. 2, the machine body 10 forms a space Sp1 between the first block 10L and the second block 10R to allow the crop V1 (work object) to pass through, which is the target of work (spraying work) by the spraying device 4 (working unit). Specifically, the dimensions of each part of the machine body 10 are set so as to form a space Sp1 with a height and width equal to or greater than the standard size of the crop V1, which is the target of spraying. Therefore, if the crop V1 is of a standard size, the machine body 10 can allow the crop V1 to pass through the space Sp1 while straddling the crop V1 and leaving a gap of a predetermined value or more so that the crop V1 does not contact the machine body 10. When the crop V1 is passing through the space Sp1, the first block 10L is located to the left of the crop V1, the second block 10R is located to the right of the crop V1, and the connecting part 10C is located above the crop V1.
[0044] More specifically, in this embodiment, the aircraft 10 is configured to be approximately symmetrical in the left-right direction D2. The first block 10L and the second block 10R are formed in a rectangular shape of approximately the same size and shape in a side view. The first block 10L and the second block 10R each have a flat shape in the left-right direction D2, in which the dimension in the left-right direction D2 is the smallest among the up-down direction D1, the left-right direction D2, and the front-back direction D3. In addition, the first block 10L and the second block 10R each have a tapered shape in which the dimension in the left-right direction D2 decreases toward the upper end in the portion above the center in the up-down direction D1. The connecting portion 10C is formed in a rectangular shape in which the dimension in the front-back direction D3 is larger than the dimension in the left-right direction D2 in a plan view. The connecting portion 10C has a flat shape in the up-down direction D1, in which the dimension in the up-down direction D1 is the smallest among the up-down direction D1, the left-right direction D2, and the front-back direction D3.
[0045] Thus, the body 10 can be roughly divided into three parts (blocks): the first block 10L, the second block 10R, and the connecting portion 10C. Each of the first block 10L, the second block 10R, and the connecting portion 10C has a frame 101 and a cover 102. In other words, each of the first block 10L and the second block 10R has a frame 101 and a cover 102. Furthermore, most of the components of the sprayer 1, such as the positioning device 2 and the support frame 3, are distributed among the first block 10L, the second block 10R, and the connecting portion 10C.
[0046] The travelling section 11 is a traveling device (vehicle body) that travels the sprayer 1, and is provided under the body 10. The travelling section 11 enables the body 10 to travel (including turning) on the ground, thereby moving in the left-right direction D2 and the front-back direction D3 within the field F1. By providing such a travelling section 11 on the body 10, the sprayer 1 can perform work (spraying work) while moving within the field F1.
[0047] The traveling unit 11 includes a pair of crawlers (tracks) 111L, 111R arranged in the left-right direction D2 (see FIG. 1). The pair of crawlers 111L, 111R are arranged at a certain interval in the left-right direction D2, and a space Sp1 is formed between the pair of crawlers 111L, 111R to allow the crop V1, which is the spraying target, to pass through. That is, the left crawler 111L located to the left of the space Sp1 and the right crawler 111R located to the right of the space Sp1 face each other across the space Sp1. When there is no particular distinction between the left crawler 111L and the right crawler 111R, each crawler 111L, 111R is also simply referred to as a "crawler 111". The traveling unit 11 also includes a motor 112 (see FIG. 1) that drives the crawler 111. In other words, the traveling unit 11 is a crawler-type (endless track-type) traveling device that drives an endless belt-like crawler 111 by a motor 112 to cause the spreader 1 to travel.
[0048] Here, at least two motors 112 are provided corresponding to the pair of crawlers 111L, 111R. The left motor 112 that drives the left crawler 111L and the right motor 112 that drives the right crawler 111R can drive the crawlers 111 individually. In this embodiment, as an example, the motor 112 is a hydraulic motor (hydraulic actuator), and drives the crawlers 111 by being supplied with hydraulic oil from a hydraulic pump. With this configuration, even if the road surface condition of the field F1 is rough, the machine body 10 can travel relatively stably.
[0049] Here, the crawler 111 and the motor 112 are provided at the bottom of each of the first block 10L and the second block 10R. That is, the first block 10L has a left crawler 111L and a motor 112 that drives the crawler 111L, and the second block 10R has a right crawler 111R and a motor 112 that drives the crawler 111R. In this embodiment, the pair of crawlers 111L, 111R and the pair of motors 112 are configured to be approximately symmetrical in the left-right direction D2. In this way, the pair of traveling parts 11 are arranged apart in the left-right direction D2 by the space Sp1, so that the sprayer 1 can travel in a relatively stable posture in various road surface conditions of the field F1, including a horizontally inclined slope in which either the left or right direction D2 is lower.
[0050] Here, the pair of crawlers 111L, 111R are driven by power from the power source 63 in a state where independent speed change is possible by the hydrostatic continuously variable transmission. Therefore, the machine body 10 is in a forward state moving straight forward in the forward direction by driving the pair of crawlers 111L, 111R at a constant speed in the forward direction, and in a reverse state moving straight backward in the reverse direction by driving the pair of crawlers 111L, 111R at a constant speed in the reverse direction. Also, the machine body 10 is in a forward turning state turning while moving forward by driving the pair of crawlers 111L, 111R at a non-uniform speed in the forward direction, and in a reverse turning state turning while moving backward by driving the pair of crawlers 111L, 111R at a non-uniform speed in the reverse direction. The machine body 10 is in a pivot state when one of the pair of crawlers 111L, 111R is stopped and the other is driven, and is in a spin state when the pair of crawlers 111L, 111R are driven at a constant speed in the forward and reverse directions. The machine body 10 is in a travel stop state when the pair of crawlers 111L, 111R are stopped.
[0051] In addition, the first block 10L is equipped with a power source 63, etc., and the second block 10R is equipped with a tank 64, etc. In this way, by distributing and arranging the components of the sprayer 1 between the first block 10L and the second block 10R of the machine body 10, the sprayer 1 is balanced in the left-right direction D2 and has a low center of gravity. As a result, the sprayer 1 can travel stably on slopes, etc. of the field F1.
[0052] As described above, the positioning device 2 is a device that detects the current position and current orientation of the aircraft 10. The positioning device 2 has at least an antenna 21. The antenna 21 receives GNSS signals and the like transmitted from the satellite 203. In other words, the antenna 21 includes a position identification antenna for identifying the position of the aircraft 10. Here, the antenna 21 is disposed on the upper surface (top surface) of the aircraft 10 so as to facilitate reception of signals (GNSS signals) from the satellite 203. In other words, the antenna 21 is disposed at a position even higher than the highest position of the aircraft 10. Furthermore, the positioning device 2 includes an attitude detection unit and the like that detects the attitude of the aircraft 10.
[0053] In this embodiment, the positioning device 2 further includes an antenna 22 which is a second antenna in addition to the antenna 21 which is a first antenna. The positioning device 2 receives GNSS signals and the like with each of these two antennas 21, 22. Here, the antenna 22 (second antenna) is arranged to be aligned with the antenna 21 (first antenna) in the front-to-rear direction D3. This allows the positioning device 2 to transmit and receive signals (GNSS signals and the like) with each of the antennas 21, 22. In particular, when the antennas 21, 22 are position identification antennas, the current position can be identified at each of the front and rear of the aircraft 10, and therefore the direction (current orientation) of the aircraft 10 can also be identified.
[0054] The support frame 3 is attached to one end of the machine body 10 in the front-rear direction D3, and is a member that supports a spray nozzle 41 of the spray device 4 described later. In this embodiment, the support frame 3 is attached to the rear end of the machine body 10. The support frame 3 has a gate-shaped shape like the machine body 10, and is arranged at a position overlapping the machine body 10 in a rear view (viewed from the rear). That is, the support frame 3 has a vertical frame 3L (first vertical frame) and a vertical frame 3R (second vertical frame) arranged side by side in the left-right direction D2, and a horizontal frame 3C that connects the upper ends of the vertical frame 3L and the vertical frame 3R. As a result, the support frame 3 forms a gate-shaped shape that surrounds the space Sp1 on three sides, the left, right, and upper sides, with the vertical frame 3L, the vertical frame 3R, and the horizontal frame 3C.
[0055] Specifically, the support frame 3 has a vertical frame 3L and a vertical frame 3R arranged side by side in the left-right direction D2. The vertical frame 3L and the vertical frame 3R face each other in the left-right direction D2 with a certain distance or more therebetween. In the present embodiment, as an example, the vertical frame 3L is located on the left side, and the vertical frame 3R is located on the right side. Therefore, the vertical frame 3L is located behind the first block 10L of the body 10, and the vertical frame 3R is located behind the second block 10R of the body 10. In addition, in a rear view (viewed from the rear), the horizontal frame 3C has a length along the left-right direction D2, and the vertical frame 3L and the vertical frame 3R each have a length along the up-down direction D1.
[0056] Here, the horizontal frame 3C connects the upper ends of the vertical frame 3L and the vertical frame 3R, so in other words, the vertical frame 3L and the vertical frame 3R protrude downward from both ends (in the left-right direction D2) of the horizontal frame 3C. In this way, the support frame 3 includes the horizontal frame 3C having a length along the left-right direction D2 and a pair of vertical frames 3L, 3R each having a length along the up-down direction D1 and protruding downward from both ends of the horizontal frame 3C. As a result, the support frame 3 forms a gate-shaped shape that is open downward in addition to both sides in the front-rear direction D3 with the vertical frame 3L, the vertical frame 3R and the horizontal frame 3C. And inside the support frame 3, a space Sp1 is formed that is surrounded on three sides by the vertical frame 3L, the vertical frame 3R and the horizontal frame 3C and is open in the front-rear direction D3.
[0057] In short, as shown in FIG. 2, the support frame 3 forms a space Sp1 between a pair of vertical frames 3L, 3R through which the crop V1 (work object, spraying object) that is the target of the work (spraying work) by the spraying device 4 (working unit) passes. Specifically, the dimensions of each part of the support frame 3 are set so as to form a space Sp1 with a height and width equal to or greater than the standard size of the crop V1 that is the spraying object. Therefore, if the crop V1 is of a standard size, the support frame 3 can allow the crop V1 to pass through the space Sp1 while straddling the crop V1 and leaving a gap of a predetermined value or more so that the crop V1 does not contact the support frame 3. When the crop V1 is passing through the space Sp1, the vertical frame 3L is located to the left of the crop V1, the vertical frame 3R is located to the right of the crop V1, and the horizontal frame 3C is located above the crop V1.
[0058] More specifically, in this embodiment, the support frame 3 is configured to be substantially symmetrical in the left-right direction D2. The vertical frame 3L and the vertical frame 3R have a cylindrical shape with a circular cross section. In this embodiment, as an example, the vertical frame 3L and the vertical frame 3R are each configured by arranging two cylindrical members side by side. The horizontal frame 3C has a square tube shape with a rectangular cross section. Here, the vertical frame 3L and the vertical frame 3R are firmly fixed to the horizontal frame 3C by appropriate fixing means such as connecting metal fittings, diagonal braces, or welding. Therefore, the vertical frame 3L and the vertical frame 3R maintain a state where they are perpendicular to the horizontal frame 3C. In other words, in the rear view, the corners between the vertical frame 3L and the horizontal frame 3C and the corners between the vertical frame 3R and the horizontal frame 3C are each right-angled.
[0059] In this embodiment, the support frame 3 is supported by the machine body 10 so as to be rotatable about a rotation axis Ax1 (see Figs. 8 and 9) while maintaining the relative positional relationship between the pair of vertical frames 3L, 3R and the horizontal frame 3C. The rotation axis Ax1 is an axis that passes through the fulcrum part 31 provided on the horizontal frame 3C and extends along the front-rear direction D3. In other words, the support frame 3 that supports the working part (spraying nozzle 41) is supported by the machine body 10 so as to be rotatable about the rotation axis Ax1 that extends along the front-rear direction D3. Here, the "rotation axis" in this disclosure means a virtual axis (straight line) that is the center of the rotational motion of the rotating body. In other words, the rotation axis Ax1 is a virtual axis that does not have a substance. However, the rotation axis Ax1 may be a material member such as an axle pin.
[0060] The spraying device 4 has a spray nozzle 41 and the like. The spraying device 4 performs a spraying operation of spraying the chemical solution stored in the tank 64 as a spraying material on the crop V1 as a spraying target. The spray nozzle 41 is supported by the support frame 3 and is a part that sprays the spraying material. In this embodiment, as an example, the spray nozzle 41 is an outlet (spraying part) that actually serves as an outlet for the spraying material (chemical solution). The spraying device 4 has a plurality of spray nozzles 41 (12 in this embodiment as an example).
[0061] In addition to the spray nozzle 41, the spray device 4 has a spray pipe 42, a pump 43 (see FIG. 7), a valve 44 (see FIG. 7), and a spray pipe. The spray nozzle 41 is an example of a working part that performs a task (spraying task), and is supported by the support frame 3. Since the support frame 3 is supported by the machine body 10, the spray nozzle 41 (working part) is indirectly supported by the machine body 10. In this embodiment, the spray nozzle 41 is attached to the spray pipe 42. The spray pipe 42 is connected to the pump 43 via the valve 44 by the spray pipe. The pump 43 pressure-feeds the spray material (chemical solution) stored in the tank 64 to the spray pipe 42. The valve 44 is an electronically controlled valve unit such as an electromagnetic valve, and changes the pressure (spray pressure) and spray pattern when spraying the spray material. As a result, the chemical liquid in the tank 64 is supplied by the pump 43 through the valve 44 and the spray pipe 42 to the spray nozzle 41, and is sprayed from the spray nozzle 41. Here, the chemical liquid is discharged (sprayed) in the form of a mist from the spray nozzle 41.
[0062] More specifically, as shown in Figs. 9 and 10, the spray pipes 42 are piping having a length in the up-down direction D1, and two of them are attached to each of the vertical frames 3L and 3R of the support frame 3. That is, in this embodiment, the spraying device 4 has a total of four spray pipes 42. The two (pair) spray pipes 42 attached to each of the vertical frames 3L and 3R are arranged side by side in the left-right direction D2. Each spray pipe 42 discharges the chemical solution as a spraying object injected from its upper end from the three spray nozzles 41 while flowing it downward through the pipe. Three spray nozzles 41 are attached to each spray pipe 42, and thus the spraying device 4 has a total of 12 spray nozzles 41.
[0063] Each spray nozzle 41 is attached to the corresponding spray tube 42 so that its position can be changed in the up-down direction D1. This allows each spray nozzle 41 to change the interval between adjacent spray nozzles 41 and the height position relative to the spray tube 42 depending on the object to be sprayed (crop V1). Also, each spray nozzle 41 is attached so that its position in the up-down direction D1 and left-right direction D2 relative to the machine body 10 and its direction (angle) can be changed depending on the object to be sprayed. However, in the spraying device 4, the number of spray nozzles 41 provided on each spray tube 42 can be appropriately changed depending on the type of object to be sprayed (crop V1) or the length of each spray tube 42.
[0064] The airflow generating unit 5 generates an airflow that carries the spray material (chemical solution) discharged from the spray nozzle 41. The airflow generating unit 5 is supported by the support frame 3 together with the spray nozzle 41. In other words, the sprayer 1 according to this embodiment is an air-assisted type sprayer that sprays the spray material (chemical solution) by utilizing the airflow generated by the airflow generating unit 5. This enables the sprayer 1 to efficiently spray the spray material (chemical solution) even on the spray target (crop V1) that is located relatively far from the spray nozzle 41.
[0065] The airflow generating unit 5 has a duct 51 and a blower 52. The duct 51 forms a flow path for air to flow along the vertical direction D1. The blower 52 blows air into the duct 51. The airflow generating unit 5 forms an airflow by blowing air from the blowing holes 511 (see FIG. 10) formed in the duct 51. In short, the airflow generating unit 5 blows the air sent by the blower 52 into the duct 51 through the flow path in the duct 51 and blows it out of the blowing holes 511, thereby generating a flow of air (airflow) flowing outward from the blowing holes 511. With this configuration, a stable airflow can be generated over a relatively wide range. Furthermore, the airflow generating unit 5 can adjust the air volume of the airflow by controlling the blower 52. The airflow generating unit 5 can adjust the transport distance of the scattering object by adjusting the air volume, and the larger the air volume, the farther the scattering object can be transported. Therefore, in the sprayer 1 according to this embodiment, the range over which the spraying material is sprayed by the spraying device 4 can be adjusted.
[0066] More specifically, the duct 51 is a pipe having a length in the vertical direction D1, and one duct 51 is attached to each of the vertical frames 3L and 3R of the support frame 3. That is, in this embodiment, the airflow generating unit 5 has a total of two ducts 51. Each duct 51 has a plurality of blowing holes 511 formed on the left and right sides of the duct 51 so as to be aligned in a row along the vertical direction D1. Furthermore, two spray pipes 42 of the spraying device 4 are fixed to the rear side of each duct 51.
[0067] Here, the duct 51, the two spray pipes 42 attached thereto, and the total of six spray nozzles 41 attached to these two spray pipes 42 are arranged symmetrically in the left-right direction D2. Of the two spray pipes 42, the three spray nozzles 41 provided on the left spray pipe 42 discharge the spray material (chemical solution) toward the left front, and the three spray nozzles 41 provided on the right spray pipe 42 discharge the spray material (chemical solution) toward the right front. Therefore, the mist-like spray material discharged from the left spray nozzle 41 is carried leftward by the airflow blown out from the duct 51 to the left, and the mist-like spray material discharged from the right spray nozzle 41 is carried rightward by the airflow blown out from the duct 51 to the right.
[0068] Therefore, among the multiple (12) spray nozzles 41, the three spray nozzles 41 provided on the leftmost spray tube 42 spray the chemical solution to the left toward the crop V1 located on the left outer side of the machine body 10. Among the multiple spray nozzles 41, the three spray nozzles 41 provided on the left inner spray tube 42 adjacent to the leftmost spray tube 42 spray the chemical solution to the right toward the crop V1 located in the inner space Sp1 of the machine body 10. Among the multiple spray nozzles 41, the three spray nozzles 41 provided on the rightmost spray tube 42 spray the chemical solution to the right toward the crop V1 located on the right outer side of the machine body 10. Among the multiple spray nozzles 41, the three spray nozzles 41 provided on the right inner spray tube 42 adjacent to the rightmost spray tube 42 spray the chemical solution to the left toward the crop V1 located in the inner space Sp1 of the machine body 10.
[0069] With the above-mentioned configuration, in the spraying device 4, the two spraying pipes 42 and the six spraying nozzles 41 provided on the vertical frame 3L of the support frame 3 function as a left-side spraying unit. Also, the two spraying pipes 42 and the six spraying nozzles 41 provided on the vertical frame 3R of the support frame 3 function as a right-side spraying unit. The pair of left and right spraying units are arranged at the rear of the machine body 10, in a state where they can spray in the left-right direction D2, with a gap (space Sp1) between them that allows the crop V1 to pass through.
[0070] In addition, the spraying device 4 is configured such that a plurality of (12) spray nozzles 41 are divided into a plurality of systems and can be controlled for each system. In this embodiment, as an example, the six spray nozzles 41 provided on the two inner spray pipes 42 in the left-right direction D2 among the four spray pipes 42 are classified into a first system, the three spray nozzles 41 provided on the leftmost spray pipe 42 are classified into a second system, and the three spray nozzles 41 provided on the rightmost spray pipe 42 are classified into a third system. Therefore, the spraying pattern by the spraying device 4 includes a full spraying pattern in which the spraying material (chemical solution) is sprayed from all the spray nozzles 41, and a limited spraying pattern in which the spraying direction is limited. The limited spray pattern includes a first spray pattern in which only the six spray nozzles 41 of the first system are sprayed, a second spray pattern in which only the three spray nozzles 41 of the second system are sprayed, and a third spray pattern in which only the three spray nozzles 41 of the third system are sprayed. In addition, the limited spray pattern includes a fourth spray pattern in which only the nine spray nozzles 41 of the first and second systems are sprayed, a fifth spray pattern in which only the nine spray nozzles 41 of the first and third systems are sprayed, and a sixth spray pattern in which only the six spray nozzles 41 of the second and third systems are sprayed.
[0071] The spraying device 4 is controlled by the control device 7, and the above-mentioned multiple spraying patterns (a total of six patterns including the full spraying pattern and six limited spraying patterns) are appropriately switched. At least the valve 44 of the spraying device 4 is provided for each system of the multiple spray nozzles 41, and in this embodiment, three valves 44 are provided to correspond to three systems (first system, second system, and third system). These multiple (here, three) valves 44 are individually controlled by the control device 7 to change the spraying pattern. In addition, the spraying device 4 can change the spraying range of the sprayed material by changing the pressure (spray pressure) when spraying the sprayed material for each system. Furthermore, in this embodiment, the spraying range of the sprayed material can be adjusted by adjusting the air volume of the airflow generating unit 5, so that a more diverse spraying range can be realized depending on the spray target (crop V1) or the sprayed material (chemical solution).
[0072] In the present embodiment, as described above, the support frame 3 is configured to be rotatable about the rotation axis Ax1, rather than being fixed relatively to the machine body 10. When the support frame 3 rotates, the multiple spray nozzles 41 supported by the support frame 3 also rotate about the rotation axis Ax1.
[0073] In addition, the sprayer 1 according to this embodiment does not include an actuator or the like that actively rotates the support frame 3. Therefore, the support frame 3 rotates only when an external force acts on the support frame 3. For example, when the machine body 10 travels on a horizontally inclined slope, the support frame 3 rotates due to its own weight, that is, gravity acting on the support frame 3. Here, if the support frame 3 and the members supported by the support frame 3 (such as the spray nozzle 41, the spray pipe 42, and the airflow generating unit 5) have a weight balance that is symmetrical in the left-right direction D2, the support frame 3 will be maintained in a neutral position as long as the machine body 10 is kept horizontal.
[0074] According to the rotatable support frame 3 as described above, for example, when the machine body 10 is traveling on a horizontally inclined slope, the support frame 3 rotates, so that the amount of the sprayed material (chemical solution) by the spray nozzle 41 is less likely to be uneven (uneven spraying). In other words, if the support frame 3 is fixedly supported by the machine body 10, the machine body 10 may tilt when traveling on a horizontally inclined slope. In this case, the distance from the spray nozzle 41 to the top and bottom of the crop V1 (spray target) extending straight vertically from the ground (field F1) is different, and unevenness in the amount of the sprayed material may occur. In contrast, in the sprayer 1 according to this embodiment, the support frame 3 rotates, so that the support frame 3 and the spray nozzle 41 supported by the support frame 3 can maintain the same posture as when traveling on a horizontal plane. Therefore, even for a crop V1 (target object) that extends vertically from the ground (field F1), the distance from the spray nozzle 41 to the top and bottom is less likely to vary, making it easier to prevent unevenness in the amount of sprayed product.
[0075] 5, the communication device 60 has a first communication unit 601 and a second communication unit 602. The first communication unit 601 and the second communication unit 602 are communication interfaces that can operate independently and perform communication using different protocols to execute data communication according to a predetermined communication protocol with external devices such as the server 201, the first operation terminal 210, and the second operation terminal 220. In other words, the communication device 60 is configured to be capable of communication on a plurality of communication channels (such as frequency bands) including communication by the first communication unit 601 and communication by the second communication unit 602.
[0076] The user interface 61 is a device that performs at least one of outputting information to a user and accepting operations. Here, as shown in FIG. 7, the user interface 61 has a display unit 611 such as a liquid crystal display or an organic EL display that displays various information, and an operation unit 612 such as a touch panel, a knob, or a push button switch that accepts operations. An operator, who is an example of a user, can operate the operation unit 612 according to the operation screen displayed on the display unit 611 to perform various settings. Specifically, the operator operates the operation unit 612 of the user interface 61 to set operating conditions, etc. of the spraying device 4. Examples of operating conditions of the spraying device 4 include the pressure (spray pressure) and flow rate when spraying the spraying material from the spray nozzle 41.
[0077] The obstacle detection device 62 includes a first imaging section 621 and a second imaging section 622. The first imaging section 621 and the second imaging section 622 are both arranged facing the front of the vehicle 10. The first imaging section 621 is arranged at the left front end of the upper surface of the vehicle 10, and the second imaging section 622 is arranged at the right front end of the upper surface of the vehicle 10. In other words, the obstacle detection device 62 is mounted on the vehicle 10 of the work vehicle (sprayer 1), and includes a plurality of imaging sections (the first imaging section 621 and the second imaging section 622) that are mounted at a distance from each other in a width direction (left-right direction D2) perpendicular to the traveling direction (front-rear direction D3) of the work vehicle (sprayer 1) in a plan view.
[0078] These multiple imaging sections (first imaging section 621 and second imaging section 622) capture images of a monitoring area Z1 around the machine body 10 from diagonally above, as shown in Figure 11. Figure 11 is a plan view of the sprayer 1 seen from above, and diagrammatically shows the monitoring area Z1 set ahead in the direction of travel of the sprayer 1, the detection target Ob1, and the machine body 10 of the sprayer 1 (including the first imaging section 621 and second imaging section 622).
[0079] Here, each of the first imaging unit 621 and the second imaging unit 622 is, for example, a camera having an image sensor such as a CCD (Charge Coupled Devices) or a CMOS (Complementary Metal Oxide Semiconductor) and an optical system such as a lens. In particular, each of the first imaging unit 621 and the second imaging unit 622 is a monocular camera. Each of the first imaging unit 621 and the second imaging unit 622 constantly captures images of the monitoring area Z1 while the obstacle detection device 62 is energized, and outputs the captured images (video) to the control device 7 in real time.
[0080] More specifically, the combined range of the imaging range Z11 of the first imaging unit 621 and the imaging range Z12 of the second imaging unit 622 is set as the monitoring area Z1. The imaging range Z11 is an area that spreads in front of the first imaging unit 621 installed at the left front end of the aircraft 10, and the imaging range Z12 is an area that spreads in front of the second imaging unit 622 installed at the right front end of the aircraft 10. The pair of imaging units (the first imaging unit 621 and the second imaging unit 622) have an overlapping imaging range Z10 (cross-hatched portion in FIG. 11) in which the imaging ranges Z11 and Z12 of the first imaging unit 621 and the second imaging unit 622 overlap. That is, in the overlapping imaging range Z10 in the monitoring area Z1, in which the imaging ranges Z11 and Z12 of the first imaging unit 621 and the second imaging unit 622 overlap, imaging is possible by both the first imaging unit 621 and the second imaging unit 622.
[0081] Here, a pair of imaging units (first imaging unit 621 and second imaging unit 622) among the multiple imaging units are located on both sides of the work target row (crop row Vr1) in the width direction (left-right direction D2) while the work vehicle (sprayer 1) is performing work. In other words, the sprayer 1 travels with the machine body 10 straddling the crop row Vr1 while performing work, so the first imaging unit 621 and the second imaging unit 622 installed at both left and right ends of the machine body 10 are located on both sides of the crop row Vr1 in the width direction (left-right direction D2). Therefore, the first imaging unit 621 and the second imaging unit 622 can capture images of both sides of the crop row Vr1, respectively.
[0082] The obstacle detection device 62 further includes a first sensor 623 (see FIG. 1), a second sensor 624 (see FIG. 1), a third sensor 625 (see FIG. 6), and a fourth sensor 626 (see FIG. 7). The first sensor 623 and the second sensor 624 are both arranged facing the front of the airframe 10, and the third sensor 625 and the fourth sensor 626 are both arranged facing the rear of the airframe 10. The first sensor 623 is arranged on the front of the first block 10L, and the second sensor 624 is arranged on the front of the second block 10R. The third sensor 625 is attached to the vertical frame 3L, and the fourth sensor 626 is attached to the vertical frame 3R.
[0083] Each of the first sensor 623 to the fourth sensor 626 includes, for example, a sonar sensor, a radar, or a LiDAR (Light Detection and Ranging) sensor, and detects the surrounding conditions of the aircraft 10. As an example in this embodiment, each of the first sensor 623 to the fourth sensor 626 is a three-dimensional sensor that measures the distance to each ranging point (measurement target) in the measurement range by a TOF (Time Of Flight) method that measures the distance to a ranging point based on the round-trip time it takes for light or sound to reach the ranging point and return. The surrounding conditions of the aircraft 10 include, for example, the presence or absence of an object (obstacle, etc.) present ahead in the traveling direction of the aircraft 10, and the position (distance and direction) of the object.
[0084] The obstacle detection device 62 further includes a front contact sensor 627 and a rear contact sensor 628. The front contact sensors 627 are arranged in a pair on the left and right sides on the front side of the aircraft 10, and the rear contact sensors 628 are arranged in a pair on the left and right sides on the rear side of the aircraft 10. Each of the front contact sensor 627 and the rear contact sensor 628 detects an obstacle when it comes into contact with the obstacle. Each sensor transmits a detection signal to the control device 7 when it detects an obstacle.
[0085] The power source 63 is a drive source that supplies power to at least the traveling unit 11. The power source 63 has an engine such as a diesel engine. The power source 63 drives a hydraulic pump and supplies hydraulic oil from the hydraulic pump to the motor 112 of the traveling unit 11, thereby driving the traveling unit 11, etc. Electronic devices such as the positioning device 2, the control device 7, and the communication device 60 are connected to a battery and can operate even when the power source 63 is stopped.
[0086] Tank 64 stores a spray material such as a chemical solution. The spray material stored in tank 64 is supplied to spray device 4 and sprayed from spray nozzle 41 of spray device 4. Tank 64 can be refilled with the spray material, which is the chemical solution, from the outside. The capacity of tank 64 is, for example, about 200 L.
[0087] The display 65 is disposed on the top surface of the machine body 10. As an example, the display 65 is formed in a cylindrical shape having a length in the vertical direction D1. The illumination state of the display 65 changes according to the operating state of the spreader 1 (traveling state, spraying work execution state, etc.). This makes the operating state of the spreader 1 visible even from around the spreader 1.
[0088] The sensor device 66 includes, for example, a remaining amount sensor that detects the remaining amount of the chemical liquid to be sprayed and the remaining amount of fuel. As an example, the sensor device 66 detects the remaining amount of chemical liquid from the amount of chemical liquid in the tank 64. Similarly, the sensor device 66 detects the remaining amount of fuel from the amount of fuel in the fuel tank.
[0089] The control device 7 mainly comprises a computer system having one or more processors such as a CPU (Central Processing Unit) and one or more memories such as a ROM (Read Only Memory) and a RAM (Random Access Memory), and executes various processes (information processing). In this embodiment, the control device 7 is an integrated controller that controls the entire sprayer 1, and is composed of, for example, an electronic control unit (ECU). However, the control device 7 may be provided separately from the integrated controller, or may be mainly composed of one processor or multiple processors.
[0090] 5, the control device 7 includes an acquisition processing unit 71, an automatic driving processing unit 72, a manual driving processing unit 73, a detection processing unit 74, a switching processing unit 75, and a scattering processing unit 76. In this embodiment, as an example, the control device 7 is mainly configured as a computer system having one or more processors, and these multiple functional units (acquisition processing unit 71, etc.) are realized by the one or more processors executing a control program. These multiple functional units included in the control device 7 may be provided in a distributed manner across multiple housings, or may be provided in a single housing.
[0091] The control device 7 is configured to be able to communicate with devices provided in each part of the machine body 10. That is, at least the traveling part 11, the positioning device 2, the spraying device 4, the airflow generating part 5, the communication device 60, the user interface 61, the obstacle detection device 62, the power source 63, and the display 65 are connected to the control device 7. This allows the control device 7 to control the traveling part 11 and the spraying device 4, etc., and to obtain electrical signals from the positioning device 2, the communication device 60, the obstacle detection device 62, etc. The control device 7 may directly exchange various information (data) with each device, or may indirectly exchange information (data) with each device via a repeater or the like.
[0092] In addition to the above-mentioned functional units, the control device 7 further includes an engine control unit, and an HST (Hydro-Static Transmission) control unit that controls the hydrostatic continuously variable transmission. The engine control unit controls the engine (power source 63). The HST control unit controls the hydrostatic continuously variable transmission.
[0093] The acquisition processing unit 71 executes an acquisition process for acquiring an electric signal (including data) from each device. In this embodiment, the acquisition processing unit 71 periodically or irregularly acquires image data (captured images) from at least each of the first imaging unit 621 and the second imaging unit 622 of the obstacle detection device 62. In other words, the acquisition processing unit 71 acquires images captured by the multiple imaging units (the first imaging unit 621 and the second imaging unit 622).
[0094] Furthermore, the acquisition processing unit 71 periodically or irregularly acquires information (data) such as the output of other sensors of the obstacle detection device 62, and the remaining amount of chemical solution and the remaining amount of fuel as a spray material from the sensor device 66. The acquisition processing unit 71 may acquire various types of data directly from various sensors (including an imaging unit) or indirectly via an electronic control unit. The data acquired by the acquisition processing unit 71 is stored, for example, in a memory or the like.
[0095] The automatic travel processing unit 72 automatically travels the machine 10 along a target route in the field F1 based on the positioning information acquired from the positioning device 2. Specifically, the automatic travel processing unit 72 automatically travels the traveling unit 11 along the target route based on the positioning information including the position and orientation of the machine 10 measured by the positioning device 2. For example, when the positioning information is in a state where RTK positioning is possible and the operator operates (e.g., presses and holds) the third operation unit 223 of the second operation terminal 220, the second operation terminal 220 outputs a travel start instruction (work start instruction) to the sprayer 1. When the automatic travel processing unit 72 acquires the travel start instruction from the second operation terminal 220, it starts the automatic travel of the sprayer 1 based on the positioning information of the machine 10 measured by the positioning device 2. As a result, the sprayer 1 starts automatic travel along the target route and starts the spraying work by the spraying device 4.
[0096] The manual driving processing unit 73 executes driving control processing to control the traveling unit 11 in accordance with an operation signal from the manual operation device 8. In other words, the control device 7 controls the traveling unit 11 in accordance with the operation of the manual operation device 8 by the operator by using the manual driving processing unit 73, thereby enabling manual operation of the traveling unit 11.
[0097] The detection processing unit 74 executes a detection process to detect the detection object Ob1 based on images captured by at least the multiple imaging units (the first imaging unit 621 and the second imaging unit 622). That is, the detection processing unit 74 detects the detection object Ob1 in a monitoring area Z1 set ahead in the traveling direction of the sprayer 1. Here, the detection processing unit 74 determines the presence or absence (presence or absence) of the detection object Ob1 in the monitoring area Z1, and outputs a detection result indicating whether or not the detection object Ob1 exists in the monitoring area Z1.
[0098] In this embodiment, as an example, the detection object Ob1 is an obstacle with which the sprayer 1 must avoid contact (collision), and is a "person." In other words, when the sprayer 1 moves, or when a "person" around the sprayer 1 moves, resulting in a "person" entering the monitoring area Z1 in front of the sprayer 1, the detection processing unit 74 detects the "person" as the detection object Ob1. When multiple detection objects Ob1 exist in the monitoring area Z1, the detection processing unit 74 may also detect the number (number of people) of detection objects Ob1.
[0099] In this embodiment, the detection processing unit 74 detects a detection object Ob1 in the monitoring area Z1 based on the output (image data) of a plurality of imaging units (the first imaging unit 621 and the second imaging unit 622). Specifically, the detection processing unit 74 performs image processing using, for example, machine learning on the image data acquired by the acquisition processing unit 71 to extract a feature amount in the image, and determines whether or not a detection object Ob1 (a "person" in this embodiment) is captured in the image based on the feature amount.
[0100] The detection processing unit 74 also detects objects around the airframe 10 based on detection signals from sensors (such as the first sensor 623 to the fourth sensor 626, the front contact sensor 627, and the rear contact sensor 628) other than the multiple imaging units in the obstacle detection device 62. However, in this case, unlike the case where the detection processing unit 74 detects based on images captured by the multiple imaging units (the first imaging unit 621 and the second imaging unit 622), the detection processing unit 74 does not determine whether the detected object is a detection target Ob1 (in this embodiment, a "person") or not.
[0101] The switching processing unit 75 executes a switching process for switching the mode of the detection process of the detection object Ob1 according to a switching condition. The "mode of the detection process" in the present disclosure refers to the mode of the process of detecting the detection object Ob1 based on images captured by the multiple imaging units (the first imaging unit 621 and the second imaging unit 622) executed in the detection processing unit 74. In other words, the switching processing unit 75 switches the mode of the operation of the detection processing unit 74 according to the switching condition. As a result, the mode of the detection process of the detection object Ob1 performed by the detection processing unit 74 based on images captured by the multiple imaging units is selected from multiple modes, not one mode.
[0102] The "switching condition" in this disclosure is a condition for the switching processing unit 75 to switch the mode of the detection process of the detection object Ob1, and is set in advance. Therefore, the switching processing unit 75 judges whether the switching condition is satisfied, and automatically switches the mode of the detection process of the detection object Ob1 according to the judgment result. The switching condition will be described in detail in the section "[3.3] Switching process".
[0103] The spraying processing unit 76 performs spraying control processing related to the work (spraying work) of the spraying device 4 and the airflow generation unit 5, etc. Specifically, when the sprayer 1 starts automatic travel at the work start position, the spraying processing unit 76 outputs a switching signal to the spraying device 4 to switch the spraying pattern based on control information included in a predetermined target route. On receiving the switching signal, the spraying device 4 performs the spraying work in a predetermined spraying pattern.
[0104] The manual operation device 8 is a device for manually controlling the sprayer 1. The sprayer 1 acquires, at the control device 7 (acquisition processing unit 71), an operation signal that the manual operation device 8 outputs in response to an operation by an operator.
[0105] In this embodiment, the manual operation device 8 is connected to the control device 7 of the sprayer 1 by a cable having a sufficient length, and communicates with the control device 7 by wire. Therefore, the operator can manually operate the sprayer 1 using the manual operation device 8 while standing around the machine 10, for example, without boarding the machine 10 of the sprayer 1. Here, the manual operation device 8 may communicate with the sprayer 1 (control device 7) by wireless communication using radio waves or light, and even in this case, the operator can manually operate the sprayer 1 using the manual operation device 8 from outside the machine 10. In short, the manual operation device 8 can be operated outside the machine 10. Therefore, for example, when loading and unloading the sprayer 1 on a transport vehicle, the operator can manually operate the sprayer 1 in a safe place outside the machine 10.
[0106] [3] Method for controlling a work vehicle Hereinafter, with reference to Figs. 12 to 16, a control method for the work vehicle (sprayer 1) executed mainly by the control device 7 (hereinafter simply referred to as "the control method") will be described.
[0107] The control method according to this embodiment is executed by the control device 7, which is mainly composed of a computer system, and in other words is embodied in a control program (hereinafter simply referred to as the "control program") for the work vehicle (sprayer 1). In other words, the control program according to this embodiment is a computer program for causing one or more processors to execute each process related to the control method. Such a control program may be executed, for example, by the control device 7 and the first operation terminal 210 in cooperation with each other.
[0108] The control device 7 that executes the control method, together with the positioning device 2 and the obstacle detection device 62, etc., constitutes a work vehicle control system (hereinafter simply referred to as the "control system") 100, as shown in Fig. 5. The control system 100 is a system that executes processing related to the control of the work vehicle (sprayer 1). In other words, the control system 100 according to this embodiment includes the control device 7, which includes an acquisition processing unit 71, a detection processing unit 74, a switching processing unit 75, etc., and the positioning device 2 and the obstacle detection device 62, etc. However, at least one of the positioning device 2 and the obstacle detection device 62 may not be included as a component of the control system 100, and for example, the control system 100 may not include the positioning device 2.
[0109] As described above, the control system 100 according to this embodiment includes a control device 7 that includes at least an acquisition processing unit 71, a detection processing unit 74, a switching processing unit 75, etc. The control device 7 is mounted on the body 10 of the sprayer 1 and is one of the components of the sprayer 1. Therefore, the control system 100, together with the body 10, configures the sprayer 1 as a work vehicle. In other words, the work vehicle (sprayer 1) according to this embodiment includes the control system 100 and the body 10. The work vehicle (sprayer 1) works while moving through a field F1 in which a plurality of work target rows (crop rows Vr1) consisting of a plurality of work objects (crops V1) are arranged.
[0110] [3.1] Basic operation First, a basic operation will be described when the automatic driving processing unit 72 executes the automatic driving process to cause the spreader 1, which serves as a work vehicle, to automatically drive within the field F1, which serves as a work site.
[0111] The automatic travel processing unit 72 starts the automatic travel of the sprayer 1 when the acquisition processing unit 71 acquires an automatic travel start instruction in a state where a predetermined automatic travel condition is satisfied. The automatic travel condition includes, for example, that the target route R10 (see FIG. 12) is set, that the key switch (engine key switch) for starting the engine (power source 63) of the sprayer 1 is in the ON state, and that the sprayer 1 is located at the work start position Ps1 (see FIG. 12). That is, when the target route R10 is set and the engine is running, the automatic travel condition is satisfied when the sprayer 1 is moved to the work start position Ps1 of the target route R10 by manual operation using the manual operation device 8. In this state, for example, the operator operates the third operation unit 223 of the second operation terminal 220, and an automatic travel start instruction is output from the second operation terminal 220 to the sprayer 1, whereby the automatic travel processing unit 72 starts the automatic travel of the sprayer 1.
[0112] As an example, a field F1 in which seven crop rows Vr11-Vr17 exist as shown in FIG. 12 is assumed to be the work area. This field F1 includes a work area F11 (hatched area in FIG. 12) in which the crop rows Vr11-Vr17 are formed, and a non-work area F12 as a headland area formed around the work area F11 so as to surround the work area F11. The work area F11 is an area of the field F1 in which spraying work is performed by the spreader 1. The non-working area F12 is an area in which spraying work is not performed by the spreader 1. In other words, the work area (field F1) includes the work area F11 in which work is performed by the work vehicle (sprayer 1), and the non-working area F12 in which work is not performed by the work vehicle (sprayer 1).
[0113] The sprayer 1 can automatically travel (autonomously travel) within such a farm field F1 along a preset target route R10. For example, the sprayer 1 automatically travels from a work start position Ps1 to a work end position Pg1 along a target route R10 including a plurality of work routes R1 and a plurality of movement routes R2. Each of the plurality of work routes R1 is a linear route along which the sprayer 1 performs work (spraying work) on a crop V1 that is a work object (a spraying object), and each of the plurality of movement routes R2 is a route (non-work route) along which the sprayer 1 moves between crop rows Vr1 without performing spraying work, and may include a turning route and a straight route.
[0114] In the example of FIG. 12, the target path R10 includes four work paths R11 to R14 that are formed in the work area F11 along the vertical direction A1, which is the longitudinal direction of the crop row Vr1 (i.e., the direction in which the multiple crops V1 are lined up). Here, as an example, the work path R11 is set on the crop row Vr11, the work path R12 is set on the crop row Vr13, the work path R13 is set on the crop row Vr15, and the work path R14 is set on the crop row Vr17. The movement path R2 is formed in the non-working area F12 located on both sides of the vertical direction A1 as viewed from the work area F11 so as to connect the work paths R11 to R14 adjacent to each other in the width direction A2. That is, basically, of the target path R10, the work path R1 is formed in the work area F11 of the work land (field F1), and the movement path R2 is formed in the non-working area F12.
[0115] According to the above-mentioned target path R10, the sprayer 1 travels in the working area F11 from the work start position Ps1 along the working path R11 toward one side of the vertical direction A1 (upward in FIG. 12), and then travels in the non-working area F12 toward the start of the next working path R12 along the moving path R2. Then, the sprayer 1 travels in the working area F11 toward the other side of the vertical direction A1 (downward in FIG. 12) along the working path R12, and then travels in the non-working area F12 toward the start of the next working path R13 along the moving path R2. Then, the sprayer 1 travels in the working area F11 toward one side of the vertical direction A1 along the working path R13, and then travels in the non-working area F12 toward the start of the next working path R14 along the moving path R2. Finally, the sprayer 1 travels in the working area F11 toward the other side of the vertical direction A1 along the working path R14 to the work end position Pg1.
[0116] Here, the current position of the sprayer 1 is identified by the position of the antenna 21 arranged at the center in the left-right direction D2 at the rear of the body 10 in a plan view. Therefore, when the sprayer 1 automatically travels along the target route R10, the center of the rear of the body 10 in the left-right direction D2 passes over the target route R10. Furthermore, as described above, the sprayer 1 travels with the gate-shaped body 10 in a position straddling one crop row Vr1, and sprays a spray material (chemical solution) on the crops V1 in this crop row Vr1 and the crops V1 in the crop row Vr1 adjacent to this crop row Vr1.
[0117] Therefore, for example, as shown in Fig. 12, while the sprayer 1 is traveling along the work route R13 set on the crop row Vr15, the machine body 10 travels across the crop row Vr15. At this time, the first block 10L travels along the work path between the crop row Vr14 and the crop row Vr15, and the second block 10R travels along the work path between the crop row Vr15 and the crop row Vr16. Furthermore, at this time, the sprayer 1 can simultaneously spray the spraying material (chemical solution) on the crop V1 in the crop row Vr15, the crop V1 in the crop row Vr14 located on the left side, and the crop V1 in the crop row Vr16 located on the right side.
[0118] The sprayer 1 also automatically travels in a predetermined row order. In the example of FIG. 12, the work path R1 is set to alternate rows in the arrangement order of the crop rows Vr1, such as crop rows Vr11, Vr13, Vr15, and Vr17. Therefore, the sprayer 1 automatically travels through the multiple crop rows Vr1 every other row. The sprayer 1 can perform spraying work on all of the spraying targets by simultaneously spraying the spraying material (chemical solution) on three rows of spraying targets (crops V1) adjacent to each other in the width direction A2 while traveling through the multiple crop rows Vr1 every other row. However, setting the work path R1 in this manner is merely an example, and the sprayer 1 may travel every row in the arrangement order of the crop rows Vr1, or may travel every several rows.
[0119] Here, the sprayer 1 performs spraying while traveling along the work path R1, and does not perform spraying while traveling along the movement path R2. Therefore, the sprayer 1 starts spraying when it starts traveling along the work path R1, and stops spraying when it travels to the end of the work path R1. The sprayer 1 then travels along the movement path R2 with spraying stopped, and resumes spraying when it reaches the start of the next work path R1. As a result, the sprayer 1 performs spraying while traveling through the work area F11, and does not perform spraying while traveling through the non-work area F12.
[0120] In the example of Fig. 12, the travel route R2 includes a turning route for turning right or left gently, but the turning manner for changing the orientation of the sprayer 1 is not limited to "gentle turning" and may include, for example, "pivot turning" and "super pivot turning", etc. Furthermore, the turning manner of the sprayer 1 may include a turning manner in which the vehicle 10 turns while switching between forward and reverse to enable the vehicle 10 to turn within a limited space, such as a so-called "fishtail turn".
[0121] The target route R10 is generated based on information such as work vehicle information on the work vehicle (sprayer 1), field information on the field F1, and work information on the work (here, spraying work). The work vehicle information includes, for example, the model of the sprayer 1, the position of the antenna 21 of the sprayer 1, the type of work machine (here, the spraying device 4), the size and shape of the work machine, the position of the spraying device 4 relative to the machine body 10, the vehicle speed and engine speed of the machine body 10 during work, etc. The field information includes information such as the position and shape of the field F1, the work start position Ps1, the work end position Pg1, and the work direction. The work direction here means the direction in which the sprayer 1 travels while performing spraying work in the work area F11, which is the area excluding the non-work area F12 such as the headland from the field F1. The work information includes information such as the skip number, which is the number of work paths R1 that the sprayer 1 skips when turning in the non-working area F12, and the width of the non-working area F12.
[0122] The work vehicle information, the field information, the work information, and the like may be set manually, for example, by the operator performing a registration operation on the first operation terminal 210. Alternatively, for example, information on the position and shape of the field F1 and the like may be acquired automatically by the operator manually operating the spreader 1 to travel around the perimeter of the field F1 once and recording the transition of the position information of the antenna 21 at that time.
[0123] The generated target route R10 is stored in a memory (storage unit) of the control device of the sprayer 1 and is used for automatic traveling by the automatic traveling processing unit 72. In addition, the target route R10 can also be displayed on the display unit 211 of the first operation terminal 210, etc.
[0124] [3.2] Detection process of the object to be detected Next, a process for detecting a detection target Ob1 (see FIG. 11) performed during automatic travel of the sprayer 1 serving as a work vehicle will be described.
[0125] That is, the control method according to this embodiment includes a detection process that detects the detection object Ob1 based on images captured by at least the multiple imaging units (first imaging unit 621 and second imaging unit 622). The detection process is executed by the detection processing unit 74 at any time during automatic travel of the sprayer 1. Basically, when the detection object Ob1 appears in an image captured by the multiple imaging units, the detection processing unit 74 determines that the detection object Ob1 is present in a monitoring area Z1 (see FIG. 11) set ahead in the traveling direction of the sprayer 1.
[0126] Here, the detection processing unit 74 is configured to be able to execute an identification process for identifying the detection object Ob1 by performing detection based on the image captured by the imaging unit. In the present disclosure, "identification" means distinguishing the type and nature of an object. That is, when an object is captured in an image captured by a plurality of imaging units, the detection processing unit 74 can distinguish and detect whether the object is a "person" as the detection object Ob1. For example, when an extended branch or weed of the work object (crop V1) is present ahead in the traveling direction of the work vehicle (sprayer 1), the detection processing unit 74 can determine that it is not the detection object Ob1.
[0127] When a detection object Ob1 exists in the monitoring area Z1, the work vehicle (sprayer 1) is controlled to avoid the detection object Ob1. Specifically, when the detection processing unit 74 determines that the detection object Ob1 exists in the monitoring area Z1, it outputs the detection result to the automatic driving processing unit 72. At this time, the automatic driving processing unit 72 executes a check process to check the operation of the sprayer 1, which is a work vehicle, based on the detection result of the detection processing unit 74. In this embodiment, when the detection result of the detection processing unit 74 indicates the presence of the detection object Ob1 (here, a person) in the monitoring area Z1, the automatic driving processing unit 72 executes the check process. In this disclosure, the "check process" means a process that acts in a direction to suppress the operation of the sprayer 1 in some way. As an example, the check process includes a restriction process that directly checks the operation of the sprayer 1 by controlling the traveling unit 11 of the sprayer 1, etc. Furthermore, the restraining process includes an alarm process that indirectly restrains the operation of the sprayer 1 by warning the user (operator) who operates the sprayer 1 with sound or light (including display).
[0128] In this embodiment, when a detection object Ob1 is present in the monitoring area Z1, the automatic driving processing unit 72 executes a restriction process that at least restricts the operation of the sprayer 1, and directly checks the operation of the sprayer 1. As an example, the restriction process includes a process of prohibiting the traveling unit 11 from traveling (making the traveling operation impossible), a process of continuing the traveling of the sprayer 1 while avoiding the detection object Ob1, and a process of reducing the traveling speed of the traveling unit 11. This makes it possible to forcibly restrict the operation of the sprayer 1 without the operation of the operator, and to avoid contact between the machine body 10 and the detection object Ob1 caused by the operation of the sprayer 1.
[0129] In the control method according to the present embodiment, the mode of the detection process for detecting the object Ob1 based on images captured by the multiple imaging units (the first imaging unit 621 and the second imaging unit 622) includes at least a two-dimensional mode and a three-dimensional mode. The two-dimensional mode is a mode for detecting the object Ob1 using two-dimensional images not including distance information captured by each of the multiple imaging units. The three-dimensional mode is a mode for detecting the object Ob1 using three-dimensional images including distance information generated from images captured by the multiple imaging units.
[0130] Specific examples of the detection process in each of the two-dimensional mode and the three-dimensional mode will be described below with reference to Fig. 13 and Fig. 14. In Fig. 13 and Fig. 14, the image G1 captured by the first imaging section 621 is referred to as the "left camera image", and the image G2 captured by the second imaging section 622 is referred to as the "right camera image".
[0131] FIG. 13 is an explanatory diagram conceptually showing the detection process in the two-dimensional mode. In FIG. 13, as in FIG. 12, it is assumed that the sprayer 1 is traveling on the work path R13 set on the crop row Vr15 in the work area F11. In this state, the machine body 10 travels across the crop row Vr15, so that the first block 10L travels on the work path between the crop row Vr14 and the crop row Vr15, and the second block 10R travels on the work path between the crop row Vr15 and the crop row Vr16. Therefore, the first imaging unit 621 installed at the left front end of the machine body 10 is located on the work path between the crop row Vr14 and the crop row Vr15 in the width direction (left-right direction D2). On the other hand, the second imaging unit 622 installed at the right front end of the machine body 10 is located on the work path between the crop row Vr15 and the crop row Vr16 in the width direction (left-right direction D2).
[0132] In the example of Fig. 13, it is assumed that a "person" is present as the detection object Ob1 on the work passage between the crop row Vr15 and the crop row Vr16. Here, it is assumed that the detection object Ob1 is not visible from the position of the first imaging unit 621 because the crop V1 of the crop row Vr15 is located between the first imaging unit 621 and the detection object Ob1. Therefore, the detection object Ob1 appears in the image G2 captured by the second imaging unit 622 located on the work passage between the crop row Vr15 and the crop row Vr16, whereas the detection object Ob1 does not appear in the image G1 captured by the first imaging unit 621 because the crop row Vr15 acts as a barrier.
[0133] In the two-dimensional mode, as shown in FIG. 13, first, the acquisition processing unit 71 acquires an image G1 captured by the first imaging unit 621 and an image G2 captured by the second imaging unit 622. The detection processing unit 74 performs a detection process for each of these two images G1 and G2. At this time, the detection processing unit 74 extracts a feature amount in the image G1 and estimates what is reflected where in the image G1 based on the feature amount. Similarly, the detection processing unit 74 extracts a feature amount in the image G2 and estimates what is reflected where in the image G2 based on the feature amount. In the example of FIG. 13, by such a detection process, the detection processing unit 74 determines that the detection object Ob1 does not exist from the image G1 ("no obstacle") and determines that the detection object Ob1 exists from the image G2 ("obstacle exists").
[0134] Fig. 14 is an explanatory diagram conceptually showing the detection process in the three-dimensional mode. In Fig. 14, it is assumed that the sprayer 1 is traveling along a travel route R2 set in a non-work area F12 as a headland area. In this state, the machine body 10 travels without straddling the crop row Vr1.
[0135] In the example of Fig. 14, it is assumed that a "person" is present as a detection object Ob1 in a position slightly to the right of the center in a monitoring area Z1 ahead of the sprayer 1 in the traveling direction in the non-working area F12. Here, it is assumed that the detection object Ob1 is located in an overlapping imaging range Z10 (see Fig. 11) where the imaging ranges Z11, Z12 of the first imaging unit 621 and the second imaging unit 622 overlap. Therefore, the detection object Ob1 is captured in both the image G1 captured by the first imaging unit 621 and the image G2 captured by the second imaging unit 622.
[0136] In the three-dimensional mode, as shown in FIG. 14, first, the acquisition processing unit 71 acquires an image G1 captured by the first imaging unit 621 and an image G2 captured by the second imaging unit 622. The detection processing unit 74 performs detection processing only on one of these two images G1 and G2. Here, as an example, it is assumed that detection processing is performed only on the image G2 captured by the second imaging unit 622. At this time, the detection processing unit 74 extracts a feature amount in the image G2 and estimates what is reflected in the image G2 based on the feature amount. Then, the detection processing unit 74 performs stereo matching on the image G1 and the image G2 to generate a three-dimensional image G3. That is, the detection processing unit 74 estimates parallax by matching each part of the image G1 and the image G2, and calculates the distance from the aircraft 10 (the first imaging unit 621 and the second imaging unit 622) to the object reflected in the three-dimensional image G3 based on the principle of triangulation.
[0137] In short, when the detection object Ob1 is captured in the three-dimensional image G3, the detection processing unit 74 can identify the three-dimensional position of the detection object Ob1 in the monitoring area Z1, including the distance from the aircraft 10 to the detection object Ob1. Therefore, the detection processing unit 74 can detect only the detection object Ob1 that exists within a certain distance (for example, 2 m, 3 m, 4 m, or 5 m, etc.) from the aircraft 10. In other words, the detection processing unit 74 can detect the detection object Ob1 in the monitoring area Z1 of an arbitrarily set size and shape, as well as the entire area captured by the first imaging unit 621 and the second imaging unit 622 as the monitoring area Z1. In the three-dimensional mode, the detection processing unit 74 performs detection including the three-dimensional position of the detection object Ob1 using the three-dimensional image G3 including distance information of the detection object Ob1 (and other objects) by such detection processing.
[0138] Particularly in this embodiment, the first imaging unit 621 and the second imaging unit 622 are arranged at both ends of the width direction (left-right direction D2) of the body 10, so that a sufficient baseline length is ensured, and detection processing can be performed in three-dimensional mode with excellent distance resolution and maximum detection distance.
[0139] As described above, the detection processing mode includes a two-dimensional mode and a three-dimensional mode, so that the detection object Ob1 can be detected in either the two-dimensional mode or the three-dimensional mode. In the two-dimensional mode, the detection processing unit 74 uses multiple imaging units (the first imaging unit 621 and the second imaging unit 622), each of which is a monocular camera, for separate detection processing, whereas in the three-dimensional mode, the detection processing unit 74 can use multiple imaging units for one detection processing like a stereo camera. In particular, in the three-dimensional mode, it is possible to specify (estimate) the position of the detection object Ob1, including the distance from the machine body 10 to the detection object Ob1.
[0140] [3.3] Switching process Next, a process related to a switching process for switching the mode of the detection process for the detection object Ob1 will be described.
[0141] That is, the control method according to this embodiment has a switching process for switching the mode of the detection process of the detection target object Ob1. The switching process is executed by the switching processor 75 at any time at least during the automatic travel of the sprayer 1. The switching processor 75 basically switches the detection process mode between the above-mentioned two-dimensional mode and three-dimensional mode in accordance with a switching condition.
[0142] Here, when considering how to control the operation of the sprayer 1 as a check process (restriction process) when the detection object Ob1 is detected, the detection process in the three-dimensional mode is more convenient than the two-dimensional mode. In other words, in the three-dimensional mode, the three-dimensional position of the detection object Ob1, including the distance from the machine 10 to the detection object Ob1, can be specified (estimated), so that the subsequent check process (restriction process) can be, for example, a process of continuing the travel of the sprayer 1 while avoiding the detection object Ob1.
[0143] However, in the detection process in the three-dimensional mode, when occlusion occurs, the detection target Ob1 may not be detected correctly. Here, "occlusion" refers to a part that appears in one of the images G1 and G2 when a certain object and a different object overlap, but is not seen in the other due to obstruction. In other words, when such occlusion occurs, it becomes difficult to associate objects between the images G1 and G2 captured by the multiple imaging units (the first imaging unit 621 and the second imaging unit 622), which causes problems in generating a three-dimensional image.
[0144] In particular, in the sprayer 1 according to this embodiment, the machine body 10 travels in a posture straddling one crop row Vr1 during work, so that a pair of imaging units (the first imaging unit 621 and the second imaging unit 622) among the multiple imaging units are located on both sides of the crop row Vr1 in the width direction (left-right direction D2). Therefore, when the crop V1 of the crop row Vr1 overlaps with the detection object Ob1 located on one side of the crop row Vr1 in the width direction, the crop V1 may become an obstruction, and the detection object Ob1 may not be captured in the image captured by the imaging unit located on the other side of the crop row Vr1 in the width direction. As a result, for example, as shown in FIG. 13, the detection object Ob1 may not be captured in the image G1 captured by the first imaging unit 621 because it is obstructed by the crop row Vr1.
[0145] Therefore, in this embodiment, when the aircraft 10 is straddling the crop row Vr1, two-dimensional mode detection processing is applied to avoid the effects of occlusion described above, and when the aircraft 10 is not straddling the crop row Vr1, three-dimensional mode detection processing is applied.
[0146] Specifically, the switching condition includes a condition regarding an object present between a pair of imaging units (the first imaging unit 621 and the second imaging unit 622) among the multiple imaging units in the width direction (the left-right direction D2). That is, for example, as shown in FIG. 15, when the machine body 10 straddles the crop row Vr1 and a tall object (the crop V1 in the crop row Vr1) is present between the first imaging unit 621 and the second imaging unit 622, the switching processing unit 75 determines that the switching condition is satisfied and switches the mode of the detection process to the two-dimensional mode. As an example, in a situation where occlusion may occur due to an object such as the crop row Vr1 present between the first imaging unit 621 and the second imaging unit 622, the detection processing unit 74 can reduce erroneous detection of the detection target Ob1 by applying the detection process in the two-dimensional mode.
[0147] More specifically, the switching condition includes a condition related to the current position of the work vehicle (sprayer 1). That is, the switching processing unit 75, for example, identifies where the sprayer 1 is traveling on the target route R10 based on the positioning information acquired from the positioning device 2 and the route information related to the target route R10, and determines whether the switching condition is satisfied based on the information. As an example, as shown in FIG. 15, if the sprayer 1 is traveling on the work route R1 set in the work area F11, the switching processing unit 75 assumes that the crop row Vr1 exists between the first imaging unit 621 and the second imaging unit 622, determines that the switching condition is satisfied, and switches the mode of the detection process to the two-dimensional mode. On the other hand, if the sprayer 1 is traveling on the movement route R2 set in the non-work area F12, the switching processing unit 75 assumes that the crop row Vr1 does not exist between the first imaging unit 621 and the second imaging unit 622, determines that the switching condition is not satisfied, and switches the mode of the detection process to the three-dimensional mode.
[0148] As a result, in a situation where occlusion may occur due to an object such as a crop row Vr1 existing between the first imaging unit 621 and the second imaging unit 622, even without directly monitoring the object existing between the first imaging unit 621 and the second imaging unit 622, the detection processing unit 74 can reduce false detection of the detection target object Ob1 by applying detection processing in two-dimensional mode.
[0149] In short, in this embodiment, if the work vehicle (sprayer 1) is in a position where the work object (crop V1) blocks the overlapping imaging range Z10 of at least one of the pair of imaging units (first imaging unit 621 and second imaging unit 622), the detection processing mode becomes the two-dimensional mode according to the switching condition. The two-dimensional mode is a mode in which the detection object Ob1 is detected using two-dimensional images (images G1, G2) that do not include distance information captured by each of the pair of imaging units.
[0150] For example, as shown in FIG. 15, when the sprayer 1 is traveling on the work path R1, the switching processing unit 75 selects the two-dimensional mode as the mode of the detection process. Therefore, in the example of FIG. 15, the detection processing unit 74 can detect the detection object Ob1 on the work path between the crop row Vr15 and the crop row Vr16 at least from the image G2 captured by the second imaging unit 622 without being affected by occlusion. In the detection process in the two-dimensional mode, although the three-dimensional position of the detection object Ob1 cannot be specified, if the detection object Ob1 is captured approximately in the center of the image G2 captured by the second imaging unit 622 (see FIG. 13), it is estimated that the detection object Ob1 is present on the work path between the crop row Vr15 and the crop row Vr16.
[0151] On the other hand, if the work vehicle (sprayer 1) is not in a position where it is blocked by the work object (crop V1) between the pair of imaging units (first imaging unit 621 and second imaging unit 622) and the overlapping imaging range Z10, the detection processing mode becomes the three-dimensional mode according to the switching condition. The three-dimensional mode is a mode in which the detection object Ob1 is detected using a three-dimensional image G3 including distance information generated from images G1, G2 captured by the pair of imaging units.
[0152] For example, if the sprayer 1 moves further forward from the state in Fig. 15 and moves onto the movement path R2 in the non-work area F12, the switching processing unit 75 selects the three-dimensional mode as the mode of the detection process. At this time, since the crop row Vr1 that causes occlusion does not exist between the first imaging unit 621 and the second imaging unit 622, the detection processing unit 74 can detect the detection object Ob1 from the three-dimensional image G3 including distance information without being affected by occlusion.
[0153] As described above, according to the control method of this embodiment, the detection object Ob1 is detected based on images captured by multiple imaging units, while the target of the detection process is switched in accordance with the switching conditions, which has the advantage that erroneous detection of the detection object Ob1 is less likely to occur.
[0154] Incidentally, the control method according to this embodiment further includes changing the control of the work vehicle (sprayer 1) when the detection object Ob1 is present, depending on the state of the detection process. That is, as the switching processing unit 75 switches the state of the detection process, the content of the restraint process (restriction process) when the detection object Ob1 is present is changed. This makes it possible to control the work vehicle (sprayer 1) appropriately depending on the state of the detection process.
[0155] Specifically, if the detection processing mode is the two-dimensional mode, the work vehicle (sprayer 1) is stopped when the detection object Ob1 is present. In other words, when the two-dimensional mode is selected by the switching processing unit 75, the detection processing unit 74 outputs a detection result indicating the presence of the detection object Ob1 to the automatic driving processing unit 72 when it determines that the detection object Ob1 is present in the monitoring area Z1. At this time, the detection result does not include information regarding the three-dimensional position of the detection object Ob1, and the automatic driving processing unit 72 receiving the detection result stops the sprayer 1 by prohibiting the traveling operation of the traveling unit 11 (making the traveling operation impossible). Such a check processing is performed in the same way regardless of whether the detection object Ob1 is captured in the image G1, G2 captured by either the first imaging unit 621 or the second imaging unit 622.
[0156] In this embodiment, the two-dimensional mode is selected when the vehicle 10 is traveling through the work passage between the crop rows Vr1, and therefore, in such a state where there is not enough space to avoid the detection object Ob1, stopping the sprayer 1 is the most reliable collision avoidance means. In other words, with the above configuration, when the detection object Ob1 is detected, it is possible to reliably avoid contact between the detection object Ob1 and the vehicle 10.
[0157] Furthermore, when the sprayer 1 stops, the automatic travel processing unit 72 notifies the operator that the sprayer 1 has stopped, for example, via the first operation terminal 210. At this time, it is preferable to display images G1, G2 captured by at least one of the first imaging unit 621 and the second imaging unit 622 on the display unit 211 of the first operation terminal 210. When the detection object Ob1 is no longer detected, the automatic travel processing unit 72 may automatically resume the travel of the sprayer 1, or may resume it by the operation of the operator. Furthermore, the automatic travel processing unit 72 may issue a warning to the detection object Ob1 by sound or light (including display) at an appropriate timing before and / or after the sprayer 1 is stopped.
[0158] On the other hand, if the mode of the detection process is the three-dimensional mode, when the detection object Ob1 exists, the work vehicle (sprayer 1) is made to travel along an avoidance route that avoids contact with the detection object Ob1. In other words, when the three-dimensional mode is selected by the switching processing unit 75, when the detection processing unit 74 determines that the detection object Ob1 exists in the monitoring area Z1, it outputs a detection result indicating the presence of the detection object Ob1 and a three-dimensional position including the distance to the detection object Ob1 to the automatic driving processing unit 72. The automatic driving processing unit 72 that receives the detection result controls the traveling unit 11 to perform a process of continuing the travel of the sprayer 1 while avoiding the detection object Ob1. Here, if the detection object Ob1 is not on the target route R10 of the sprayer 1, the sprayer 1 may continue to travel on the target route R10.
[0159] In this embodiment, the three-dimensional mode is selected when the vehicle 10 is traveling in the non-working area F12, so in a state where there is sufficient spatial margin to avoid the detection object Ob1, the sprayer 1 is not stopped, but continues traveling while avoiding the detection object Ob1. That is, according to the above configuration, when the detection object Ob1 is detected, it is possible to continue traveling while avoiding contact between the detection object Ob1 and the vehicle 10. However, if there is not enough spatial margin to avoid the detection object Ob1, the automatic traveling processing unit 72 may stop the sprayer 1 by prohibiting the traveling operation of the traveling unit 11 (making the traveling operation impossible), as in the two-dimensional mode.
[0160] Furthermore, when a detection object Ob1 is present, it is preferable that the automatic driving processing unit 72 controls the driving unit 11 to reduce the driving speed of the sprayer 1. If there is not enough spatial margin to avoid the detection object Ob1, the automatic driving processing unit 72 may stop the sprayer 1. Alternatively, after stopping the sprayer 1, the automatic driving processing unit 72 may determine whether there is enough spatial margin to avoid the detection object Ob1, and if there is, may resume driving of the sprayer 1 and drive it along the avoidance route.
[0161] FIG. 16 is a flowchart showing an example of processing mainly related to the switching processing in the control method according to this embodiment.
[0162] That is, during automatic travel of the sprayer 1, which is a work vehicle, the switching processing unit 75 determines whether or not the sprayer 1 is traveling on the work path R1 based on the current position of the sprayer 1 and the target path R10 (S1). If the sprayer 1 is traveling on the work path R1 (S1: Yes), the switching processing unit 75 selects the two-dimensional mode as the detection processing mode in accordance with the switching conditions (S2). Then, the detection processing unit 74 detects the detection target Ob1 based on the images G1, G2 captured by the first imaging unit 621 and the second imaging unit 622 by the detection processing in the two-dimensional mode (S3).
[0163] At this time, if the detection object Ob1 is present (S3: Yes), the detection processing unit 74 outputs the detection result to the automatic driving processing unit 72. The automatic driving processing unit 72, which has received this detection result, performs processing to stop the sprayer 1 (S4). If the detection object Ob1 is not present (S3: No), the detection processing unit 74 transitions the processing to step S1.
[0164] On the other hand, if the sprayer 1 is traveling along the travel route R2 (S1: No), the switching processing unit 75 selects the three-dimensional mode as the detection processing mode in accordance with the switching condition (S5). Then, the detection processing unit 74 detects the detection target Ob1 based on the images G1 and G2 captured by the first imaging unit 621 and the second imaging unit 622 by the detection processing in the three-dimensional mode (S6).
[0165] At this time, if the detection object Ob1 is present (S6: Yes), the detection processing unit 74 outputs the detection result to the automatic driving processing unit 72. The automatic driving processing unit 72, which has received this detection result, performs processing to continue driving the sprayer 1 while avoiding the detection object Ob1 (S7). If the detection object Ob1 is not present (S6: No), the detection processing unit 74 transitions the processing to step S1.
[0166] During automatic travel of the spreader 1, which is a work vehicle, the processes of steps S1 to S7 are repeatedly executed. However, the flowchart shown in Fig. 16 is merely an example, and processes may be added or omitted as appropriate, and the order of processes may be changed as appropriate.
[0167] [4] Variations Below, we will list some modified examples of the embodiment 1. The modified examples explained below can be applied in appropriate combinations.
[0168] The control device 7 in the present disclosure includes a computer system. The computer system mainly comprises one or more processors and one or more memories as hardware. The processor executes a program recorded in the memory of the computer system to realize the function of the control device 7 in the present disclosure. The program may be pre-recorded in the memory of the computer system, may be provided through a telecommunication line, or may be recorded and provided in a non-transitory recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by the computer system. In addition, some or all of the functional units included in the control device 7 may be configured with electronic circuits.
[0169] Furthermore, it is not essential for the control device 7 that at least some of the functions of the control device 7 are concentrated in one housing, and the components of the control device 7 may be distributed across multiple housings. Conversely, in the control device 7, functions that are distributed across multiple devices (e.g., the control device 7 and the first operation terminal 210) may be concentrated in one housing. Furthermore, at least some of the functions of the control device 7 may be realized by the cloud (cloud computing) or the like.
[0170] The sprayer 1 may be used not only in orchards such as vineyards or apple orchards, but also in other fields F1 or in work areas other than the field F1. Furthermore, the material sprayed by the sprayer 1 is not limited to chemical solutions, but may be, for example, water, fertilizer, disinfectant or other liquids, or powders. Similarly, the object to which the material is sprayed is not limited to grape trees, but may be other crops or objects other than crops (including inorganic substances). Furthermore, the sprayer 1 is not limited to unmanned vehicles that operate by automatic operation, but may be configured to operate by operation (including remote operation) by a person (operator), for example, a riding type (manned vehicle) on which an operator can ride. Even in this case, an antenna 21 or the like is provided on the sprayer 1 in order to grasp the current position of the sprayer 1.
[0171] Furthermore, the support frame 3 only needs to be attached to one end of the machine body 10 in the front-rear direction D3, and may be attached to the front of the machine body 10. In this case, the working unit (spraying nozzle 41) supported by the support frame 3 is also disposed in the front of the machine body 10, not in the rear.
[0172] The spreader 1 may also be provided with a pair of spraying devices 4 aligned in the front-rear direction D3. This allows the spreader 1 to perform work (spraying work) in each of the pair of spraying devices 4 (working devices) aligned in the front-rear direction D3, improving work efficiency compared to when work is performed using only one of the spraying devices 4. The spreader 1 may also be provided with a rotation drive device that generates a rotational force that rotates the support frame 3 relative to the machine body 10 about the rotation axis Ax1.
[0173] Furthermore, the machine body 10 only needs to have the first block 10L and the second block 10R arranged side by side in the left-right direction D2, and the first block 10L and the second block 10R may be reversed left-right. That is, the first block 10L in which the power source 63 and the like are provided may be located on the right side, and the second block 10R in which the user interface 61 and the like are provided may be located on the left side.
[0174] In addition, the traveling unit 11 is not limited to a crawler type traveling device, and may be configured to have one or more wheels and travel by rotating the wheels, for example. In addition, the traveling unit 11 is not limited to a configuration driven by a hydraulic motor, and may be configured to be driven by an electric motor, for example.
[0175] Furthermore, the sprayer 1 is not limited to an air-assisted type sprayer as in the first embodiment, but may be, for example, an electrostatic sprayer, or a combination of an air-assisted type and an electrostatic sprayer, etc. If the sprayer 1 is an electrostatic sprayer, the airflow generating unit 5 can be omitted.
[0176] Furthermore, the power source 63 is not limited to an engine, and may have, for example, a motor (electric motor), or may be a hybrid power source including an engine and a motor.
[0177] Furthermore, the sprayer 1 may be configured such that the machine body 10 does not have a gate-shaped configuration, and the entire machine body 10 travels between a pair of adjacent crop rows Vr1 (work passage). In this case, the sprayer 1 travels through each work passage without straddling the crop rows Vr1. In this case, the spraying device 4 performs spraying work by switching between a spraying pattern in which the chemical solution is sprayed in both the left and right directions D2, a spraying pattern in which the chemical solution is sprayed only to the left, and a spraying pattern in which the chemical solution is sprayed only to the right.
[0178] Furthermore, in the first embodiment, the sprayer 1 has been described as an example of a work vehicle, but the work vehicle is not limited to the sprayer 1.
[0179] Furthermore, the detection object Ob1 may include, in addition to or instead of a "person", a moving object such as a vehicle (including other work vehicles), a structure such as a wall or a pillar, a plant, an animal, a step, a groove, or other obstacles. Alternatively, the detection object Ob1 may be something other than an obstacle, such as a supply point for fuel or chemicals.
[0180] Furthermore, the detection processing unit 74 may perform the detection process of the detection object Ob1 not only during automatic driving of the sprayer 1, but also during manual driving (manual operation). Even in this case, the automatic driving processing unit 72 controls the work vehicle (sprayer 1) when the detection object Ob1 is present, that is, performs the restraint process.
[0181] The detection process mode switched by the switching processor 75 is not limited to the two-dimensional mode and the three-dimensional mode, and may include other modes. Furthermore, the detection processor 74 may execute a plurality of detection processes in parallel, for example, a detection process in the two-dimensional mode and a detection process in the three-dimensional mode in parallel.
[0182] Furthermore, it is not essential that the switching processing unit 75 sets the condition related to the current position of the sprayer 1 as the switching condition. For example, the switching processing unit 75 may determine the switching condition by an operator inputting whether or not an object (such as a crop row Vr1) exists between the first imaging unit 621 and the second imaging unit 622 in the width direction (left-right direction D2), or by detecting the presence of an object from the images G1, G2 captured by the first imaging unit 621 and the second imaging unit 622.
[0183] The switching condition may also include, for example, the growth rate of the crop V1 in the crop row Vr1 as a condition related to an object present between the pair of imaging units (the first imaging unit 621 and the second imaging unit 622) in the width direction (the left-right direction D2). That is, when the crop V1 is in a seedling state or the like and is so short that it cannot become an obstruction, even if the crop row Vr1 is present between the first imaging unit 621 and the second imaging unit 622, the switching processing unit 75 may determine that the switching condition is not satisfied and switch the mode of the detection process to the three-dimensional mode.
[0184] Furthermore, the timing for switching the detection processing mode from the two-dimensional mode to the three-dimensional mode is not limited to the time when the sprayer 1 moves from working path R1 to moving path R2, but may be, for example, just before that, that is, when the sprayer 1 reaches a position a predetermined distance before the end of working path R1. Similarly, the timing for switching the detection processing mode from the three-dimensional mode to the two-dimensional mode is not limited to the time when the sprayer 1 moves from moving path R2 to working path R1, but may be, for example, just before that, that is, when the sprayer 1 reaches a position a predetermined distance before the end of moving path R2.
[0185] [Appendix to the invention] The following will provide an overview of the invention extracted from the above-described embodiment. Note that the configurations and processing functions described in the following supplementary notes can be selected and combined as desired.
[0186] <Appendix 1> A control method for a work vehicle that performs work while moving through a field in which a plurality of rows of work objects each consisting of a plurality of work objects are arranged, comprising the steps of: Acquiring images captured by a plurality of imaging units mounted on a body of the work vehicle and spaced apart from each other in a width direction perpendicular to a traveling direction of the work vehicle in a plan view; Detecting a detection target based on images captured by the plurality of imaging units; Switching the mode of the detection process of the detection object according to a switching condition, A method for controlling a work vehicle.
[0187] <Appendix 2> A pair of imaging units among the plurality of imaging units are positioned on both sides of the work target row in the width direction while the work vehicle is performing work. 2. A method for controlling a work vehicle as described in claim 1.
[0188] <Appendix 3> the switching condition includes a condition regarding an object present between a pair of imaging units among the plurality of imaging units in the width direction. 3. A method for controlling a work vehicle according to claim 1 or 2.
[0189] <Appendix 4> The switching condition includes a condition related to a current position of the work vehicle. A control method for a work vehicle according to any one of claims 1 to 3.
[0190] <Appendix 5> The detection process includes a two-dimensional mode in which the detection object is detected using a two-dimensional image not including distance information captured by each of the plurality of imaging units, and a three-dimensional mode in which the detection object is detected using a three-dimensional image including distance information generated from images captured by the plurality of imaging units. A method for controlling a work vehicle according to any one of claims 1 to 4.
[0191] <Appendix 6> A pair of the imaging units among the plurality of imaging units has an overlapping imaging range in which the imaging ranges of the imaging units overlap each other, When the work vehicle is in a position where the work object is blocked between at least one of the pair of imaging units and the overlapping imaging range, the detection processing mode becomes a two-dimensional mode in which the detection object is detected using a two-dimensional image not including distance information captured by each of the pair of imaging units, according to the switching condition. A method for controlling a work vehicle according to any one of claims 1 to 4.
[0192] <Appendix 7> For any of the pair of imaging units, if the work vehicle is not in a position where the work object is blocked between the overlapping imaging range and the pair of imaging units, the switching condition causes the detection processing mode to become a three-dimensional mode in which the detection object is detected using a three-dimensional image including distance information generated from images captured by the pair of imaging units. 7. A method for controlling a work vehicle as described in appendix 6.
[0193] <Appendix 8> The method further includes changing control of the work vehicle when the detection object is present according to a state of the detection process. A method for controlling a work vehicle according to any one of appendixes 5 to 7.
[0194] <Appendix 9> If the mode of the detection process is the two-dimensional mode, the work vehicle is stopped when the detection object is present. 9. A method for controlling a work vehicle as described in appendix 8.
[0195] <Appendix 10> If the mode of the detection process is the three-dimensional mode, when the detected object exists, the work vehicle is caused to travel along an avoidance path that avoids contact with the detected object. 10. A method for controlling a work vehicle according to claim 8 or 9.
[0196] <Appendix 11> A method for controlling a work vehicle according to any one of appendices 1 to 10, A work vehicle control program for execution by one or more processors. [Explanation of symbols]
[0197] 1 Sprayer (work vehicle) 10 Aircraft 71 Acquisition processing unit 74 Detection processing section 75 Switching Processing Section 100 Control system for work vehicle 621 First imaging unit (imaging unit) 622 Second imaging unit (imaging unit) D2 Left / right direction (width direction) F1 field G1, G2 images (2D images) G3 3D Image Ob1 Detected object V1 Crops (working objects) Vr1 Crop row (row to be worked on)
Claims
1. A control method for a work vehicle that performs work while moving through a field in which a plurality of rows of work objects each consisting of a plurality of work objects are arranged, comprising the steps of: Acquiring images captured by a plurality of imaging units mounted on a body of the work vehicle and spaced apart from each other in a width direction perpendicular to a traveling direction of the work vehicle in a plan view; Detecting a detection target based on images captured by the plurality of imaging units; Switching the mode of the detection process of the detection object according to a switching condition, A method for controlling a work vehicle.
2. A pair of imaging units among the plurality of imaging units are positioned on both sides of the work target row in the width direction while the work vehicle is performing work. A method for controlling a work vehicle according to claim 1.
3. the switching condition includes a condition regarding an object present between a pair of imaging units among the plurality of imaging units in the width direction. A method for controlling a work vehicle according to claim 1 or 2.
4. The switching condition includes a condition related to a current position of the work vehicle. A method for controlling a work vehicle according to claim 1 or 2.
5. The detection process includes a two-dimensional mode in which the detection object is detected using a two-dimensional image not including distance information captured by each of the plurality of imaging units, and a three-dimensional mode in which the detection object is detected using a three-dimensional image including distance information generated from images captured by the plurality of imaging units. A method for controlling a work vehicle according to claim 1 or 2.
6. A pair of the imaging units among the plurality of imaging units has an overlapping imaging range in which the imaging ranges of the imaging units overlap each other, When the work vehicle is in a position where the work object is blocked between at least one of the pair of imaging units and the overlapping imaging range, the detection processing mode becomes a two-dimensional mode in which the detection object is detected using a two-dimensional image not including distance information captured by each of the pair of imaging units, according to the switching condition. A method for controlling a work vehicle according to claim 1 or 2.
7. For any of the pair of imaging units, if the work vehicle is not in a position where the work object is blocked between the overlapping imaging range and the pair of imaging units, the switching condition causes the detection processing mode to become a three-dimensional mode in which the detection object is detected using a three-dimensional image including distance information generated from images captured by the pair of imaging units. A method for controlling a work vehicle according to claim 6.
8. The method further includes changing control of the work vehicle when the detection object is present according to a state of the detection process. A method for controlling a work vehicle according to claim 5.
9. If the mode of the detection process is the two-dimensional mode, the work vehicle is stopped when the detection object is present. A method for controlling a work vehicle according to claim 8.
10. If the mode of the detection process is the three-dimensional mode, when the detected object exists, the work vehicle is caused to travel along an avoidance path that avoids contact with the detected object. A method for controlling a work vehicle according to claim 8.
11. A method for controlling a work vehicle according to claim 1 or 2, A work vehicle control program for execution by one or more processors.
12. The present invention is used in a work vehicle that performs work while moving through a field in which a plurality of rows of work objects each consisting of a plurality of work objects are arranged, an acquisition processing unit that is mounted on a body of the work vehicle and acquires images captured by a plurality of imaging units that are spaced apart in a width direction perpendicular to the traveling direction of the work vehicle in a plan view; A detection processing unit that detects a detection target based on images captured by the plurality of imaging units; A switching processing unit that switches the mode of the detection process of the detection object according to a switching condition. Control system for work vehicles.
13. A work vehicle control system according to claim 12; The airframe, Work vehicle.
Citation Information
Patent Citations
Route determination method, route determination system, and route determination program
JP2022183962A
Cited By
Aerial display and guidance system
JP7871938B1
