Grass trimmer

The lawn mower uses satellite and sensor units to maintain accurate self-positioning by identifying vegetation coverage and switching to sensor-based estimation under GPS interference, ensuring consistent accuracy.

JP7601024B2Active Publication Date: 2024-12-17TOYOTA JIDOSHA KK
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2022021600
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-02-15
Publication Date
2024-12-17
Estimated Expiration
2042-02-15

AI Technical Summary

Technical Problem

Existing lawn mowers using GPS for self-position estimation face accuracy issues when traveling under tree cover, leading to decreased positioning accuracy.

Method used

The lawn mower employs a combination of satellite positioning and sensor units, including a detection unit that uses RGB image data and ortho image data with point cloud data to identify vegetation coverage, switching to sensor-based positioning when GPS accuracy is compromised.

Benefits of technology

This approach maintains accurate self-position estimation by utilizing sensor data to supplement GPS in vegetation-covered areas, thereby preventing a decrease in positioning accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007601024000001
    Figure 0007601024000001
  • Figure 0007601024000002
    Figure 0007601024000002
  • Figure 0007601024000003
    Figure 0007601024000003
Patent Text Reader

Abstract

To provide a grass mower capable of suppressing deterioration in accuracy of self-position estimation in executing automated traveling.SOLUTION: A grass mower 10 includes: a grass mower body having a cutting blade part for mowing grass; a first position estimation part for estimating a self-position of the grass mower body using a satellite positioning system; a second position estimation part for estimating a self-position of the grass mower body using a sensor part provided in the grass mower body; a detection part for detecting a portion covered with vegetation in a preset traveling passage; and an automated traveling control part for referring to the self-position estimated by the first position estimation part and causing the grass mower body to travel on the traveling passage, and for executing switching so as to refer to the self-position estimated by the second position estimation part, and causing the grass mower body to travel in the portion 66 (66A and 66B) covered with vegetation detected by the detection part.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a grass cutter. [Background technology]

[0002] Patent Document 1 discloses that for an autonomous lawnmower, a survey is carried out in advance within a target work area using a GPS (Global Positioning System, Global Positioning Satellite) while the lawnmower is manually operated, and a route for the lawnmower is generated based on this survey data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 9-128045 Summary of the Invention [Problem to be solved by the invention]

[0004] In the lawnmower described in Patent Document 1, when the lawnmower travels autonomously to mow the lawn, if the travel path is covered by trees or other objects, the accuracy of self-location estimation may be reduced when using GPS for measurement.

[0005] In consideration of the above, an object of the present invention is to provide a grass cutter that can suppress a decrease in the accuracy of self-position estimation when autonomously traveling. [Means for solving the problem]

[0006] The grass cutter according to the present invention described in claim 1 includes a grass cutter body having a cutting blade for cutting grass, a first position estimation unit that estimates the self-position of the grass cutter body by using a satellite positioning system, a second position estimation unit that estimates the self-position of the grass cutter body by using a sensor unit provided in the grass cutter body, and a predetermined travel path. Before mowing beginsa detection unit that detects an area covered with vegetation; and an automatic travel control unit that causes the grass cutter body to travel on the travel path by referring to the self-position estimated by the first position estimation unit, and switches to referring to the self-position estimated by the second position estimation unit in the area covered with vegetation detected by the detection unit, and causes the grass cutter body to travel. The detection unit acquires RGB image data having color information and ortho-image data that corresponds to the photographed area of ​​the RGB image data and includes point cloud data, identifies the vegetation based on the color information in the RGB image data, and identifies the height of the vegetation based on height information of the point cloud data in the ortho-image data, thereby detecting the area covered with vegetation. .

[0007] In the grass cutter according to the present invention as set forth in claim 1, the grass cutter body is provided with a cutting blade unit for cutting grass, and the grass can be cut by this cutting blade unit. Also, the grass cutter according to the present invention as set forth in claim 1 includes a first position estimation unit that estimates the self-position of the grass cutter body using a satellite positioning system, and a second position estimation unit that estimates the self-position of the grass cutter body using a sensor unit provided in the grass cutter body, and therefore the self-position can be estimated by the first position estimation unit and the second position estimation unit. Also, the grass cutter according to the present invention as set forth in claim 1 includes a detection unit that detects areas covered with vegetation on a preset travel path, and therefore the detection unit can detect areas covered with vegetation.

[0008] In the grass cutter according to the present invention described in claim 1, the automatic driving control unit drives the grass cutter body on the roadway by referring to the self-position estimated by the first position estimation unit, and in an area covered with vegetation detected by the detection unit, switches to refer to the self-position estimated by the second position estimation unit and drives the grass cutter body. Therefore, in an area where it is considered difficult to estimate the self-position using a satellite positioning system, the sensor unit can be used to estimate the self-position instead of the satellite positioning system, and a decrease in the accuracy of the self-position estimation can be suppressed.

[0010] Claim 1 According to the grass cutter of the present invention described above, the position of the vegetation can be identified using RGB image data, and the height of the vegetation can be identified using ortho-image data, so that the height of the vegetation on the travel path can be identified based on the ortho-image data and the RGB image data.

[0011] Claim 2 The grass cutter according to the present invention described in a first position estimation unit that estimates a self-position of the mower body using a satellite positioning system; a second position estimation unit that estimates a self-position of the mower body using a sensor unit provided in the mower body; a detection unit that detects a location on a preset travel path that is covered with vegetation before mowing begins; and an automatic driving control unit that causes the mower body to travel on the travel path by referring to the self-position estimated by the first position estimation unit, and switches to referring to the self-position estimated by the second position estimation unit in the location covered with vegetation detected by the detection unit, The detection unit detects an image including the road, First image data acquired in a first period that is a mowing season, and a period when there are fewer vegetation than the mowing season The vegetated areas are detected by comparing the first image data with second image data acquired at a second time period different from the first time period.

[0012] Claim Section 2 The grass cutter according to the present invention In the present invention, a cutting blade unit for cutting grass is provided on the mower body, and the grass can be cut by the cutting blade unit. The mower according to the present invention described in claim 2 includes a first position estimation unit that estimates the self-position of the mower body using a satellite positioning system, and a second position estimation unit that estimates the self-position of the mower body using a sensor unit provided on the mower body, and therefore the self-position can be estimated by the first position estimation unit and the second position estimation unit. The mower according to the present invention described in claim 2 includes a detection unit that detects areas covered with vegetation on a preset travel path, and therefore the detection unit can detect areas covered with vegetation. In addition, in the grass cutter according to the present invention described in claim 2, the automatic driving control unit drives the grass cutter body on the road by referring to the self-position estimated by the first position estimation unit, and in a place covered with vegetation detected by the detection unit, switches to referring to the self-position estimated by the second position estimation unit and drives the grass cutter body. Therefore, in a place where it is considered difficult to estimate the self-position using a satellite positioning system, the sensor unit can be used to estimate the self-position instead of the satellite positioning system, and the accuracy of the self-position estimation can be reduced. The lower part can be suppressed. The grass cutter according to the present invention as set forth in claim 2. According to the method, the detection unit detects vegetation-covered areas by comparing the first image data and the second image data acquired at different times, and therefore, vegetation-covered areas on the road can be identified based on the first data and the second data. In addition, according to the grass cutter of the present invention described in claim 2, an image of a specific location on the travel path that is covered with vegetation and an image that is less covered with vegetation than the image can be obtained, so that the locations that are covered with vegetation can be easily identified by comparing the images.

[0015] Claim 3 The grass cutter according to the present invention described in claim 1 Or claim 2 In the configuration described in the above, the sensor unit is composed of one or more sensors selected from a plurality of sensors including a distance measurement sensor, a camera, a gyro sensor, a magnetic sensor, an acceleration sensor, and a radar sensor.

[0016] Claim 3 According to the mower of the present invention described above, information on the position of the mower body can be obtained by one or more of a plurality of sensors including a distance sensor, a camera, a gyro sensor, a magnetic sensor, an acceleration sensor, and a radar sensor. This makes it possible to estimate the self-position of the mower body from the information on the position of the mower body. Effect of the Invention

[0017] As described above, the grass mower according to the present invention has the excellent effect of being able to suppress a decrease in the accuracy of self-position estimation when autonomously traveling. [Brief description of the drawings]

[0018] [Figure 1] 1 is a perspective view illustrating a schematic configuration of a grass cutter according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a perspective view of the grass cutter of FIG. 1 as seen from below. [Diagram 3] FIG. 2 is a perspective view for explaining a schematic configuration of a cutting blade unit of the grass cutter of FIG. 1. [Figure 4] 1 is a block diagram showing a hardware configuration of a grass cutter according to an embodiment of the present invention. [Diagram 5] 1 is a block diagram showing a functional configuration of a grass cutter according to an embodiment of the present invention. [Figure 6] FIG. 2 is a plan view showing a schematic view of the entire hydroponic land area including the running paths during the grass-cutting season. [Figure 7] FIG. 2 is a side view showing a schematic view of a travel path during a grass cutting season. [Figure 8] 4 is a flowchart showing a series of processes of a grass cutter according to an embodiment of the present invention. [Figure 9] FIG. 2 is a side view showing a schematic view of a road in winter. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] A grass mower 10 according to an embodiment of the present invention will be described with reference to the drawings. In each drawing, the arrow UP indicates the upper side in the vertical direction of the vehicle, and the arrow FR indicates the front side in the longitudinal direction of the vehicle. The arrow LH indicates the left side in the width direction of the vehicle, and the arrow RH indicates the right side in the width direction of the vehicle. In the following description, the vertical direction and the longitudinal direction respectively refer to the up and down direction in the vertical direction of the vehicle and the front and rear direction in the longitudinal direction of the vehicle, and the left and right direction respectively refer to the left and right direction in the width direction of the vehicle.

[0020] (Configuration of the grass cutter 10) The grass cutter 10 according to the first embodiment is a self-propelled grass cutter, and as an example, cuts grass on rice field ridges, farm fields, etc. As an example, as shown in Fig. 1, the grass cutter 10 as the grass cutter main body includes a main body section 12, a crawler section 14 as a drive section, a motor controller 16, a battery device 18, a control device 20, a drive motor 22, a camera section 24, a GPS device 26, a sensor section 27, an exterior cover section 28, and a cutting blade section 30.

[0021] 1 and 2, the main body 12 is formed of a substantially rectangular plate material, and various devices are placed on the upper surface. The main body 12 is also provided with an undercover 12A that covers the inside of the four crawler units 14 in the vehicle width direction, which will be described later. The undercover 12A is formed of a plate material, and extends downward in a substantially rectangular shape from both ends of the main body 12 in the vehicle width direction at positions corresponding to the four crawler units 14. In this embodiment, the main body 12 and the undercover 12A are formed integrally as an example, but they may be formed separately.

[0022] Furthermore, the main body 12 is provided with a blade cover 13 between two under-covers 12A provided on the left and right sides, respectively, for covering a cutting blade 36 of the cutting blade unit 30, which will be described later. The blade cover 13 is formed of a plate material, and both ends in the front-rear direction of the vehicle are respectively connected to the under-covers 12A of the two crawler units 14. The main body 12, the under-cover 12A, and the blade cover 13 are made of, for example, a metal material such as steel or aluminum, a fiber-reinforced plastic material, or the like.

[0023] The blade cover 13 includes a central portion 13A, two oblique portions 13B, and an upper portion 13C. The central portion 13A is formed in a rectangular shape and protrudes outward in the vehicle width direction from the undercover 12A. The two oblique portions 13B are provided at both ends of the central portion 13A in the vehicle front-rear direction, and extend obliquely from both ends of the central portion 13A in the vehicle front-rear direction toward the undercover 12A. The upper portion 13C is formed in a substantially trapezoidal shape, and four sides are connected to the main body portion 12, the central portion 13A, and the two oblique portions 13B, respectively. In the present embodiment, the blade cover 13 is formed as a separate body portion 12, and the undercover 12A, as an example, but may be formed integrally. The blade cover 13 prevents foreign objects from being inserted into the blade 36 from the sides, i.e., the left and right sides, of the grass cutter 10, and also prevents cut grass from scattering over the sides of the grass cutter 10.

[0024] The crawler units 14 are provided on both the left and right sides in the front-rear direction, and the grass mower 10 of this embodiment has four crawler units 14. Each crawler unit 14 has a rotating unit 14A and a crawler 14B. The rotating unit 14A is formed of a columnar body in the shape of a substantially right-angled triangle, and rotates around an axis along the vehicle width direction. The crawler 14B is a rubber member that covers the outer circumferential surface of the rotating unit 14A around the axis, and is formed in a belt shape. The outer surface of the crawler 14B is formed with unevenness (not shown), and is configured to maintain travelability even when the state of the traveling surface on which the vehicle travels is unstable. The shaft (not shown) of the rotating unit 14A is connected to the motor shaft (not shown) of the driving motor 22, and is rotated by the driving motor 22. Note that in this embodiment, the two front and rear crawler units 14 on the left side in the vehicle width direction may be referred to as the left crawler unit 14L, and the two front and rear crawler units 14 on the right side in the vehicle width direction may be referred to as the right crawler unit 14R.

[0025] The motor controller 16 drives and controls the drive motor 22 and a blade motor 32, which will be described later. The grass cutter 10 of this embodiment is equipped with four drive motors 22 and two blade motors 32, as will be described later. Therefore, as an example, the grass cutter 10 of this embodiment is equipped with a total of six motor controllers 16A to 16F, including four motor controllers 16A to 16D that drive and control the four drive motors 22, respectively, and two motor controllers 16E, 16F that drive and control the two blade motors 32, respectively.

[0026] Motor controllers 16A-16D that drive and control drive motor 22 are electrically connected to drive motor 22 and control device 20 (see FIG. 4), and motor controllers 16A-16D control the drive of rotating unit 14A, i.e., crawler unit 14, connected to drive motor 22. Motor controllers 16E, 16F that drive and control blade motor 32 are electrically connected to blade motor 32 and control device 20 (see FIG. 4), and motor controllers 16E, 16F drive and control blade 36, described below, connected to blade motor 32.

[0027] The battery device 18 is a device that serves as a drive source for the drive motor 22, and is, for example, configured as a rechargeable DC power source with a rated voltage of 18 V and a rated capacity of 6.0 Ah. The battery device 18 is configured to include a secondary battery such as a lithium-ion secondary battery or a nickel-metal hydride battery, and a capacitor such as an electric double layer capacitor can also be used. In the grass cutter 10 of this embodiment, four battery devices 18 are provided, for example. The four battery devices 18 supply power to electronic devices mounted on the grass cutter 10, such as the drive motor 22 and the blade motor 32.

[0028] The control device 20 is a device that controls the overall driving of the grass cutter 10, and is disposed on the upper side inside the exterior cover portion 28. The control device 20 will be described in detail later.

[0029] The grass cutter 10 of this embodiment is provided with four drive motors 22, which are configured by DC brushless motors, for example. The four drive motors 22 are connected to the four crawler units 14, respectively, and are each driven by commands from the motor controllers 16A to 16D.

[0030] The camera units 24 are cameras capable of photographing the surroundings of the grass cutter 10, and are provided on the front and rear sides of the upper outer surface of the exterior cover unit 28 in the grass cutter 10 of this embodiment. The camera units 24 provided on the front and rear sides each include a 3D (three-dimensional) camera 24A and a Raspberry Pi camera 24B.

[0031] The GPS device 26 is equipped with an antenna (not shown) that receives radio signals from a GPS satellite (not shown), and is capable of measuring the current position of the grass cutter 10. The GPS device 26 is provided on the upper side of the control device 20, and is fixed to the exterior cover portion 28. The GPS satellites and the GPS device 26 form a satellite positioning system.

[0032] The sensor unit 27 has a three-axis acceleration sensor and outputs gravitational acceleration in the left-right direction (horizontal direction: x direction), front-back direction (horizontal direction: y direction), and up-down direction (vertical direction: z direction) of the grass cutter 10. The sensor unit 27 also has a gyro sensor and detects the rotation, i.e., angular velocity, of the grass cutter 10.

[0033] The exterior cover portion 28 is formed in a box shape with an open bottom, and is a housing that covers the main body portion 12 from above.

[0034] The cutting blade 30 has a structure for cutting grass. Specifically, as shown in Fig. 3, the cutting blade 30 has a rectangular plate-shaped base 31 disposed on the upper surface of the main body 12. This base 31 has a height adjustment structure (not shown) that can adjust the height in the vertical direction relative to the main body 12. This height adjustment structure may be, for example, a manual type or an automatic type, and a known structure can be used.

[0035] A blade motor 32 is mounted at a predetermined interval in the left-right direction on the upper surface of the base 31. In this embodiment, the blade motor 32 is, for example, a DC brushless motor.

[0036] The two blade motors 32 each include a motor shaft 34 that passes through an insertion hole (not shown) in the base 31. A blade 36 is rotatably fixed to the lower end of each of the two motor shafts 34.

[0037] The cutting blade 36 is formed in a disk shape and includes a disk portion 37 rotatably fixed to the motor shaft 34, and four rectangular cutting edges 38 fixed so as to protrude outward in all directions from the outer periphery of the disk portion 37. The left and right cutting blades 36 are disposed with a slight difference in position in the up-down direction (height direction) so that the cutting edges 38 do not interfere with each other. The cutting blades 36 are rotated by the cutting blade motor 32 to cut grass.

[0038] In this embodiment, the height of the base 31 is adjusted in the vertical direction by the above-mentioned height adjustment structure, and this adjustment also allows the height position of the cutting blade 36 to be adjusted. In this embodiment, as one example, the height is adjusted so that the cutting edge 38 is located at a height of 50 mm from the ground. Note that, as one example, the cutting edge 38 can be adjusted to multiple heights, such as 80 mm or 100 mm in addition to the height of 50 mm from the ground. This makes it possible to mow grass at multiple heights.

[0039] Furthermore, in this embodiment, the control device 20 controls the travel of the grass cutter 10 based on data acquired by the camera unit 24, the GPS device 26, and the sensor unit 27, as well as a pre-set travel path stored in the storage 20D described later.

[0040] (Hardware configuration of the grass cutter 10) Next, the control device 20 will be described in detail. As shown in Fig. 4, the control device 20 mounted on the grass cutter 10 includes a CPU (Central Processing Unit) 20A, which is an example of a processor, a ROM (Read Only Memory) 20B, a RAM (Random Access Memory) 20C, a storage 20D, a communication interface (communication I / F) 20E, and an input / output interface (input / output I / F) 20F. Each component is connected to be able to communicate with each other via a bus 20G.

[0041] The CPU 20A is a central processing unit that executes various programs and controls each part. That is, the CPU 20A reads a program from the ROM 20B or the storage 20D, and executes the program using the RAM 20C as a working area. The CPU 20A controls each of the above components and performs various arithmetic processing according to the program recorded in the ROM 20B or the storage 20D.

[0042] The ROM 20B stores various programs and various data. The RAM 20C temporarily stores programs or data as a working area. The storage 20D is configured with an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores various programs including an operating system and various data including map data. The storage 20D also stores preset driving routes. In this embodiment, the ROM 20B or the storage 20D stores programs for performing various functions, various data, and the like.

[0043] The communication I / F 20E is an interface for the grass cutter 10 to communicate with a server and other devices (not shown), and uses standards such as Ethernet (registered trademark), LTE, FDDI, and Wi-Fi (registered trademark), for example.

[0044] The input / output I / F 20F is an interface for the control device 20 to communicate with each device mounted on the grass cutter 10. The control device 20 is connected to each device described below via the input / output I / F 20F so as to be able to communicate with each other. Note that these devices may be directly connected to the bus 20G.

[0045] In detail, the motor controllers 16A to 16D, the motor controllers 16E and 16F, the camera unit 24, the GPS device 26, the sensor unit 27, and the like are connected to the input / output I / F 20F.

[0046] The motor controllers 16A to 16D output control signals to the drive motor 22 based on command signals input from the control device 20, and are capable of controlling the number of rotations, the rotation speed, the rotation direction, etc. of the drive motor 22. In this embodiment, the control device 20 and the motor controllers 16A to 16D independently control the number of rotations, the rotation speed, the rotation direction, etc. of the motor controllers 16A to 16D, thereby making it possible to change the traveling direction of the grass mower 10.

[0047] The motor controllers 16E, 16F output a control signal to the blade motor 32 based on a command signal input from the control device 20, and are capable of controlling the number of rotations, the rotation speed, the rotation direction, etc. of the blade motor 32. In this embodiment, the control device 20 and the motor controllers 16E, 16F independently control the number of rotations, the rotation speed, the rotation direction, etc. of the motor controllers 16E, 16F, thereby making it possible to change the grass mowing state of the grass cutter 10.

[0048] The camera unit 24 is a camera that photographs the surroundings of the grass cutter 10, and the photographed images of objects and the like in the surroundings of the grass cutter 10 are temporarily stored in the storage 20D.

[0049] The GPS device 26 functions as part of a satellite positioning system, temporarily stores position information indicating the measured self-position of the grass cutter 10 in the storage 20D, and updates the position information of the grass cutter 10 at predetermined time intervals.

[0050] The sensor unit 27 is a device that detects the gravitational acceleration of the grass cutter 10, and the gravitational acceleration in the left-right direction (x direction), the front-back direction (y direction), and the up-down direction (z direction) output by the sensor unit 27 is temporarily stored in the storage 20D. Note that the gravitational acceleration data stored in the storage 20D is data in a state where noise has been removed by applying a predetermined filter to the gravitational acceleration data output from the sensor unit 27.

[0051] Next, the functional configuration of the control device 20 will be described with reference to Fig. 5. The control device 20 functions as a collection of an automatic travel control unit 202, a blade control unit 204, a detection unit 206, a first position estimation unit 208, and a second position estimation unit 210 by the CPU 20A reading out an execution program stored in the ROM 20B and executing the program.

[0052] The automatic driving control unit 202 inputs a control signal to the motor controllers 16A-16D by referring to the driving path stored in the storage 20D, the map data, the images captured by the camera unit 24, and the own position of the grass cutter 10 estimated by a first position estimation unit 208 and a second position estimation unit 210 described later, and controls the drive motor 22 via the motor controllers 16A-16D so that the grass cutter 10 travels along the driving path. Note that a method of driving the grass cutter 10 by referring to the own position estimated by the first position estimation unit 208 and the second position estimation unit 210 will be described in detail later.

[0053] In addition, when an object approaching the grass cutter 10 is detected in the image captured by the camera unit 24, the drive control unit 202 is able to temporarily stop the grass cutter 10 by controlling the drive motor 22 via the motor controllers 16A-16D.

[0054] When the drive control unit 202 starts traveling of the grass cutter 10, the blade control unit 204 inputs the number of rotations, rotation speed, rotation direction, etc. of the blade motor 32 that are preset in the motor controllers 16E, 16F, and drives and controls the number of rotations, rotation speed, rotation direction, etc. of the blade motor 32 via the motor controllers 16E, 16F. In addition, when an object approaching the grass cutter 10 is detected in an image captured by the camera unit 24 or when the blade motor 32 is overloaded, the blade control unit 204 is able to temporarily halt the rotation of the blade 36 by controlling the blade motor 32 via the motor controllers 16E, 16F.

[0055] The detection unit 206 detects areas covered with vegetation on a travel path that is set in advance and stored in the storage 20D. In this embodiment, "vegetation" includes leaves growing on tree branches and grass itself. In the grass cutter 10 of this embodiment, the detection unit 206 identifies areas covered with vegetation based on RGB image data having color information, which is an image including a travel path that is set in advance and stored in the storage 20D, and orthoimage data that corresponds to the shooting area of ​​the RGB image data and includes point cloud data. A method for identifying areas covered with vegetation on the travel path by the detection unit 206 will be described in detail later.

[0056] The first position estimation unit 208 estimates the self-position of the grass cutter 10 using a satellite positioning system. Specifically, an antenna (not shown) of the GPS device 26 receives radio signals from GPS satellites in outer space and outputs them to the input / output I / F 20F. The first position estimation unit 208 acquires the radio signals output from the CPS device 26 via the input / output I / F 20F. The first position estimation unit 208 estimates the self-position based on these radio signals. Specifically, the first position estimation unit 208 estimates the distance based on the time difference between the transmission time and the reception time of the radio signal. Note that a method of estimating the self-position using the GPS device 26 can use a known technique, and therefore a detailed description thereof will be omitted here.

[0057] The second position estimation unit 210 estimates the self-position of the grass cutter 10 using the sensor unit 27. Specifically, detection data acquired by the sensor unit 27, i.e., the gyro sensor and the three-axis acceleration sensor, is output to the input / output I / F 20F. The second position estimation unit 210 acquires the detection data output from the gyro sensor and the three-axis acceleration sensor via the input / output I / F 20F. The second position estimation unit 210 estimates the self-position based on this detection data.

[0058] Specifically, the second position estimation unit 210 estimates the orientation, i.e., the moving direction, of the grass cutter 10 based on the angular velocity data output from the gyro sensor. Also, the second position estimation unit 210 estimates the moving distance based on the gravity acceleration data output from the three-axis acceleration sensor.

[0059] Here, a method for identifying locations on the roadway that are covered with vegetation by the detection unit 206 will be described. In this embodiment, the detection unit 206 acquires, as an example, RGB image data, which is an aerial image captured by flying a drone equipped with a camera, and which is a color image having color information, and orthoimage (orthogonally transformed image) data that accurately displays the position and size of the subject by analyzing the data of the aerial image. In this embodiment, the orthoimage data has point cloud data represented by orthogonal coordinates (x, y, z).

[0060] In this embodiment, as an example, a drone equipped with a camera is flown over the area shown in Fig. 6, and the area is photographed from each direction to obtain RGB image data (image data of the aerial image), which is a plurality of aerial images, and the data is stored in the storage 20D via the communication I / F 20E. Also, in this embodiment, as an example, the detection unit 206 converts the plurality of aerial images stored in the storage 20D into orthoimage data including point cloud data using a conversion tool such as Metashape (registered trademark). Note that the RGB image data and the orthoimage data converted from the RGB image data are associated with each other in terms of coordinate position information.

[0061] Fig. 6 is a plan view showing the entire hydroponic land 50 including the travel path 60 during the mowing season, and Fig. 7 is a side view showing the travel path 60 during the mowing season. In Fig. 6, a trajectory 60A showing the self-position estimated by the first position estimation unit 208 when the mower 10 travels on the travel path 60 is superimposed on an orthoimage P. As shown in Fig. 6, in the hydroponic land 50, a ridge W is provided at the boundary between each paddy field area 50A where water is stored, by piling up mud to prevent water from leaking out. This ridge W is a road on which a vehicle can travel, and as shown in Fig. 7, grass 70, grass 70A, trees 72, large grass 74, and the like grow other than agricultural crops.

[0062] The tree 72 has a trunk 72A extending upward from the ground, a plurality of branches 72B extending obliquely upward from the periphery of the trunk 72A, and leaves 72C extending from the branches 72B. The large grass 74 is taller than the grass 70 and the grass 70A. In the present embodiment, the grass cutter 10 cuts the grass 70 growing on the ridge W, for example, so a running path 60 along which the grass cutter 10 runs is set on the ridge W. The running path 60 is set in advance based on RGB image data taken in the winter season, when there is less vegetation than during the grass cutting season. The running path 60 may be set based on topographical information acquired, for example, by downloading from an external site.

[0063] 6, the boundaries of each paddy field area 50A are ridges W containing grass 70, grass 70A, leaves 72C of tree 72, and large grass 74, and thus the ridges W are mostly green. Therefore, the detection unit 206 identifies these green areas as areas that are likely to be covered with grass. In addition, the areas of branches 72B that do not have leaves 72C are brown, and therefore the detection unit 206 identifies these brown areas as areas that are likely to be covered with trees.

[0064] The detection unit 206 detects the height of the vegetation in the area of ​​the vegetation identified in the RGB image data as described above based on the orthoimage data. Specifically, the height of the vegetation is detected based on the height information of the point cloud data in the area of ​​the vegetation identified in the RGB image data. When the detected height exceeds a predetermined height, the detection unit 206 detects the area exceeding the predetermined height as an area covered with vegetation. Here, in this embodiment, the "predetermined height" is, for example, 1 m. The detection unit 206 acquires the area covered with vegetation as the vertical and horizontal coordinate positions in the orthoimage P.

[0065] 6, the mower 10 traveling on the travel path 60 has a trajectory 60A of its own position estimated by the first position estimation unit 208 using a satellite positioning system, which has a first own position 62 indicated by a black line and a second own position 64 indicated by a gray line. The first own position 62 is regarded as a self-position acquired with higher accuracy than the second own position 54.

[0066] As an example, it is assumed that the grass cutter 10 starts traveling from approximately the center of the orthoimage P shown in Fig. 6. In this case, as shown in Fig. 6, the first self-position 62 and the second self-position 64 do not exist between the first path 62A and the second path 62B of the first self-position 62 in the area indicated by the dashed-dotted frame A1, and the first path 66A of the third self-position 66 indicated by the white line exists. This first path 66A is set as an area in which the first position estimation unit 208 cannot estimate the self-position.

[0067] 7, the grass 70A and the grass 70B are covered above by leaves 72C of a tree 72 and large grass 74, respectively, so that radio signals from a GPS satellite in outer space do not reach the antenna (not shown) of the GPS device 26 of the grass mower 10. In this way, the point on the road 60 where radio signals cannot be received becomes the third self-position 66.

[0068] In this embodiment, the detection unit 206 detects the location corresponding to the third self-position 66 as a location covered with vegetation. Therefore, in this embodiment, the automatic driving control unit 202 estimates the self-position of the grass cutter 10 by the second position estimation unit 210 using the sensor unit 27, not the first position estimation unit 208, in the location covered with vegetation detected by the detection unit 206, i.e., the third self-position 66.

[0069] Specifically, when the grass mower 10 reaches a location covered with vegetation detected by the detection unit 206 from the first self-position 62, the automatic driving control unit 202 acquires the coordinate position of the self-position acquired by the first position estimation unit 208 at the first self-position 62 adjacent to the location covered with vegetation. The automatic driving control unit 202 causes the grass mower 10 to travel by referring to the self-position calculated by adding the travel distance estimated by the second position estimation unit 210, starting from this coordinate position.

[0070] Then, when the grass cutter 10 reaches the first self-position 62 from the area covered with vegetation detected by the detection unit 206, the automatic driving control unit 202 acquires the coordinate position of the self-position acquired by the first position estimation unit 208 at the first self-position 62 adjacent to the area covered with vegetation, and thereafter causes the grass cutter 10 to travel to the first self-position 62 by referring to the self-position estimated by the first position estimation unit 208.

[0071] 6, in this embodiment, the first self-position 62 and the second self-position 64 are not present in the area indicated by the dashed-dotted frame A2 between the first path 64A and the second path 64B of the second self-position 64 adjacent to the second path 62B of the first self-position 62, but the second path 66B of the third self-position 66 indicated by the white line is present. In the area indicated by the frame A2, the third path 64C of the second self-position 64 is present between the first path 64A and the second path 64B, slightly shifted from the first path 64A and the second path 64B.

[0072] This third path 64C occurs because the radio signal from a GPS satellite in outer space does not reach the antenna (not shown) of the GPS device 26 of the grass cutter 10 directly, but instead receives a signal that has bounced off a reflecting object such as a leaf 72C of a tree 72, resulting in a reception delay.

[0073] Therefore, in this embodiment, even in the second self-position 64 where the self-position is acquired with lower accuracy than the first self-position 62, the automatic driving control unit 202 drives the grass cutter 10 by referring to the self-position estimated by the second position estimation unit 210 rather than the first position estimation unit 208.

[0074] Specifically, the detection unit 206 detects in advance an area where the positioning accuracy decreases when the antenna (not shown) of the GPS device 26 receives a radio signal from a GPS satellite in outer space. Then, when traveling in the area detected by the detection unit 206, i.e., the area corresponding to the second self-position 64, the automatic traveling control unit 202 acquires the coordinate position of the self-position acquired by the first position estimation unit 208 in the first self-position 62 adjacent to this area, and causes the grass mower 10 to travel by referring to the self-position calculated by adding the travel distance estimated by the second position estimation unit 210 from this coordinate position as a starting point.

[0075] 6 as an example, the automatic driving control unit 202 causes the grass cutter 10 to travel on the travel paths 60 corresponding to the first path 62A, the second path 62B, the third path 62C, and the fourth path 62D of the first self-position 62, with reference to the self-position estimated by the first position estimation unit 208. The automatic driving control unit 202 also causes the grass cutter 10 to travel on the first path 64A, the second path 64B, and the fourth path 64D of the second self-position 64, and the first path 66A and the second path 66B of the third self-position 66, with reference to the self-position estimated by the second position estimation unit 210.

[0076] (Automatic driving control method) Hereinafter, a series of process steps of the automatic travel control method for the grass cutter 10 will be described with reference to the flowchart shown in Fig. 8. As shown in Fig. 8, in the grass cutter 10 according to the first embodiment, first, in step S10, the detection unit 206 detects areas covered with vegetation and areas where positioning accuracy has decreased on the preset travel path 60, as described above.

[0077] Next, in step S11, the automatic driving control unit 202 drives and controls the drive motor 22 to start the grass cutter 10 traveling, and the blade control unit 204 drives and controls the blade motor 32 to start grass cutting by the grass cutter 10.

[0078] Next, in step S12, the automatic driving control unit 202 judges whether or not the grass mower 10 is traveling through an area covered with vegetation or an area with reduced positioning accuracy detected by the detection unit 206. If the grass mower 10 is not traveling through an area covered with vegetation or an area with reduced positioning accuracy (step S12; NO), in step S13, the automatic driving control unit 202 causes the grass mower 10 to travel with reference to its own position estimated by the first position estimation unit 208 using the satellite positioning system.

[0079] On the other hand, in step S12, if the grass mower 10 is not traveling through an area covered with vegetation or an area where positioning accuracy is reduced (step S12; YES), in step S14, the automatic driving control unit 202 causes the grass mower 10 to travel by referring to the self-position estimated by the second position estimation unit 210 using the sensor unit 27.

[0080] Next, in step S15, the automatic traveling control unit 202 judges whether or not mowing has been completed. Specifically, the automatic traveling control unit 202 judges whether or not traveling on the predetermined travel path 60 has been completed. If mowing has not been completed (step S15; NO), the CPU 20A shifts the process to step S12 and causes the processes from step S12 onward to be performed. On the other hand, if mowing has been completed (step S15; YES), the automatic traveling control unit 202 stops and terminates the grass mower 10.

[0081] (Actions and Effects of the Embodiments) Next, the operation and effects of this embodiment will be described.

[0082] The grass cutter 10 according to this embodiment is provided with a cutting blade unit 30 for cutting grass, and the grass can be cut by the cutting blade unit 30. The grass cutter 10 is also provided with a first position estimation unit 208 that estimates the self-position of the grass cutter 10 using a satellite positioning system, and a second position estimation unit 210 that estimates the self-position of the grass cutter 10 using a sensor unit 27 provided in the grass cutter 10, and therefore the self-position can be estimated by the first position estimation unit 208 and the second position estimation unit 210. The grass cutter 10 is also provided with a detection unit 206 that detects areas covered with vegetation on the preset travel path 60, and therefore the detection unit 206 can detect areas covered with vegetation.

[0083] Furthermore, in particular, in the grass cutter 10, the automatic driving control unit 202 drives the grass cutter 10 on the driving path 60 by referring to the self-position estimated by the first position estimation unit 208, and in an area covered with vegetation detected by the detection unit, switches to refer to the self-position estimated by the second position estimation unit 210 and drives the grass cutter 10. Therefore, in an area where it is considered difficult to estimate the self-position using a satellite positioning system, the sensor unit 27 can be used to estimate the self-position, instead of the satellite positioning system, and a decrease in the accuracy of the self-position estimation can be suppressed.

[0084] Furthermore, according to the grass cutter 10 of this embodiment, the position of the vegetation can be identified using RGB image data, and the height of the vegetation can be identified using orthoimage data, so that the height of the vegetation on the running path 60 can be identified based on the orthoimage data and the RGB image data.

[0085] (Modification) In the above embodiment, the detection unit 206 detects a place covered with vegetation based on the RGB image data and the orthoimage data in the mowing season, but the present invention is not limited to this. For example, a place covered with vegetation may be detected by comparing the first image data acquired in a first period with the second image data acquired in a second period different from the first period. In this modified example, as an example, the first period is the mowing season, and the second period is winter, a period with less vegetation than the mowing season.

[0086] In this modified example, an example will be described in which both the first image data and the second image data are orthoimage data.

[0087] FIG. 9 is a side view showing a schematic view of the road 60 in winter. The location shown in FIG. 9 and the location shown in FIG. 7 are the same location. As shown in FIG. 9, the grass 70, 70A, 70B, and the large grass 74 are almost not growing on the road 60 at this time of year. In addition, the branches 72B of the tree 72 have no leaves 72C. In this modified example, a drone equipped with a camera is flown in the sky above the area shown in FIG. 6 in winter, and the area is photographed from each direction to obtain RGB image data (image data of the aerial image) which is a plurality of winter aerial images, and the RGB image data is stored in the storage 20D via the communication I / F 20E. In addition, in this embodiment, as an example, the detection unit 206 converts the plurality of winter aerial images stored in the storage 20D into winter orthoimage data including point cloud data using a conversion tool such as Metashape (registered trademark).

[0088] Meanwhile, FIG. 7 shows a side view that shows the road 60 in the first period, which is the mowing period. As shown in this figure, grass 70, 70A, 70B, and large grass 74 grow on the road 60 in this period. Also, leaves 72C grow on the branches 72B of the tree 72. Then, as in the winter season, a drone equipped with a camera is flown over the area shown in FIG. 6, and the area is photographed from each direction to obtain RGB image data (image data of the aerial image) that is an aerial image of a plurality of mowing periods, which are stored in the storage 20D via the communication I / F 20E. Also, in this embodiment, as an example, the detection unit 206 converts the aerial images of a plurality of mowing periods stored in the storage 20D into orthoimage data of the mowing period including point cloud data using a conversion tool such as Metashape (registered trademark).

[0089] In this modified example, the detection unit 206 identifies (estimates) the height of vegetation relative to the ground by comparing the orthoimage data in the grass-cutting season with the orthoimage data in the winter season. The detection unit 206 compares the orthoimage data in the grass-cutting season with the orthoimage data in the winter season to estimate the area where a subject exists that exceeds a predetermined height relative to the ground as a "place where vegetation grows."

[0090] In this manner, in the modified example, the detection unit 206 detects areas covered with vegetation by comparing the orthoimage data acquired at different times, and therefore, areas on the road 60 that are covered with vegetation can be identified based on the orthoimage data acquired at different times.

[0091] In addition, according to the modified example, at a specific location on the roadway 60, an image of the location covered with vegetation and an image of the location less covered with vegetation can be obtained, so that the locations covered with vegetation can be easily identified by comparing the images.

[0092] In the above-described embodiment of the grass cutter 10, the second period is winter, but the present invention is not limited to this. For example, the second period does not have to be winter, but may be autumn, which is closer to winter, as long as there is less vegetation than in the first period.

[0093] Furthermore, in the grass cutter 10 of the embodiment described above, the automatic driving control unit 202 causes the grass cutter 10 to travel along the travel path 60 corresponding to the second self-position 64 and the third self-position 66 by referring to the self-position estimated by the second position estimation unit 210, but the present invention is not limited to this. The automatic driving control unit 202 may cause the grass cutter 10 to travel only along the travel path 60 corresponding to the third self-position 66 by referring to the self-position estimated by the second position estimation unit 210.

[0094] In the grass cutter 10 of the above embodiment, the sensor unit 27 is configured with a three-axis acceleration sensor and a gyro sensor, but the present invention is not limited to this. The sensor unit 27 may be configured with three acceleration sensors that each detect acceleration along one of three different axes, or may have any other configuration. In addition, the sensor unit 27 may be configured with one or more sensors including a distance sensor, a camera, a gyro sensor, a magnetic sensor, an acceleration sensor, and a radar sensor, as long as the sensor unit 27 can estimate the self-position of the grass cutter 10. With such a configuration, the self-position of the grass cutter 10 can be estimated from information related to the position of the grass cutter 10.

[0095] In the above embodiment, the GPS device 26 is used as the satellite positioning system, but the present invention is not limited to this. For example, known technologies such as the Global Navigation Satellite System (GNSS) and the Quasi-Zenith Satellite System (QZSS) can be used.

[0096] In addition, in the crawler unit 14 of the embodiment described above, the rotating unit 14A is formed as a columnar body having a substantially right-angled triangle shape, but the present invention is not limited to this. For example, it may be elliptical or circular, and can be modified as appropriate.

[0097] Furthermore, in the above-described embodiment, the grass cutter 10 is a four-wheel drive, but the present invention is not limited to this and may be a two-wheel drive.

[0098] In the above-described embodiment, the crawler unit 14 is used as the drive unit, but the present invention is not limited to this. The drive unit may be, for example, wheels. Furthermore, the number of drive units of the grass cutter of the present invention is not limited to four, and the grass cutter may have a structure having one drive unit on each of the left and right sides.

[0099] In addition, various processors other than the CPU may execute each process executed by the CPU 20A shown in FIG. 4 by reading the software (program) in the above-mentioned embodiment. In this case, examples of the processor include a PLD (Programmable Logic Device) such as an FPGA (Field-Programmable Gate Array) whose circuit configuration can be changed after manufacture, and a dedicated electric circuit such as an ASIC (Application Specific Integrated Circuit) which is a processor having a circuit configuration designed exclusively for executing a specific process. Each process may be executed by one of these various processors, or may be executed by a combination of two or more processors of the same or different types (for example, a plurality of FPGAs, a combination of a CPU and an FPGA, etc.). More specifically, the hardware structure of these various processors is an electric circuit that combines circuit elements such as semiconductor elements.

[0100] Furthermore, each of the programs described in the above-mentioned embodiments may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), a USB (Universal Serial Bus) memory, etc. Furthermore, the programs may be provided in a form downloaded from an external device via a network.

[0101] Although one embodiment of the present invention has been described above, the present invention is not limited to the above, and it is of course possible to implement the present invention in various other modified forms without departing from the spirit and scope of the present invention. [Explanation of symbols]

[0102] 10 Grass cutter (grass cutter body) 202 Automatic Driving Control Unit 206 Detection Unit 208 1st position estimation section 210 Second position estimation section 26 GPS device (Satellite Positioning System) 27 Sensor section 30 Cutting blade part 60 Running Track 70, 70A, 70B Grass (plants) 72 Trees (Plants) 74 Large Grass (Plants) P Ortho image

Claims

1. A grass cutter body having a cutting blade for cutting grass; a first position estimation unit that estimates a self-position of the grass cutter body using a satellite positioning system; a second position estimation unit that estimates a self-position of the grass cutter body using a sensor unit provided in the grass cutter body; a detection unit that detects areas covered with vegetation on a preset travel path before mowing begins; an automatic travel control unit that causes the grass cutter body to travel on the travel path by referring to the self-position estimated by the first position estimation unit, and switches to refer to the self-position estimated by the second position estimation unit in a location covered with vegetation detected by the detection unit, and causes the grass cutter body to travel; Including, The detection unit acquires RGB image data having color information and ortho-image data that corresponds to the shooting area of ​​the RGB image data and includes point cloud data, identifies the vegetation based on the color information in the RGB image data, and identifies the height of the vegetation based on height information of the point cloud data in the ortho-image data, thereby detecting areas covered with vegetation.

2. A grass cutter body having a cutting blade for cutting grass; a first position estimation unit that estimates a self-position of the grass cutter body using a satellite positioning system; a second position estimation unit that estimates a self-position of the grass cutter body using a sensor unit provided in the grass cutter body; a detection unit that detects areas covered with vegetation on a preset travel path before mowing begins; an automatic travel control unit that causes the grass cutter body to travel on the travel path by referring to the self-position estimated by the first position estimation unit, and switches to refer to the self-position estimated by the second position estimation unit in a location covered with vegetation detected by the detection unit, and causes the grass cutter body to travel; Including, The detection unit detects areas covered with vegetation by comparing first image data, which is an image including the travel path and is acquired at a first time during the mowing season, with second image data acquired at a second time different from the first time, which is a time when there is less vegetation than during the mowing season.

3. 3. The grass mower according to claim 1, wherein the sensor unit is configured with one or more sensors selected from a plurality of sensors including a distance measuring sensor, a camera, a gyro sensor, a magnetic sensor, an acceleration sensor, and a radar sensor.

Citation Information

Patent Citations

  • Robotic vehicle for movable operation in a work area

    EP3753387A1

  • Route generating system for automatic traveling machine

    JP1997128045A

  • Control device and automatic working vehicle

    JP2011233028A

  • Autonomous travelling device

    JP2016076001A

  • Satellite mask generation method and satellite mask generation device

    JP2020118562A