Information processing device, information processing system, and information processing program

Abstract

To allow a work machine to travel more safely.SOLUTION: A management device 200 acquires positional information of a shovel 100 from the shovel 100, and based on the positional information of the shovel 100, generates a safety map M in which a travel region TA where the shovel 100 has traveled is displayed on a map. That is, a region which has a traveling record of the shovel 100 can be displayed on a map as a traveling possible region. Therefore, different from the conventional way of showing a region which does not include a prohibition region as a traveling possible region, the region which can be traveled can be presented more surely.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing system, and an information processing program.

Background Art

[0002] At a work site where construction machinery such as an excavator or a crane performs work, it is not uncommon for the road surface condition to be poor, such as having unevenness or cracks on the road surface. Since an accident such as the overturning of the vehicle body can occur when the road surface condition is poor, it is extremely important to grasp the area where the vehicle can travel safely in order to prevent such accidents.

[0003] Therefore, for example, in the technique described in Patent Document 1, a prohibited area where traveling is prohibited is set, and an area that does not include the prohibited area is defined as an area where traveling is possible. However, an area other than the prohibited area is not necessarily an area where traveling is possible.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The present invention has been made in view of the above circumstances, and an object thereof is to make a work machine travel more safely.

Means for Solving the Problems

[0006] The information processing apparatus according to the present invention includes information acquisition means for acquiring position information of a work machine, map generation means for generating safety map information in which a first area where the work machine has traveled is displayed on a map based on the position information of the work machine, A detection means for detecting the working range of the working elements of the aforementioned work machine, and is provided with The map generation means is The first region is determined based on the trajectory of the position information of the work machine and the travel width of the work machine. 、 The safety map information is generated by displaying a second region, which is hidden by excluding the operating range of the work element from the first region, on a map. .

[0007] The information processing system according to the present invention is The above information processing device and, The information processing device and at least one of the work machines capable of sending and receiving information, Includes.

[0008] The information processing program according to the present invention is Computers, Information acquisition means for acquiring location information of work machinery, Map generation means that generates safety map information that displays the first area traveled by the work machine based on the location information of the work machine, Detection means for detecting the working range of the working elements of the aforementioned work machine, To make it function as, The map generation means is The first region is determined based on the trajectory of the position information of the work machine and the travel width of the work machine. 、 The safety map information is generated by displaying a second region, which is hidden by excluding the operating range of the work element from the first region, on a map. . [Effects of the Invention]

[0009] According to the present invention, it is possible to operate work machinery more safely. [Brief explanation of the drawing]

[0010] [Figure 1] This is a side view of the excavator according to this embodiment. [Figure 2] This block diagram shows the schematic configuration of the information management system according to this embodiment. [Figure 3] This flowchart shows the flow of the safety map display process according to this embodiment. [Figure 4] This is a diagram illustrating the safety map display process according to this embodiment. [Figure 5] This is a diagram for explaining the safety map display process according to the present embodiment. [Figure 6] This is a diagram for explaining the safety map display process according to the present embodiment. [Embodiments for Carrying Out the Invention]

[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[0012] [Configuration of Excavator] FIG. 1 is a side view of an excavator 100 according to the present embodiment. As shown in this figure, the excavator 100 is an example of a work machine according to the present invention, and includes a lower traveling body 1, an upper revolving body 3 mounted on the lower traveling body 1 so as to be capable of revolving via a revolving mechanism 2, a boom 4, an arm 5, and a bucket 6 as an attachment 11, and a cab 10 on which an operator rides. The attachment 11 is not limited to this as long as a working element (for example, a bucket, a crusher, a crane device, etc.) is provided.

[0013] The lower traveling body 1 includes, for example, a pair of left and right crawlers, and each crawler is hydraulically driven by a traveling hydraulic motor (not shown) to make the excavator 100 travel. The upper revolving body 3 revolves with respect to the lower traveling body 1 by being driven by a revolving hydraulic motor or an electric motor (both not shown) or the like.

[0014] The boom 4 is pivotally attached to the front center of the upper revolving body 3 so as to be capable of pitching, the arm 5 is pivotally attached to the tip of the boom 4 so as to be capable of rotating vertically, and the bucket 6 is pivotally attached to the tip of the arm 5 so as to be capable of rotating vertically. The boom 4, the arm 5, and the bucket 6 are each hydraulically driven by a boom cylinder 7, an arm cylinder 8, and a bucket cylinder 9. The cabin 10 is a cockpit where the operator sits, and is mounted, for example, on the front left side of the upper slewing body 3. The shovel 100 operates actuators in response to the operations of the operator sitting in the cabin 10, driving driven elements such as the lower traveling body 1, the upper slewing body 3, the boom 4, the arm 5, and the bucket 6.

[0015] Figure 2 is a block diagram showing the schematic configuration of the information management system 400, including the shovel 100. As shown in this figure, the information management system 400 is comprised of at least one excavator 100, and a management device 200 and a terminal device 300 that can communicate with the excavator 100.

[0016] In addition to the above configuration, the shovel 100 includes an imaging device 40, a distance sensor 41, an operation / attitude sensor 42, a position sensor 43, an orientation sensor 44, an operating device 45, a display device 50, an audio output device 60, a communication device 80, and a controller 30.

[0017] The imaging device 40 captures images of the area around the shovel 100 and outputs the images to the controller 30. The imaging device 40 includes, for example, a rear camera that captures the area behind the shovel 100, a left camera that captures the area to the left, and a right camera that captures the area to the right. Each imaging device 40 is installed so that its optical axis is pointed diagonally downward and has an imaging range (angle of view) in the vertical direction that includes from the ground near the shovel 100 to the area far from the shovel 100.

[0018] The distance sensor 41 is a distance measuring means that measures the distance to objects around the shovel 100 and acquires that information (two-dimensional or three-dimensional distance information), and outputs the acquired information to the controller 30. The distance sensor 41 is, for example, provided to correspond to the imaging device 40 and capable of measuring in three directions: rear, left, and right of the shovel 100.

[0019] The motion and posture sensor 42 is a sensor that detects the motion and posture of the shovel 100 and outputs the detection results to the controller 30. The motion and posture sensor 42 includes a boom angle sensor, an arm angle sensor, a bucket angle sensor, a three-axis inertial measurement unit (IMU), a slewing angle sensor, and an acceleration sensor. These sensors may consist of stroke sensors for cylinders such as booms, and sensors that acquire rotational information such as rotary encoders, or they may be replaced by acceleration (which may also include velocity and position) acquired by an IMU. The arm angle sensor detects the rotation angle of arm 5 relative to boom 4 (hereinafter referred to as "arm angle"). The bucket angle sensor detects the rotation angle of the bucket 6 relative to the arm 5 (hereinafter referred to as the "bucket angle"). The IMU is attached to each of the boom 4 and arm 5 and detects the acceleration of the boom 4 and arm 5 along a predetermined three axis, and the angular acceleration of the boom 4 and arm 5 around the predetermined three axis. The rotation angle sensor detects the rotation angle relative to a predetermined angular direction of the upper rotation body 3. However, it is not limited to this, and the rotation angle may also be detected based on GPS or IMU sensors provided on the upper rotation body 3. The acceleration sensor is mounted at a position away from the pivot axis of the upper rotating body 3 and detects the acceleration of the upper rotating body 3 at that position. Based on the detection results of the acceleration sensor, it is possible to determine whether the upper rotating body 3 is rotating or whether the lower traveling body 1 is traveling, etc.

[0020] The position sensor 43 is a sensor that acquires information about the position (current position) of the shovel 100, and in this embodiment, it is a GPS (Global Positioning System) receiver. The position sensor 43 receives a GPS signal containing the position information of the shovel 100 from GPS satellites and outputs the acquired position information of the shovel 100 to the controller 30. Note that the position sensor 43 does not have to be a GPS receiver as long as it can acquire information about the position of the shovel 100, and may use a satellite positioning system other than GPS, for example. Also, the position sensor 43 may be installed on either the lower traveling body 1 or the upper rotating body 3.

[0021] The compass sensor 44 is a sensor that acquires information about the direction (orientation) that the shovel 100 is facing, and is, for example, a geomagnetic sensor. The compass sensor 44 acquires information about the direction of the shovel 100 and outputs it to the controller 30. The compass sensor 44 only needs to be able to acquire information about the direction of the shovel 100, and its type is not particularly limited. For example, two GPS receivers could be installed, and the direction information could be obtained from the difference in their position information.

[0022] The operating device 45 is located near the cockpit of the cabin 10 and is an operating means for the operator to operate each of the operating elements (lower traveling body 1, upper slewing body 3, boom 4, arm 5, and bucket 6, etc.). In other words, the operating device 45 is an operating means for operating each hydraulic actuator that drives each of the operating elements. The operating device 45 includes, for example, levers, pedals, and various buttons, and outputs operating signals to the controller 30 according to the content of these operations. Furthermore, the operating device 45 also serves as an operating means for controlling the imaging device 40, distance sensor 41, motion / attitude state sensor 42, position sensor 43, display device 50, audio output device 60, communication equipment 80, etc., and outputs operation commands for each of these parts to the controller 30.

[0023] The display device 50 is installed around the cockpit in the cabin 10 and displays various image information to be notified to the operator under the control of the controller 30. The display device 50 may be, for example, a liquid crystal display or an organic EL (electroluminescence) display, and may also be a touch panel type that also serves as at least a part of the operating device 45.

[0024] The voice output device 60 is installed around the cockpit in the cabin 10 and outputs various voice information to notify the operator under the control of the controller 30. The voice output device 60 is, for example, a speaker or a buzzer.

[0025] The communication device 80 is a communication device that transmits and receives various information to and from remote external devices and other excavators 100, etc., via a predetermined communication network NW based on a predetermined wireless communication standard. The communication network NW may include, for example, a mobile communication network with base stations as its endpoints, a satellite communication network using communication satellites in the air, a short-range communication network compliant with protocols such as WiFi and Bluetooth (registered trademark), and an Internet communication network.

[0026] The controller 30 is a control device that controls the operation of each part of the shovel 100 and performs drive control of the shovel 100. The controller 30 is mounted inside the cabin 10. The functions of the controller 30 may be realized by any hardware, software, or a combination thereof, and for example, it is mainly composed of a microcomputer including a CPU, RAM, ROM, I / O, etc. In addition to these, the controller 30 may also be composed of other components such as an FPGA or ASIC.

[0027] Furthermore, the controller 30 includes a storage unit 35 as a storage area defined in internal memory such as EEPROM (Electrically Erasable Programmable Read-Only Memory). The memory unit 35 stores various programs and data for operating the various parts of the shovel 100, and also functions as the work area for the controller 30. The memory unit 35 in this embodiment has a safety map storage area 350 for storing the safety map M, which will be described later.

[0028] Furthermore, the information management system 400 allows each excavator 100 to communicate with the management device 200 and terminal device 300 through a predetermined communication network NW.

[0029] The management device 200 (an example of an information processing device) is located geographically separate from the users who possess the shovel 100 and terminal device 300. The management device 200 is installed, for example, in a management center located outside the work site where the shovel 100 operates, and is a server device consisting of one or more server computers. In this case, the server device may be a proprietary server operated by the system operator or a related company, or it may be a rental server. This server device may also be a so-called cloud server. Furthermore, the management device 200 may be a server device (a so-called edge server) located in a management office within the work site of the shovel 100, or it may be a stationary or portable general-purpose computer terminal. As described above, the management device 200 can communicate with the shovel 100 and the terminal device 300 via the communication network NW. This allows the management device 200 to receive and store (store) various information uploaded from the shovel 100. The management device 200 can also transmit various information to the terminal device 300 in response to requests from the terminal device 300. Furthermore, the management device 200 manages (stores) information about multiple shovels 100 by associating it with the ID information of each shovel 100 so that each shovel 100 can be identified. Specifically, the management device 200 comprises a control unit 210 and a storage unit 220. The control unit 210 operates various parts of the management device 200 based on user operations, etc., and also deploys programs pre-stored in the storage unit 220 and executes various processes in cooperation with the deployed programs. The storage unit 220 stores various programs and data and also functions as a workspace for the control unit 210.

[0030] Terminal device 300 is a user terminal used by the user. Users may include, for example, site supervisors, managers, operators of shovel 100, managers of shovel 100, service technicians for shovel 100, developers of shovel 100, etc. Terminal device 300 is, for example, a general-purpose portable terminal such as a laptop computer, tablet, or smartphone owned by the user. Alternatively, terminal device 300 may be a stationary general-purpose terminal such as a desktop computer. Furthermore, terminal device 300 may be a dedicated terminal (portable or stationary terminal) for receiving information. The terminal device 300 can communicate with the management device 200 via the communication network NW. This allows the terminal device 300 to receive information transmitted from the management device 200 and provide that information to the user through its built-in display device. Furthermore, the terminal device 300 may be configured to communicate with the shovel 100 via the communication network NW.

[0031] [Safety map display processing] Next, we will explain the safety map display process, which generates and displays a safety map M that indicates a safe driving area. Figure 3 is a flowchart illustrating the safety map display process. Figures 4 to 6 are diagrams illustrating the safety map display process, where (a) in each figure is a plan view of the work site, and (b) is the safety map M corresponding to (a).

[0032] The safety map display process is performed collaboratively between the excavator 100 and the management device 200 by the controller 30 of the excavator 100 (or the control unit 210 of the management device 200) executing a predetermined program stored in the memory unit. This process may be executed and terminated based on operator input, or it may be executed continuously while the excavator 100 is in operation. Here, the management device 200 generates a safety map M of a work site based on information from multiple excavators 100 working at that work site. The safety map M is a map display of the travel area TA or safe area SA in which the excavators 100 can (or are presumed to be) travel safely.

[0033] As shown in Figure 3, when the safety map display process is executed, the controller 30 of each excavator 100 first acquires its own position information using the position sensor 43 and transmits it to the management device 200 (step S1). In this case, the controller 30 of each shovel 100 may associate the location information to be transmitted with its own ID information.

[0034] Next, the control unit 210 of the management device 200 determines the travel area TA that each excavator 100 actually traveled, based on the position information acquired from each excavator 100 (step S2). Specifically, as shown in Figure 4(a), the control unit 210 determines the travel range TA by adding an additional width α to both sides of the vehicle width W of the shovel 100, and using this as the travel width of the shovel 100. The value of the vehicle width W may be stored as vehicle information for each shovel 100, or it may be simply the value of the vehicle width of a general excavator. The value of the additional width α is not particularly limited and may be zero or a negative value.

[0035] Next, the control unit 210 of the management device 200 determines the safety area SA by excluding the operating range R of the bucket 6 from the travel area TA (step S3). Here, "operation" of bucket 6 (attachment 11) means that bucket 6 (attachment 11) is actually performing excavation or other work (including changes in posture during work), and does not include states where it is merely holding the excavated material. In other words, the operating range R of bucket 6 refers to the range of motion when bucket 6 is performing excavation or other work. Specifically, the operating range R of the bucket 6 is determined based on the operating status of the bucket 6 (attachment 11) and the position information of the bucket 6. The operating status of the attachment 11 (whether it is operating or not) is determined by detecting the operation and load of the bucket 6 from various actuators that drive the attachment 11 and the motion / attitude sensor 42. The position information of the bucket 6 is determined from the attitude information of the attachment 11 obtained from the motion / attitude sensor 42. For example, as shown in Figure 5(a), when the shovel 100 is excavating a hole 91 or piling up the excavated soil to form a mound 92, the surrounding area is considered the operating range R of the bucket 6. The safety area SA can then be determined by excluding this operating range R from the travel area TA. The method for determining the operating range R of the bucket 6 is not limited to the method described above. For example, an imaging device 40 may be mounted facing forward on the vehicle, and the operating range R or operating status of the attachment 11 may be obtained based on image data acquired by this imaging device 40. Furthermore, the work performed by the bucket 6 includes, for example, simple excavation work, slope finishing work, trench excavation work, horizontal excavation work, swivel leveling work, soil pouring work, spreading work, pressing work, crane work, loading work, etc.

[0036] Next, the control unit 210 of the management device 200 generates a safety map M that displays the safety area SA on a map and stores it in the storage unit 220 (step S4). Here, for example, as shown in Figure 5(b), a safety map M is generated by mapping the safety area SA onto pre-acquired map data of the work site. The information included in the safety map M is not particularly limited and may include, for example, buildings and roads. However, it is preferable that the position and orientation of each excavator 100 be included. Furthermore, the map data of the work site does not have to be pre-acquired; it may be obtained from the internet or created from scratch.

[0037] The safety map M only needs to display the driving area TA on a map, as shown in Figure 4(b). Furthermore, as shown in Figures 6(a) and (b), the area in which the shovel 100 travels after, for example, the hole 91 has been filled or the mound of soil 92 has been excavated may be considered a travel area TA (safety area SA).

[0038] Next, the control unit 210 of the management device 200 transmits the safety map M to each excavator 100, and the controller 30 of each excavator 100 stores the safety map M in the safety map storage area 350 and displays it on the display device 50 (step S5). This allows each excavator 100 operator to recognize areas where they have previously operated but where the bucket 6 is not currently working by looking at the displayed safety map M, enabling them to operate the excavator 100 more safely. Furthermore, when displaying the information on the display device 50, it is preferable to identify (highlight) the vehicle on the safety map M so that it is easy to identify the vehicle itself.

[0039] Next, the control unit 210 determines whether or not to terminate the safety map display process (step S6). If it determines not to terminate the process (step S6; No), it proceeds to step S1 described above. As a result, while the safety map display process is running, steps S1 to S5 are repeated, for example, at regular time intervals, and the safety map M is updated as needed. Then, if it is determined that the safety map display process should be terminated, for example, due to the completion of work (Step S6; Yes), the control unit 210 of the management device 200 and the controller 30 of the shovel 100 terminate the safety map display process.

[0040] [Technical effects of this embodiment] As described above, according to this embodiment, a safety map M is generated that displays the travel area TA that the shovel 100 traveled through, based on the position information of the shovel 100. In other words, the area where the Shovel 100 has a proven track record of operation can be displayed on the map as a drivable area. Therefore, unlike the conventional method which defined a drivable area as an area that did not include prohibited areas, it is possible to display an area where operation is more reliably possible. Ultimately, this allows for safer operation of the Shovel 100.

[0041] Furthermore, according to this embodiment, the safety map M displays the safety area SA, which is obtained by excluding the operating range R of the bucket 6 from the travel area TA. This allows us to present a safety map M that excludes the area where the bucket 6 is moving during operation from the travel area TA, as this area may not be safe to travel in. Therefore, the shovel 100 can be operated even more safely.

[0042] [others] Although embodiments of the present invention have been described above, the present invention is not limited to the above embodiments or their modifications. For example, in the above embodiment, the generated safety map M is displayed on the display device 50 and presented to the operator. However, it may also be used for controlling the operation of work, such as controlling the movement of autonomous work machinery. Furthermore, it is preferable that the safety map M is managed (stored) in the management device 200 as work management information for the work site, linked to the information of the work site.

[0043] Furthermore, in the above embodiment, the management device 200 is primarily responsible for control as the information processing device according to the present invention. However, the information processing device according to the present invention is not limited to this, and may be mounted on, for example, a work machine. In this case, each work machine may individually generate and display a safety map, or a specific work machine may transmit information related to the safety map to other work machines. Furthermore, the information processing system according to the present invention may include an information processing device and at least one work machine.

[0044] Furthermore, the work machine according to the present invention is not limited to shovels, but is applicable to construction machinery in general, and is also suitably applicable to work machines including construction machinery. Furthermore, details shown in the embodiments can be modified as appropriate without departing from the spirit of the invention. [Explanation of symbols]

[0045] 6 Buckets (work elements) 11 Attachments 30 controllers 35 Storage section 42 Motion and posture sensor 43. Position sensor (information acquisition means) 50 Display device (display means) 91 holes 92 Tsuchiyama 100 Shovel (working machine) 200 Management device (information processing device) 210 Control Unit 220 Storage section 400 Information Management Systems (Information Processing Systems) M Safety Map (Safety Map Information) R Operating range SA safety area TA driving area W (Wide width) α additional width

Claims

1. Information acquisition means for acquiring location information of work machines, A map generation means generates safety map information that displays the first area traveled by the work machine based on the location information of the work machine, A detection means for detecting the working range of the working elements of the aforementioned work machine, Equipped with, The map generation means is Based on the trajectory of the position information of the work machine and the travel width of the work machine, the first region is determined. The safety map information is generated by displaying a second region, which is hidden by excluding the operating range of the work element from the first region, on a map. Information processing device.

2. The detection means detects the operating range of the work element based on the operating status of the work element and the position information of the work element. The information processing apparatus according to claim 1.

3. An information processing apparatus according to claim 1 or claim 2, The information processing device and at least one of the work machines capable of sending and receiving information, An information processing system that includes this.

4. Each of the at least one work machine is equipped with a display means for displaying the safety map information. The information processing system according to claim 3.

5. Computers, Information acquisition means for acquiring location information of work machinery, Map generation means that generates safety map information that displays the first area traveled by the work machine based on the location information of the work machine, Detection means for detecting the working range of the working elements of the aforementioned work machine, To make it function as, The map generation means is Based on the trajectory of the position information of the work machine and the travel width of the work machine, the first region is determined. The safety map information is generated by displaying a second region, which is hidden by excluding the operating range of the work element from the first region, on a map. Information processing program.

Images