Operation simulator, operation simulation program, and operation simulation method

The work simulator and simulation program assist in placing objects and areas in a virtual space by providing a placement assistance function, addressing the inefficiencies of manual placement and reducing time and effort in work simulations.

JP2024168316APending Publication Date: 2024-12-05KOBELCO CONSTR MASCH CO LTD

Patent Information

Application Number
JP2023084875
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-23
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

The task of arranging placement targets in a virtual space is time-consuming and effort-intensive, necessitating a solution to reduce the effort and time involved.

Method used

A work simulator and simulation program that assist in placing objects and areas in a virtual space by providing a placement assistance function, utilizing a computer to simulate work sites and perform placement steps efficiently.

Benefits of technology

The solution significantly reduces the effort and time required for arranging placement targets in a virtual environment, enhancing efficiency and productivity in work simulations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024168316000001_ABST
    Figure 2024168316000001_ABST
Patent Text Reader

Abstract

To reduce labor and time to place arrangement objects.SOLUTION: An operation simulator 1 comprises a calculator 13. The calculator 13 simulates in a virtual space a work site S where a work machine 40 operates. The calculator 13 places an arrangement object T in the virtual space. The arrangement object T is at least either one of an object 30 and an area A. The calculator 13 has a function to assist the placement of the arrangement object T.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a work simulator, a work simulation program, and a work simulation method for simulating a work site in a virtual space. [Background technology]

[0002] For example, Patent Document 1 describes a work planning system that creates a work plan (see claim 1 of Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-11680 Summary of the Invention [Problem to be solved by the invention]

[0004] When a user places a placement target (e.g., an object, an area) in a virtual space, the task may take time and effort. Therefore, it is desirable to be able to reduce the time and effort required for placing a placement target.

[0005] An object of the present invention is to provide a work simulator, a work simulation program, and a work simulation method that can reduce the effort and time required for placing an object to be placed. [Means for solving the problem]

[0006] The work simulator includes a computer that simulates, in a virtual space, a work site where a work machine performs work. The computer places a placement target, which is at least one of an object and an area, in the virtual space. The computer has a function of assisting in the placement of the placement target.

[0007] The work simulation program is a program for simulating, in a virtual space, a work site where a work machine performs work. The work simulation program causes a computer to execute a placement step and a placement assistance step. The placement step places a placement target, which is at least one of an object and an area, in the virtual space. The placement assistance step assists in the placement of the placement target.

[0008] The work simulation method is a method for simulating, in a virtual space, a work site where a work machine performs work. The work simulation method includes a placement step and a placement assistance step. The placement step places a placement target, which is at least one of an object and an area, in the virtual space. The placement assistance step assists in the placement of the placement target. Effect of the Invention

[0009] The above-described work simulator, work simulation program, and work simulation method each make it possible to reduce the effort and time required for placing an object to be placed. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing a work simulator 1. [Diagram 2] 2 is a flowchart showing the process of a computer 13 shown in FIG. 1. [Figure 3A] 1, in which the position of a facility 65 is calculated based on the position of a work machine 40. FIG. [Figure 3B] 3B is a diagram showing the display of the output device 15 when the position of equipment 65 is calculated based on a work machine area A40 having a shape different from that of the work machine area A40 shown in FIG. 3A. [Figure 4A] 1. FIG. 4 is a diagram showing the display on the output device 15 when a work position P43c, which is a point, of the work machine 40 shown in FIG. 1 is set. [Figure 4B]4B is a diagram showing the display of the output device 15 when the work position P43c and the work machine installation position P40c shown in FIG. 4A are set. FIG. [Figure 4C] FIG. 4C is a diagram showing a display on the output device 15 when the setting assistance function for the working position P43c shown in FIG. 4B is used for the working area A45. [Figure 4D] 4C is a diagram showing a display on the output device 15 when the setting assistance function for the work position P43c shown in FIG. 4B is used in the loading platform area A61a. [Figure 5A] 1. FIG. 4 is a diagram showing the display on the output device 15 when a work position P43c, which is a line, of the work machine 40 shown in FIG. 1 is set on a slope. [Figure 5B] 5B is a diagram showing the display of the output device 15 when the work position P43c and the work machine installation position P40c shown in FIG. 5A are set. FIG. [Figure 5C] 1. FIG. 4 is a diagram showing the display on the output device 15 when a work position P43c, which is a line, of the work machine 40 shown in FIG. 1 is set underground 31b. [Figure 5D] 5B is a diagram showing a display on the output device 15 when the working position P43c shown in FIG. 5A is set at a position away from the obstacle 63 by an offset distance L63. [Figure 6A] 1. FIG. 4 is a diagram showing the display on the output device 15 when a work machine installation position P40c of the work machine 40 shown in FIG. 1 has been set. [Figure 6B] 6B is a diagram showing the display of the output device 15 when the work machine installation position P40c and the work position P43c shown in FIG. 6A are set. FIG. [Figure 7A] 1. FIG. 4 is a diagram showing the display on the output device 15 when a workable area A40b in which the work machine 40 shown in FIG. 1 can work is displayed. [Figure 7B] 7B is a diagram showing how the workable area A40b shown in FIG. 7A is displayed by the output device 15 as a limited workable area A40b1 that is limited by the depth from the ground surface 31a, etc. FIG. [Figure 7C] 7B is a diagram showing a display by the output device 15 of a limited workable area A40b1 in which the workable area A40b shown in FIG. 7A is limited by the turning angle of the work machine 40. FIG. [Figure 7D] 1. FIG. 4 is a diagram showing a display by the output device 15 of a rated load display Db2 of the work machine 40 shown in FIG. [Figure 8A] 1. FIG. 4 is a diagram showing the display on the output device 15 when the state of interference between a work machine movable area A40a of the work machine 40 shown in FIG. 1 and an obstacle 63 is determined. [Figure 8B] 8B is a diagram showing a display on the output device 15 when the work machine movable area A40a shown in FIG. 8A interferes with an obstacle 63. FIG. [Figure 8C] FIG. 8B is a diagram showing the display on the output device 15 when determining the state of interference between a work machine movable area A40a having a shape different from the example shown in FIG. 8A and an obstacle 63 or the like. [Figure 9] 1. FIG. 2 is a diagram showing the display on the output device 15 when the work machine 40 shown in FIG. 1 and a second work machine 50 are placed at a work site S. [Figure 10A] 2 is a diagram showing a ground contact determination point P21 and the like of the work machine 40 shown in FIG. [Figure 10B] 10B is a diagram showing the display on the output device 15 when the ground contact determination point P21 and the like shown in FIG. 10A are projected onto the ground 31a. [Figure 10C] 10B is a diagram showing the display of the output device 15 when the work machine 40 shown in FIG. 10A is placed on a sloping ground 31a. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] The work simulator 1 will be described with reference to FIGS. 1 to 10C.

[0012] As shown in Fig. 1, the work simulator 1 is a simulator that performs a simulation (work simulation) of a work site S in a virtual space. The work simulator 1 is, for example, at least one of a personal computer, a tablet, and a smartphone. The work simulator 1 includes an input device 11, a calculator 13, and an output device 15. The work simulator 1 may also include a client device 10 and a server device 20.

[0013] The input device 11 is a device for inputting information to the calculator 13. The input device 11 includes an operation input device 11a and an information input device 11b.

[0014] The operation input device 11a is operated by a user (operator) of the work simulator 1. The operation of the operation input device 11a by the user is also referred to as "manual operation". The operation input device 11a may be used to set (specify, select) a position in the virtual space. The operation input device 11a may be used to set an object 30 (placement target T) and an area A (placement target T) (each of which will be described later). The operation input device 11a may be used to operate a work machine 40 (described later) in the virtual space. The operation input device 11a may be used, for example, to instruct the start and end of the operation of the work machine 40, and may be used for the running of the work machine 40, the rotation of the upper rotating body 41b (see FIG. 3A), and the operation of the attachment 43 (see FIG. 3A). For example, the operation input device 11a may include at least one of a mouse, a keyboard, a touch panel, and a game pad. The operation input device 11a may be equipped with levers and pedals that imitate left and right operation levers and left and right operation pedals (pedals at the feet) of an actual machine (a machine corresponding to the work machine 40).

[0015] The information input device 11b is a device for inputting various information (excluding information obtained by operating the operation input device 11a) to the calculator 13. The above-mentioned "various information" is, for example, information regarding the object 30 and the area A (both of which will be described later).

[0016] The calculator 13 is a computer that performs input and output of signals, calculations, and storage of information. The calculator 13 simulates a work site S in a virtual space. Each function of the calculator 13 (for example, functions of an object processing unit 13b1 and an area processing unit 13b2 described later) is realized by executing a program (a work simulation program) stored in the storage unit 13a in the calculation unit 13b. The calculator 13 and other devices (for example, the input device 11 and the output device 15) may be connected by wireless communication or by wired communication. Information output by the input device 11 is input to the calculator 13. The calculator 13 outputs information to the output device 15. The calculator 13 (more specifically, the calculator 13 of the client device 10) may exchange information with the server device 20. The exchange between the calculator 13 of the client device 10 and the server device 20 is performed by a communication means such as a mobile phone line, an optical line, a wireless LAN (Local Area Network), or a wired LAN. The calculator 13 includes a storage unit 13a and a calculation unit 13b.

[0017] The storage unit 13a stores various types of information. The storage unit 13a stores a work simulation program.

[0018] The calculation unit 13b performs calculations (processing such as calculation and determination). The calculation unit 13b includes an object processing unit 13b1 and an area processing unit 13b2. The object processing unit 13b1 processes an object 30 (described later). The area processing unit 13b2 processes an area A (described later).

[0019] The output device 15 performs output in response to commands input from the computer 13. The output performed by the output device 15 is, for example, a display. The output device 15 is, for example, a monitor (screen). The output device 15 displays the calculation results of the computer 13. The output device 15 displays a virtual space calculated by the computer 13. The output device 15 displays a GUI (Graphical User Interface) that allows the user to operate the work simulation. "Display" below is a display that the computer 13 causes the output device 15 to perform. The output device 15 may output audio.

[0020] The server device 20 is a computer that operates in response to a command from the client device 10. The client device 10 is composed of the above-mentioned input device 11, the calculator 13, and the output device 15. The functions of the work simulator 1 (for example, the functions of the object processing unit 13b1 and the area processing unit 13b2, etc.) may be realized by the client device 10 and the server device 20. The calculator 13 (at least one of the memory unit 13a and the calculation unit 13b) may be provided in the client device 10 and the server device 20. The input device 11 may be provided in the server device 20 (not shown). In this case, for example, information (for example, the above-mentioned "various information") may be input from the input device 11 provided in the server device 20 to the calculator 13 provided in the client device 10. A plurality of server devices 20 may be provided. Note that the work simulator 1 does not need to include the server device 20.

[0021] (Activation) The work simulator 1 (mainly the computer 13) is configured to perform the following operations (work simulation). The work simulation program causes the computer 13 to execute the following operations. The work simulation method is a method in which the following operations are performed.

[0022] The work simulator 1 simulates a work site S in a virtual space. The work site S is a site (construction site) where a work machine 40 performs work. For example, the work simulator 1 (construction plan simulator) is used to make a plan (construction plan) for the work site S. The work simulator 1 is used to make a plan regarding the work machine 40 at the work site S. The work simulator 1 is used to check the position, size, workability (productivity), safety, etc. of the work machine 40. The work simulator 1 may be used to make a plan for an object other than the work machine 40 or for an area A. The work simulator 1 has an object processing function and an area processing function. The work simulator 1 may have various functions such as an operation mode switching function, a time change function, and an interference determination function. The work simulator 1 may have a function to record (save) the situation at the work site S, for example, and may have a function to play back the recorded situation.

[0023] (Object processing function) The computer 13 (more specifically, the object processing unit 13b1) processes the object 30 (placement target T) (object processing function, object processing step). The object 30 is a model of an object in the work site S. The object 30 may be a three-dimensional model (see FIG. 4C, etc.) or a two-dimensional model. Each operation (function) of the work simulator 1 may be a "step" in the work simulation program and the work simulation method. For example, the processing of the object 30 may be an "object processing step."

[0024] The processing of the object 30 includes the deletion of the object 30 (deletion from the virtual space) and the placement of the object 30 (placement in the virtual space) (placement step, object placement step). The placement of the object 30 includes new placement of the object 30 and movement of the object 30. The new placement of the object 30 is a new placement of the object 30 in the virtual space (at the work site S). The movement of the object 30 is a movement of the object 30 that is already in the virtual space (at the work site S). The movement of the object 30 includes rotational movement and parallel movement of the object 30. For example, a change in the attitude of the work machine 40 is included in the movement of the object 30. Also, for example, a deformation of the terrain 31 (described later) is included in the movement of the object 30. When the object 30 is placed (newly placed, moved) in the virtual space, the computer 13 stores the position (described later) of the placed object 30. The processing of the object 30 may include a function of managing the object 30 placed in the virtual space (for example, a function of managing a plurality of objects 30 in a list format). The processing of the objects 30 may include a function for switching between display and non-display for each object 30 .

[0025] In the following, unless otherwise specified, events in the virtual space will be described. For example, "a work machine 40 is placed on the ground 31a" means that an object 30 of the work machine 40 is placed on an object 30 on the ground 31a in the virtual space. Also, for example, "a work machine area A40 is set around the work machine 40" means that a work machine area A40 is set around the object 30 of the work machine 40 in the virtual space.

[0026] The conditions for processing (placement, deletion) of the object 30 are, for example, as follows: The processing of the object 30 may be performed in response to a manual operation by a user. The processing of the object 30 may be performed automatically when a condition preset in the computer 13 is satisfied.

[0027] The "position" of the object 30 includes the reference position of the object 30 and the direction of the object 30. The reference position of the object 30 is a reference position (origin) of the object 30. For example, the reference position of the object 30 may be the center position of the bottom surface of the object 30 (e.g., a center point 41ac of the bottom surface of the work machine (see FIG. 4B) described later), or the center of gravity of the object 30. The direction of the object 30 is a rotation angle (attitude, for example, a three-dimensional rotation angle) with respect to a predetermined coordinate axis.

[0028] Specific examples of the objects 30 are as follows. The objects 30 include the terrain 31 (surrounding environment information), the work machine 40, and "other objects 30." The above-mentioned "other objects 30" include, for example, a second work machine 50 (see FIG. 9), a transport vehicle 61, a suspended load 62 (see FIG. 4D), an obstacle 63, equipment 65, and a worker 67 (see FIG. 9). Below, the input device 11, the calculator 13, and their components (such as the memory unit 13a) will be described with reference to FIG. 1.

[0029] As shown in FIG. 4B, the terrain 31 is shape information of the land of the work site S. The terrain 31 may be a two-dimensional shape or a three-dimensional shape. The terrain 31 includes, for example, flat land, a sloping surface (e.g., a slope), and unevenness. The terrain 31 includes the ground 31a and underground 31b. The ground 31a is the surface (ground surface) of the terrain 31, and is, for example, a surface of soil or sand. The underground 31b is the part of the terrain 31 below the ground 31a, and is, for example, a part where soil or sand is present.

[0030] This terrain 31 may be a model of real land. In this case, the terrain 31 may be shape information generated based on detection information of the real land. In this case, the detection information of the real land may be detected by a stereo camera, or may be detected by a distance sensor and a two-dimensional camera. The above-mentioned "distance sensor" may be, for example, a LIDAR (Light Detection and Ranging) or a millimeter wave radar. The terrain 31 may also be shape information of design data (design surface) designed on a computer. The computer on which the design data is designed may be the work simulator 1, or may not be the work simulator 1. The terrain 31 shown in FIG. 1 may be set only one in the computer 13, or may be set multiple times. When multiple terrains 31 are set, at least one of the terrain 31 before the work, the terrain 31 in the middle of the work, and the terrain 31 after the work is completed (finished) may be set in the computer 13. The same applies to the object 30 and the area A other than the terrain 31, which may be set only one or multiple times. The terrain 31 (shape information of the terrain 31) is input (read) into the computer 13, for example, from the input device 11. The object 30 and the area A other than the terrain 31 are also input into the computer 13, for example, from the input device 11.

[0031] This terrain 31 may be deformed in accordance with time changes in the work simulation. A specific example of a case in which the terrain 31 is deformed is as follows. The work machine 40 shown in FIG. 4B is operated, and the end attachment 43c (described later) performs work on the terrain 31 (e.g., earth and sand). For example, the work machine 40 performs an operation to excavate the ground surface 31a. In such a case, the terrain 31 may be deformed. For example, the terrain 31 may be deformed into a shape after the earth and sand have been excavated (a hole, a trench, etc.). Also, for example, the terrain 31 may be deformed into a shape after the earth and sand have been removed and piled up (a mountain of earth and sand).

[0032] The work machine 40 is a machine that performs work, for example a construction machine that performs construction work, and may be, for example, a shovel, a crane, a bulldozer, or a wheel loader. In the following, a case where the work machine 40 is a shovel will be mainly described. The work machine 40 may operate (work machine operation step). The work machine 40 may operate based on information preset in the calculator 13. The work machine 40 may operate in response to manual operation by a user (see the operator operation mode described later). The work machine 40 may travel, an upper rotating body 41b (described later) may rotate relative to a lower traveling body 41a (described later), and the attitude of the attachment 43 may change. Note that the work machine 40 does not have to operate (it may simply be placed in a virtual space). The work machine 40 includes a machine body 41 and an attachment 43.

[0033] The machine body 41 is a main body portion of the work machine 40. The machine body 41 includes a lower traveling body 41a and an upper rotating body 41b.

[0034] The lower traveling body 41a is capable of traveling on a traveling surface (such as the ground 31a). The lower traveling body 41a may be equipped with crawlers 41a1 or wheels (not shown). The center point of the underside of the work machine 40 (i.e., the underside of the lower traveling body 41a) is defined as the work machine underside center point 41ac. The work machine underside center point 41ac is the intersection point of a virtual plane tangent to the underside of the lower traveling body 41a and a turning central axis 41b1 (described later) (see FIG. 10A). The work machine underside center point 41ac may be defined as the reference position (origin) of the work machine 40, for example.

[0035] The upper rotating body 41b can rotate relative to the lower traveling body 41a. The axis of rotation of the upper rotating body 41b relative to the lower traveling body 41a is the rotation center axis 41b1. The upper rotating body 41b includes a cab 41b2. The cab 41b2 is a part where an operator operates a real machine (a machine corresponding to the work machine 40). The cab 41b2 may be fixed to the bottom (a rotating frame) of the upper rotating body 41b. The cab 41b2 may be movable relative to the bottom of the upper rotating body 41b. In this case, the cab 41b2 may be a cab (elevator cab, link cab, etc.) that has a mechanism that can move in the vertical direction (the direction will be described later) relative to the bottom of the upper rotating body 41b. In addition, the cab 41b2 may be a tilt cab that has a mechanism for rotating (tilting) up and down about a rotation axis extending laterally relative to the bottom of the upper rotating body 41b to make it easier to see upward from within the cab 41b2. The cab 41b2 may be equipped with an accessory that is attached to the main body of the cab 41b2. This accessory may be, for example, a guard for protecting the top surface and front window of the cab 41b2 from flying objects.

[0036] (direction) The directions related to the work machine 40 are defined as follows. The direction in which the rotation axis 41b1 of the revolving shaft extends is the up-down direction. The direction in which the rotation axis of the boom 43a1 (described later) for raising and lowering relative to the upper revolving body 41b extends is the lateral direction. The direction perpendicular to each of the up-down direction and the lateral direction is the front-rear direction. In the front-rear direction, the side from which the attachment 43 protrudes relative to the upper revolving body 41b is the front side, and the opposite side is the rear side. The direction in which the upper revolving body 41b revolves relative to the lower running body 41a is the revolving direction. Note that the work machine 40 may be placed on an inclined surface (see FIG. 10C). Therefore, the up-down direction of the work machine 40 may not coincide with the vertical direction, and the lateral direction and the fore-aft direction of the work machine 40 may not coincide with the horizontal direction.

[0037] The attachment 43 is a part (working device) that performs work. The attachment 43 can be raised and lowered (can rotate in the up and down direction) with respect to the upper rotating body 41b. The attachment 43 includes a base end attachment 43a and a tip end attachment 43c.

[0038] The base end attachment 43a is provided between the tip end attachment 43c and the upper rotating body 41b. The base end attachment 43a includes a boom 43a1 and an arm 43a2. The boom 43a1 is rotatably attached to the upper rotating body 41b (rotatable in the front-rear direction and the up-down direction). The arm 43a2 is rotatably attached to the boom 43a1 (rotatable in the front-rear direction and the up-down direction).

[0039] The tip attachment 43c is provided at the tip of the attachment 43. The tip attachment 43c is rotatably attached to the base end attachment 43a (rotatable in the front-rear and up-down directions), specifically, rotatably attached to the arm 43a2. The tip attachment 43c may be a bucket for scooping or excavating a work object. The tip attachment 43c may be a device for clamping a work object (grapple, nibbler, etc.), a device for crushing a work object (breaker, etc.), or a magnet for attracting a metal work object. As shown in FIG. 4D, the tip attachment 43c may include a hook 43cf. The hook 43cf is for lifting a load 62. The object (work target) to be worked on by the tip attachment 43c shown in FIG. 4B may be soil, stone, wood, metal, resin, waste, a structure (such as a block), or a suspended load 62 (see FIG. 4D).

[0040] As shown in FIG. 9, the second work machine 50 is a machine different from the work machine 40. The second work machine 50 is a machine similar to the work machine 40 (e.g., a shovel, a crane, etc.). More specifically, the second work machine 50 is a machine equipped with a machine body 41 (lower traveling body 41a, upper rotating body 41b) and an attachment 43, similar to the work machine 40. When there are multiple machines at the work site S, if an object 30 of one machine is designated as a "work machine 40", an object 30 of a machine different from this "work machine 40" is a "second work machine 50". The second work machine 50 may be the same model as the work machine 40, or may be a different model. When there are multiple machines (work machine 40, second work machine 50) at the work site S, the number of machines may be three or more.

[0041] As shown in Fig. 4D, the transport vehicle 61 is a vehicle that transports a work object to be worked on by the work machine 40. The transport vehicle 61 is, for example, a dump truck. The transport vehicle 61 has a loading platform 61a. The loading platform 61a is a portion (container) in which the work object is placed. Note that a container (not shown) in which the work object is placed other than the loading platform 61a may be present at the work site S.

[0042] The load 62 is a work object that is lifted by the work machine 40 .

[0043] As shown in Fig. 8C, the obstacle 63 is, for example, an object that becomes an obstacle when the work machine 40 performs work. The obstacle 63 may include, for example, a building 63a, or may include a wall 63b (see Fig. 8B) fixed to the ground 31a.

[0044] The equipment 65 is installed in the work site S. The equipment 65 may include a partition device 65a, and as shown in Fig. 9, may include an imaging device 65b, may include an antenna 65c, may include a pole 65d, and may include a path 65e (see Fig. 8C).

[0045] 3A, the partitioning device 65a is a member that separates the work site S and is used as a boundary. The partitioning device 65a may be a cone (pylon), a combination of a cone and a bar, or a fence temporarily installed on the ground 31a.

[0046] As shown in FIG. 9, the imaging device 65b captures (photographs, detects, etc.) the work site S. For example, the imaging device 65b detects information overlooking the situation of the work site S. For example, the imaging device 65b may be used when a real machine (a machine corresponding to the work machine 40) is remotely operated or automatically operated. The imaging device 65b may allow an operator to grasp the situation around the machine when the real machine is remotely operated. The imaging device 65b may be used to monitor a worker 67 or a work machine 40 at the work site S. Specifically, the imaging device 65b may be used to monitor whether there is a worker 67 or a work machine 40 approaching a specific area A or an object 30. The imaging device 65b may be used for purposes other than the above. The imaging device 65b may be fixed to an object 30 such as the work machine 40. The imaging device 65b may be disposed inside the cab 41b2 (it may capture an image from the operator's viewpoint). The imaging device 65b may be a camera that captures two-dimensional images (such as a surveillance camera or an on-site camera), or may be a device that detects distance images (three-dimensional images including depth information) (such as a stereo camera, LIDAR, or millimeter wave radar).

[0047] Antenna 65c is used for wireless communication with work machine 40. For example, antenna 65c may be an antenna used when an actual machine (a machine corresponding to work machine 40) is remotely operated or automatically operated.

[0048] The pole 65d is a support for supporting a device, which may be, for example, the imaging device 65b or the antenna 65c.

[0049] The path 65e (see FIG. 8C) is a portion (such as a passageway or road) on which people and vehicles pass. The facility 65 may include other things than those described above. For example, the facility 65 may include materials, a material storage area (stockyard), or lights that illuminate the work site S.

[0050] The worker 67 is a person, and may be, for example, a person who performs the work manually or a supervisor.

[0051] (Area processing function) As shown in Fig. 1, the computer 13 (more specifically, the area processing unit 13b2) processes the area A (placement target T) (area processing function, area processing step). The area A is an area in a virtual space. The area A may be an area having a three-dimensional shape, an area having a two-dimensional shape, an area represented by a line, or an area (position) represented by a point.

[0052] The processing of area A, like the processing of object 30, includes deleting area A (removing from the virtual space) and arranging area A (arranging in the virtual space) (arranging step, area arranging step). The arrangement of area A is also referred to as "setting" area A (area setting step). Area A may be set based on object 30, for example, may be set based on the work machine 40 (see work machine area A40 described later), or may be set based on an object 30 other than the work machine 40. Area A may be set without being based on object 30. For example, area A may be set (arbitrarily) by manual operation by the user.

[0053] The conditions for processing (placement, deletion) of area A are, for example, as follows. The processing of area A may be performed in response to a manual operation by the user. The processing of area A may be performed automatically when a condition preset in the computer 13 is satisfied. For example, when an object 30 is placed (new placement, movement), area A may be placed based on the position of this object 30, etc.

[0054] Specific examples of area A are as follows: Area A includes the object coincidence area Ao (see FIG. 8A), the work machine area A40, and "other areas A." The "other areas A" include, for example, the work area A45, the second work machine area A50 (see FIG. 9), the no-entry area A71, the loading platform area A61a (see FIG. 4D), and the judgment target area A73 (see FIG. 8C).

[0055] 8A, the object coincident area Ao coincides (including approximately coincident) with the area in which the object 30 exists (area occupied). The object coincident area Ao is used, for example, for interference determination (described later). For example, when the work machine 40 is positioned, an area that coincides with the area in which the object 30 of the work machine 40 exists is set as the object coincident area Ao of the work machine 40. Note that the object 30 and the object coincident area Ao do not need to be distinguished (they do not need to be processed as separate information).

[0056] As shown in FIG. 1, the work machine area A40 is associated with the position of the work machine 40 (for example, work machine installation position P40c (see FIG. 4B)) (work machine area setting step). When the work machine 40 moves, the work machine area A40 also moves along with the movement of the work machine 40. Note that when the work machine 40 moves and the work machine area A40 moves, the area (trajectory) through which the work machine area A40 has passed may be set as the new work machine area A40. The work machine area A40 includes a work machine movable area A40a (see FIG. 3A) and a workable area A40b (see FIG. 7A). The object matching area Ao (see FIG. 8A) of the work machine 40 is included in the work machine area A40.

[0057] As shown in FIG. 3A, the work machine movable area A40a is set based on a position where the work machine 40 may be located when the work machine 40 is operated. The work machine movable area A40a is used, for example, to check the separation distance between the work machine 40 and the object 30 around the work machine 40 (safety check). The work machine movable area A40a is set based on a position where the work machine 40 may be located when the upper rotating body 41b rotates relative to the lower traveling body 41a without the work machine 40 traveling. The work machine movable area A40a is set based on at least one of the maximum working radius of the attachment 43 and the rear end turning radius of the upper rotating body 41b. Specifically, the work machine movable area A40a includes a maximum working radius area A40a1 and a rear end radius area A40a2 (see FIG. 3B).

[0058] The maximum working radius area A40a1 is set based on the maximum working radius of the attachment 43. The "maximum working radius" is the maximum value of the radius (attachment turning radius) of the attachment 43 centered on the turning central axis 41b1. In detail, the "maximum working radius" is the horizontal distance from the turning central axis 41b1 to the tip of the tip attachment 43c when the tip of the tip attachment 43c is disposed at the farthest position (forwardmost) from the upper turning body 41b. The maximum working radius area A40a1 may be circular when viewed from above, or may be fan-shaped or approximately fan-shaped when viewed from above (see FIG. 3B) (the turning angle of the upper turning body 41b may be limited). The radius of the maximum working radius area A40a1 is equal to or approximately equal to the maximum working radius. Note that the radius of the maximum working radius area A40a1 does not have to be equal to the maximum working radius, and may be, for example, larger than the maximum working radius (there may be a margin). As shown in FIG. 7C, when the maximum working radius area A40a1 has a three-dimensional shape, the maximum working radius area A40a1 may be a cylinder having a predetermined height (the same applies to the rear end radius area A40a2 (see FIG. 8B)). The maximum working radius area A40a1 may also be a sector or an approximate sector (more specifically, a three-dimensional shape with a sector or approximate sector shape at the bottom and top) having a predetermined height (the same applies to the rear end radius area A40a2 (see FIG. 8B)). When the maximum working radius area A40a1 is a sector or an approximate sector when viewed from above, the maximum working radius area A40a1 also rotates (rotates around the rotation central axis 41b1) with the rotation of the upper rotating body 41b (the same applies to the rear end radius area A40a2). When the maximum working radius area A40a1 turns, the area (path) through which the maximum working radius area A40a1 has passed may be set as the new maximum working radius area A40a1 (the same applies to the rear end radius area A40a2).

[0059] The rear end radius area A40a2 is set based on the rear end turning radius of the upper rotating body 41b, as shown in FIG. 3B. The "rear end turning radius" is the horizontal distance from the turning center axis 41b1 to the rear end of the upper rotating body 41b. The rear end radius area A40a2 may be circular when viewed from above, or may be fan-shaped or approximately fan-shaped when viewed from above (the turning angle of the upper rotating body 41b may be limited). The radius of the rear end radius area A40a2 is equal to or approximately equal to the rear end turning radius. Note that the radius of the rear end radius area A40a2 does not have to be equal to the rear end turning radius, and may be, for example, larger than the rear end turning radius (there may be a margin).

[0060] This work machine movable area A40a may be set based only on the maximum working radius area A40a1. The work machine movable area A40a may be set based on the maximum working radius area A40a1 and the rear end radius area A40a2. For example, the work machine movable area A40a may be an area in which the maximum working radius area A40a1 and the rear end radius area A40a2 are overlapped. The shape of the work machine area A40 used may differ depending on the use of the work machine area A40 (e.g., simple display, interference detection, etc.) (the same applies to areas A other than the work machine area A40).

[0061] As shown in Fig. 7A, the workable area A40b is used, for example, to check the workability (productivity) of the work machine 40 (details will be described later). As shown in Fig. 7B, the limited workable area A40b1 is an area to which the workable area A40b is limited (details will be described later).

[0062] 1, the work area A45 is an area (work area, work range) where the work machine 40 performs work. For example, the work area A45 is an area where work is planned to be performed by the work machine 40. The work area A45 may be set, for example, based on information (for example, a construction plan) input from the information input device 11b. The work area A45 may be set (specified), for example, by manual operation by the user.

[0063] The second work machine area A50 is associated with the location of the second work machine 50, as shown in Figure 9. The second work machine area A50 is associated with the location of the second work machine 50, similar to the work machine area A40 which is associated with the location of the work machine 40.

[0064] The loading platform area A61a is set inside the loading platform 61a as shown in Fig. 4D. When the work machine 40 is selected (for example, selected by the user) to work on the loading platform 61a, the loading platform area A61a may be the work area A45.

[0065] As shown in FIG. 8C, the no-entry area A71 is an area (no-entry area) into which the work machine 40 cannot enter. The no-entry area A71 may be set based on the position of the object 30. For example, the no-entry area A71 may be set based on the position of the obstacle 63, based on the position of the path 65e (safety passage, road, etc.), or based on the position of a material storage area (stockyard) not shown. For example, the no-entry area A71 may be set based on the topography 31, and specifically, for example, may be set on an unstable part of the ground such as a slope. For example, the no-entry area A71 may be set (arbitrarily) by manual operation by the user.

[0066] The judgment target area A73 is an area that is the target of interference judgment (judgment target area setting step) which will be described later.

[0067] (Operation mode switching function) A plurality of operation modes may be set in the calculator 13 shown in Fig. 1 (the work simulator 1 may have a plurality of operation modes). The calculator 13 may switch between a plurality of operation modes (operation mode switching function, operation mode switching step). The operation modes include, for example, a construction planning mode (step S20 shown in Fig. 2) and an operator operation mode (step S30 shown in Fig. 2). Note that operation modes other than these may be set in the calculator 13.

[0068] The construction planning mode (step S20 shown in FIG. 2) (construction planning step) is an operation mode for making a construction plan. For example, in the construction planning mode, the output device 15 displays a bird's-eye view of the work site S. For example, in the construction planning mode, the user manually operates or the computer 13 automatically arranges and deletes the object 30, and arranges and deletes the area A, etc.

[0069] The operator operation mode (step S30 shown in FIG. 2) (operator operation step) is an operation mode that simulates the operation of a real machine (a machine corresponding to the work machine 40). For example, in the operator operation mode, a user operates the work machine 40 by manual operation. Then, the work machine 40 operates (moves, changes its posture, etc.) in response to the user's manual operation. Specifically, the lower traveling body 41a, upper rotating body 41b, boom 43a1, arm 43a2, and tip attachment 43c shown in FIG. 4B move in response to the user's manual operation.

[0070] In this operator operation mode, the state of the work site S may change in response to the operation (work) of the work machine 40. For example, the terrain 31 may be deformed, and the object 30, which is the work target (earth and sand, a suspended load 62 (see FIG. 4D), etc.), may move.

[0071] This operator operation mode may be used for storing (teaching) the operation of the work machine 40 shown in Fig. 1. Teaching is performed as follows: the user operates the work machine 40 by manual operation, and the computer 13 stores this operation of the work machine 40. Thereafter, the work machine 40 may operate with the stored (taught) operation.

[0072] (Other features) The calculator 13 may have various functions other than those described above. Specific examples of the functions are as follows.

[0073] The computer 13 may have a function (time change function, time change step) of simulating a time change in the work site S. For example, the object 30 and the area A may change in accordance with a predetermined step or a time change in the work simulation.

[0074] The computer 13 has a function (placement assistance function, placement assistance step) (on-site construction support tool) that assists in the placement of the placement target T (specifically, at least one of the object 30 and the area A). The placement assistance function will be described in detail later.

[0075] The computer 13 may have a function (interference determination function, interference determination step) for determining interference between the areas A. The interference determination function will be described in detail later. The interference determination function may be included in the placement assistance function.

[0076] (Example of computer processing) The computer 13 can perform various processes in various orders. An example of the flow of the process of the computer 13 will be described with reference to Fig. 2. Each step (step S10 to step S50) will be described below with reference to Fig. 2.

[0077] 1 sets (lays out) the terrain 31. For example, information on the terrain 31 is read into the calculator 13 from the information input device 11b.

[0078] In step S20, the computer 13 sets the operation mode to the construction planning mode. The object processing unit 13b1 places and deletes the object 30. The area processing unit 13b2 places (sets) and deletes the area A.

[0079] In step S21, the computer 13 judges whether or not to start the operator operation mode. More specifically, the computer 13 judges whether or not the condition for starting the operator operation mode is satisfied. For example, the computer 13 judges whether or not starting the operator operation mode is selected by a user's manual operation (e.g., operation of the GUI). If the condition for starting the operator operation mode is satisfied (YES in step S21), the computer 13 advances the process flow to step S30 and sets the operation mode to the operator operation mode. If the condition for starting the operator operation mode is not satisfied (NO in step S21), the computer 13 advances the process flow to step S40 without setting the operation mode to the operator operation mode.

[0080] In step S30, the calculator 13 operates in an operator operation mode. In the operator operation mode, the user manually operates the work machine 40. This allows the user to check the workability of the work machine 40.

[0081] In step S31, the computer 13 judges whether or not to end the operator operation mode. More specifically, the computer 13 judges whether or not a condition for ending the operator operation mode is satisfied. For example, the computer 13 judges whether or not ending the operator operation mode is selected by a manual operation (for example, an operation of the GUI) of the user. If the condition for ending the operator operation mode is not satisfied (NO in step S31), the computer 13 continues the operator operation mode. In this case, the flow returns to step S30. Also, if the condition for ending the operator operation mode is satisfied (YES in step S31), the computer 13 ends the operator operation mode and sets the operation mode to the construction planning mode. In this case, the flow returns to step S20. When ending the operator operation mode, the computer 13 may save the situation of the work site S that has changed in the operator operation mode (for example, the shape of the ground 31a after the change, etc.). When the operation mode is changed from the operator operation mode to the construction planning mode, the computer 13 may set the work site S in the construction planning mode to the saved work site S (the change in the operator operation mode may be inherited). When the operation mode is changed from the operator operation mode to the construction planning mode, the computer 13 may set the work site S in the construction planning mode to the work site S before the change in the operator operation mode (the change in the operator operation mode may not be carried over). The computer 13 may allow the user to select whether or not to carry over the situation of the work site S that has changed in the operator operation mode to the construction planning mode.

[0082] In step S40, the calculator 13 performs various calculations. For example, the calculator 13 performs calculations of various events at the work site S. The calculator 13 may perform calculations related to safety at the work site S (for example, interference determination, which will be described later). The calculator 13 may calculate the workability (productivity) of work by the work machine 40. The user checks the safety at the work site S, the workability of the work machine 40, etc.

[0083] In step S50, computer 13 determines whether or not to end the work simulation. More specifically, computer 13 determines whether or not a condition for ending the work simulation has been met. For example, computer 13 determines whether or not ending the work simulation has been selected by a user's manual operation (e.g., GUI operation). If the condition for ending the work simulation is met (YES in step S50), computer 13 ends the work simulation. If the condition for ending the work simulation is not met (NO in step S50), computer 13 continues the work simulation. In this case, the flow returns to step S20.

[0084] (Example of manual position setting) A position in the virtual space (for example, the position of the object 30, the position of the area A, etc.) can be set (specified) by a user through manual operation. A specific example of a method for setting a position through manual operation is as follows. A position in the virtual space may be set by inputting a numerical value, for example, by inputting coordinates, or by inputting a numerical value indicating a direction (such as a rotation angle with respect to a predetermined coordinate axis). A position in the virtual space may be set by a mouse operation, a touch operation, or the like. Specifically, for example, when a user moves a mouse pointer, a position on the ground 31a is selected with the movement of the mouse pointer. A position on the ground 31a is set by a user clicking the mouse. With a position on the ground 31a being set, a position above or below the ground 31a is set by a user moving (for example, dragging) the mouse pointer up or down and clicking at a desired height. With a mode for setting a direction being set by a user operating a GUI, etc., a direction is set by moving (for example, dragging) the mouse pointer and clicking in a desired direction. Note that the above-mentioned method for setting a position through manual operation is merely one example, and a position may be set by various methods.

[0085] (Example of placement assistance function) The computer 13 has a function of assisting in the placement of the placement target T. The placement target T is at least one of the object 30 and the area A. For example, the computer 13 may calculate the position of the placement target T (see [Example A] below). The computer 13 may automatically place the placement target T at the calculated position of the placement target T, or may cause the output device 15 to output a candidate for the position of the placement target T. The computer 13 may calculate information useful for the placement of the placement target T (see [Example B], [Example C], [Example D], and [Example E] below). A specific example of the placement assistance function will be described below. As described above, the input device 11, the computer 13, and these components (such as the storage unit 13a) will be described with reference to FIG. 1. The object 30, the area A, and the placement target T will also be described with reference to FIG. 1.

[0086] ([Example A] Calculating the position of placement target T) As described above, in the work simulator 1, the position of the placement target T (object 30, area A) may be set by a manual operation by the user. However, if the user manually sets all of the settings of the position of the placement target T, the setting work is troublesome and time-consuming.

[0087] Therefore, it is preferable that the calculator 13 calculates (automatically calculates) the position of the placement target T. Specifically, the calculator 13 calculates an unset position P12 based on a set position P11 shown in Fig. 3A. The set position P11 is the position of the placement target T whose position has already been set. The unset position P12 is the position of the placement target T whose position has not been set.

[0088] For example, the calculator 13 may output (e.g., display) the calculated unset position P12 to the output device 15 as a candidate for the position of the placement target T. Also, for example, the calculator 13 may automatically place the placement target T at the calculated position. By the calculator 13 calculating the position of the placement target T, it is possible to reduce the effort and time required for the user to manually place the placement target T.

[0089] The positions of various types of placement targets T can be the set position P11 and the unset position P12. Specific examples of the set position P11 and the unset position P12 are as follows.

[0090] The set position P11 may be at least a part of the work machine 40. For example, the set position P11 may be a work machine area A40 associated with the position of the work machine 40, and the unset position P12 may be a placement target T different from the work machine 40 (see [Example A1] below). As shown in FIG. 4B, the set position P11 may be the position of at least a part of the object 30 of the work machine 40, and the unset position P12 may be a position of the work machine 40 different from the set position P11 (see [Example A2] below). Note that the set position P11 and the unset position P12 may be the positions of a placement target T different from the work machine 40.

[0091] ([Example A1] Example of calculating the position of a placement target T different from the work machine 40) For example, as shown in Fig. 3A, the set position P11 may be a position in the work machine area A40. Specifically, the set position P11 may be a position in the work machine movable area A40a. The unset position P12 may be a position of a placement target T different from the work machine 40. The calculator 13 may calculate the position of the placement target T different from the work machine 40 based on the position of the work machine area A40 (e.g., the work machine movable area A40a).

[0092] Here, the shape and size of the work machine area A40 may differ depending on the type and size of the work machine 40. In this example, the calculator 13 calculates the position of a placement target T different from the work machine 40 based on the work machine area A40. Therefore, an appropriate position depending on the type and size of the work machine 40 can be calculated as the position of the placement target T different from the work machine 40.

[0093] The "placement target T different from the work machine 40", which is the unset position P12, may be the object 30 or the area A. In the example shown in FIG. 3A, the "placement target T different from the work machine 40" is equipment 65 and a partition device 65a (e.g., a cone). The "placement target T different from the work machine 40" may be the second work machine 50 (see FIG. 9), a transport vehicle 61 (see FIG. 4D), or an obstacle 63 (see FIG. 1). The "placement target T different from the work machine 40" may be the area A, for example, the second work machine area A50 (see FIG. 9), a work area A45 (see FIG. 1), or a no-entry area A71 (see FIG. 1).

[0094] A specific example of the unset position P12 (the position of the partition device 65a in the example shown in FIG. 3A) calculated by the calculator 13 is as follows. The unset position P12 is calculated based on the work machine movable area A40a. For example, the calculated unset position P12 is a position outside the work machine movable area A40a (the side farther from the work machine 40). The calculated unset position P12 may be a position away from the work machine movable area A40a by a predetermined distance (a margin (e.g., 1 m)). The calculated unset position P12 may be a position along the outer periphery of the work machine movable area A40a. The calculated unset position P12 may be a position along a tangent to the arc-shaped portion of the work machine movable area A40a (see the tangent indicated by the two-dot chain line in FIG. 3A). This tangent may be one or more.

[0095] The work machine area A40 used in the calculation of the unset position P12 may be changed depending on the type of placement target T (e.g., partition device 65a, etc.) that is the subject of calculation of the unset position P12. For example, as shown in FIG. 3B, the maximum working radius area A40a1 and the rear end radius area A40a2 may be variously combined depending on the type of placement target T that is the subject of calculation of the unset position P12. In this case, the maximum working radius area A40a1 may or may not have a limited turning angle. In the example shown in FIG. 3B, the work machine area A40 used in the calculation of the unset position P12 is the shaded work machine movable area A40a.

[0096] When there are a plurality of unset positions P12 to be calculated (a plurality of partition devices 65a in the figure), the plurality of unset positions P12 are calculated, for example, as follows. Note that in Figs. 3A and 3B, only one unset position P12 among the plurality of unset positions P12 (a plurality of partition devices 65a) is given a symbol. As shown in Fig. 3B, the plurality of calculated unset positions P12 may be spaced apart from one another. This space may be set in various ways. Specifically, this space may be a set value manually set by the user, or may be a set value preset in the calculator 13. The calculator 13 may calculate the plurality of unset positions P12 so that the space is equal or approximately equal.

[0097] ([Example A2] Example of calculating the attitude of the work machine 40) 4B, the set position P11 may be the position of at least a part of the work machine 40 (e.g. the position of the object 30). The unset position P12 may be a position of the work machine 40 that is different from the set position P11. The calculator 13 may calculate a position of the work machine 40 that is different from the set position P11 based on the position of at least a part of the work machine 40.

[0098] Here, the position of the work machine 40 (including the attitude of the work machine 40) is determined by the position of the lower traveling body 41a (for example, work machine installation position P40c), the swing angle of the upper rotating body 41b relative to the lower traveling body 41a, and the attitude of the attachment 43. The attitude of the attachment 43 is determined by the angle of the boom 43a1 relative to the upper rotating body 41b, the angle of the arm 43a2 relative to the boom 43a1, and the angle of the tip attachment 43c relative to the arm 43a2. If the user were to set all of the positions of each part of the work machine 40 only by manual operation, the setting work would be laborious and time-consuming.

[0099] Therefore, when the position of at least a part of the work machine 40 (set position P11) has been set, it is preferable for the calculator 13 to calculate a position of the work machine 40 that is different from the set position P11 (unset position P12). In this case, the effort and time required for setting the positions of each part of the work machine 40 can be reduced.

[0100] ([Example A2-1] Calculation of the attitude of the work machine 40 based on the work machine installation position P40c) For example, as shown in Fig. 3B, the set position P11 may be the work machine installation position P40c. The unset position P12 may be the position of each part of the work machine 40 (the attitude of the work machine 40). In this example, the calculator 13 calculates the attitude of the work machine 40 based on the work machine installation position P40c and a preset attitude (described later).

[0101] The work machine installation position P40c (set position P11) is a position where the lower traveling structure 41a is installed. For example, the work machine installation position P40c is the position of the center point 41ac of the underside of the work machine (see FIG. 10A).

[0102] The calculated attitude of the work machine 40 (calculated unset position P12) may be the attitude of the attachment 43, specifically, the positions (angles) of the boom 43a1, the arm 43a2, and the tip attachment 43c. The calculated attitude of the work machine 40 may be the rotation angle of the upper rotating body 41b relative to the lower traveling body 41a.

[0103] The above-mentioned "preset posture" is a posture of the work machine 40 that is set in advance in the calculator 13. Various postures of the work machine 40 may be set as preset postures. Furthermore, parameters relating to the preset postures may be set by manual operation by the user.

[0104] Specific examples of the preset postures are as follows. The preset posture may be a maximum reach posture. The maximum reach posture is the posture of the work machine 40 when the radius of the attachment 43 about the turning central axis 41b1 ("attachment turning radius") is maximum. The preset posture may be a minimum turning radius posture (not shown). The minimum turning radius posture is the posture of the work machine 40 when the attachment turning radius is minimum. The preset posture may be a traveling posture (not shown). The traveling posture is the posture of the work machine 40 when it is traveling. Specifically, the traveling posture is a posture in which the arm 43a2 and the tip attachment 43c shown in FIG. 4B are brought close to the boom 43a1 (a posture in which the attachment 43 is embraced).

[0105] The preset posture may be a lifting posture (crane work posture) as shown in FIG. 4D. The lifting posture is the posture of the work machine 40 when the work machine 40 works to lift the load 62. Specifically, the lifting posture is a posture in which the tip of the tip attachment 43c is brought close to the arm 43a2 (a posture in which the tip attachment 43c is embraced), and is a posture in which work using the hook 43cf is possible. The parameters of the lifting posture may be set by the user. For example, the lifting height (height of the hook 43cf) in the lifting posture may be set. This lifting height may be the height from the underside of the work machine 40, the height from the load 62, or the height from the position where the load 62 is placed (for example, the loading platform 61a). In addition, for example, the work radius in the lifting posture may be set. The parameters of the lifting posture may be set in the calculator 13 based on the load 62. For example, the parameters of the lifting attitude may be associated (linked) with the load 62 and set in advance in the calculator 13. In this case, when the load 62 to be lifted is selected, the calculator 13 may read (reference) and set the parameters of the lifting attitude associated with the load 62. For example, the parameters of the lifting attitude may be calculated by the calculator 13 based on the state of the load 62 (e.g., at least one of the mass, volume, and shape).

[0106] The preset posture may be a loading posture. The loading posture is the posture of the work machine 40 when the work machine 40 loads a work object (such as earth and sand) onto the transport vehicle 61 or the like. The parameters of the loading posture may be set by the user. For example, the loading height (height of the tip attachment 43c) in the loading posture may be set. This loading height may be the height from the bottom surface of the work machine 40, or may be the height from the loading position (such as the loading platform 61a). In addition, for example, the working radius in the loading posture may be set. The parameters of the loading posture may be set in the calculator 13 based on the object (such as the transport vehicle 61) on which the work object is loaded. In the following, a case where the "object on which the work object is loaded" is the transport vehicle 61 will be described. For example, the parameters of the loading posture may be associated (linked) with the transport vehicle 61 and set in advance in the calculator 13. In this case, when a transport vehicle 61 onto which the work object is to be loaded is selected, the computer 13 may read (reference) and set parameters of the loading posture associated with the transport vehicle 61. For example, the parameters of the loading posture may be calculated by the computer 13 based on the state of the transport vehicle 61 (for example, at least one of the width, height, and shape of the loading platform 61a).

[0107] The preset posture may be the excavation posture shown in FIG. 5C. The excavation posture is the posture of the work machine 40 when the work machine 40 excavates a work object. Parameters of the excavation posture may be set by the user. For example, the excavation height in the excavation posture may be set. This excavation height may be the height from the bottom surface of the work machine 40 to the upper side, or the height (depth) from the bottom surface of the work machine 40 to the lower side. In addition, the working radius in the excavation posture may be set. The angle of the tip attachment 43c (specifically, the bucket) in the excavation posture may be set by the user, or may be automatically set by the calculator 13 according to the angle of the ground surface 31a to be excavated, etc.

[0108] The preset posture may be a slope cutting posture as shown in FIG. 4B. The slope cutting posture is the posture of the work machine 40 when the work machine 40 moves the tip attachment 43c (specifically, a bucket) along the inclined ground surface 31a (slope). The parameters of the slope cutting posture may be set by the user. For example, the excavation depth (e.g., the depth from the slope surface) in the slope cutting posture may be set. The angle of the tip attachment 43c (specifically, a bucket) in the slope cutting posture may be set by the user, or may be automatically set by the calculator 13 according to the angle of the slope surface (ground surface 31a) or the like.

[0109] A specific example of user operations in this [Example A2-1] is as follows. The user sets the work machine installation position P40c shown in FIG. 3A. For example, the user moves the mouse cursor to a position that the user wishes to set as the work machine installation position P40c, and clicks. The user selects one preset posture from a selection of multiple preset postures. The user may set parameters related to the preset posture. As a result, the posture of the work machine 40 is set to the selected preset posture. The posture of the work machine 40 may be adjustable from the preset posture to a posture desired by the user. For example, while a part of the attachment 43 is fixed, the posture (angle) of another part of the attachment 43 may be adjustable by a user operation.

[0110] ([Example A2-2] Calculation of the posture of the work machine 40 based on the work position P43c and the work machine installation position P40c) For example, as shown in Fig. 4B, the set position P11 may be the work position P43c and the work machine installation position P40c. The unset position P12 may be the position of the base end attachment 43a. The calculator 13 may calculate the position of the base end attachment 43a based on the work position P43c and the work machine installation position P40c.

[0111] The work position P43c is the position of at least a part of the end attachment 43c when the work machine 40 is working. The work position P43c differs depending on the type of the end attachment 43c and the type of work performed by the end attachment 43c (by the work machine 40). At least one of the type of the end attachment 43c and the type of work performed by the end attachment 43c may be selected by the user or automatically selected by the calculator 13.

[0112] For example, when the tip attachment 43c is a bucket and the work machine 40 performs excavation or compaction, the work position P43c is the tip (tip) of the tip attachment 43c (bucket). Also, for example, as shown in FIG. 4C, when the tip attachment 43c is a bucket and the work machine 40 performs earth dumping, the work position P43c is the center of the area inside the tip attachment 43c (bucket). The posture of the work machine 40 shown in FIG. 4C may be a posture in which earth is dumped or a posture before excavation. Also, for example, when the tip attachment 43c is a device (not shown) that grips a work target, the work position P43c is a position where the work target is gripped. Also, for example, as shown in FIG. 4D, when a lifting operation is performed by a hook 43cf, the work position P43c is the position of the hook 43cf, for example, a position (lifting position) of the hook 43cf where a rope is hung.

[0113] This working position P43c may be a point (working point), or may be one point or multiple points, as shown in Fig. 4B. As shown in Fig. 5B, the working position P43c may be a line (working line). The working line may include a straight line or a curved line. The working position P43c may be a surface (working surface) (not shown). The working surface may include a flat surface or a curved surface. The working position P43c may be a three-dimensional shape (working solid) (not shown).

[0114] The working position P43c is set, for example, as follows. The working position P43c may be set by a manual operation of the user. The working position P43c may be set by using a setting assistance function described later. The working position P43c may be set automatically by the calculator 13.

[0115] A specific example of the working position P43c being set by a manual operation by the user is as follows.

[0116] 4A, when the work position P43c is a point (work point), the user may set the work position P43c by specifying the position to be set as the work point. For example, the user may set the work position P43c by moving the mouse cursor to the position to be set as the work position P43c and clicking the mouse cursor.

[0117] As shown in FIG. 5A, a specific example of a method for setting the work position P43c when the work position P43c is a line (work line) is as follows. The work position P43c that is a work line may be set by the user specifying both ends of the work line (work start point, work end point). The work position P43c that is a work line may be set by the user specifying the end of the work line (e.g., work start point), the angle of the work line, and the length of the work line. The work position P43c that is a work line may be set so as to pass through a via point (midpoint) specified by the user. The work position P43c that is a work line may include a curve (e.g., a spline curve, etc.) calculated based on multiple points. The work position P43c that is a work line may be set by a line drawn by the user dragging the mouse, for example.

[0118] If the work position P43c is a surface (work surface) (not shown), the work position P43c may be set, for example, by the user specifying the position of the periphery of the work surface (such as a point or line on the periphery). The method of setting the point or line on the periphery may be the same as the method of setting the work point or work line described above. If the work position P43c is a solid (work solid) (not shown), the work position P43c may be set, for example, by the user specifying the bottom and top surfaces of the work solid. The method of setting the bottom and top surfaces of the work solid may be the same as the method of setting the work surface described above.

[0119] The position where this work position P43c is set may be limited based on some condition. For example, the work position P43c may be limited according to the specifications of the work machine 40. Specifically, an upper limit may be set for the distance from the turning center axis 41b1 shown in Fig. 4B to the work position P43c, an upper limit for the length of the work line (see Fig. 5B), or an upper limit for the size of the work surface or work solid.

[0120] (Work position P43c setting assistance function) It is preferable that the calculator 13 calculates a position suitable as the working position P43c shown in Fig. 4A. The calculator 13 may output (e.g., display) the calculated position to the output device 15 as a candidate for the working position P43c. The calculator 13 may automatically set the calculated position as the working position P43c. By the calculator 13 calculating the working position P43c, the effort and time required for setting the working position P43c can be reduced compared to when the user sets the working position P43c only by manual operation.

[0121] The calculator 13 calculates the work position P43c, for example, as follows. The calculator 13 may calculate the work position P43c based on the situation around the work machine 40 (for example, the situation of the object 30 or area A). The calculator 13 may calculate the work position P43c based on the type of work performed by the work machine 40 (for example, excavation, loading, lifting, etc.). The calculator 13 may calculate the work position P43c taking into account time changes in the work simulation. A specific example of the calculation of the work position P43c is as follows.

[0122] The calculator 13 may calculate the working position P43c based on the object 30.

[0123] The computer 13 may calculate the work position P43c based on the terrain 31. For example, when the work machine 40 performs work (excavation, slope cutting, etc.) on the terrain 31 (for example, the ground 31a), the computer 13 may calculate the work position P43c based on the terrain 31. The computer 13 may calculate a position on the ground 31a (a slope in the example shown in FIG. 4A) as the work position P43c. As shown in FIG. 5C, the computer 13 may calculate a position a predetermined distance (offset amount) away from the ground 31a as the work position P43c. In this case, the computer 13 may calculate a position lower (deep position) than the ground 31a as the work position P43c, or may calculate a position higher (in the air) than the ground 31a as the work position P43c. 4A, when the ground surface 31a is a slope, the calculator 13 may calculate a position that is a predetermined distance (offset amount) away from the ground surface 31a in a direction perpendicular to the ground surface 31a as the work position P43c. The offset amount may be set manually by the user or may be set in the calculator 13 in advance.

[0124] When the calculator 13 calculates the work position P43c based on the terrain 31, the terrain 31 on which the work machine 40 is placed may be different from the terrain 31 used to calculate the work position P43c. For example, when the work machine 40 is placed on the terrain 31 (ground surface 31a) as a model of the actual land (see FIG. 4B), the calculator 13 may calculate the work position P43c based on the terrain 31 as design data (design surface).

[0125] 5D, the computer 13 may calculate the working position P43c based on an obstacle 63 (e.g., a wall 63b) or the like. For example, the computer 13 may calculate a position that is a predetermined distance (offset distance L63) away from the obstacle 63 as the working position P43c.

[0126] 4D, when the work machine 40 performs a lifting operation, the computer 13 may calculate a work position P43c based on the suspended load 62. For example, the computer 13 may calculate a position directly above the suspended load 62, a predetermined distance (offset amount) above the suspended load 62, as the work position P43c (not shown).

[0127] The calculator 13 may calculate the work position P43c based on the area A.

[0128] 4C, the calculator 13 may calculate a working position P43c based on a working area A45 (an area where the work machine 40 performs work). The calculator 13 may calculate a predetermined position within the working area A45 as the working position P43c. For example, the calculator 13 may calculate the center of gravity, the centroid, or the position of an end (corner) of the working area A45 as the working position P43c.

[0129] 5D, the computer 13 may calculate the work position P43c based on the no-entry area A71, etc. The computer 13 may calculate a position that is a predetermined distance (offset distance LA71) away from the no-entry area A71 as the work position P43c.

[0130] The computer 13 may calculate the work position P43c based on the object 30 and the area A. For example, when the work machine 40 performs excavation work, the computer 13 may calculate a position that is a predetermined distance deeper than the ground surface 31a and within the work area A45 shown in Fig. 4C as the work position P43c, as shown in Fig. 5C. When the work machine 40 performs earth removal work (see Figs. 4C and 4D), the computer 13 may calculate a position (not shown) within the work area A45 and higher than the earth removal position (for example, the ground surface 31a, the loading platform 61a (see Fig. 4D), etc.) by a predetermined distance.

[0131] Calculator 13 may calculate work position P43c taking into account time changes in the work simulation. For example, assume that in the previous work performed by work machine 40, the work was completed only in a part of work area A45. In this case, calculator 13 may calculate the position where work will be performed next to the position where the work was completed in the previous work as work position P43c. In this case, the order of work in work area A45 (the order in which the work will be performed) may be set in advance in calculator 13.

[0132] (Specify the angle of the tip attachment 43c) As shown in Fig. 4A, when the working position P43c is set (determined), at least a part of the position of the tip attachment 43c is set (determined). At this time, the angle (posture, for example, the ground angle) of the tip attachment 43c may be undetermined. In this case, the angle of the tip attachment 43c is set, for example, as follows.

[0133] The angle of the tip attachment 43c may be set by a manual operation of the user. For example, the user may input a numerical value for the angle of the tip attachment 43c, may set the angle by operating a mouse, or may select one angle from a selection of multiple angles.

[0134] The angle of the tip attachment 43c may be set based on the type of work of the work machine 40, or may be set based on a preset posture set in the calculator 13. For example, as shown in FIG. 4D, when a lifting work or a preset posture of the lifting posture is selected, the angle of the tip attachment 43c may be set so that the tip of the tip attachment 43c (e.g., the tip of the bucket) approaches the arm 43a2. Also, for example, as shown in FIG. 5C, when an excavation work or a preset posture of the excavation posture is selected, the angle of the tip attachment 43c may be set so that the tip attachment 43c (bucket) is inclined by a predetermined angle with respect to the ground 31a. The above-mentioned "predetermined angle" is, for example, a parameter set by the user (see the explanation of the preset posture).

[0135] (Setting order of work position P43c and work machine installation position P40c) In this [Example A2-2], the calculator 13 calculates the position of the base end attachment 43a based on the work position P43c and the work machine installation position P40c as shown in Fig. 4B. Either the work position P43c or the work machine installation position P40c may be set first.

[0136] As shown in FIG. 4A, after the work position P43c is set, the work machine installation position P40c may be set as shown in FIG. 4B. In this case, the work position P43c and the work machine installation position P40c are set, for example, as follows. The work position P43c may be set by a manual operation by the user. Also, the setting assistance function may be used to set the work position P43c. After the work position P43c is set, the work machine 40 (for example, the work machine underside center point 41ac) moves in conjunction with, for example, the movement of the mouse pointer by the user's operation. At this time, the calculator 13 may display the attitude of the work machine 40 calculated from the inverse kinematics on the output device 15. Then, the user moves and clicks the mouse pointer, whereby the work machine installation position P40c is set (determined).

[0137] As shown in FIG. 6A, after the work machine installation position P40c is set, the work position P43c may be set as shown in FIG. 6B. In this case, the work machine installation position P40c and the work position P43c are set, for example, as follows. For example, the user moves and clicks the mouse pointer to set the work machine installation position P40c. After the work machine installation position P40c is set, the tip attachment 43c may move, for example, in conjunction with the movement of the mouse pointer by the user's operation. At this time, the calculator 13 may display the attitude of the work machine 40 calculated from the inverse kinematics on the output device 15. Then, the user may move and click the mouse pointer to set the work position P43c. The work position P43c may also be set by a setting assistance function for the work position P43c.

[0138] (Calculation of the position of the base end attachment 43a) As described above, the work position P43c and the work machine installation position P40c are set. Then, the calculator 13 calculates the position of the base end attachment 43a based on the work position P43c and the work machine installation position P40c. At this time, the calculator 13 calculates the position of the base end attachment 43a by inverse kinematics. Specifically, the calculator 13 calculates the position of the boom 43a1 (angle of the boom 43a1 relative to the upper rotating body 41b) and the position of the arm 43a2 (angle of the arm 43a2 relative to the boom 43a1).

[0139] (Determination of whether the attitude of the work machine 40 is established) As described above, the calculator 13 calculates the position of the base end attachment 43a using inverse kinematics. However, depending on the relative positions of the work machine installation position P40c and the work position P43c, the posture of the work machine 40 may not be established. For example, if the work machine installation position P40c and the work position P43c are too far away or too close, the posture of the work machine 40 will not be established. Therefore, it is preferable for the calculator 13 to determine whether the posture of the work machine 40 is established.

[0140] When the posture of the work machine 40 is not established, it is preferable that the calculator 13 causes the output device 15 to notify the user. Specific examples of this notification are as follows, for example. The output device 15 may output a message (error message) (e.g., text, voice, etc.) indicating that the posture of the work machine 40 is not established. The output device 15 may change the display mode (e.g., the color or transparency of the display of the work machine 40) between when the posture of the work machine 40 is established and when it is not established. The output device 15 may display the work machine 40 when the posture of the work machine 40 is established, and may not display the work machine 40 (or display it semi-transparently) when the posture of the work machine 40 is not established. The output device 15 may issue a notification to prompt the user to correct the work position P43c or the work machine installation position P40c.

[0141] In this example, a notification is given to the user when the posture of the work machine 40 is not established. This allows the user to consider whether the work machine 40 can be installed at the desired location (work position P43c) (whether it can be set as the work machine installation position P40c). Alternatively, the user can consider whether work can be performed at the location where the work machine 40 is desired to be installed (work machine installation position P40c) (whether the work position P43c can be set).

[0142] (Display of multiple positions of the work machine 40) For example, when the posture of the work machine 40 is set (determined) as in [Example A2-1] and [Example A2-2] above, the output device 15 displays the work machine 40 in the set posture. Here, the output device 15 may display only one posture of the work machine 40, or may display multiple postures of the work machine 40 as shown in FIG. 5B. When the output device 15 displays multiple postures of the work machine 40, the output device 15 may simultaneously display the multiple postures of the work machine 40, or may display changes (movements) in the posture of the work machine 40 as animation (animation display). Displaying multiple postures of the work machine 40 allows the user to easily grasp the movement of the work machine 40.

[0143] A specific example in which the output device 15 displays a plurality of postures of the work machine 40 is as follows.

[0144] If the work position P43c is a plurality of work points (not shown), the output device 15 may display the posture of the work machine 40 when working at each work point.

[0145] When the work position P43c is a work line, the output device 15 may display the posture of the work machine 40 when the end attachment 43c is at each of multiple points (start point, midpoint, end point, etc.) on the work line. When the work position P43c is a work line, the output device 15 may display the trajectory of at least a part of the attachment 43 when the end attachment 43c moves along the work line. The trajectory displayed at this time may be linear (trajectory of a point on the attachment 43) or may be a three-dimensional shape (trajectory of a surface or a solid on which the attachment 43 is located) (three-dimensional trajectory).

[0146] When the work position P43c is a surface (work surface) or a solid (work solid), the output device 15 may display as follows. In this case, the output device 15 may simultaneously display a posture when the end attachment 43c is at a certain position within the work surface or work solid, and a posture when the end attachment 43c is at another position. The output device 15 may display a trajectory of at least a part of the attachment 43 when the attachment 43 moves within the work surface or work solid.

[0147] The output device 15 may display each posture of the work machine 40 when the work machine 40 performs multiple types of work. For example, when the work machine 40 performs excavation work and earth removal work, the output device 15 may simultaneously display the posture of the work machine 40 when performing excavation work (see FIG. 5C) and the posture of the work machine 40 when performing earth removal work (see FIG. 4C).

[0148] The output device 15 may display multiple postures for a portion of the work machine 40, and only one posture for the other portion (not shown). For example, when the upper rotating body 41b rotates, the output device 15 may display multiple postures of the upper rotating body 41b and the attachment 43. In this case, the display of the upper rotating body 41b may overlap and be difficult to see. Therefore, the output device 15 may display multiple postures of the attachment 43, and only one posture of the upper rotating body 41b.

[0149] The output device 15 may display, as an animation, the change in posture (movement) of the work machine 40. For example, the output device 15 may display, as an animation, the change in posture of the work machine 40 when the end attachment 43c moves along the work position P43c of the work line.

[0150] ([Example A3] Calculation of the position of the placement target T different from the work machine 40) Note that the set position P11 shown in FIG. 3A may be a placement target T different from the work machine 40, and the unset position P12 may be a placement target T different from the work machine 40. The computer 13 may calculate the position of the placement target T different from the work machine 40 based on the placement target T different from the work machine 40. Specifically, for example, as shown in FIG. 1, it is assumed that a no-entry area A71 has been set (at an arbitrary position) by manual operation by the user. The computer 13 may calculate the position of the equipment 65 based on the position of the no-entry area A71. For example, the computer 13 may calculate the position of the boundary (or its vicinity) between the inside and outside of the no-entry area A71 as the position of the equipment 65.

[0151] ([Example B] Display to assist in the placement of the placement target T, etc.) As shown in Fig. 7A, it is preferable that the output device 15 performs a display that assists in the placement of the placement target T (at least one of the object 30 and the area A). For example, the output device 15 may perform a display that assists in the placement of the work machine 40. Specifically, the output device 15 may display the work machine area A40 (see [Example B1] below), or may perform a display showing the capability of the work machine 40 (see [Example B2] below) (see Fig. 7D).

[0152] ([Example B1] Display of work machine area A40) The output device 15 may display the work machine area A40 superimposed on the work machine 40. As described above, the work machine area A40 is associated with the position of the work machine 40. When the work machine 40 moves, the calculator 13 moves the work machine area A40 in conjunction with the movement of the work machine 40. At this time, the output device 15 displays the work machine area A40 after the movement. Also, as described above, when the work machine 40 moves and the work machine area A40 moves, the area (trajectory) through which the work machine area A40 has passed may be set as the new work machine area A40. In this case, the output device 15 may display the above-mentioned "new work machine area A40".

[0153] ([Example B1-1] Display of work machine movable area A40a) As shown in FIG. 7C, the output device 15 may display the work machine movable area A40a (see FIG. 3A and FIG. 3B). As described above, when the maximum working radius area A40a1 is a sector or a nearly sector when viewed from above, the maximum working radius area A40a1 may also rotate as the upper rotating body 41b rotates. In this case, the output device 15 displays the maximum working radius area A40a1 after the rotation (similar to the rear end radius area A40a2). Also, as described above, when the upper rotating body 41b rotates and the maximum working radius area A40a1 rotates, the area (trajectory) through which the maximum working radius area A40a1 passed may be set as the new maximum working radius area A40a1 (similar to the rear end radius area A40a2). In this case, the output device 15 may display the "new maximum working radius area A40a1" (similar to the rear end radius area A40a2).

[0154] ([Example B1-2] Display of workable area A40b) As shown in FIG. 7A, the output device 15 may display a workable area A40b. The workable area A40b is an area in which the tip attachment 43c can be placed when the attachment 43 is operated. The difference between the workable area A40b and the work machine movable area A40a (see FIG. 7C) is as follows. As shown in FIG. 7C, the work machine movable area A40a is an area in which the movable area of ​​the tip attachment 43c in the front-rear direction is taken into consideration, and the movable area of ​​the tip attachment 43c in the up-down direction is not taken into consideration. Therefore, it is difficult for the user to accurately grasp how far the work machine 40 can work in the up-down direction by only displaying the work machine movable area A40a. On the other hand, as shown in FIG. 7A, the workable area A40b is an area in which the movable area of ​​the tip attachment 43c in the front-rear direction and the up-down direction is taken into consideration. The workable area A40b is an area that indicates how far (how deep and how high) the work machine 40 can work in the forward / backward and vertical directions. The workable area A40b is an area that is determined by physical constraints such as the dimensions and shape of the attachment 43 and the operating range of the actuator that operates the attachment 43 (specifically, the stroke of the cylinder).

[0155] By displaying the workable area A40b, the output device 15 can allow the user to grasp the area in which the work machine 40 can work at the position where the work machine 40 is installed (work machine installation position P40c). This allows the user to, for example, consider and confirm the workability (productivity) of the work machine 40. As a result, it is easy for the user to consider the installation position of the work machine 40.

[0156] The output device 15 displays the workable area A40b, for example, as follows.

[0157] The output device 15 may display the workable area A40b two-dimensionally. For example, the output device 15 displays a display (two-dimensional display) of the machine body 41 and the attachment 43 viewed from the side and the two-dimensional workable area A40b (operating range diagram) in a superimposed manner.

[0158] The output device 15 may display the workable area A40b in three dimensions. For example, the output device 15 may display a two-dimensional (planar) workable area A40b (operating range diagram) superimposed on the three-dimensional work machine 40 (not shown). In this case, the workable area A40b may be displayed at the center position in the lateral direction (width direction) of the attachment 43. The workable area A40b may rotate about the rotation central axis 41b1 following the rotation of the upper rotating body 41b relative to the lower traveling body 41a.

[0159] (Display of limited workable area A40b1) As shown in Fig. 7B, the output device 15 may display a limited workable area A40b1. The limited workable area A40b1 is within the range of the workable area A40b and is an area narrower than the workable area A40b (an area to which the workable area A40b is limited). For example, the limited workable area A40b1 is set based on a workable area limit value (a predetermined parameter).

[0160] As described above, the workable area A40b is an area determined by physical constraints such as the attachment 43. On the other hand, the limited workable area A40b1 is determined by a workable area limit value that is set based on, for example, operational constraints of the work machine 40. Specifically, the workable area limit value may be a limit value based on the work machine 40 or a limit value based on the work site S. The workable area limit value may be a limit value in the height direction, for example, a limit value in the height direction from the underside of the work machine 40, or a limit value in the height direction (height or depth) from the ground 31a. For example, when the workable area limit value is set to a predetermined depth below the ground 31a, the limited workable area A40b1 is set to a height equal to or higher than this "predetermined depth". The workable area limit value may be a limit value in the front-rear direction or the lateral direction of the upper rotating body 41b. For example, when the workable area limit value is set to a predetermined position forward of the lower traveling body 41a, the limited workable area A40b1 is set to a position forward of this "predetermined position." As shown in Fig. 7C, the workable area limit value may be a limit value for the rotation direction (rotation angle) of the upper rotating body 41b. In this case, the limit value for the rotation angle may be set to a value (a numerical value of an angle) that is greater than 0 degrees and less than 360 degrees, or may be set by a value indicating how many times the width of the tip attachment 43c (e.g., a bucket) is.

[0161] The output device 15 may cause the display mode (e.g., display color) of the limited workable area A40b1 to differ from the display mode of portions different from the limited workable area A40b1. For example, the output device 15 may cause the display of the limited workable area A40b1 to differ from the display of the work machine movable area A40a, or may cause the display of the terrain 31 outside the range of the limited workable area A40b1 to differ from the display of the work machine movable area A40a.

[0162] ([Example B2] Display showing the capacity of the work machine 40) As shown in FIG. 7D, the output device 15 may perform a display showing the capacity of the work machine 40 other than the workable area A40b (see FIG. 7A). For example, when the work machine 40 is performing a lifting operation, the output device 15 may perform the following display. The output device 15 may perform a display (rated load display Db2) showing the relationship between the working radius (horizontal distance from the rotation center axis 41b1 to the hook 43cf) and the load that can be lifted (mass of the suspended load 62 (see FIG. 4D)). The output device 15 may change the display mode (display color, etc.) according to the load that can be lifted. The output device 15 may superimpose the display showing the relationship between the working radius and the load and the work machine 40. The output device 15 may display a table (rated load table) showing the relationship between the load that can be lifted and the work radius without superimposing it on the work machine 40.

[0163] ([Example C] Calculation of work capacity (productivity)) It is preferable that the calculator 13 calculates a value indicating the workable amount (productivity) of the work machine 40. The calculated value indicating the workable amount may be the workable amount itself, or may be a value correlated with the workable amount. The workable amount is the amount of work object (such as soil and sand) that the work machine 40 can work on. Specifically, for example, the workable amount is the amount of soil and sand that the work machine 40 can excavate. By the calculator 13 calculating a value indicating the workable amount of the work machine 40, the user can plan the work (for example, place the placement object T) while checking the workable amount.

[0164] As shown in FIG. 7B, the calculator 13 may calculate a value indicating the amount of work possible based on the workable area A40b. The calculator 13 may calculate a value indicating the amount of work possible (for example, the amount of excavation possible) based on the limited workable area A40b1. For example, the calculator 13 may calculate the area of ​​the region surrounded by the two-dimensional limited workable area A40b1 and the ground 31a as the value indicating the amount of work possible. The calculator 13 may calculate the volume, which is the product of this area and the width of the tip attachment 43c (here, a bucket), as the value indicating the amount of work possible. The calculator 13 may calculate the volume of the region surrounded by the three-dimensional limited workable area A40b1 and the ground 31a as the value indicating the amount of work possible. The calculator 13 may calculate the workable mass based on this volume and the density of the work object (for example, soil and sand) as the value indicating the amount of work possible.

[0165] The output device 15 may display a value indicating the calculated possible work amount (e.g., area, volume, mass, etc.). The output device 15 may perform display based on the value indicating the calculated possible work amount. For example, the output device 15 may change the display mode (e.g., display color) of the workable area A40b or the limited workable area A40b1 used in calculating the possible work amount according to the calculated possible work amount.

[0166] ([Example D] Collision detection function) As shown in FIG. 8A, it is preferable that the computer 13 judges (performs interference judgment) the state of interference between areas A (including object-coincident areas Ao). In this case, the user can check the state of interference between areas A. As a result, the user can check whether the positions of the object 30 and area A are appropriate. "Interference" between areas A means that areas A overlap (areas overlap each other). The "state of interference" judged by the computer 13 includes at least whether or not there is interference. The "state of interference" judged by the computer 13 may include the amount of interference (e.g., area, volume), the time of interference, or the number of times interference occurs.

[0167] Various areas A can be the subject of interference determination. For example, the calculator 13 may perform interference determination between the work machine area A40 and the judgment target area A73 (see [Example D1] below). The calculator 13 may perform interference determination between an area A other than the work machine 40 (i.e., an area A other than the work machine area A40) and the judgment target area A73 (see [Example D2] below). Specific examples of interference determination are as follows.

[0168] ([Example D1] Collision determination between work machine area A40 and judgment target area A73) The calculator 13 may perform interference determination between the work machine area A40 and the judgment target area A73. This determination may be used, for example, to confirm whether a sufficient separation distance is secured between the work machine 40 and the judgment target area A73.

[0169] In this example, the judgment target area A73 is an area A different from the work machine area A40. Various areas A can be the judgment target area A73. For example, the judgment target area A73 may be an area A different from the second work machine area A50 (see FIG. 9) (see [Example D1-1] below), or may be the second work machine area A50 (see FIG. 9) (see [Example D1-2] below).

[0170] ([Example D1-1] Collision determination between the work machine area A40 and an area A different from the second work machine area A50) As shown in FIG. 8A, the calculator 13 may perform interference determination between a work machine area A40 and an area A (an example of a determination target area A73) different from the second work machine area A50 (see FIG. 9).

[0171] The determination target area A73 may be an object 30 (more specifically, an object-coincident area Ao of the object 30). The determination target object 30 may be, for example, a transport vehicle 61 (see FIG. 4D), a suspended load 62 (see FIG. 4D), an obstacle 63, a facility 65 (see FIG. 8C), or a worker 67 (see FIG. 9). The determination target area A73 may be an area A set based on the position of the determination target object 30, and may be an area A other than the object-coincident area Ao. The determination target area A73 may be an area A set without being based on the position of the object 30 (for example, an area A set by a manual operation by a user).

[0172] Specifically, for example, the determination target area A73 may be a no-entry area A71. For example, the no-entry area A71 may be set between a position a predetermined distance away from an object 30 (for example, an obstacle 63) and the object 30 (in this example, the obstacle 63). As shown in Fig. 8C, a boundary between the inside and outside of the no-entry area A71 may be set based on the position of the object 30 (for example, a partition fixture 65a). The no-entry area A71 may be set (arbitrarily) by a manual operation of the user.

[0173] ([Example D1-2] Collision determination between work machine area A40 and second work machine area A50) As shown in FIG. 9, the computer 13 may perform interference determination between the work machine area A40 and the second work machine area A50 (an example of the determination target area A73). For example, the computer 13 may perform interference determination between the work machine 40 and the second work machine 50. This "work machine 40" is, in detail, the object coincidence area Ao of the work machine 40 (an example of the work machine area A40), and this "second work machine 50" is the object coincidence area Ao of the second work machine 50 (an example of the second work machine area A50). By performing interference determination between the work machine area A40 and the second work machine area A50, it is possible to determine the state of contact or approach between multiple machines (the work machine 40 and the second work machine 50). When interference determination is performed between the object coincidence area Ao of the work machine 40 and the object coincidence area Ao of the second work machine 50, it is possible to determine the presence or absence of contact between the multiple machines (the work machine 40 and the second work machine 50).

[0174] ([Example D2] Collision determination between area A different from the work machine 40 and the judgment target area A73) The computer 13 may perform interference determination between areas A that are set regardless of the work machine 40. Specifically, for example, the computer 13 may perform interference determination between the facility 65 (more specifically, the object coincidence area Ao of the facility 65) and the obstacle 63 (more specifically, the object coincidence area Ao of the obstacle 63) shown in Fig. 8C. In this case, for example, it is possible to determine whether the facility 65 overlaps with the obstacle 63 or whether it is too close to the obstacle 63.

[0175] (Change in criteria) The computer 13 may change the criteria for the interference determination (at least one of the two areas A that are the subject of the interference determination). For example, the computer 13 may change the criteria for the interference determination depending on the type of the area A for which the interference determination is performed.

[0176] Here, as a specific example, a case where interference determination is performed between the work machine area A40 and the judgment target area A73 (the case of [Example D1] above) will be described as shown in Fig. 8A. The calculator 13 may change the work machine area A40 (judgment criterion) used for interference judgment depending on the type of the judgment target area A73.

[0177] Specifically, for example, in the example shown in FIG. 8A and FIG. 8B, the computer 13 performs interference determination between the work machine area A40 and the wall 63b (more specifically, the object coincidence area Ao of the wall 63b). In this example, the work machine area A40 used for interference determination is an area obtained by superimposing the maximum working radius area A40a1, in which the turning angle is limited, and the rear end radius area A40a2. Also, in the example shown in FIG. 8C, the computer 13 performs interference determination between the work machine area A40 and the building 63a (more specifically, the object coincidence area Ao of the building 63a). In this example, the work machine area A40 used for interference determination is the maximum working radius area A40a1. Also, in this example, the computer 13 performs interference determination between the work machine area A40 and the no-entry area A71. In this example, the work machine area A40 used for interference determination is the maximum working radius area A40a1. In this way, the computer 13 may change the criteria for interference determination depending on the type of area A for which interference determination is performed.

[0178] (Using the results of collision detection) Information on the result of the collision detection may be used for various processes. A specific example of a method of using the result of the collision detection is as follows.

[0179] The output device 15 may change the display mode (e.g., display color) of the area A for which an interference judgment has been made depending on whether the areas A interfere with each other. For example, as shown in FIG. 8B, the output device 15 may change the display mode of the judgment target area A73 between when the work machine area A40 and the judgment target area A73 interfere with each other and when there is no interference (see FIG. 8A) (not shown). The output device 15 may change the display mode of the work machine area A40 between when the work machine area A40 and the judgment target area A73 interfere with each other and when there is no interference. In this case, the output device 15 may change the display mode of the entire work machine area A40 (not shown). Also, there are cases where the work machine area A40 is made up of multiple parts (specifically, the maximum work radius area A40a1 and the rear end radius area A40a2). In the example shown in FIG. 8B, the output device 15 changes the display mode of only the portion of the work machine area A40 that is interfering with the judgment target area A73 from the display mode when there is no interference.

[0180] The output device 15 may provide a notification when the areas A interfere with each other. The output device 15 may output a message (error message) (e.g., text, audio, etc.) indicating that the areas A interfere with each other. The output device 15 may output a notification urging the user to change the position of the placement target T when the areas A interfere with each other. In this case, the output device 15 may show options for the position of the placement target T so that the areas A do not interfere with each other. The output device 15 may output a notification urging the user to change the model of the work machine 40 when the areas A interfere with each other. In this case, the output device 15 may show options for the model of the work machine 40 so that the areas A do not interfere with each other.

[0181] For example, when the work machine 40 or the like is operating, the area A may move. In such a case, the areas A may interfere with each other multiple times (interfering with each other and not interfering with each other may be repeated). Therefore, the calculator 13 may count the number of times the areas A interfere with each other.

[0182] The calculator 13 may store the posture of the work machine 40 when the work machine area A40 and the judgment target area A73 interfere with each other. In this case, the output device 15 may display the stored posture of the work machine 40. This allows the user to understand the posture of the work machine 40 when the work machine area A40 and the judgment target area A73 interfere with each other.

[0183] (Placement restrictions based on collision detection results) The computer 13 may restrict the placement of the placement target T based on the result of the interference determination. For example, the computer 13 may restrict the placement of the object 30 (such as the work machine 40) that is about to be placed based on the result of the interference determination. For example, the computer 13 may restrict the placement of the object 30 that is about to be placed so that the area A associated with the object 30 that is about to be placed does not interfere with the determination target area A73.

[0184] For example, the calculator 13 may restrict the placement of the work machine 40 so that the work machine area A40 of the work machine 40 to be placed does not interfere with the judgment target area A73. Specifically, for example, the calculator 13 restricts the placement of the work machine 40 to a position where the work machine area A40 will interfere with an obstacle 63, as in the example shown in Figure 8B. The calculator 13 also allows the placement of the work machine 40 to a position where the work machine area A40 will not interfere with an obstacle 63, as in the example shown in Figure 8A.

[0185] For example, the computer 13 may restrict the placement of the equipment 65 (see FIG. 8C) so that the equipment 65 to be placed does not interfere with the judgment target area A73 (such as the object matching area Ao of the obstacle 63).

[0186] (Interference detection when time changes) As described above, the computer 13 may change the state (position, shape, etc.) of the area A in response to time changes (changes in time, steps, etc.) in the work simulation. Then, the computer 13 may perform an interference determination between the areas A when the state of the area A changes. The computer 13 may perform the interference determination continuously or stepwise in response to continuous or stepwise changes in time.

[0187] For example, when the work machine 40 operates (e.g., travels, turns, etc.), the work machine area A40 may move. In this case, the calculator 13 performs an interference determination between the moving work machine area A40 and the determination target area A73. In this case, interference determination can be performed while the work machine 40 is operating.

[0188] (Time changes of multiple machines) As shown in FIG. 9, when multiple machines (the work machine 40 and the second work machine 50) are at the work site S, the multiple machines may operate (move) depending on time changes in the work simulation. In this case, the computer 13 may perform interference determination, for example, as follows. The computer 13 may determine the state of interference between the work machine area A40 and the second work machine area A50 when the work machine 40 and the second work machine 50 are each operated. In this case, it is possible to check the work plan and safety when multiple machines (the work machine 40, the second work machine 50) are operated (operated) at the work site S.

[0189] When interference determination is performed for a plurality of operating machines (the work machine 40, the second work machine 50), the machines may be operated by various methods. At least one of the work machine 40 and the second work machine 50 may operate simultaneously with the user's manual operation in accordance with the operator operation mode (step S30 in FIG. 2). At least one of the work machine 40 and the second work machine 50 may operate based on information previously stored (taught) in accordance with the user's manual operation. At least one of the work machine 40 and the second work machine 50 may operate based on an operation previously stored in the calculator 13 (preset operation).

[0190] A specific example of an operation by the user to operate the work machine 40 and the second work machine 50 is as follows.

[0191] [Specific Example 1 of Operation] For example, the user selects a machine for which the user wishes to memorize (teach) the operation from among a plurality of machines (work machine 40, second work machine 50). The user selects one work machine 40, for example, by operating an operation target selection section (not shown) of the GUI. The user operates and operates the selected work machine 40. The computer 13 stores the operation of this work machine 40. The user selects the start of operation of the work machine 40 in the taught operation, for example, by operating the GUI. Then, the work machine 40 starts operation in the taught operation. In addition, before, simultaneously with, or after the start of operation of the work machine 40, the user selects a machine (second work machine 50) to be the object of interference judgment. The user operates the second work machine 50 by manual operation. Then, the computer 13 may perform interference judgment between the work machine area A40 of the operating work machine 40 and the second work machine area A50 of the operating second work machine 50.

[0192] [Specific Example of Operation 2] Furthermore, for example, the user may perform teaching of each of the work machine 40 and the second work machine 50. The user operates the work machine 40 and the second work machine 50 based on the taught information, for example, by operating a GUI. Then, the calculator 13 may perform interference determination between the work machine area A40 of the operating work machine 40 and the second work machine area A50 of the operating second work machine 50.

[0193] [Specific Example of Operation 3] Furthermore, for example, the user may operate at least one of the work machine 40 and the second work machine 50 based on a preset operation by operating the GUI.

[0194] ([Example E] Checking visibility) As described above, the output device 15 displays the work site S in the virtual space. The output device 15 may display various views. The output device 15 may display views from various positions (reference positions, directions) of the work site S. The output device 15 may display views with various angles of view (range, viewing angle). The output device 15 may switch between and display various views. The output device 15 may display multiple views simultaneously. The output device 15 may display a view from the object 30, or may display a view from the area A. The output device 15 may display a view from outside the object 30, or may display a view from outside the area A. Specific examples of views output by the output device 15 are as follows.

[0195] The output device 15 may display a bird's-eye view of the entire or most part of the work site S (site bird's-eye view mode). The output device 15 may display a view from outside the work machine 40 (work machine external viewpoint). When the work machine external viewpoint is displayed, the user can check how the work machine 40 appears from the surroundings of the work machine 40. This allows the user to easily grasp, for example, the state of separation between the work machine 40 and objects around the work machine 40.

[0196] The output device 15 may display the field of view from the work machine 40. For example, the output device 15 may display the field of view from a camera (rear camera) provided on the rear portion of the upper rotating body 41b.

[0197] The output device 15 may display the view from inside the cab 41b2 (cab viewpoint) (see the second view V2). By displaying the cab viewpoint, the user can confirm the view from the operator in the cab 41b2 (the operator's line of sight). In this case, the user can confirm the operator's line of sight (in advance) without operating the actual machine (corresponding to the work machine 40). For example, the user can confirm where the blind spot is when viewed from the cab 41b2. As a result, risk prediction activities become easier. When the cab viewpoint is displayed in the operator operation mode, the user (operator) can confirm the view from the cab 41b2 while experiencing the operation of the work machine 40.

[0198] As described above, the cab 41b2 may be movable relative to the bottom of the upper revolving body 41b. In this case, the cab viewpoint (angle, height) may be changed according to the position (angle, height) of the cab 41b2 relative to the bottom of the upper revolving body 41b. This allows the user to confirm the operator's line of sight when the position of the cab 41b2 relative to the bottom of the upper revolving body 41b changes. As described above, the cab 41b2 may be equipped with accessories (e.g., a guard, etc.). In this case, the output device 15 may display a view from a cab viewpoint in a state where the accessories are attached to the main body of the cab 41b2. This allows the user to confirm the operator's line of sight in a state where the accessories are attached to the main body of the cab 41b2.

[0199] As shown in Fig. 8A, there are cases where the calculator 13 performs interference determination between the work machine area A40 of the work machine 40 and the judgment target area A73 (see [Example D1] above). In this case, the output device 15 may display a bird's-eye view of this work machine 40 (the work machine 40 corresponding to the work machine area A40 for which interference determination is performed) and the judgment target area A73. In this case, the user can grasp the state of separation between the work machine 40 and the judgment target area A73.

[0200] Furthermore, when the calculator 13 performs interference determination between the work machine area A40 of the work machine 40 and the judgment target area A73, the output device 15 may display the field of view of the judgment target area A73 from this work machine 40. In this case, as shown in Fig. 9 (see second view V2), the field of view from the work machine 40 may be the field of view from inside the cab 41b2, or may be the field of view from a position on the work machine 40 other than the inside of the cab 41b2 (such as a rear camera). Displaying the field of view of the judgment target area A73 from the work machine 40 allows the user to grasp the field of view when looking in the direction from the work machine 40 towards the judgment target area A73.

[0201] The output device 15 may display the view from an object 30 other than the work machine 40. The output device 15 may display the view from an obstacle 63 (see FIG. 8C), may display the view from equipment 65 (such as the imaging device 65b), or may display the view from a worker 67 (such as a supervisor).

[0202] The imaging device 65b can be installed in various positions in the actual work site S, and the user may want to consider an appropriate installation position for the imaging device 65b. In this case, the output device 15 displays the field of view from the imaging device 65b. This allows the user to understand (confirm) where in the work site S the imaging device 65b should be installed.

[0203] When an object 30, such as the imaging device 65b or the antenna 65c, which is small compared to the work machine 40, is placed at the work site S, it may be difficult for a user looking at the display of the output device 15 to grasp the presence or absence and position of the small object 30. Therefore, for example, it is preferable that the small object 30 (such as the imaging device 65b) and the pole 65d are provided as a set (integrally).

[0204] (Simultaneous display of multiple views) Output device 15 may display multiple (two or more) views simultaneously. Output device 15 may display a first view V1 and a second view V2. The first view V1 and the second view V2 are views from different positions (viewpoints) in the virtual space. Output device 15 may display three or more views (a third view, a fourth view, etc.). Specific examples of when output device 15 displays multiple views are as follows.

[0205] The output device 15 may display the view from the work machine 40 (work machine viewpoint) and the view from outside the work machine 40 (work machine external viewpoint) (bird's-eye view image). For example, in the construction planning mode (step S20 in FIG. 2), the output device 15 may display the view from outside the work machine 40 in most of the display area. At this time, the output device 15 may display the view from an arbitrary (user-desired) position in a part of the display area. The view from this arbitrary position may be, for example, the view from the imaging device 65b, the view from a worker 67 (e.g., a supervisor), or the view from the cab 41b2.

[0206] For example, in the operator operation mode (step S30 in FIG. 2), the output device 15 may display the view from inside the cab 41b2 in most of the display area (e.g., a screen), and display the view from outside the work machine 40 in a portion of the display area. In this case, the user can check the state of contact or proximity between the work machine 40 and objects around the work machine 40, while experiencing the operation of the work machine 40.

[0207] (Calculation of placement of object 30) As described above, the computer 13 places the object 30 in the work site S in the virtual space. The object 30 is usually placed so as to be in contact with the ground 31a. Note that there may be an object 30 that is not placed so as to be in contact with the ground 31a. For example, there may be an object 30 that floats in the air (such as a flying object such as a drone) or an object 30 that is placed only underground 31b.

[0208] The work machine 40 is disposed so as to be in contact (or approximately in contact) with the ground 31a. More specifically, as shown in Fig. 4B, the lower surface of the lower structure 41a is disposed so as to be in contact (or approximately in contact) with the ground 31a. Specific examples of the arrangement of the work machine 40 on the ground 31a are as follows, for example.

[0209] [Layout Example 1] The work machine 40 may be arranged so that the underside of the lower body 41a is in contact with the ground 31a. In this case, the work machine 40 may be arranged so that the underside of the lower body 41a is not located below the ground 31a (so as not to penetrate into the ground 31b).

[0210] (Example of placement using the ground contact point P21) [Layout Example 2] It is preferable to reduce the calculation load on the computer 13 regarding the layout of the work machine 40. Specifically, as shown in Fig. 10C, the computer 13 may calculate the contact between the ground contact determination point P21 and the ground 31a without calculating the contact between the entire underside of the work machine 40 and the ground 31a.

[0211] The ground contact judgment points P21 are used to judge whether the work machine 40 is placed on the ground 31a so that the work machine 40 is in contact or nearly in contact with the ground 31a. As shown in Fig. 10A, the ground contact judgment points P21 are set at three or more specific points (positions) on the underside of the work machine 40. For example, the ground contact judgment points P21 are set at four specific points on the underside of the work machine 40. For example, the multiple ground contact judgment points P21 are placed at positions equidistant from the center point 41ac of the underside of the work machine.

[0212] When the lower traveling body 41a includes left and right crawlers 41a1, 41a1, the ground contact judgment point P21 is set at both ends (front end, rear end) in the longitudinal direction of each of the left and right crawlers 41a1, 41a1 (four points in total). For example, as shown in FIG. 6B, when the crawler 41a1 includes a plurality of rollers 41a2, the ground contact judgment point P21 (see FIG. 10A) is set at a position below the rollers 41a2 at both ends (the frontmost and rearmost) in the longitudinal direction among the plurality of rollers 41a2. As shown in FIG. 10A, the ground contact judgment point P21 may be set at the center in the width direction of the crawler 41a1. The ground contact judgment point P21 may also be set at an end in the width direction of the crawler 41a1 (not shown), etc.

[0213] When the lower traveling body 41a includes a plurality of wheels (not shown), the ground contact determination point P21 may be set at the lower end of the wheel. The ground contact determination point P21 may be set at the center of the wheel in the width direction, or may be disposed at an end of the wheel in the width direction.

[0214] As shown in Fig. 10C, the computer 13 rotates the work machine 40 with respect to the horizontal direction so that the three ground contact determination points P21 come into contact with the ground 31a. The computer 13 positions the work machine 40 so that the three ground contact determination points P21 come into contact with the ground 31a. A specific example of this positioning is as follows.

[0215] The computer 13 performs the following process or a process substantially equivalent to the following process. As shown in FIG. 10B, the computer 13 projects (vertically projects, for example, downwardly projects) each of the multiple ground contact judgment points P21 onto the ground 31a in a state in which the work machine 40 is not tilted relative to the horizontal plane (a state in which the turning center axis 41b1 (see FIG. 4B) extends in the vertical direction). The computer 13 calculates the position (position on the ground 31a) of the ground contact judgment point P21 projected onto the ground 31a. The position of the ground contact judgment point P21 projected onto the ground 31a is set as the projected ground contact judgment point P23. The computer 13 calculates the ground contact surface P25 based on three or more projected ground contact judgment points P23. For example, the computer 13 may set a plane passing through the three projected ground contact judgment points P23 as the ground contact surface P25. In this method of calculating the ground surface P25, when there are four or more projected ground determination points P23, it is sufficient that at least three of the projected ground determination points P23 are on the ground surface P25. Also, for example, the calculator 13 may calculate a plane that minimizes the distance between the four or more projected ground determination points P23 and the plane, for example, by using the least squares method, and may use the calculated plane as the ground surface P25 (may be approximated as a plane).

[0216] In a state where the work machine 40 is not placed on the ground 31a, for example, when the user is attempting to place the work machine 40 on the ground 31a, the work machine 40 may be displayed above the ground 31a. In such a case, the output device 15 may display at least a part of the ground surface P25. For example, the output device 15 may display the range in which a rectangle having four sides at the widthwise ends and front-rear ends of the lower traveling structure 41a is projected onto the ground surface P25. The output device 15 may also display the range in which the crawler 41a1 is projected (projected downward) onto the ground surface P25 (not shown).

[0217] Calculator 13 calculates the three-dimensional rotation angle of contact surface P25 (e.g., the three-dimensional rotation angle relative to the horizontal direction). As shown in Fig. 10C, calculator 13 rotates work machine 40 relative to the horizontal direction so that the three-dimensional rotation angle of contact surface P25 and the three-dimensional rotation angle of the underside of work machine 40 (more specifically, the underside of crawler 41a1) match. At this time, calculator 13 rotates work machine 40, for example, around work machine underside center point 41ac.

[0218] The calculator 13 positions the work machine 40 so that the underside of the rotated undercarriage 41a of the work machine 40 coincides with the ground contact surface P25. At this time, for example, the calculator 13 may position the work machine 40 so that the position of the center point 41ac of the work machine underside is directly above the position designated by the user as the work machine installation position P40c (see FIG. 4B). Also, for example, the calculator 13 may position the work machine 40 so that the three ground contact determination points P21 coincide with the ground surface 31a.

[0219] In this [Layout Example 2], the calculation load related to the placement of the work machine 40 on the ground 31a can be reduced compared to the above [Layout Example 1] (where the underside of the lower running body 41a is not placed below the ground 31a).

[0220] (Determination of contact between the work machine 40 and the ground surface 31a) The calculator 13 may determine that the underside of the work machine 40 and the ground 31a are in "contact" when three ground contact judgment points P21 are in contact with the ground 31a (are on the ground 31a) and the remaining ground contact judgment points P21 are at a height equal to or higher than the ground 31a. Note that when only three ground contact judgment points P21 are set, the calculator 13 may determine that the underside of the work machine 40 and the ground 31a are in "contact" when three ground contact judgment points P21 are in contact with the ground 31a.

[0221] (Effects of the first invention) The effects of the work simulator 1 shown in Fig. 1 are as follows: The work simulator 1 includes a computer 13. The computer 13 simulates, in a virtual space, a work site S where a work machine 40 performs work.

[0222] [Configuration 1] The computer 13 places a placement target T in a virtual space. The placement target T is at least one of an object 30 and an area A. The computer 13 has a function of assisting in the placement of the placement target T.

[0223] In the above [Configuration 1], the computer 13 has a function of assisting in the placement of the placement target T. Therefore, compared to the case where the user manually performs all of the operations for placing the placement target T, the effort and time required for placing the placement target T can be reduced.

[0224] (Effects of the second invention) [Configuration 2] As shown in Fig. 3A, the calculator 13 (see Fig. 1; the same applies to the calculator 13 below) calculates an unset position P12 based on a set position P11. The set position P11 is the position of a placement target T (see Fig. 1) whose position has already been set. The unset position P12 is the position of a placement target T (see Fig. 1) whose position has not been set. The set position P11 is the position of at least a part of the work machine 40 arranged in the virtual space.

[0225] In the above [Configuration 2], the computer 13 automatically calculates the unset position P12 based on the set position P11, which is the position of at least a portion of the work machine 40 arranged in the virtual space. Therefore, it is possible to reduce the effort and time required for setting the unset position P12, compared to when the user manually sets all of the unset positions P12.

[0226] (Effects of the third invention) [Configuration 3] The computer 13 sets a work machine area A40, which is an area A associated with the position of the work machine 40. The set position P11 is the work machine area A40.

[0227] In the above [Configuration 3], the calculator 13 automatically calculates the unset position P12 based on the work machine area A40, which is the set position P11. Therefore, the effort and time required for setting the unset position P12 can be reduced compared to when the user manually sets the unset position P12.

[0228] (Effect of the fourth invention) As shown in Fig. 4B, the work machine 40 includes a machine body 41 and an attachment 43. The attachment 43 is capable of being raised and lowered relative to the machine body 41. The attachment 43 includes a tip attachment 43c and a base attachment 43a. The tip attachment 43c is provided at the tip of the attachment 43. The base attachment 43a is provided between the tip attachment 43c and the machine body 41.

[0229] [Configuration 4] The set position P11 is the working position P43c and the work machine installation position P40c. The working position P43c is the position of at least a part of the tip attachment 43c when the work machine 40 is working. The work machine installation position P40c is the position where the machine body 41 is installed. The unset position P12 is the base end attachment 43a.

[0230] In the above [Configuration 4], the calculator 13 automatically calculates the position (unset position P12) of the base end attachment 43a based on the work position P43c and the work machine installation position P40c (based on the set position P11). Therefore, compared to the case where the user manually sets all of the positions of the base end attachment 43a, the effort and time required for setting the position of the base end attachment 43a can be reduced.

[0231] (Effect of the fifth aspect of the invention) [Configuration 5] After the work position P43c is set, the work machine installation position P40c is set.

[0232] The above [Configuration 5] provides the following effects. In the above [Configuration 4], the work position P43c and the work machine installation position P40c are set as the set position P11. Here, it is assumed that a position suitable for the work position P43c has been determined in advance. In such a case, it is convenient for the user to set the work machine installation position P40c after the work position P43c has been set.

[0233] (Effect of the sixth aspect of the invention) [Configuration 6] After the work machine installation position P40c is set, the work position P43c is set.

[0234] The above [Configuration 6] provides the following effects. In the above [Configuration 4], the work position P43c and the work machine installation position P40c are set as the set position P11. Here, it is assumed that a position suitable for the work machine installation position P40c has been determined in advance. In such a case, it is convenient for the user to set the work position P43c after the work machine installation position P40c has been set.

[0235] (Effects of the seventh aspect of the invention) [Configuration 7] The calculator 13 determines whether the posture of the work machine 40 when the tip attachment 43c is positioned at the work position P43c and the lower running body 41a is positioned at the work machine installation position P40c is a posture that the work machine 40 can take.

[0236] The above [Configuration 7] provides the following effect. In the above [Configuration 4], the position of the base end attachment 43a (unset position P12) is calculated based on the positions of the work position P43c and the work machine installation position P40c (set position P11). However, depending on the positions of the work position P43c and the work machine installation position P40c, there are cases where the posture of the work machine 40 is not established. Therefore, the work simulator 1 is provided with the above [Configuration 7]. Therefore, the calculator 13 can automatically determine whether the posture of the work machine 40 corresponding to the work position P43c and the work machine installation position P40c is a posture that the work machine 40 can take.

[0237] (Effect of the eighth aspect of the invention) The work machine 40 includes a machine body 41 and an attachment 43. The attachment 43 is capable of rising and lowering relative to the machine body 41. The attachment 43 includes a tip attachment 43c provided at the tip of the attachment 43.

[0238] [Configuration 8] The computer 13 sets a workable area A40b as shown in Fig. 7A. The workable area A40b is an area in which the tip attachment 43c can be placed when the attachment 43 is operated.

[0239] By the above [Configuration 8], the computer 13 can perform processing based on the workable area A40b (for example, displaying on the output device 15, etc.).

[0240] (Effect of the ninth aspect of the invention) [Configuration 9] The computer 13 sets a limited workable area A40b1 as shown in Fig. 7B. The limited workable area A40b1 is set based on a workable area limit value set in the computer 13. The limited workable area A40b1 is within the range of the workable area A40b and is narrower than the workable area A40b.

[0241] The above [Configuration 9] enables the calculator 13 to perform processing based on the limited workable area A40b1. Specifically, for example, the calculator 13 may cause the output device 15 to display the limited workable area A40b1, and may calculate a value indicating the workable amount of the work machine 40 in the limited workable area A40b1.

[0242] (Effect of the 10th Invention) [Configuration 10] As shown in FIG. 9, the computer 13 causes the output device 15 to simultaneously display a plurality of views (for example, a first view V1 and a second view V2) from different positions in a virtual space.

[0243] The above [Configuration 10] allows the user to simultaneously check multiple views (e.g., the first view V1 and the second view V2). For example, the user can place a placement target T (see FIG. 1) while checking the multiple views.

[0244] (Effects of the eleventh aspect of the invention) [Configuration 11] The computer 13 sets three or more predetermined points on the underside of the work machine 40 as ground contact determination points P21, as shown in FIG. 10A. The computer 13 calculates the position of a projected ground contact determination point P23 obtained by projecting the ground contact determination point P21 onto the ground surface 31a, as shown in FIG. 10B. The computer 13 calculates the three-dimensional rotation angle of the ground contact surface P25 calculated based on the three or more projected ground contact determination points P23. The computer 13 rotates the work machine 40 so that the three-dimensional rotation angle of the ground contact surface P25 and the three-dimensional rotation angle of the underside of the work machine 40 match, as shown in FIG. 10C. The computer 13 positions the work machine 40 so that the underside of the work machine 40 and the ground contact surface P25 match.

[0245] The above [Configuration 11] makes it possible to reduce the computational load for calculations relating to the placement of the work machine 40 on the ground 31a, compared to when the state of contact between the entire underside of the work machine 40 and the ground 31a is calculated (for example, the above [Placement Example 1]).

[0246] (Effects of the twelfth aspect of the invention) [Configuration 12] The computer 13 has a function of operating the work machine 40 with the placement object T placed in the virtual space.

[0247] The above [Configuration 12] makes it possible to simulate in a virtual space what kind of situation will occur when the work machine 40 operates at the work site S where the placement object T is placed. Therefore, the user or computer 13 can confirm (verify) what kind of situation will occur when the work machine 40 operates at the work site S.

[0248] (Effects of the thirteenth aspect of the invention) [Configuration 13] As shown in Fig. 4B, the work machine 40 includes a lower traveling body 41a, an upper rotating body 41b, and an attachment 43. The upper rotating body 41b can rotate relative to the lower traveling body 41a. The attachment 43 can be raised and lowered relative to the upper rotating body 41b.

[0249] In the above [Configuration 13], the work machine 40 is a machine (specifically, a shovel, a crane, etc.) equipped with an upper rotating body 41b that can rotate relative to a lower traveling body 41a, and an attachment 43 that can be raised and lowered relative to the upper rotating body 41b. The work simulator 1 can assist in the placement of a placement target T at a work site S where such a work machine 40 performs work (see the effect of the above [Configuration 1]).

[0250] (Effects of the fourteenth aspect of the invention) [Configuration 14] The effects of the work simulation program are as follows. The work simulation program is a program for simulating, in a virtual space, a work site S where a work machine 40 performs work, as shown in Fig. 1. The work simulation program causes the computer 13 to execute a placement step and a placement assistance step. The placement step places a placement target T, which is at least either an object 30 or an area A, in the virtual space. The placement assistance step assists in the placement of the placement target T.

[0251] In the above [Configuration 14], the placement assistance step assists in the placement of the placement target T. Therefore, compared to the case where the user manually performs all of the placement operations of the placement target T, the effort and time required for placing the placement target T can be reduced.

[0252] (Effects of the fifteenth aspect of the invention) [Configuration 15] The effects of the work simulation method are as follows. The work simulation method is a method for simulating, in a virtual space, a work site S where a work machine 40 performs work. The work simulation method includes a placement step and a placement assistance step. The placement step places a placement target T, which is at least one of an object 30 and an area A, in the virtual space. The placement assistance step assists in the placement of the placement target T.

[0253] In the above [Configuration 15], the placement assistance step assists in the placement of the placement target T. Therefore, compared to the case where the user manually performs all of the placement operations of the placement target T, the effort and time required for placing the placement target T can be reduced.

[0254] (Modification) The work simulator 1 shown in FIG. 1 may include at least some of the components of a remote control device for remotely controlling a real machine (a real machine configured similarly to the work machine 40). The work simulator 1 may utilize the components of the remote control device. For example, the work simulator 1 may be implemented in a remote control device. For example, the remote control device includes an input device 11, a calculator 13, and an output device 15. The input device 11 includes an operation device (e.g., an operation lever, an operation pedal), and outputs an operation signal (a lever operation signal, a pedal operation signal) according to the operation of the operation device. During remote operation, the calculator 13 exchanges signals with the real machine to be remotely operated via a communication means. During remote operation, the calculator 13 transmits a signal (operation command signal) to the real machine to operate the work device (corresponding to the attachment 43 (see FIG. 4B)) and the traveling device (corresponding to the lower traveling body 41a (see FIG. 4B)) of the real machine based on the operation signal input from the input device 11. During remote control, the computer 13 receives image data from a camera mounted on the actual machine, signals output from sensors mounted on the actual machine, etc. via a communication means. During remote control, the output device 15 (specifically, a monitor) outputs image data from a camera mounted on the actual machine (data acquired by the computer 13).

[0255] The work simulator 1 may include only some of the components of the remote control device. For example, the input device 11 may utilize the components of the remote control device, and the computer 13 and the output device 15 may not each utilize the components of the remote control device. Also, for example, the input device 11 and the output device 15 may each utilize the components of the remote control device, and the computer 13 may not each utilize the components of the remote control device.

[0256] When the work simulator 1 is equipped with an input device 11 of a remote control device, the user can operate the work machine 40 in the virtual space using the input device 11 of the remote control device for remotely operating the actual machine (see, for example, the operator operation mode described above). Thus, the user can experience the feeling of operating the actual machine by operating the work machine 40 in the virtual space. As a result, for example, the user's mastery of operating the remote control device can be promoted. In addition, for example, it is possible to easily imagine (such as what kind of situation will arise) what would happen if the actual machine at the actual site (corresponding to the work site S) were operated by the remote control device.

[0257] When the work simulator 1 is equipped with the output device 15 of the remote control device, the user can operate the work machine 40 in the virtual space while looking at the output device 15 of the remote control device, which is the same as when remotely operating a real machine. In this case, the output device 15 of the work simulator 1 can also be used as the output device 15 of the remote control device. Therefore, there is no need to use a device (such as a monitor) separate from the output device 15 of the remote control device as the output device 15 of the work simulator 1.

[0258] When the work simulator 1 is equipped with the input device 11 of the remote control device and the output device 15 of the remote control device, the following effects can be obtained. In this case, the user can operate the work machine 40 in the virtual space by operating the input device 11 of the remote control device that is operated when remotely operating the actual machine, while looking at the output device 15 of the remote control device that is viewed when remotely operating the actual machine. Therefore, compared to when the work simulator 1 is equipped with only one of the input device 11 of the remote control device and the output device 15 of the remote control device, the user can experience a sensation closer to the sensation of operating the actual machine.

[0259] (Other variations) The above embodiment and modified examples may be modified in various ways. For example, various examples (including modified examples) of the above embodiment may be combined in various ways. For example, the connection of each component shown in FIG. 1 and the like may be changed. For example, the number of components (including modified examples) of the above embodiment may be changed, and some of the components may not be provided. The "components" include components in the virtual space (specifically, the object 30 and the area A) (same below). For example, the arrangement of the components may be changed. For example, the inclusion relationship of the components may be changed in various ways. For example, a component described as a lower component included in a higher-level component may not be included in this higher-level component, and may be included in another component. For example, a component described as a plurality of different members or parts may be treated as a single member or part. For example, a component described as a single member or part may be provided separately as a plurality of different members or parts. For example, the order of the steps in the flowchart shown in FIG. 2 and the like may be changed, and some of the steps may not be performed, and for example, each component may have only a part of each feature (action function, arrangement, shape, operation, etc.). [Explanation of symbols]

[0260] 1. Work simulator 13 Calculator 15 Output Devices 30 Objects 40 Work Machinery 41 Machine body 41a Undercarriage 41b Upper rotating body 43 Attachment 43a Base end attachment 43c Tip Attachment Area A A40 Work Machine Area A40b Working area A40b1 Limited work area P11 Set position P12 Unset position P21 Grounding judgment point P23 Projected ground judgment point P25 Ground plane P40c Work machine installation position P43c Working position S Work site T placement target

Claims

1. A computer is provided for simulating in a virtual space a work site where a work machine performs work, the computer places a placement target, which is at least one of an object and an area, in the virtual space; The computer has a function of assisting in the placement of the placement target. Work simulator.

2. The work simulator according to claim 1, the computer calculates an unset position, which is a position of the placement object whose position has not been set, based on a set position, which is a position of the placement object whose position has been set; the set position is a position of at least a part of the work machine arranged in the virtual space; Work simulator.

3. The work simulator according to claim 2, The computer sets a work machine area, which is the area associated with the position of the work machine; the set location is the work machine area; Work simulator.

4. The work simulator according to claim 2, The work machine includes: The machine body, an attachment that can be raised and lowered relative to the machine body; Equipped with The attachment comprises: A tip attachment provided at a tip portion of the attachment; a base end attachment provided between the tip end attachment and the machine body; Equipped with the set positions are a work position which is a position of at least a part of the tip attachment when the work machine is working, and a work machine installation position which is a position where the machine main body is installed, The unset position is the base end attachment. Work simulator.

5. The work simulator according to claim 4, After the work position is set, the work machine installation position is set. Work simulator.

6. The work simulator according to claim 4, After the work machine installation position is set, the work position is set. Work simulator.

7. The work simulator according to claim 4, the computer determines whether or not a posture of the work machine when the end attachment is disposed at the work position and the lower traveling body is disposed at the work machine installation position is a posture that the work machine can take. Work simulator.

8. The work simulator according to claim 1, The work machine includes: The machine body, an attachment that can be raised and lowered relative to the machine body; Equipped with The attachment includes a tip attachment provided at a tip portion of the attachment, The computer sets a workable area which is an area in which the end attachment can be placed when the attachment is activated. Work simulator.

9. The work simulator according to claim 8, the computer sets a limited workable area within the range of the workable area and narrower than the workable area based on a workable area limit value set in the computer; Work simulator.

10. The work simulator according to claim 1, The computer causes an output device to simultaneously display a plurality of views from different positions in the virtual space. Work simulator.

11. The work simulator according to claim 1, The computer includes: three or more predetermined points on the underside of the work machine are set as ground contact determination points; Calculating a position of a projected contact point obtained by projecting the contact point onto the ground; Calculating a three-dimensional rotation angle of the ground contact surface calculated based on the three or more projected ground contact determination points; rotating the work machine so that a three-dimensional rotation angle of the contact surface and a three-dimensional rotation angle of a bottom surface of the work machine coincide with each other; Positioning the work machine so that the underside of the work machine coincides with the ground contact surface; Work simulator.

12. The work simulator according to claim 1, The computer has a function of operating the work machine in a state in which the placement object is placed in the virtual space. The work simulator according to claim 1 .

13. The work simulator according to claim 1, The work machine includes: A lower running body; An upper rotating body that is rotatable relative to the lower traveling body; An attachment that can be raised and lowered relative to the upper rotating body; Equipped with Work simulator.

14. A work simulation program for simulating, in a virtual space, a work site where a work machine performs work, comprising: an arrangement step of arranging an arrangement target, which is at least one of an object and an area, in the virtual space; a placement assistance step of assisting in placement of the placement object; Execute the following on a computer. Work simulation program.

15. A work simulation method for simulating, in a virtual space, a work site where a work machine performs work, comprising the steps of: an arrangement step of arranging an arrangement target, which is at least one of an object and an area, in the virtual space; a placement assistance step of assisting in placement of the placement object; Equipped with Work simulation method.

Citation Information

Patent Citations

  • Work plan system and work plan method

    JP2022011680A

Cited By

  • Augmented reality display system for construction work

    JP7908458B1