Operation verification device, operation verification program, and operation verification method

JP2025003032APending Publication Date: 2025-01-09KOBELCO CONSTR MASCH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023103477
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-06-23
Publication Date
2025-01-09

AI Technical Summary

Benefits of technology

【0009】 上記の動作検証装置、動作検証プログラム、および、動作検証方法のそれぞれにより、作業シミュレーションを行う仮想空間内の状態を、所望のタイミングにリセットすることができる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025003032000001_ABST
    Figure 2025003032000001_ABST
Patent Text Reader

Abstract

To reset the state in a virtual space where work simulation is performed at a desired timing.SOLUTION: A work simulator 1 includes a computer 13. The computer 13 simulates a work site S that includes a work machine 40 and the surrounding environment being the work target of the work machine 40 in a virtual space. The computer 13 resets the state in the virtual space to the state at a specified timing.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an operation verification device, an operation verification program, and an operation verification method for simulating a work site in a virtual space. [Background technology]

[0002] For example, Patent Document 1 describes a management system that executes a simulation of a work machine (see paragraph 0094 of Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-157635 A Summary of the Invention [Problem to be solved by the invention]

[0004] In a simulation of a work machine, it is desirable to be able to reset the state in the virtual space at a desired timing.

[0005] An object of the present invention is to provide an operation verification device, an operation verification program, and an operation verification method that are capable of resetting the state in a virtual space at a desired timing. [Means for solving the problem]

[0006] The operation verification device includes a computer that simulates in a virtual space a work site including a work machine and a surrounding environment in which the work machine is to work. The computer resets a state in the virtual space to a state at a specified time.

[0007] The operation verification program is a program for simulating in a virtual space a work site including a work machine and the surrounding environment in which the work machine is to work. The work simulation program causes a computer to execute a reset step of resetting a state in the virtual space to a state at a specified timing.

[0008] The operation verification method is a method for simulating in a virtual space a work site including a work machine and a surrounding environment in which the work machine is to work. The work simulation method includes a reset step of resetting a state in the virtual space to a state at a specified timing. Effect of the Invention

[0009] The above-mentioned operation verification device, operation verification program, and operation verification method each make it possible to reset the state in the virtual space in which the task simulation is performed to a desired timing. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing a work simulator 1. [Diagram 2] 2 is a flowchart showing the process of a computer 13 shown in FIG. 1. [Diagram 3] 2 is a diagram showing an image in which the state of the object 30 in the work site S shown in FIG. 1 is stored at fixed time intervals. FIG. [Figure 4] 2 is a diagram showing an image in which the state of an object 30 in the work site S shown in FIG. 1 is stored each time a task is started. FIG. [Diagram 5] 2 is a diagram showing an image in which the state of the object 30 in the work site S shown in FIG. 1 is stored each time an event occurs. FIG. [Figure 6] 1. FIG. 4 is a diagram showing a specific example of a display screen displayed on the output device 15 when the state of the object 30 in the work site S shown in FIG. 1 is manually stored. [Figure 7]1. FIG. 4 is a diagram showing a specific example of a display screen displayed on the output device 15 when selecting a reset timing for resetting the state of the object 30 in the work site S shown in FIG. [Figure 8] 1. FIG. 4 is a diagram showing a specific example of a display screen displayed on the output device 15 after selecting a reset timing when resetting the state of the object 30 in the work site S shown in FIG. [Figure 9] 3 is a flowchart showing a reset process of the calculator 13 called in the flowchart shown in FIG. 2. [Figure 10] FIG. 4 is a diagram showing a specific example of a display screen displayed on the output device 15 when automatic reset is performed in the operator operation mode in step S30 in the flowchart shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] A task simulator 1 serving as an action verification device will be described with reference to FIGS. 1 to 10.

[0012] As shown in Fig. 1, the work simulator 1 is a simulator that performs a simulation (work simulation) of a work site S in a virtual space. The work simulator 1 may be at least one of a personal computer, a tablet, and a smartphone. The work simulator 1 includes an input device 11, a calculator 13, and an output device 15 (display device). The work simulator 1 may also include a client device 10 and a server device 20.

[0013] The input device 11 is a device for inputting information to the calculator 13. The input device 11 includes an operation input device 11a and an information input device 11b.

[0014] The operation input device 11a is operated by a user (worker, operator) of the work simulator 1. The operation of the operation input device 11a by the user is also referred to as "manual operation". The operation input device 11a may be used to set (specify, select) a position in a virtual space. The operation input device 11a may be used to set an object 30 (described later). The operation input device 11a may be used to operate a work machine 40 (described later) in a virtual space. The operation input device 11a may be used, for example, to instruct the start and end of the operation of the work machine 40, and may be used for the running of the work machine 40, the rotation of the upper rotating body 41b (see FIG. 1), and the operation of an attachment 43 (see FIG. 1). For example, the operation input device 11a may include at least one of a mouse, a keyboard, a touch panel, and a game pad. The operation input device 11a may be equipped with levers and pedals that imitate left and right operation levers and left and right operation pedals (pedals at the feet) of an actual machine (a machine corresponding to the work machine 40).

[0015] The information input device 11b is a device for inputting various information (excluding information by operation of the operation input device 11a) to the computer 13. The above-mentioned "various information" is, for example, information on an object 30 (described later) and request information input by the user regarding reset timing (described later).

[0016] The calculator 13 is a computer that performs input and output of signals, calculations, and storage of information. The calculator 13 simulates a work site S in a virtual space. Each function of the calculator 13 (for example, functions of an object processing unit 13b1 and a reset timing processing unit 13b3 described later) is realized by executing a program (a work simulation program as an operation verification program) stored in the storage unit 13a in the calculation unit 13b. The calculator 13 and other devices (for example, the input device 11 and the output device 15) may be connected by wireless communication or by wired communication. Information output by the input device 11 is input to the calculator 13. The calculator 13 outputs information to the output device 15. The calculator 13 (more specifically, the calculator 13 of the client device 10) may exchange information with the server device 20. The exchange between the calculator 13 of the client device 10 and the server device 20 is performed by a communication means such as a mobile phone line, an optical line, a wireless LAN (Local Area Network), or a wired LAN. The calculator 13 includes a storage unit 13a and a calculation unit 13b.

[0017] The memory unit 13a stores various types of information. The memory unit 13a stores a work simulation program. The memory unit 13a stores history information (described later) of the state in the virtual space (e.g., the state of the object 30). The memory unit 13a stores reset timing (described later). The memory unit 13a stores intervals of fixed time (described later). The memory unit 13a stores task conditions (described later). The memory unit 13a stores event conditions (described later). The memory unit 13a stores authentication information for login. The authentication information may be stored in the memory unit 13a of the server device 20.

[0018] The calculation unit 13b performs calculations (processing such as calculation and determination). The calculation unit 13b includes an object processing unit 13b1 and a reset timing processing unit 13b3. The object processing unit 13b1 processes the object 30 (described later). The reset timing processing unit 13b3 stores candidate reset timings in the storage unit 13a (described later).

[0019] Although not shown, the calculation unit 13b may have an authentication processing unit. The authentication processing unit performs a process of authenticating a user's login. The authentication processing unit identifies the user using user identification information. The user identification information may be stored in the storage unit 13a in association with a reset timing (described later). The user identification information may be, for example, a user name and a user ID. The authentication process may be executed in the calculation unit 13b of the server device 20.

[0020] The output device 15 (display device) performs output in response to a command input from the computer 13. The output performed by the output device 15 is, for example, a display. The output device 15 outputs a recorded video 15a. The output device 15 may display the field of view from the cab 41b2 in the operator operation mode (described later). The output device 15 is, for example, a monitor (screen). The output device 15 displays the calculation results of the computer 13, etc. The output device 15 displays the virtual space calculated by the computer 13. The output device 15 displays a GUI (Graphical User Interface) that allows the user to operate the work simulation. The output device 15 displays a GUI related to the specification of the reset timing (described later). The "display" below is a display that the computer 13 causes the output device 15 to perform. The output device 15 may output sound.

[0021] The server device 20 is a computer that operates in response to a command from the client device 10. The client device 10 is composed of the above-mentioned input device 11, calculator 13, and output device 15. The server device 20 may store authentication information used by the calculation unit 13b to process user authentication. The server device 20 may also execute authentication processing to authenticate the user. The functions of the work simulator 1 (for example, the functions of the object processing unit 13b1 and the reset timing processing unit 13b3) may be realized by the client device 10 and the server device 20. The calculator 13 (at least one of the storage unit 13a and the calculation unit 13b) may be provided in the client device 10 and the server device 20. A plurality of server devices 20 may be provided. The work simulator 1 does not need to include the server device 20. The input device 11 may be provided in the server device 20 (not shown). In this case, for example, information (such as the above-mentioned "various information") may be input from the input device 11 provided in the server device 20 to the calculator 13 provided in the client device .

[0022] (Activation) The work simulator 1 (mainly the computer 13) is configured to perform the following operations (work simulation). The work simulation program causes the computer 13 to execute the following operations. The operation verification method is a method in which the following operations are performed.

[0023] The work simulator 1 simulates a work site S in a virtual space. The work site S is a site (construction site) where a work machine 40 performs work. The work site S includes the work machine 40 and the surrounding environment such as a terrain 31 (described later) on which the work machine 40 performs work. For example, the work simulator 1 (construction plan simulator) is used to make a plan (construction plan) for the work site S. The work simulator 1 is used to make a plan regarding the work machine 40 at the work site S. The work simulator 1 is used to check the position, size, workability (productivity), safety, etc. of the work machine 40. The work simulator 1 may also be used to make a plan for something other than the work machine 40. The work simulator 1 has an object processing function. The work simulator 1 may have various functions such as an operation mode switching function and a time change function. The work simulator 1 may have a function to record (save) the situation at the work site S, for example, and may have a function to play back the recorded situation.

[0024] (Object processing function) The computer 13 (more specifically, the object processing unit 13b1) processes the object 30 (object processing function, object processing step). The object 30 is a model of an object in the work site S. The object 30 may be a three-dimensional model or a two-dimensional model.

[0025] The processing of the object 30 includes deleting the object 30 (deleting from the virtual space), arranging the object 30 (arranging in the virtual space), and resetting the object 30. The arrangement of the object 30 includes new arrangement of the object 30, movement of the object 30, and initial arrangement of the object 30. The new arrangement of the object 30 is to newly arrange the object 30 in the virtual space (work site S). The movement of the object 30 is to move the object 30 that is already in the virtual space (work site S). The movement of the object 30 includes rotational movement and parallel movement of the object 30. For example, a change in the attitude of the work machine 40 is included in the movement of the object 30. Also, for example, a deformation of the terrain 31 (described later) is included in the movement of the object 30. When the object 30 is arranged (newly arranged, moved) in the virtual space, the computer 13 stores the position (described later) of the arranged object 30.

[0026] The object processing unit 13b1 stores the history of the state of the object 30 (the computer 13 stores the history of the state in the virtual space). For example, the object processing unit 13b1 stores the history of the position of the object 30 at each time. The object processing unit 13b1 may store the history of physical quantities other than the position. For example, the object processing unit 13b1 may store the history of the remaining fuel, the operating time, and the fuel consumption information for the object 30 of the work machine 40. The object processing unit 13b1 may record the movement amount per unit time of the work object moved by the work machine 40 as the history. The work object is, for example, at least one of earth and sand, metal, and wood. The object processing unit 13b1 may store the total movement amount of the work object moved by the work machine 40 as the history. The object processing unit 13b1 may store the number of movements (number of cycles) between predetermined points as the history. The predetermined points are, for example, the distance from a predetermined ground position to the loading platform of a dump truck. The object processing unit 13b1 may record the number of cycles per unit time as the history. The object processing unit 13b1 may record the operation ratio of each drive unit of the work machine 40 as the history. The operation ratio of the drive unit may be, for example, the ratio of the rotation time of the upper rotating body 41b to the drive time of the work machine 40. The object processing unit 13b1 may record the operation ratio of each operation lever of the work machine 40 as the history. For example, the object processing unit 13b1 may store the history of the position, orientation, amount, shape, etc. of the object 30 other than the work machine 40. The object processing unit 13b1 may store the history of the state of all objects 30 existing in the virtual space. The object processing unit 13b1 may store the history of the state of the object 30 permanently or may delete it at a predetermined time (may be stored temporarily).

[0027] The above-mentioned "resetting of the object 30" refers to resetting the object 30 to the state of the object 30 at a specified reset timing. The reset timing may be specified by the user, or may be specified based on a predetermined condition. When resetting the object 30, the object processing unit 13b1 reflects the state of the object 30 specified at the specified timing in the state of the object 30 after reset. The reset may be performed on all objects 30 in the virtual space. The reset may be performed on some of the objects 30 in the virtual space. The reset may be performed excluding a predetermined target. For example, the reset target to be reset may be the position and / or posture of the dump truck. For example, the reset target may be the arrangement of the work object. The work object to be reset may be stone, wood, metal, resin, waste, scrap, or a structure (such as a block). For example, the predetermined target to be excluded from the reset may be the position and / or posture of the work machine 40. For example, the predetermined target to be excluded from the reset may be the object 30 arranged in the surrounding environment (around the work machine 40). For example, the predetermined target excluded from resetting may be a non-deforming object 30. This "non-deforming object 30" may be an object 30 that does not deform even when contacted by a work machine 40 or the like, and may be, for example, a block-shaped object 30 that resembles a building (such as a factory).

[0028] The processing of the objects 30 may include a function for managing the objects 30 arranged in the virtual space (for example, a function for managing a plurality of objects 30 in a list format). The processing of the objects 30 may include a function for switching between display and non-display for each object 30.

[0029] In the following, unless otherwise specified, events in the virtual space will be described. For example, "a work machine 40 is placed on the ground 31a" means that an object 30 of the work machine 40 is placed on an object 30 on the ground 31a in the virtual space.

[0030] The conditions for processing (placing, deleting, resetting) the object 30 are, for example, as follows: The processing of the object 30 may be performed in response to a manual operation by the user. The processing of the object 30 may be performed automatically when a condition preset in the computer 13 is satisfied.

[0031] The "position" of the object 30 includes the reference position of the object 30 and the orientation of the object 30. The reference position of the object 30 is the reference position (origin) of the object 30. For example, the reference position of the object 30 may be the center position of the bottom surface of the object 30 or the center of gravity of the object 30. The orientation of the object 30 is the rotation angle (attitude) with respect to a predetermined coordinate axis.

[0032] Specific examples of the objects 30 are as follows. The objects 30 include the terrain 31 (surrounding environment information), the work machine 40, and "other objects 30." The above-mentioned "other objects 30" include, for example, obstacles and facilities. Below, the input device 11, the calculator 13, and their components (such as the memory unit 13a) will be described with reference to FIG. 1.

[0033] As shown in Fig. 1, the terrain 31 is information on the shape of the land of the work site S. The terrain 31 may be a two-dimensional shape or a three-dimensional shape. The terrain 31 includes, for example, flat land, a sloping surface (e.g., a slope), and unevenness. The terrain 31 includes a ground surface 31a and an underground surface 31b. The ground surface 31a is the surface (ground surface) of the terrain 31, and is, for example, a surface of soil or sand. The underground surface 31b is the portion of the terrain 31 below the ground surface 31a, and is, for example, a portion where soil or sand is present.

[0034] This terrain 31 may be a model of real land. In this case, the terrain 31 may be shape information generated based on detection information of the real land. In this case, the detection information of the real land may be detected by a stereo camera, or may be detected by a distance sensor and a two-dimensional camera. The above-mentioned "distance sensor" may be, for example, a LIDAR (Light Detection and Ranging) or a millimeter wave radar. The terrain 31 may also be shape information of design data (design surface) designed on a computer. The computer on which the design data is designed may be the work simulator 1, or may not be the work simulator 1. Only one terrain 31 shown in FIG. 1 may be set in the computer 13, or multiple terrains 31 may be set. When multiple terrains 31 are set, at least one of the terrain 31 before the work, the terrain 31 in the middle of the work, and the terrain 31 after the work is completed (finished) may be set in the computer 13. The same applies to the objects 30 other than the terrain 31, which may be set only one or multiple. The terrain 31 (shape information of the terrain 31) is input (read) into the computer 13, for example, from the input device 11. The same applies to objects 30 other than the terrain 31, for example, being input into the computer 13 from the input device 11.

[0035] This terrain 31 may be deformed in accordance with time changes in the work simulation. A specific example of a case in which the terrain 31 is deformed is as follows. The work machine 40 shown in FIG. 1 is operated, and the end attachment 43c (described later) performs work on the terrain 31 (e.g., earth and sand). For example, the work machine 40 performs an operation to excavate the ground surface 31a. In such a case, the terrain 31 may be deformed. For example, the terrain 31 may be deformed into a shape after the earth and sand have been excavated (a hole, a trench, etc.). Also, for example, the terrain 31 may be deformed into a shape after the earth and sand have been removed and piled up (a mountain of earth and sand).

[0036] The work machine 40 is a machine that performs work, for example, a construction machine that performs construction work, and may be, for example, a shovel, a crane, a bulldozer, a wheel loader, or a dump truck (transport vehicle). In the following, a case where the work machine 40 is a shovel will be mainly described. The work machine 40 may operate. The work machine 40 may operate based on information preset in the calculator 13. The work machine 40 may operate in response to manual operation by a user (see the operator operation mode described later). The work machine 40 may travel, an upper rotating body 41b (described later) may rotate relative to a lower traveling body 41a (described later), and the attitude of the attachment 43 may change. Note that the work machine 40 does not have to operate (it may simply be placed in a virtual space). The work machine 40 includes a machine body 41 and an attachment 43.

[0037] The machine body 41 is a main body portion of the work machine 40. The machine body 41 includes a lower traveling body 41a and an upper rotating body 41b.

[0038] The lower traveling body 41a is capable of traveling on a traveling surface (such as the ground 31a). The lower traveling body 41a may include a crawler 41a1 or may include a wheel (not shown).

[0039] The upper rotating body 41b can rotate with respect to the lower traveling body 41a. The upper rotating body 41b may include a cab 41b2. The cab 41b2 is a part where an operator operates a machine in an actual work machine. The cab 41b2 may be fixed to the bottom (rotating frame) of the upper rotating body 41b. The cab 41b2 may be movable with respect to the bottom of the upper rotating body 41b. In this case, the cab 41b2 may be vertically movable in parallel with the bottom of the upper rotating body 41b, may be vertically rotatable (rotating), or may be vertically movable in parallel and rotatable. For example, the cab 41b2 may be an elevator cab, a link cab, or a tilt cab. The cab 41b2, which is an elevator cab, can be vertically movable with respect to the bottom of the upper rotating body 41b. The cab 41b2, which is a link cab, is installed on the bottom of the upper rotating body 41b via a link mechanism. The cab 41b2, which is a link cab, can move up and down and back and forth with respect to the bottom of the upper rotating body 41b by operating the link mechanism. The cab 41b2, which is a tilt cab, can rotate (tilt) up and down about a rotation axis extending laterally with respect to the bottom of the upper rotating body 41b. The cab 41b2 may include an accessory attached to the main body of the cab 41b2. The accessory may be, for example, a guard for protecting the top surface and front window of the cab 41b2 from flying objects and the like.

[0040] The attachment 43 is a part (working device) that performs work. The attachment 43 can be raised and lowered (can rotate in the up and down direction) with respect to the upper rotating body 41b. The attachment 43 includes a boom 43a1, an arm 43a2, and a tip attachment 43c.

[0041] The boom 43a1 is rotatably attached to the upper rotating body 41b. The arm 43a2 is rotatably attached to the boom 43a1.

[0042] The tip attachment 43c is provided at the tip of the attachment 43. The tip attachment 43c is rotatably attached to the arm 43a2. The tip attachment 43c may be a bucket for scooping or excavating a work object. The tip attachment 43c may be a device for clamping a work object (grapple, nibbler, etc.), a device for crushing a work object (breaker, etc.), or a magnet for attracting a metal work object. The object (work object) to be worked on by the tip attachment 43c shown in FIG. 1 may be soil, stone, wood, metal, resin, waste, or a structure (block, etc.).

[0043] (Area processing function) Although not shown, the computer 13 processes the area. The area is an area in a virtual space. The area may be an area of ​​a three-dimensional shape, an area of ​​a two-dimensional shape, an area represented by a line, or an area (position) represented by a point.

[0044] The processing of an area includes the deletion of an area (deletion from the virtual space) and the arrangement of an area (arrangement in the virtual space). The arrangement of an area is also referred to as "setting" of the area. Conditions for the processing of an area (arrangement, deletion) are as follows, for example. The processing of an area may be performed in response to a manual operation by a user. The processing of an area may be performed automatically when a condition preset in the calculator 13 is satisfied. For example, when an object 30 is arranged (newly arranged, moved), the area may be arranged based on the position of this object 30, etc. For example, the area may be set based on the position of the work machine 40. Specifically, the area may be set as an area where work is scheduled to be performed by the work machine 40. The object 30 (more specifically, the terrain 31) within the area set based on the work machine 40 may be set as the work target of the work machine 40. Specifically, the object 30 within the area set based on the work machine 40 may be set as the reset target when resetting the work machine 40. The area may be set based on an object 30 other than the work machine 40. The area may be set without being based on the object 30. For example, the area may be set (arbitrarily) by a manual operation of the user. Specifically, the area may be set as a no-entry area into which the work machine 40 cannot enter. The area may be reset in the same manner as in the resetting of the object 30 described above.

[0045] (Operation mode switching function) A plurality of operation modes may be set in the calculator 13 shown in Fig. 1 (the work simulator 1 may have a plurality of operation modes). The calculator 13 may switch between a plurality of operation modes (operation mode switching function, operation mode switching step). The operation modes include, for example, a construction planning mode (step S20 shown in Fig. 2) and an operator operation mode (step S30 shown in Fig. 2). Note that operation modes other than these may be set in the calculator 13.

[0046] The construction planning mode (step S20 shown in FIG. 2) is an operation mode for making a construction plan. For example, in the construction planning mode, the output device 15 displays a bird's-eye view of the work site S. For example, in the construction planning mode, the user manually operates the computer 13 or the computer 13 automatically arranges and deletes the object 30.

[0047] The operator operation mode (step S30 shown in FIG. 2) is an operation mode that simulates the operation of a real machine (a machine corresponding to the work machine 40). For example, in the operator operation mode, the user operates the work machine 40 by manual operation. Then, the work machine 40 operates (moves, changes its posture, etc.) in response to the manual operation of the user. Specifically, the lower traveling body 41a, the upper rotating body 41b, the boom 43a1, the arm 43a2, and the tip attachment 43c shown in FIG. 1 move in response to the manual operation of the user. In the operator operation mode, the work machine 40 may be operated by means other than manual operation by the user. For example, the work machine 40 may be automatically operated by pressing a button or the like (not shown) on the screen. Also, as shown in FIG. 10, in the operator operation mode, the output device 15 may display a view seen from inside the cab 41b2 (see FIG. 1) in which the operator's seat of the work machine 40 is located. Specifically, the output device 15 may display a virtual space in which the front of the work machine 40 is seen from inside the cab 41b2 through the front window and the left and right side windows. The output device 15 may also output an image from an arbitrary position in the virtual space. For example, the output device 15 may output an image from the viewpoint of a camera arranged in the virtual space. The camera may be freely arranged in the virtual space. For example, the camera may be freely arranged at an arbitrary position in the virtual space in an arbitrary line of sight direction. The camera may be arranged in a construction planning mode or in an operator operation mode. A plurality of cameras may be installed in the virtual space. The output device 15 may be configured to be capable of displaying an image of a camera arranged in the virtual space (an image in the virtual space in the line of sight direction of the camera). The output device 15 may output an image of any of a plurality of cameras in the virtual space. The output device 15 may output an image of a camera designated from a plurality of cameras in the virtual space. The output device 15 may simultaneously output images of a plurality of cameras in the virtual space.

[0048] In this operator operation mode, the state of the work site S may change in response to the operation (work) of the work machine 40. For example, the terrain 31 may be deformed, and the object 30 that is the work target (earth and sand, suspended load, etc.) may move.

[0049] This operator operation mode may be used for storing (teaching) the operation of the work machine 40 shown in Fig. 1. Teaching is performed as follows: the user operates the work machine 40 by manual operation, and the computer 13 stores this operation of the work machine 40. Thereafter, the work machine 40 may operate with the stored (taught) operation.

[0050] In addition, in this operator operation mode, the reset timing processing unit 13b3 stores the state of the object 30 at the reset timing from the history of the state of the object 30. The reset timing is the timing at which the state of the object 30 is stored, and is the timing at which the state of the object 30 can be reset (returned to its original state). The reset timing may be automatically set in the calculator 13, or may be manually set by the user.

[0051] The state of the object 30 at the reset timing may be automatically stored. As shown in Fig. 3, for example, the state of the object 30 at the reset timing may be automatically stored at fixed time intervals after the work simulation is started. The fixed time may be changeable, for example, in response to a request from the user via the information input device 11b. As shown in Figs. 3 to 5, the start time of the work simulation may be included as the reset timing that is automatically stored.

[0052] Also, as shown in FIG. 4, for example, the state of the object 30 at the reset timing may be automatically stored when the work simulation is started and the work machine 40 manually operated by the user starts a predetermined task. A task is a type of work performed by the work machine 40. For example, tasks are movement of the work machine 40, dump truck loading work by the work machine 40, and leveling work by the work machine 40. Which task the work performed by the work machine 40 corresponds to (or does not correspond to) is determined from task conditions stored in advance in the storage unit 13a. For example, at least one of the position of the work machine 40, operation information of the work machine 40 (e.g. lever information), and the attitude of the attachment 43 is used as the task condition.

[0053] Also, as shown in FIG. 5, for example, the state of the object 30 at the reset timing may be automatically stored when the work machine 40 manually operated by the user generates a predetermined event. For example, the event is an occurrence (excluding a task) of the work machine 40. Specifically, the event is at least one of the following: the work machine 40 approaches another object 30 to within a predetermined distance, the work machine 40 enters a predetermined area, and the work machine 40 is lifted up. "Approaching another object 30 to within a predetermined distance" may include contact with another object 30. Which event the event that occurred to the work machine 40 corresponds to (or does not correspond to) is determined based on the event conditions stored in the storage unit 13a in advance. As the event condition, at least one of the position of the work machine 40, the position of the object 30 in the surrounding environment, and the position of the area is used. When the state of the object 30 is recorded when an event occurs, the state quantity at the time of the event occurrence may be recorded together with the recorded state of the object 30. For example, the state quantity recorded when an event occurs is at least any one of the objects 30 (people, obstacles, etc.) that the work machine 40 has approached, the distance from the area, the amount of intrusion into the area, and the lift angle of the work machine 40. The reset timing at which the state is recorded may be determined to be a certain time prior to the time when the event occurred. This makes it possible to reset to the state before the event occurred.

[0054] The state of the object 30 at the reset timing may be recorded manually. Here, as described above, the object processing unit 13b1 permanently or temporarily stores the history of the state in the virtual space (the state of the object 30 in this example). When the user wishes to record a state as a resettable state during the work simulation, the user manually specifies the state to be recorded. Specifically, for example, the user requests the reset timing processing unit 13b3 (the computer 13) to output the history of the state in the virtual space to the output device 15. In response to the user's request, the reset timing processing unit 13b3 outputs the history in the virtual space to the output device 15 in a form that can be specified by the input device 11. At this time, the history in the virtual space may be output as the recorded video 15a or may be output as a list of still images. The user specifies the history to be recorded as a resettable state from the history in the virtual space. The reset timing processing unit 13b3 records the state in the virtual space corresponding to the history specified by the user as a resettable state.

[0055] The reset timing processing unit 13b3 may store the state of the object 30 at the reset timing in association with identifiable information. The identifiable information may be, for example, at least one of a time in the history, a task name, and an event name. The identifiable information may be identification information of a logged-in user.

[0056] (Reset function) The object processing unit 13b1 resets the state in the virtual space. The reset is to return the state changed in the virtual space to the state at a predetermined timing (reset timing). The object processing unit 13b1 returns the state of the object 30 changed in the virtual space to the state at a predetermined timing (reset timing). The reset may be performed by a manual operation by the user or automatically. The reset may be performed in any operation mode. For example, the reset may be performed in the construction plan mode or the operator operation mode. When the reset is performed in response to a request from the user, the object processing unit 13b1 may display candidates of the stored state of the virtual space and allow the user to select one. When resetting, the object processing unit 13b1 may specify the object 30 to be reset. The object 30 to be reset may be specified by a manual operation by the user or automatically. For example, when resetting during the operator operation mode, the reset target may be limited to the working machine 40 being operated and / or the object 30 to be worked on by the working machine 40. Any object 30 in the virtual space may be specified. For example, the reset target may be all objects 30 in the virtual space. For example, the reset target may be at least any of the objects 30 of the work machine 40 being operated, the objects 30 in the work area of ​​the work machine 40, and the objects 30 being worked on by the work machine 40. The object processing unit 13b1 may identify the object 30 to be reset and the reset timing, and perform the reset.

[0057] (Other features) The calculator 13 may have various functions other than those described above. Specific examples of the functions are as follows.

[0058] The computer 13 may have a function (time change function, time change step) of simulating a time change in the work site S. For example, the object 30 may change in accordance with a predetermined step or a time change in the work simulation.

[0059] (Example of computer processing) The computer 13 can perform various processes in various orders. An example of the flow of the process of the computer 13 will be described with reference to Fig. 2. Each step (step S10 to step S50) will be described below with reference to Fig. 2.

[0060] 1 sets (lays out) the terrain 31. For example, information on the terrain 31 is read into the calculator 13 from the information input device 11b.

[0061] In step S20, the computer 13 sets the operation mode to the construction planning mode. The object processing unit 13b1 places and deletes the object 30. The object processing unit 13b1 may also reset the object 30 in the construction planning mode.

[0062] In step S21, the computer 13 judges whether or not to start the operator operation mode. More specifically, the computer 13 judges whether or not the condition for starting the operator operation mode is satisfied. For example, the computer 13 judges whether or not starting the operator operation mode is selected by a user's manual operation (e.g., operation of the GUI). If the condition for starting the operator operation mode is satisfied (YES in step S21), the computer 13 advances the process flow to step S30 and sets the operation mode to the operator operation mode. If the condition for starting the operator operation mode is not satisfied (NO in step S21), the computer 13 advances the process flow to step S40 without setting the operation mode to the operator operation mode.

[0063] In step S30, the calculator 13 operates in an operator operation mode. In the operator operation mode, the user operates the work machine 40 by manual operation. This allows the user to check the workability of the work machine 40. The calculator 13 may also reset the object 30 in the operator operation mode.

[0064] In step S31, the computer 13 judges whether or not to record the reset timing. The computer 13 executes this judgment in parallel while the user operates the work machine 40. For example, the trigger for this judgment is a change in the object 30 in the virtual space, or at a predetermined time interval. For example, if the user requests to record the reset timing, the judgment in step S31 is YES. For example, if the automatic recording conditions (at fixed times, task conditions, event conditions, etc.) are met, the judgment in step S31 is YES. If the reset timing is not to be recorded (NO in step S31), the flow proceeds to step S33. If the reset timing is to be recorded (YES in step S31), the flow proceeds to step S32.

[0065] In step S32, the computer 13 performs a process of recording the reset timing. If a user requests recording of the reset timing, the computer 13 performs a process of having the user determine the reset timing. In the case of automatic recording, the computer 13 records the reset timing according to the automatic recording conditions as shown in Figures 3 to 5. After this, the flow proceeds to step S33.

[0066] In step S33, the computer 13 judges whether or not to end the operator operation mode. More specifically, the computer 13 judges whether or not a condition for ending the operator operation mode is satisfied. For example, the computer 13 judges whether or not ending the operator operation mode is selected by a manual operation (for example, an operation of the GUI) of the user. If the condition for ending the operator operation mode is not satisfied (NO in step S33), the computer 13 continues the operator operation mode. In this case, the flow returns to step S30. If the condition for ending the operator operation mode is satisfied (YES in step S33), the computer 13 ends the operator operation mode and sets the operation mode to the construction planning mode. In this case, the flow returns to step S20. When ending the operator operation mode, the computer 13 may save the situation of the work site S that has changed in the operator operation mode (for example, the shape of the ground 31a after the change, etc.). When the operation mode is changed from the operator operation mode to the construction planning mode, the computer 13 may set the work site S in the construction planning mode to the saved work site S (the change in the operator operation mode may be inherited). When the operation mode is changed from the operator operation mode to the construction planning mode, the computer 13 may set the work site S in the construction planning mode to the work site S before the change in the operator operation mode (the change in the operator operation mode may not be carried over). The computer 13 may allow the user to select whether or not to carry over the situation of the work site S that has changed in the operator operation mode to the construction planning mode.

[0067] In step S40, the calculator 13 performs various calculations. For example, the calculator 13 performs calculations of various events at the work site S. The calculator 13 may perform calculations related to safety at the work site S (e.g., interference determination, etc.). The calculator 13 may calculate the workability (productivity) of work by the work machine 40. The user checks the safety at the work site S, the workability of the work machine 40, etc.

[0068] In step S50, computer 13 determines whether or not to end the work simulation. More specifically, computer 13 determines whether or not a condition for ending the work simulation has been met. For example, computer 13 determines whether or not ending the work simulation has been selected by a user's manual operation (e.g., GUI operation). If the condition for ending the work simulation is met (YES in step S50), computer 13 ends the work simulation. If the condition for ending the work simulation is not met (NO in step S50), computer 13 continues the work simulation. In this case, the flow returns to step S20.

[0069] (Example of manually recording the state of object 30) FIG. 6 is a diagram showing an image displayed on the output device 15 when the state of the object 30 is manually recorded. In the example of FIG. 6, an image of a past history of loading work into a dump truck (transport vehicle) by a work machine 40 as a work simulation is displayed on the display screen of the output device 15. For example, as shown in FIG. 6, the work simulator 1 may be one in which the user specifies the reset timing at which the state is to be recorded while watching the recorded image 15a displayed on the output device 15. In this way, the work simulator 1 displays the recorded image 15a on the output device 15 to allow the user to determine the timing at which the state of the object 30 is to be recorded. The recorded image 15a may be an image of the field of view from inside the driver's cab 41b2 such as an elevator cab, as shown in FIG. 6. The recorded image 15a may be an image of the work machine 40 viewed from a third person's perspective, as shown in FIG. 1. It is preferable that the recorded image 15a can be stopped at any timing by the user operating the input device 11. Specifically, as shown in FIG. 6, an indicator 15b capable of adjusting the playback timing may be displayed below the recorded image 15a. This makes it possible to clearly indicate the state of the virtual space at the reset timing in a stopped state. In addition, in order to simplify the confirmation of the recorded video 15a, it is preferable that the input device 11 can realize the operation of functions such as fast-forwarding and rewinding the recorded video 15a. Specifically, as shown in FIG. 6, an operation panel 15c for these functions and for determining the reset timing may be displayed below the indicator 15b. Furthermore, when the user determines the reset timing, the reset timing processing unit 13b3 may display a dialogue for confirming whether or not it is OK to determine the reset timing. Specifically, as shown in FIG. 6, the content of the operation panel 15c may be changed to a confirmation dialogue for determining by operation whether or not it is OK to determine the reset timing.

[0070] (Example of GUI for specifying reset timing) For example, as shown in FIG. 7, the computer 13 displays a list 15d of candidates for the state of (object 30) in the recorded virtual space. The list 15d is displayed, for example, when the user performs an operation requesting a reset of the object 30. In the list 15d, one reset timing is shown per line. The user operates the input device 11 to select one of the reset timings. For each reset timing shown in the list 15d, a user, a task name, a recording time, and a tag are shown. The user is the name of the user who was logged in when the state was recorded. The task name may be the name of the task detected by the task condition, or may be input by the user. The recording time indicates the time when the state was recorded in the history. The tag indicates the condition when the state was recorded. For example, if the tag is a tag of a reset timing recorded by automatic recording at fixed times, the tag is shown as "fixed time recording". For example, if the tag is a tag of a reset timing recorded by automatic recording due to satisfaction of the task condition, the name of the task associated with the task condition is shown. For example, if the tag is a tag of a reset timing recorded by automatic recording due to the satisfaction of an event condition, the tag is indicated as "event record." Also, for example, if the tag is a tag of a reset timing recorded by automatic recording due to the satisfaction of an event condition, a name indicating the event may be indicated. Although not shown, work simulations may be performed at multiple work sites S. In that case, list 15d may include an identification name indicating the work site S for each reset timing.

[0071] Also, as shown in Fig. 8, the reset target may be configured to be selectable. For example, a screen for selecting the reset target is displayed when the user performs an operation to determine one of the reset timings from the list 15d. Specifically, a selection screen 15e for selecting one of the work machine 40, the object 30 in the surrounding environment, or both of them may be displayed. Also, a preview image 15f may be displayed. The preview image 15f is an image showing the state of the object 30 at the selected reset timing.

[0072] (Specific example of reset function processing) As an example of the processing of the reset function, a flowchart of the reset processing will be described with reference to Fig. 9. The reset processing may be executed in any of the processing of the computer 13. For example, the reset processing may be executed in setting the terrain 31 in the processing of the computer 13 (step S10 shown in Fig. 2). Also, for example, the reset processing may be executed in the construction planning mode in the processing of the computer 13 (step S20 shown in Fig. 2). Also, for example, the reset processing may be executed in the construction planning mode in the processing of the computer 13 (step S20 shown in Fig. 2).

[0073] In step S100, the computer 13 authenticates the user. In step S110, the computer 13 reads the list 15d of the states of the objects 30 stored in the storage unit 13a. The list of the states of the objects 30 may be narrowed down depending on the authenticated user. For example, only the states of the objects 30 of the same user as the authenticated user may be narrowed down. For example, the states of the objects 30 of a user who has a higher role than the authenticated user may be excluded.

[0074] In step S120, the computer 13 displays the list 15d (list) of states of the object 30 on the output device 15 (see FIG. 7). In step S130, the computer 13 determines whether or not one reset timing has been selected from the list of states of the object 30. If a reset timing has not been selected (NO in step S130), the computer 13 executes the process of step S130 again. If a reset timing has been selected (YES in step S130), the computer 13 proceeds to the process of step S140.

[0075] In step S140, the calculator 13 displays the selection screen 15e for the object to be reset (see FIG. 8). When this routine is called from the setting of the terrain 31 in the processing of the calculator 13 (step S10 in FIG. 2), the option for the work machine 40 on the selection screen 15e may be made unselectable. The calculator 13 also displays the state of the selected object 30 in the preview image 15f (see FIG. 8).

[0076] In step S150, the computer 13 judges whether or not the object to be reset has been determined. If the object to be reset has not been determined (NO in step S150), the computer 13 executes the process of step S150 again. If the object to be reset has been determined (YES in step S150), the computer 13 moves the process to step S160. In step S160, the computer 13 reads the state of the object 30 to be reset that has been determined at the reset timing, reflects the read state in the state of the object 30 after reset, and ends this routine. For example, steps S110 to S150 may be omitted, and the following process may be performed instead. Specifically, the computer 13 may judge whether or not a specific input signal has been received from the input device 11 (whether or not a specific operation has been performed). If a specific input signal has been received from the input device 11, the computer 13 may automatically select a specific state and a specific object to be reset, and execute a reset (automatic reset). The computer 13 may return to the state at the start of the work simulation as the state after the automatic reset. The computer 13 may select the surrounding environment excluding the work machine 40 as the target for automatic reset, and execute a reset on that surrounding environment.

[0077] (Example of automatic reset) With reference to FIG. 10, an example of automatic reset by a specific operation will be described. FIG. 10 is an example of a simulation image 15g displayed on the output device 15 when the work machine 40 loads a dump truck (transport vehicle) 15h in the operator operation mode in the work simulation. In FIG. 10, a simulation image 15g is displayed in which the work machine 40 is working on a block 15j placed on the ground. Specifically, the work machine 40, which is equipped with a lifting magnet as the end attachment 43c, moves the adsorbed block 15j from a predetermined position on the ground to the loading platform of the dump truck 15h. When the computer 13 receives a specific signal from the input device 11 (when a specific operation is performed on the input device 11), it executes automatic reset. The output device 15 may display a reset button 15k for receiving the specific operation on the display screen. It is preferable that the specific operation is simple. For example, the specific operation may be a touch operation on a touch panel. For example, the specific operation may be input of a shortcut key on a keyboard. When the computer 13 receives a specific signal from the input device 11, it resets the block 15j to the state at the time when the work simulation was started. The computer 13 resets the block 15j in the simulation image 15g to the state at the time when the simulation was started. Specifically, the work object that has been moved from the initial position, such as the block 15j loaded on the bed of the dump truck 15h and the block 15j being sucked to the tip attachment 43c, is deleted. In addition, the object 30 of the work object at the initial position, such as the block 15j piled on the ground, is returned to the initial state. In this way, for example, in the automatic reset, the work object of the work machine 40 is reset. This allows the user to reset the work object with a simple operation, and allows the user to repeatedly practice work on the work object. Note that if the dump truck 15h is moved during the simulation, the position of the dump truck 15h may be returned to the initial position at the time when the simulation was started. The work machine 40 may be a predetermined object excluded from the reset. This allows the objects 30 other than the work machine 40 to be reset.

[0078] (Effects of the first invention) The effects of the work simulator 1 as an operation verification device shown in Fig. 1 are as follows: The work simulator 1 includes a computer 13. The computer 13 simulates, in a virtual space, a work site S including a work machine 40 and the surrounding environment where the work machine 40 is to perform work.

[0079] [Configuration 1] The computer 13 resets the state in the virtual space to the state at the specified timing.

[0080] In the above [Configuration 1], the computer 13 can reset the state in the virtual space to the state at the specified timing. Therefore, the state in the virtual space where the work simulation is performed can be reset to a desired timing.

[0081] (Effects of the second invention) [Configuration 2] The computer 13 resets the state of the work machine 40 in the virtual space.

[0082] In the above [Configuration 2], the state of the work machine 40 in the virtual space can be reset to the state at a specified timing. Therefore, the state of the work machine 40 in the virtual space can be reset to a desired timing.

[0083] (Effects of the third invention) [Configuration 3] The computer 13 resets the state of the object 30 in the surrounding environment within the virtual space.

[0084] In the above [Configuration 3], the state of the object 30 in the surrounding environment in the virtual space can be reset to the state at the specified timing. Therefore, the state of the object 30 in the surrounding environment in the virtual space can be reset to a desired timing.

[0085] (Effect of the fourth invention) [Configuration 4] As shown in FIG. 3, the computer 13 records the state in the virtual space at predetermined time intervals and resets the state in the virtual space to the state at a specified time among the recorded states.

[0086] In the above [Configuration 4], the state in the virtual space is recorded at a predetermined time interval, and the state can be reset to a state at a specified timing among the recorded states. Therefore, the state of the object 30 in the surrounding environment in the virtual space can be reset to a desired timing among the states recorded at the predetermined time interval.

[0087] (Effect of the fifth aspect of the invention) [Configuration 5] As shown in FIG. 4, the computer 13 records the state in the virtual space when a task is started by the work machine 40, and resets the state in the virtual space to the state at a specified timing among the recorded states.

[0088] In the above [Configuration 5], the state in the virtual space is recorded at the timing when a task is started by the work machine 40, and it is possible to reset to a state at a specified timing among the recorded states. Therefore, the state of the object 30 in the surrounding environment in the virtual space can be reset to a desired timing among the recorded states every time a task is started.

[0089] (Effect of the sixth aspect of the invention) [Configuration 6] As shown in FIG. 5, the computer 13 records the state in the virtual space when an event related to the work machine 40 occurs, and resets the state in the virtual space to the state at a specified timing among the recorded states.

[0090] In the above [Configuration 6], the state in the virtual space is recorded at the timing when an event related to the work machine 40 occurs, and it is possible to reset to a state at a specified timing among the recorded states. Therefore, the state of the object 30 in the surrounding environment in the virtual space can be reset to a desired timing among the recorded states each time an event occurs.

[0091] (Effects of the seventh aspect of the invention) [Configuration 7] The computer 13 records the state in the virtual space when the work machine 40 approaches a predetermined object 30 within a predetermined distance.

[0092] In the above [Configuration 7], the state in the virtual space can be recorded at the timing when the work machine 40 approaches the specified object 30 at a predetermined distance or less. Therefore, it is possible to reset the work machine 40 to a state in the virtual space where it approaches the specified object 30 at a predetermined distance or less.

[0093] (Effect of the eighth aspect of the invention) [Configuration 8] The computer 13 records the state within the virtual space when the work machine 40 enters a specified area.

[0094] In the above [Configuration 8], the state in the virtual space can be recorded at the timing when the work machine 40 enters a predetermined area. Therefore, it is possible to reset the state in the virtual space to the state when the work machine 40 entered the predetermined area.

[0095] (Effect of the ninth aspect of the invention) [Configuration 9] The computer 13 further includes an output device 15 and an input device 11. As shown in Fig. 6, the computer 13 outputs a history of the state in the virtual space to the output device 15 in a form that can be specified by the input device 11. The computer 13 resets the state in the virtual space to the state at the timing associated with the specified history.

[0096] In the above [Configuration 9], the user can check the history of the state in the virtual space, and can reset the state in the virtual space at the user's desired timing.

[0097] (Effect of the 10th Invention) [Configuration 10] The computer 13 resets the state in the virtual space, excluding certain objects.

[0098] In the above [Configuration 10], the specified target is excluded when resetting, so that the work simulation can be continued while maintaining the state of the specified target.

[0099] (Effects of the eleventh aspect of the invention) [Configuration 11] The effects of the operation verification program are as follows: The work simulation program is a program for simulating, in a virtual space, a work site S including a work machine 40 and an object 30 in the surrounding environment that is the target of work by the work machine 40. The work simulation program causes the computer 13 to execute a reset step for resetting the state in the virtual space to the state at a specified timing.

[0100] In the above [Configuration 11], the state in the virtual space can be reset to the state at the specified timing. Therefore, the state in the virtual space where the work simulation is performed can be reset to the desired timing.

[0101] (Effects of the twelfth aspect of the invention) [Configuration 12] The effects of the operation verification method are as follows: The work simulation method is a method for simulating, in a virtual space, a work site S including a work machine 40 and an object 30 in the surrounding environment that is the target of work by the work machine 40. The work simulation method includes a reset step for resetting the state in the virtual space to the state at a specified timing.

[0102] In the above [Configuration 12], the state in the virtual space can be reset to the state at the specified timing. Therefore, the state in the virtual space where the work simulation is performed can be reset to the desired timing.

[0103] (Modification) The above embodiment may be modified in various ways. For example, various examples (including modified examples) of the above embodiment may be combined in various ways. For example, the connection of each component shown in FIG. 1 and the like may be changed. For example, the number of components (including modified examples) of the above embodiment may be changed, and some of the components may not be provided. The "components" include components in the virtual space (specifically, object 30) (same below). For example, the arrangement of the components may be changed. For example, the inclusion relationship of the components may be changed in various ways. For example, a component described as a lower component included in a higher-level component may not be included in this higher-level component, and may be included in another component. For example, a component described as a plurality of different members or parts may be treated as a single member or part. For example, a component described as a single member or part may be provided separately as a plurality of different members or parts. For example, the order of the steps in the flow charts shown in FIG. 2 and FIG. 9 may be changed, and some of the steps may not be performed, and for example, each component may have only a part of each feature (action function, arrangement, shape, operation, etc.).

[0104] The work simulator 1 may be equipped with a remote control device for remotely controlling the actual machine (the actual machine configured in the same manner as the work machine 40). The work simulator 1 may be implemented in the remote control device. The remote control device includes an input device 11, a calculator 13, and an output device 15. The input device 11 includes an operation device (e.g., an operation lever, an operation pedal), and outputs an operation signal (lever operation signal, pedal operation signal) according to the operation of the operation device. During remote control, the calculator 13 exchanges signals with the actual machine to be remotely controlled via communication means. During remote control, the calculator 13 transmits signals (operation command signals) to the actual machine to operate the work device (corresponding to the attachment 43 (see FIG. 1)) and the traveling device (corresponding to the lower traveling body 41a (see FIG. 1)) of the actual machine based on the operation signal input from the input device 11. During remote control, the calculator 13 receives image data from a camera mounted on the actual machine, signals output by sensors mounted on the actual machine, and the like via communication means. The output device 15 (specifically, a monitor) outputs image data (data acquired by the computer 13) from a camera mounted on the actual machine during remote control.

[0105] By providing the work simulator 1 with a remote control device, the user can operate the work machine 40 in the virtual space using the remote control device for remotely operating the actual machine (see, for example, the operator operation mode described above). Thus, the user can experience the sensation of operating the actual machine by operating the work machine 40 in the virtual space. As a result, for example, the user's mastery of operating the remote control device is promoted. In addition, for example, it is possible to easily imagine (such as what kind of situation will arise) what would happen if the actual machine at the actual site (corresponding to the work site S) were operated with the remote control device.

[0106] The number of work machines 40 arranged in the virtual space is not limited to one, and a configuration may be made such that a plurality of work machines 40 can be arranged. Each of the plurality of work machines 40 may be operated in an operator operation mode, or may be operated by automatic driving based on a construction plan. Also, each of the plurality of arranged work machines 40 may be configured to be selectable as a reset target. Each of the plurality of arranged work machines 40 may be a construction machine, and is not limited to a shovel. [Explanation of symbols]

[0107] 1. Work simulator 10 Client Device 11 Input Devices 11a Operation input device 11b Information input device 13 Calculator 13a Storage section 13b Arithmetic unit 13b1 Object processing section 13b3 Reset timing processing section 15 Output Devices 20 Server device 40 Work Machinery

Claims

1. A computer that simulates a work site including a work machine and a surrounding environment where the work machine is to perform work in a virtual space, The computer resets the state in the virtual space to the state at the specified timing. Operation verification device.

2. 2. The operation verification device according to claim 1, The computer resets a state of the work machine in the virtual space. Operation verification device.

3. 2. The operation verification device according to claim 1, The computer resets a state of the surrounding environment in the virtual space. Operation verification device.

4. 4. The operation verification device according to claim 1, The computer includes: Recording the state of the virtual space at a predetermined time interval; resetting the state in the virtual space to the state at the specified timing among the recorded states; Operation verification device.

5. 4. The operation verification device according to claim 1, The computer includes: Recording a state in the virtual space at a timing when the task is started by the work machine; resetting the state in the virtual space to the state at the specified timing among the recorded states; Operation verification device.

6. 4. The operation verification device according to claim 1, The computer includes: Recording a state in the virtual space at the timing when an event related to the work machine occurs; resetting the state in the virtual space to the state at the specified timing among the recorded states; Operation verification device.

7. 7. An operation verification device according to claim 6, The computer includes: a state in the virtual space is recorded at a timing when the work machine approaches a predetermined object at a predetermined distance or less; Operation verification device.

8. 7. An operation verification device according to claim 6, The computer includes: A state in the virtual space is recorded at the timing when the work machine enters a predetermined area. Operation verification device.

9. 4. The operation verification device according to claim 1, Further comprising an output device and an input device, The computer includes: outputting a history of states in the virtual space to the output device in a manner that can be specified by the input device; resetting a state in the virtual space to a state at the timing associated with the specified history; Operation verification device.

10. 2. The operation verification device according to claim 1, The computer resets the state in the virtual space, excluding a predetermined object. Operation verification device.

11. An operation verification program for simulating in a virtual space a work site including a work machine and a surrounding environment in which the work machine is to perform work, a reset step of resetting the state in the virtual space to a state at a specified timing; Execute the following on a computer. Operation verification program.

12. An operation verification method for simulating a work site including a work machine and a surrounding environment in which the work machine is to perform work, in a virtual space, comprising: a reset step of resetting the state in the virtual space to a state at a specified timing; Equipped with How to verify operation.

Citation Information

Patent Citations

  • Management system for construction machine

    JP2022157635A