Construction simulation model automatic construction method and device based on video image

Abstract

The embodiment of the invention provides a construction simulation model automatic construction method and device based on a video image, and the method specifically comprises the steps: building a construction simulation model for construction operation; the construction simulation model comprises a construction process simulation model corresponding to a construction unit agent object; the construction process simulation model comprises a construction process simulation model; the construction process simulation model comprises queue elements and delay elements; the queue element is used for simulating a queuing and waiting process of a construction resource agent object in a construction process; the delay element is used for simulating the duration of the construction process; according to the video image of the construction operation site, construction resource distribution information corresponding to a construction operation surface of the construction operation site is determined by using a target detection technology, a target tracking technology and a clustering technology; and instantiating queue elements and delay elements in the corresponding construction process simulation model according to the construction resource distribution information. According to the embodiment of the invention, the construction efficiency of the construction simulation model can be improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of construction simulation technology, and in particular to a method and device for automatically constructing a construction simulation model based on video images. Background Art

[0002] Construction simulation technology is an emerging technical means for engineering construction progress control. Its purpose is to simulate the engineering construction process by computer, provide support for formulating construction schedules, allocating construction resources, and discovering possible problems in construction, thereby providing guidance for engineering construction decisions. The important basis for its realization is to establish a construction simulation model that reflects the characteristics of engineering construction.

[0003] In the related art, a static construction simulation model is usually first established for the construction work; then, the model parameters contained in the static construction simulation model are instantiated according to the conditions of the construction site. The model parameters may include: construction resource parameters, construction object parameters, etc. The instantiation method of the model parameters is usually a manual input method, in which the user manually enters the model parameters in the construction simulation model in the computer system.

[0004] However, the method of manually entering model parameter values ​​into the construction simulation model in the computer system is time-consuming and labor-intensive and lacks real-time performance, which affects the efficiency of building the construction simulation model. Summary of the invention

[0005] The embodiment of the present application provides a method for automatically constructing a construction simulation model based on video images, which can improve the construction efficiency of the construction simulation model.

[0006] Correspondingly, the embodiments of the present application also provide a device for automatically constructing a construction simulation model based on video images, an electronic device and a machine-readable medium to ensure the implementation and application of the above method.

[0007] In order to solve the above problems, the present application discloses a method for automatically building a construction simulation model based on video images, comprising: A construction simulation model is established for construction operations; the construction simulation model includes: a construction unit intelligent agent object, a construction resource scheduling intelligent agent object, a construction resource intelligent agent object, and construction process simulation models corresponding to multiple construction unit intelligent agent objects respectively; the construction process simulation model includes: one or more construction process simulation models; the construction process simulation model includes: a queue element and a delay element; the queue element is used to simulate the queuing and waiting process of the construction resource intelligent agent objects in the construction process; the delay element is used to simulate the duration of the construction process; The simulation process of the construction simulation model includes: the construction unit intelligent agent object sends a resource request message to the construction resource scheduling intelligent agent object according to the corresponding construction process simulation model; the construction resource scheduling intelligent agent object sends a task issuing message to at least one selected target construction resource intelligent agent object according to the resource request message; after receiving the task issuing message, at least one target construction resource intelligent agent object moves to the target construction work surface where the construction unit intelligent agent object is located; the construction resource intelligent agent objects that meet the set conditions at the target construction work surface are placed in a queue represented by a queue element for queuing and waiting; the construction resource intelligent agent objects that do not need to wait in queue or are taken out of the queue element at the target construction work surface are used to perform construction simulation of the construction process; after completing the simulation of the construction process of the construction unit intelligent agent object, the corresponding delay element ends; Based on the video images of the construction site, the target detection technology, target tracking technology and clustering technology are used to determine the construction resource distribution information corresponding to the construction work surface of the construction site; According to the construction resource distribution information, the queue elements and delay elements in the corresponding construction process simulation model are instantiated.

[0008] The embodiment of the present application also discloses a device for automatically constructing a construction simulation model based on video images, the device comprising: A model building module is used to establish a construction simulation model for construction operations; the construction simulation model includes: a construction unit intelligent agent object, a construction resource scheduling intelligent agent object, a construction resource intelligent agent object, and a construction process simulation model corresponding to a plurality of construction unit intelligent agent objects; the construction process simulation model includes: one or more construction process simulation models; the construction process simulation model includes: a queue element and a delay element; the queue element is used to simulate the queuing and waiting process of the construction resource intelligent agent objects in the construction process; the delay element is used to simulate the duration of the construction process; The simulation process of the construction simulation model includes: the construction unit intelligent agent object sends a resource request message to the construction resource scheduling intelligent agent object according to the corresponding construction process simulation model; the construction resource scheduling intelligent agent object sends a task issuing message to at least one selected target construction resource intelligent agent object according to the resource request message; after receiving the task issuing message, at least one target construction resource intelligent agent object moves to the target construction work surface where the construction unit intelligent agent object is located; the construction resource intelligent agent objects that meet the set conditions at the target construction work surface are placed in a queue represented by a queue element for queuing and waiting; the construction resource intelligent agent objects that do not need to wait in queue or are taken out of the queue element at the target construction work surface are used to perform construction simulation of the construction process; after completing the simulation of the construction process of the construction unit intelligent agent object, the corresponding delay element ends; A video analysis module is used to determine the construction resource distribution information corresponding to the construction work surface of the construction work site by using target detection technology, target tracking technology and clustering technology based on the video image of the construction work site; The instantiation module is used to instantiate the queue elements and delay elements in the corresponding construction process simulation model according to the construction resource distribution information.

[0009] The embodiment of the present application further discloses an electronic device, including: a processor; and a memory, on which executable code is stored. When the executable code is executed, the processor executes the method described in the embodiment of the present application.

[0010] The embodiment of the present application further discloses a machine-readable medium on which executable code is stored. When the executable code is executed, a processor executes the method described in the embodiment of the present application.

[0011] The embodiment of the present application also discloses a computer program product, including a computer program / instruction, which implements the aforementioned method when executed by a processor.

[0012] The embodiments of the present application include the following advantages: The technical solution of the embodiment of the present application specifically includes: a static model construction link, a resource distribution information acquisition link and an instantiation link.

[0013] Among them, in the static model construction link, the construction simulation model is divided into multiple parts, including construction unit intelligent agent objects, construction resource scheduling intelligent agent objects, construction resource intelligent agent objects, and construction process simulation models. The construction process simulation model is further divided into multiple construction process simulation models. The construction process simulation model consists of queue elements and delay elements, which are used to simulate the queuing waiting and process duration of construction resources, respectively, and provides a simulation process of the construction simulation model.

[0014] In the resource distribution information acquisition stage, target detection technology, target tracking technology and clustering technology are used to automatically determine the construction resource distribution information corresponding to the construction work surface.

[0015] In the model instantiation stage, the queue elements and delay elements in the corresponding construction process simulation model are instantiated according to the automatically determined construction resource distribution information.

[0016] The embodiment of the present application adopts target detection technology, target tracking technology and clustering technology to analyze the video image of the construction site, so as to quickly and automatically determine the construction resource distribution information, and use the automatically determined construction resource distribution information for the instantiation of queue elements and delay elements. On the one hand, because the embodiment of the present application does not need to manually count the construction resource distribution information one by one, the collection time of the construction resource distribution information can be shortened. On the other hand, in view of the fact that the embodiment of the present application eliminates the link of manually inputting the construction resource distribution information, it is possible to save manual input time. In summary, the embodiment of the present application can improve the construction efficiency of the construction simulation model. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a schematic diagram of the steps of a method for automatically building a construction simulation model based on video images according to an embodiment of the present application; Figure 2 It is a schematic diagram of the state transition of a construction resource intelligent agent object according to an embodiment of the present application; Figure 3 is a schematic diagram of the state transition of a transportation equipment agent object according to an embodiment of the present application; Figure 4 This is a schematic diagram of the state transition of a construction resource scheduling agent object according to an embodiment of the present application; FIG5( a ) and FIG5( b ) are schematic diagrams of modeling of a construction process according to an embodiment of the present application; Figure 6 It is a schematic diagram of a construction process simulation model of excavation blocks in an embodiment of the present application; Figure 7 is a schematic diagram of a construction simulation model of an embodiment of the present application; Figure 8 It is a structural schematic diagram of a device for automatically building a construction simulation model based on video images according to an embodiment of the present application; Fig. 9 It is a schematic diagram of the structure of a device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0018] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0019] The embodiments of the present application can be applied to the hydropower engineering industry to simulate the hydropower engineering construction process based on a computer, provide support for formulating construction schedules, allocating construction resources, and discovering possible problems in construction, thereby providing guidance for engineering construction decisions.

[0020] In the related art, a static construction simulation model is usually first established for the construction work; then, the model parameters contained in the static construction simulation model are instantiated according to the conditions of the construction site. The model parameters may include: construction resource parameters, construction object parameters, etc. The instantiation method of the model parameters is usually a manual input method, in which the user manually enters the model parameters in the construction simulation model in the computer system.

[0021] However, the method of manually entering model parameter values ​​into the construction simulation model in the computer system is time-consuming and labor-intensive and lacks real-time performance, which affects the efficiency of building the construction simulation model.

[0022] In view of the technical problem of low efficiency in constructing a construction simulation model in the related art, the embodiment of the present application provides a method for automatically constructing a construction simulation model based on video images, which specifically includes the following steps: A construction simulation model is established for construction operations; the construction simulation model includes: a construction unit intelligent agent object, a construction resource scheduling intelligent agent object, a construction resource intelligent agent object, and construction process simulation models corresponding to multiple construction unit intelligent agent objects respectively; the construction process simulation model includes: one or more construction process simulation models; the construction process simulation model includes: a queue element and a delay element; the queue element is used to simulate the queuing and waiting process of the construction resource intelligent agent objects in the construction process; the delay element is used to simulate the duration of the construction process; The simulation process of the construction simulation model includes: the construction unit intelligent agent object sends a resource request message to the construction resource scheduling intelligent agent object according to the corresponding construction process simulation model; the construction resource scheduling intelligent agent object sends a task issuing message to at least one selected target construction resource intelligent agent object according to the resource request message; after receiving the task issuing message, at least one target construction resource intelligent agent object moves to the target construction work surface where the construction unit intelligent agent object is located; the construction resource intelligent agent objects that meet the set conditions at the target construction work surface are placed in a queue represented by a queue element for queuing and waiting; the construction resource intelligent agent objects that do not need to wait in queue or are taken out of the queue element at the target construction work surface are used to perform construction simulation of the construction process; after completing the simulation of the construction process of the construction unit intelligent agent object, the corresponding delay element ends; Based on the video images of the construction site, the target detection technology, target tracking technology and clustering technology are used to determine the construction resource distribution information corresponding to the construction work surface of the construction site; According to the construction resource distribution information, the queue elements and delay elements in the corresponding construction process simulation model are instantiated.

[0023] The technical solution of the embodiment of the present application specifically includes: a static model construction link, a resource distribution information acquisition link and an instantiation link.

[0024] Among them, in the static model construction link, the construction simulation model is divided into multiple parts, including construction unit intelligent agent objects, construction resource scheduling intelligent agent objects, construction resource intelligent agent objects, and construction process simulation models. The construction process simulation model is further divided into multiple construction process simulation models. The construction process simulation model consists of queue elements and delay elements, which are used to simulate the queuing waiting and process duration of construction resources, respectively, and provides a simulation process of the construction simulation model.

[0025] In the resource distribution information acquisition stage, target detection technology, target tracking technology and clustering technology are used to automatically determine the construction resource distribution information corresponding to the construction work surface.

[0026] In the model instantiation phase, the queue elements and delay elements in the corresponding construction process simulation model are instantiated according to the automatically determined construction resource distribution information.

[0027] The embodiment of the present application adopts target detection technology, target tracking technology and clustering technology to analyze the video image of the construction site, so as to quickly and automatically determine the construction resource distribution information, and use the automatically determined construction resource distribution information for the instantiation of queue elements and delay elements. On the one hand, because the embodiment of the present application does not need to manually count the construction resource distribution information one by one, the collection time of the construction resource distribution information can be shortened. On the other hand, in view of the fact that the embodiment of the present application eliminates the link of manually inputting the construction resource distribution information, it is possible to save manual input time. In summary, the embodiment of the present application can improve the construction efficiency of the construction simulation model.

[0028] In addition, the embodiment of the present application divides the construction simulation model into multiple parts such as construction unit intelligent body object, construction resource scheduling intelligent body object, construction resource intelligent body object and construction process simulation model. The multiple parts of the construction simulation model complement each other and work closely together from different angles, showing the whole process of simulation of construction operations from resource scheduling to construction process. Among them, the construction unit intelligent body object is used to represent the construction object; the construction resource intelligent body object is used to simulate the state information of the construction resources of each resource category; the construction resource scheduling intelligent body object realizes the reasonable allocation of the construction resource intelligent body object; the construction process simulation model clarifies the simulation method of multiple construction processes; the queue element simulates the queuing waiting situation of the construction resource intelligent body object on the construction operation surface; the delay element controls the time of each construction process and simulates the time dimension of each link in the construction process. In summary, the construction simulation model of the embodiment of the present application can realize the accurate simulation of the construction process in the construction operation, can provide support for the early discovery of potential problems such as unreasonable resource allocation, unsmooth process connection, and delayed construction progress in the construction operation, and can also provide strong support for optimizing the construction operation plan, thereby helping the construction project to be promoted efficiently and with high quality.

[0029] Method Embodiment refer to Figure 1 , shows a schematic flow chart of the steps of a method for automatically building a construction simulation model based on video images according to an embodiment of the present application, the method specifically comprising the following steps: Step 101, establishing a construction simulation model for construction operations; the construction simulation model specifically includes: a construction unit intelligent agent object, a construction resource scheduling intelligent agent object, a construction resource intelligent agent object, and a construction process simulation model corresponding to a plurality of construction unit intelligent agent objects; the construction process simulation model specifically includes: one or more construction process simulation models; the construction process simulation model specifically includes: a queue element and a delay element; the queue element is used to simulate the queuing and waiting process of the construction resource intelligent agent objects in the construction process; the delay element is used to simulate the duration of the construction process; The simulation process of the above-mentioned construction simulation model specifically includes: the construction unit intelligent agent object sends a resource request message to the construction resource scheduling intelligent agent object according to the corresponding construction process simulation model; the construction resource scheduling intelligent agent object sends a task issuance message to at least one selected target construction resource intelligent agent object according to the above-mentioned resource request message; after receiving the task issuance message, at least one target construction resource intelligent agent object moves to the target construction work surface where the construction unit intelligent agent object is located; the construction resource intelligent agent objects that meet the set conditions at the target construction work surface are placed in the queue represented by the queue element for queuing and waiting; the construction resource intelligent agent objects that do not need to wait in line or are taken out from the queue element at the target construction work surface are used to perform construction simulation of the construction process; after completing the simulation of the construction process of the construction unit intelligent agent object, the corresponding delay element ends; Step 102: Determine the construction resource distribution information corresponding to the construction work surface of the construction work site by using target detection technology, target tracking technology and clustering technology according to the video image of the construction work site; Step 103: Instantiate queue elements and delay elements in the corresponding construction process simulation model according to the construction resource distribution information.

[0030] Figure 1 The method shown can be used to build a construction simulation model for construction operations.

[0031] In the engineering field, construction work refers to a series of organized and planned production activities at the construction site, in which various construction resources (such as manpower, materials, mechanical equipment, etc.) are used in accordance with specific construction processes, procedures and specifications to achieve engineering design requirements.

[0032] For example, in a hydropower project scenario, examples of construction operations may include: slope excavation operations, dam pouring operations, or tunnel excavation operations, etc. It is understood that the embodiments of the present application are not limited to specific construction operations.

[0033] Taking slope excavation as an example, the construction objects of slope excavation can be divided into three levels: excavation zones, excavation steps, and excavation layers according to the geometric structure subordination of the excavation parts.

[0034] Among them, an excavation zone may include: several excavation steps. Specifically, the entire construction object can be divided into different excavation zones such as the front block excavation zone and the protective layer top surface excavation zone according to the vertical partition line. Then, each excavation zone is further divided into multiple excavation steps according to the designed step height. For example, if the elevation of 50m-55m is designated as the first excavation step, and 55m-60m is designated as the second excavation step, the construction conditions of different excavation steps are different due to their different heights.

[0035] An excavation step specifically includes: a number of excavation blocks. Specifically, each excavation step can be divided into multiple excavation blocks along the horizontal direction, and each excavation block is a basic construction unit, and subsequent specific construction processes are carried out in these excavation blocks.

[0036] In the field of construction simulation technology, an intelligent agent refers to an entity that can perceive the environment, make decisions and take actions. It has autonomy and can decide what actions to perform based on its own goals and perception of the environment to achieve the predetermined goals.

[0037] The agent object is the instantiation of the agent in a specific application scenario (such as a construction simulation model). It is an abstract agent concept that is given specific attributes, states, and behavior rules, so that it can represent an entity with autonomous behavior capabilities in a specific construction simulation model. Behavioral rules refer to a series of rules that specify how an agent should act in a specific environment (such as a construction scene). It clarifies the agent's response to internal state changes and external stimuli (such as instructions, events, etc.), and determines the agent's behavior logic and execution order.

[0038] For example, in the construction simulation model, the construction unit agent object, the construction resource scheduling agent object and the construction resource agent object all have their own clear attributes (such as the geometric dimensions of the construction unit, the type and quantity of construction resources, etc.), status (such as idle, busy, etc.) and behavior rules (such as resource scheduling algorithms, the state transition methods of construction resources).

[0039] The construction unit intelligent agent object, construction resource scheduling intelligent agent object and construction resource intelligent agent object are explained below respectively.

[0040] The construction unit agent object is used to describe a construction unit such as an excavation block. A collection of multiple construction unit agent objects can be used to describe the construction object corresponding to the entire construction operation. The construction unit agent object usually contains attribute parameters related to the construction unit. These attribute parameters can be information such as the size, location, geological conditions, etc. of the construction unit. These attribute parameters are used to characterize the characteristics of each construction unit.

[0041] The embodiment of the present application can instantiate the construction unit to obtain the intelligent object of the construction unit. For example, the instantiation process of the construction unit specifically includes: first, obtaining the partition number of the construction unit from the engineering data; then, for the partition number of the construction unit, obtaining the geometric shape, size data, position data, first behavior rule and other attribute information of the construction unit from the engineering data; binding the partition number of the construction unit with the attribute information to obtain the intelligent object of the construction unit.

[0042] Taking slope excavation as an example, the construction unit intelligent object specifically includes: excavation partition intelligent object, excavation step intelligent object and excavation block intelligent object.

[0043] Among them, the attribute information of the excavation partition intelligent agent object includes the partition number.

[0044] The attribute information of the excavation step intelligent object includes: the partition number of the excavation partition to which it belongs, the step number, the step height, and the start and end elevations.

[0045] The attribute information of the excavation block intelligent object includes: the gradient number, the block number, and the engineering quantity information. The engineering quantity information may include the excavation block area, the length along the baseline, the width along the baseline, the excavation block height, the number of deep / shallow holes drilled, etc. The slope excavation operation can be described as a set consisting of all excavation block intelligent object objects. The construction simulation of the slope excavation operation can be understood as: simulating and calculating the set of excavation block intelligent object objects. Optionally, the set of excavation partition intelligent object objects and the set of excavation step intelligent object objects are only used for the imposition of construction constraints, engineering quantity information statistics, etc., and are not used as specific construction simulation objects.

[0046] The construction resource agent object represents various construction resources, such as manpower (construction personnel) and material resources (construction equipment, materials, etc.). In the construction scene, each construction resource can be regarded as a construction resource agent object. The construction resource agent object can receive task instructions from the construction resource scheduling agent object and play a role in the construction process corresponding to the construction unit agent object. For example, the excavation equipment performs excavation operations in the specified excavation blocks according to the instructions, and the transport vehicle transports the excavated earth away. The behavior and status of the construction resource agent object will be affected by the construction process, and it will also feedback information to the construction resource scheduling agent object to better allocate resources.

[0047] The embodiments of the present application can instantiate construction resources to obtain construction resource intelligent body objects. Specifically, the types of construction resources and construction resource scheduling requirements that may be involved in the construction work are analyzed, and the construction resource intelligent body is instantiated by defining the states that the construction resource intelligent body may be in, as well as the state transition mode, trigger conditions, and second behavior rules between different states. The information of the construction resource scheduling intelligent body object specifically includes: resource category, resource number, performance parameters, state, state transition mode, trigger conditions, etc.

[0048] The states of the construction resource intelligent object may include but are not limited to: initial state, idle state, working state, maintenance state, etc. The state transition modes may include: time trigger, condition trigger and message trigger. Among them, time trigger means switching from one set state to another set state after a specific time interval is met; condition trigger means switching from one set state to another set state after a specific condition is met; message trigger means switching from one set state to another set state when the construction resource intelligent object receives a specific message.

[0049] Reference Figure 2 , showing a schematic diagram of the state transition of the construction resource intelligent body object of an embodiment of the present application, the corresponding state transition process can be described as: when the simulation starts, the state of the construction resource intelligent body object changes from the initial state to the idle state, when the task issuance message is received (message trigger), the state of the construction resource intelligent body object changes to the working state, and goes to the corresponding construction work surface, after completing the corresponding construction process, its state changes to the idle state (condition trigger). When the operation and maintenance message is received (message trigger), the state of the construction resource intelligent body object changes to the maintenance state, and goes to the maintenance site or carries out maintenance operations on site. The construction work surface can refer to the place where the actual construction activities are carried out, such as the excavation site, the material storage yard, and the area where the dam is filled. All belong to the construction work surface.

[0050] Taking slope excavation as an example, the resource categories of construction resources that may be involved in the excavation construction process include: drilling equipment, bulldozer equipment, excavation and loading equipment, and transportation equipment. The drilling equipment intelligent object, bulldozer equipment intelligent object, excavation and loading equipment intelligent object, and transportation equipment intelligent object can be defined accordingly.

[0051] Taking the transport equipment agent object as an example, its state and state transition can be defined as follows: Figure 3 As shown in the figure. At the beginning of the simulation, the state of the transport equipment intelligent object changes from the initial state to the idle state. When receiving the task issuance message, the state of the transport equipment intelligent object changes to moving to the excavation surface. After arriving at the excavation surface, the state of the transport equipment intelligent object changes to waiting for loading. After completing the construction processes such as loading, re-hauling, and unloading, the state of the transport equipment intelligent object changes to idle. When receiving the start of daily maintenance message, the state of the transport equipment intelligent object changes to daily maintenance.

[0052] The construction resource scheduling agent object is used to schedule the construction resource agent objects. It can sense the resource demand of the construction unit agent object during the construction process. For example, in the slope excavation operation, when a certain excavation block (construction unit agent object) needs construction resources such as excavation equipment and transportation vehicles, it can send a resource request message to the construction resource scheduling agent object. The construction resource scheduling agent object will make scheduling decisions based on factors such as the availability of the construction resource agent object and the priority of the construction unit, and allocate the appropriate construction resource agent object to the required construction unit agent object.

[0053] The construction resource scheduling intelligent agent object of the embodiment of the present application may include the following information: scheduling scope (responsible construction work surface), scheduling strategy (such as allocating resources according to the priority of construction units or resource utilization efficiency, etc.), status, state transition method, trigger conditions, third behavior rules, etc.

[0054] The states of the construction resource scheduling intelligent object may include but are not limited to: initial state, construction task existence judgment state, waiting for construction task state, service construction simulation object selection state, idle construction resource judgment state, waiting for construction resource idle state, construction resource scheduling state, task issuance, etc.

[0055] Reference Figure 4 , shows a schematic diagram of the state transition of a construction resource scheduling intelligent agent object in one embodiment of the present application, wherein the states of the construction resource scheduling intelligent agent object include: initial state, construction task existence judgment state, waiting construction task state, service construction simulation object selection state, idle construction resource judgment state, waiting construction resource idle state, construction resource scheduling state, task issuing state, etc.; After the construction simulation model starts simulating, the state of the construction resource scheduling agent changes from the initial state to the construction task existence judgment state. If a resource request message is received from any construction unit agent object, it is considered that there is a construction task, and the state changes to the service construction simulation object selection state; if no resource request message is received, the state changes to the waiting state for the construction task, and the judgment is cyclic until a resource request message is received; When the state of the construction resource scheduling agent changes to the service construction simulation object selection state, according to the first preset rule, a target construction unit agent object is selected from the multiple construction unit agent objects that send the request, and the state changes to the idle construction resource judgment state; if there is an idle construction resource agent object, the state changes to the construction resource scheduling state; if not, the state changes to the waiting construction resource idle state, and the judgment is cyclically judged until the state of a construction resource agent changes to the idle state; When the state of the construction resource scheduling intelligent body changes to the construction resource scheduling state, according to the second preset rule, one or more target construction resource intelligent body objects are selected from multiple idle construction resource intelligent body objects, the state changes to the task issuance state, and a task issuance message is sent to the target construction resource intelligent body object; the task issuance message is used to prompt the target construction resource intelligent body object to go to the target construction work surface corresponding to the target construction unit intelligent body object to perform the corresponding construction process.

[0056] The first preset rule is used to optimize the resource allocation order and reasonably allocate the construction resource intelligent agent objects to specific construction unit intelligent agent objects in multiple resource request messages to speed up the construction progress and balance the supply and demand of resources.

[0057] The first preset rule specifically includes: based on the priority of the construction unit, giving priority to the construction units with key routes or construction processes to obtain construction resources; or, based on the urgency of resource demand, giving priority to the construction units with tight time and large resource shortages; or, based on resource allocation efficiency, giving priority to allocating construction resources to the construction units that are closer to the construction resource intelligent body object. It can be understood that the embodiments of the present application do not limit the specific first preset rule.

[0058] The second preset rule aims to accurately and efficiently select construction resource intelligent object to meet the resource requirements of the construction unit intelligent object.

[0059] The second preset rule specifically covers: Based on resource adaptability: Prioritize the selection of construction resource agent objects that are highly compatible with the construction process of the target construction unit agent object. For example, if the target construction unit is to perform fine welding operations, priority will be given to welding equipment agents that have high welding accuracy and can meet the process requirements of the operation.

[0060] Based on performance parameters: From the idle construction resource intelligent objects, those with better performance parameters are selected first.

[0061] Based on resource scheduling cost: Comprehensively consider the resource scheduling cost and give priority to construction resource intelligent objects with short scheduling paths and low energy consumption. For example, if there are multiple idle construction resource intelligent objects, give priority to construction resource intelligent objects that are close to the target construction work surface and have good traffic conditions on the route to the work surface to reduce transportation costs and time costs.

[0062] The construction process simulation model corresponding to the construction unit intelligent agent object is explained below.

[0063] In the specific implementation, the construction procedures involved in the construction process and the dependencies between the construction procedures can be analyzed for the construction unit intelligent object, and the construction process of the construction unit can be simulated and modeled based on the analysis results to obtain a construction process simulation model corresponding to the construction unit intelligent object.

[0064] The dependency of construction processes refers to the mutual connection and influence between different construction processes. The above dependencies specifically include: sequential dependency, parallel dependency, and end dependency. Among them, sequential dependency means that the next construction process can only start after the previous construction process is completed. Parallel dependency means that two construction processes can start at the same time, but one construction process needs to wait for the construction status of the other construction process to meet the set conditions. End dependency means that when one construction process is completed, the other construction process must also be completed.

[0065] The construction process simulation model specifically includes: one or more construction process simulation models; the construction process simulation model includes: queue elements and delay elements; the queue elements are used to simulate the queuing and waiting process of the construction resource intelligent object in the construction process; the delay elements are used to simulate the duration of the construction process. When the queue elements and delay elements are used at the same time, the queue elements and delay elements can be connected in series.

[0066] The embodiment of the present application can put the construction resource intelligent body objects that meet the set conditions at the target construction work surface into the queue represented by the queue element to queue and wait.

[0067] The above-mentioned setting conditions specifically include: Setting condition 1: for the first construction resource intelligent agent object at the target construction work surface, the first construction resource intelligent agent object corresponds to the first resource category, and the number of the first type of construction resource intelligent agent objects at the target construction work surface exceeds the maximum number of simultaneous working; and / or Setting condition 2: For the first construction resource intelligent body object at the target construction work surface, the first construction resource intelligent body object corresponds to the first resource category, and the construction resource intelligent body object of the first resource category cooperates with the construction resource intelligent body object of the second resource category to jointly simulate the construction process. The target construction work surface may refer to the construction work surface where the construction unit intelligent body object that sends the resource request message is located.

[0068] For setting condition 1, when a construction resource intelligent body object arrives at the target construction work surface, if there are construction resource intelligent body objects of the same resource category, and the number of construction resource intelligent body objects of this resource category exceeds the maximum number that can work simultaneously, the arriving construction resource intelligent body object will be placed in the queue represented by the queue element to wait until a construction resource intelligent body object of the same resource category leaves the current construction work surface.

[0069] For setting condition 2, when a construction resource intelligent body object arrives at the target construction work surface, if it needs to cooperate with construction resource intelligent body objects of other resource categories to jointly carry out the current construction process, the arrived construction resource intelligent body object will be placed in the queue represented by the queue element to wait until the construction resource intelligent body objects of other resource categories that need to be coordinated arrive at the target construction work surface.

[0070] On the basis of the simulation modeling of a single construction process, the simulation modeling of the construction process can be completed by analyzing the dependency of the construction processes involved in the construction process, using a series or parallel approach.

[0071] Referring to FIG. 5 (a), a schematic diagram of a construction process modeling of an embodiment of the present application is shown, wherein for the sequential dependency between construction processes, the construction process simulation models between different construction processes can be connected to complete the modeling of the construction process. For example, queue element 1 and delay element 1 included in construction process 1, and queue element 2 and delay element 2 included in construction process 2 are connected in series.

[0072] Referring to FIG. 5 (b), a schematic diagram of the modeling of the construction process of an embodiment of the present application is shown, wherein for parallel dependency and end dependency, the construction processes can be independently modeled, and the modeling of the dependency relationship can be achieved by using functions to impose judgment conditions. For example, queue element 3 and delay element 3 included in construction process 3 are independently modeled, and queue element 4 and delay element 4 included in construction process 4 are independently modeled. Construction process 3 and construction process 4 are presented in a parallel relationship.

[0073] The model parameters of the construction process simulation model may include: the number of queue elements, the number of delayed elements, the maximum allowed capacity of the queue, and the queue queuing rules, etc. In the embodiment of the present application, the following parameters may be set for the construction process simulation model: 1) The maximum allowed capacity of the queue, which indicates the maximum number of construction resource agent objects that the queue element can accommodate. If the queue is full, the newly arrived construction resource agent object will become idle and return to wait or be rescheduled to a new construction work surface.

[0074] 2) Queue rules: Queue rules for construction resource agent objects of the same resource category, such as first-in-first-out, first-in-last-out, etc.

[0075] Taking the slope excavation operation constructed by drilling and blasting as an example, for the excavation block, that is, the basic construction unit, its construction process involves the following construction procedures: 1) Measurement and layout (construction process A) 2) Drilling (Construction Process B) 3) Charging line (construction process C) 4) Blasting (Construction Process D) 5) Slag loading (construction process E) 6) Slag transportation (construction process F) The dependencies between the construction processes are as follows: 1) Sequence dependency: A→B (drilling can only be carried out after measurement and layout are completed) 2) Sequence dependency: B→C (charge loading and connection can only be carried out after drilling is completed) 3) Sequence dependency: C→D (blasting can only be carried out after the charging line is completed) 4) Sequence dependency: D→E (slag loading can only be carried out after blasting is completed) 5) Sequence dependency: E→F (slag transportation can only be carried out after slag loading is completed) Then a construction process simulation model of excavation blocks is as follows Figure 6 As shown, it specifically includes: construction process simulation models of 6 construction processes. The construction process simulation models of the 6 construction processes specifically include: a construction process simulation model of construction process A, a construction process simulation model of construction process B, a construction process simulation model of construction process C, a construction process simulation model of construction process D, a construction process simulation model of construction process E, and a construction process simulation model of construction process F. The construction process simulation model of construction process A specifically includes: queue element A and delay element A. The construction process simulation model of construction process B specifically includes: queue element B and delay element B. The construction process simulation model of construction process C specifically includes: queue element C and delay element C. The construction process simulation model of construction process D specifically includes: queue element D and delay element D. The construction process simulation model of construction process E specifically includes: queue element E and delay element E. The construction process simulation model of construction process F specifically includes: queue element E and delay element F.

[0076] In addition to realizing the modeling of the construction process simulation model, the embodiment of the present application also provides the following simulation process of the construction simulation model: the construction unit intelligent agent object sends a resource request message to the construction resource scheduling intelligent agent object according to the corresponding construction process simulation model; the construction resource scheduling intelligent agent object sends a task issuance message to at least one selected target construction resource intelligent agent object according to the resource request message; after receiving the task issuance message, at least one target construction resource intelligent agent object moves to the target construction work surface where the construction unit intelligent agent object is located; the construction resource intelligent agent objects that meet the set conditions at the target construction work surface are placed in the queue represented by the queue element for queuing and waiting; the construction resource intelligent agent objects that do not need to wait in queue or are taken out from the queue element at the target construction work surface are used to perform construction simulation of the construction process; after completing the simulation of the construction process of the construction unit intelligent agent object, the corresponding delay element ends.

[0077] The construction simulation model simulates a complete construction process, involving the interaction between multiple parts and the sequential execution of construction procedures. Multiple parts work together to complete the simulation of the construction process. The above simulation process specifically includes the following steps: Step A1, resource request; The construction unit agent object sends a resource request message to the construction resource scheduling agent object according to the corresponding construction process simulation model. Step A1 simulates the situation in which the construction unit requests the required resources from the department or system responsible for resource scheduling before starting construction in actual construction. For example, before the construction unit agent object performs the slag loading construction process, it needs to request construction resource agent objects such as the excavation equipment agent object and the dump equipment agent object from the construction resource scheduling agent object.

[0078] Step A2: resource scheduling; The construction resource scheduling agent object sends a task issuing message to at least one selected target construction resource agent object based on the received resource request message. The construction resource scheduling agent object selects appropriate construction resource agent objects based on the requested resource category, quantity, distance and other factors, and issues a task issuing message to notify them to prepare for work. For example, based on the location, status and other information of the transportation equipment agent object, the nearest and idle transportation equipment agent object to the construction unit agent object is selected, and a task issuing message is sent to it.

[0079] Step A3: Resource movement: After receiving the task assignment message, at least one target construction resource agent object moves to the target construction work surface where the construction unit agent object is located. This simulates the deployment process of construction resources to the work site in reality, such as the selected transportation equipment agent object will drive from the current location to the target construction work surface.

[0080] The process in which the at least one target construction resource intelligent agent object moves to the target construction work surface where the construction unit intelligent agent object is located after receiving the task issuing message specifically includes: Step B1, generating a road network model according to traffic data of the construction area; Taking the construction scenario of a hydropower project as an example, we can rely on traffic data such as the general layout plan and on-site traffic layout CAD (Computer-Aided Design) drawings to obtain the road network information of the area to be modeled, and generate a road network model described in the form of path points based on the coordinate information of the control points in the plane rectangular coordinate system.

[0081] The road network model is a model built based on the traffic data of the area to be modeled, which aims to describe the structure and characteristics of the road network in the area to be modeled in a digital way.

[0082] The road network model specifically includes the following elements: Waypoint: represents a specific location on the road, and its exact location is determined by coordinates in a plane rectangular coordinate system. These waypoints are arranged in sequence according to the direction of the road, and connected together to form the path of the road.

[0083] Path segment: It is composed of adjacent path points and represents a section of the road. Each path segment has its own specific attributes, such as length, direction, road type (such as main road, secondary road, etc.).

[0084] Topological relationship: describes the connection relationship between path points and path segments, as well as the intersection and branching relationships between roads. Through topological relationships, the structure of the entire road network can be clearly represented, which facilitates operations such as path planning and traffic flow analysis.

[0085] Step B2, setting road attribute parameters in the road network model; the road attribute parameters include: road grade, maximum allowed speed, maximum allowed traffic density, number of lanes and road width; Step B3, setting a mark of a set area in the road network model; the set area is the starting point or end point of the transportation; the set area includes: at least one of a construction work surface, a material storage area, and an equipment parking area; The material storage area may refer to the area where materials are brought in and managed, and the equipment parking area may refer to the area used to store construction resources.

[0086] Step B4: Generate a path file corresponding to the target construction resource intelligent object according to the road network model, wherein the path file includes: the starting point, the end point, the passing points, and the path length of the transportation; Step B5: After receiving the task issuing message, the at least one target construction resource intelligent agent object moves from the starting point to the target construction work surface where the construction unit intelligent agent object is located according to the path file.

[0087] The road network model and path file generated by steps B1-B4 can describe the specific route of the construction resource intelligent object from the starting point to the target construction work surface, including detailed information such as the starting point, end point, and passing points, providing clear navigation for the movement of the construction resource intelligent object.

[0088] In step B2, road attribute parameters such as the maximum allowed vehicle speed, maximum vehicle density, number of lanes and road width are set in detail. These road attribute parameters reflect the road capacity and restriction conditions.

[0089] Step B4 can calculate the travel time of each road section by using the maximum allowed speed and the road length. Alternatively, step B4 can predict the road congestion according to the maximum traffic density. Alternatively, step B4 can determine the road carrying capacity by combining the number of lanes and the road width.

[0090] By comprehensively analyzing the road attribute parameters, step B4 can accurately calculate the length and estimated time of different paths, thereby selecting the optimal driving path for the construction resource intelligent object, so that the target construction resource intelligent object can efficiently and accurately reach the target construction work surface, ensuring the orderly progress of the construction process.

[0091] Step A4: Wait in line; The construction resource agent objects that meet the set conditions at the target construction work surface are placed in the queue represented by the queue element to wait in line. For example, due to the limited construction site, multiple construction equipment cannot work at the same time after arriving, and can only wait to enter the work surface in a certain order. Construction equipment that meets certain set conditions (such as first come first served, sorted by equipment performance, etc.) enters the queue sequence.

[0092] Step A5: construction simulation; The construction resource agent objects at the target construction work surface that do not need to wait in line or be taken out from the queue elements are used to perform construction simulation of the construction process. For example, according to the construction process and process standards, the excavation equipment agent object simulates the excavation action to control the excavation depth, angle and range, and the dump equipment agent object simulates the material loading, transportation and unloading process. Through the collaborative simulation of these construction resource agent objects, the actual operation process of the construction process is fully presented.

[0093] Step A6: The process is completed.

[0094] After completing the simulation of the i-th construction process of the construction unit agent object, the corresponding delay element ends.

[0095] Delay elements are used to simulate the duration of a construction process. Taking slag loading as an example, the delay element counts the duration of the entire construction process of slag loading, including the time it takes for the dump truck to move to the designated location, the time it takes for the excavator to dig and load, and the time it takes for the dump truck to wait in the queue. These times together constitute the total time required to complete the entire slag loading process, and the delay element comprehensively counts and accumulates these times to reflect the duration of the entire construction process.

[0096] The construction process simulation model may include: dependencies between different construction processes. In this way, the embodiment of the present application may execute all construction processes included in the construction process simulation model according to the above dependencies.

[0097] For example, Figure 6 The construction sequence of the construction process simulation model shown is: first carry out construction process A (measurement and layout), and after its completion, carry out construction process B (drilling), after the completion of construction process B, carry out construction process C (charging and connecting), after the completion of construction process C, start construction process D (blasting), after the completion of construction process D, start construction process E (slag loading), and finally, implement construction process F (slag transportation) based on the completion of construction process E. Each construction process is carried out strictly in this progressive order. The completion of the previous process creates conditions for the subsequent process, and each process is simulated by the corresponding construction process simulation model (queue elements and delay elements) to simulate the queuing situation and duration in the construction process.

[0098] In a specific implementation, the construction simulation model may also include: a connection relationship between different construction process simulation models. The above connection relationship may include: series connection or parallel connection, etc. The embodiment of the present application can analyze the construction sequence between the construction unit intelligent body objects, and connect the construction process simulation models of each construction unit intelligent body object in series or parallel connection to obtain a construction simulation model of the construction operation, that is, to construct a static construction simulation model for the construction operation. It should be noted that in the static construction simulation model, the number of parallel construction process models will be pre-set in the initial stage. Subsequently, as the construction operation progresses, the number of parallel construction process simulation models will be dynamically updated based on the analysis results of the video image, so as to achieve the accuracy and real-time performance of the construction simulation model.

[0099] In a specific implementation, a process data structure can be generated according to the sequential relationship between the construction processes of different construction units; the process data structure is used to describe the sequential relationship between the construction processes of different construction units; according to the process data structure, the construction process simulation models corresponding to different construction units are connected; the connection relationship between different construction process simulation models includes: parallel or series connection.

[0100] Taking slope excavation as an example, the numbering sequence of the excavation blocks can be used to describe the excavation operation sequence between the excavation blocks, and the construction process models of the excavation blocks can be connected in series or in parallel in sequence to obtain a static construction simulation model of a certain excavation partition.

[0101] Reference Figure 7 , shows a schematic diagram of a construction simulation model of an embodiment of the present application, wherein the construction simulation model may include: parallel construction process simulation model A, construction process simulation model B, construction process simulation model C and construction process simulation model D. Assume that a certain excavation partition W is composed of four excavation blocks A, B, C, and D, and corresponding construction process simulation models A, B, C, and D are established respectively. If the four excavation blocks A, B, C, and D are excavated at the same time, the simulation model of the excavation partition W is Figure 7 As shown, it is composed of construction process simulation models A, B, C, and D in parallel, and the completion time is determined by the excavation block that ends excavation the latest.

[0102] The embodiment of the present application can execute the construction operations corresponding to all construction unit intelligent body objects according to the connection relationship between different construction process simulation models.

[0103] The embodiment of the present application can convert the connection relationship between different construction process simulation models in the construction simulation model into a data structure such as a directed graph, where the nodes in the directed graph represent the construction process simulation models, and the edges in the directed graph represent the chronological relationship between the construction process simulation models.

[0104] For the series relationship, it is reflected as a linear sequence in the directed graph, that is, the construction process simulation model corresponding to the next node can only start after the construction process simulation model corresponding to the previous node is completed; for the parallel relationship, multiple nodes can point to the same subsequent node at the same time, which means that the construction process simulation models corresponding to these nodes can be carried out in parallel.

[0105] In this way, the embodiment of the present application can perform topological sorting to clarify the order between the intelligent body objects of different construction units, use depth or breadth-first search algorithm to traverse, use multi-threading or process simulation to execute in parallel when encountering parallel processes, and strictly execute in sequence when encountering serial processes, while taking into account resource allocation and management, constraint processing, etc. in the entire process.

[0106] In step 102, target detection technology, target tracking technology and clustering technology may be used to automatically determine the construction resource distribution information corresponding to the construction work surface.

[0107] The process of determining the construction resource distribution information corresponding to the construction work surface of the construction work site by using target detection technology, target tracking technology and clustering technology according to the video image of the construction work site specifically includes: Step C1, performing target detection and target tracking on the video image, and obtaining detection frames, resource categories and identification numbers corresponding to a plurality of construction resources in the video image; Step C2: clustering the multiple construction resources in the video image according to the coordinates of the center points corresponding to the detection frames to obtain a plurality of clusters; the detection frames in the same cluster belong to the same construction work surface; Step C3: Determine the construction resource distribution information corresponding to the construction work surface of the construction work site according to the resource category corresponding to the detection frame in the same cluster.

[0108] In step C1, the target detection technology and target tracking technology are intended to identify different targets from the input video image and continuously track them, and determine the position, category and identification number of the target in the image. In the construction operation scenario, the construction resources are the targets to be detected and tracked. By using the trained target detection model and target tracking model (such as a convolutional neural network model based on deep learning, etc.), the video image is processed. The target detection model and the target tracking model will scan and continuously locate the area where multiple construction resources are located in the video image based on the learned feature patterns of various construction resources. This area is presented in the form of a detection frame, and at the same time, it can determine the category of the resource in each detection frame, such as a certain construction machinery, construction materials or construction personnel, etc., and the identification number corresponding to the resource in each detection frame, such as 1, 2, 3, etc. The construction machinery can specifically include: excavation equipment or self-unloading equipment, etc. The detection frame can be the corresponding circumscribed rectangular frame of the construction resource in the video image.

[0109] In step C2, since the spatial distribution of construction resources at the construction site is regular, the construction resources on the same construction surface often have relatively close spatial position characteristics in the input image. Clustering technology operates based on the attributes that can reflect the spatial scale, such as the coordinates of the center point corresponding to the detection frame. Classifying the detection frames with relatively close spatial distances into one category, that is, clustering them into a cluster, means that these construction resources with similar spatial scales in the input image are likely to be on the same construction surface. Because in the actual construction process, the spatial distances presented by the construction resources that cooperate to complete the same construction process in the image are similar, through this clustering method, the numerous construction resources at the entire construction site can be preliminarily divided according to the construction surfaces to which they belong, so as to distinguish the construction resources of different construction surfaces.

[0110] Assuming that the detection frame is represented by the center point coordinates (x, y), the center point coordinates of all detection frames are combined into a two-dimensional data set in the format of: data=[[x1,y1],[x2,y2],...] Manhattan distance is used as the similarity metric. According to the optimization goal of minimizing the distance within a cluster, a clustering algorithm is used to divide all detection frames into several clusters. The detection frames in the same cluster are considered to belong to the same construction work surface. According to the number of clusters, the number of construction work surfaces is obtained.

[0111] After clustering, each cluster (i.e., construction work surface) contains multiple detection frames, and each detection frame corresponds to a specific resource category. Step C3 can determine the specific construction resources and their distribution on each construction work surface by counting the resource categories corresponding to each detection frame in the same cluster and the number of each resource category.

[0112] The construction resource distribution information specifically includes: at least one resource category, and the quantity of resources corresponding to each resource category.

[0113] In a specific implementation, when the preset calling conditions are met, a calling request is sent to the video image analysis module, and the video image analysis module determines the construction resource distribution information corresponding to the construction working surface of the construction working site based on the video image of the construction working site; The preset calling conditions specifically include: Construction work commences; and / or There is an update in the construction process; and / or Changes in construction resources; and / or The next time period arrives.

[0114] In the process of construction modeling, if you want to accurately grasp the construction resource distribution information of each construction work surface at the construction site, you need to use the video image analysis module for analysis and processing. When the preset call conditions are met, a call request is sent to the video image analysis module. The purpose of this is to ensure that key information can be obtained in a timely manner while avoiding unnecessary waste of resources (such as computing resources, time costs, etc.), so that the analysis work can be carried out on demand and the distribution of construction resources can be accurately and efficiently obtained.

[0115] Among them, when the construction work starts, a call request is sent to the video image analysis module to clarify the initial resource configuration of each construction work surface and provide basic data for the instantiation of the construction simulation model.

[0116] When the construction process is updated, it means that the construction process has been switched. Sending a call request to the video image analysis module can determine whether the resource allocation under the new construction process is reasonable, ensuring smooth construction connection and on-demand resource allocation.

[0117] When construction resources change, a call request is sent to the video image analysis module to quickly understand the resource changes on the construction site.

[0118] When the next time period arrives, a call request is sent to the video image analysis module to regularly understand the dynamic changes of resources.

[0119] In a specific implementation, the construction resource distribution information includes: at least one resource category and the quantity of resources corresponding to each resource category; The process of instantiating the queue elements and delay elements in the corresponding construction process simulation model according to the construction resource distribution information specifically includes: Step C1: if the number of resources of a resource category in the construction resource distribution information exceeds the maximum number of simultaneous workers, the construction resource agent objects exceeding the maximum number of simultaneous workers are first sorted according to arrival time or priority to obtain a first sorting result; Step C2: save the first sorting result to the first queue corresponding to the queue element in the corresponding construction process simulation model.

[0120] Among them, in the construction resource distribution information, when the number of a resource category exceeds the maximum number of simultaneous workers, a sorting mechanism needs to be introduced to arrange these resources reasonably. Sorting by arrival time can give priority to the construction resource intelligent objects that arrive first; sorting by priority can highlight important construction resource intelligent objects. In this way, the construction resource intelligent objects that exceed the quantity limit are arranged in order.

[0121] On the one hand, the first sorting can make the use of construction resources more reasonable and orderly, avoid disordered competition and chaotic allocation between resource intelligent objects, and ensure the orderly development of the construction process. On the other hand, the first sorting creates good conditions for the accurate recording of the maintenance time of the delay element, making the statistics of relevant data such as resource usage time more logical and accurate, and thus better reflecting the time utilization of construction resources in the entire construction process.

[0122] Step C2 stores the first sorting result obtained in step C1 into the first queue corresponding to the queue element in the corresponding construction process simulation model, thereby achieving orderly management of the construction resource intelligent body objects.

[0123] Optionally, the above method may further include: When a construction resource intelligent agent object of a resource category completes the simulation of the construction process and the current number of tasks of a resource category is less than the maximum number of simultaneous tasks, the intelligent construction resource intelligent agent object of the corresponding resource category is taken out from the first queue for further simulation of the construction process.

[0124] In the construction process simulation, the construction resource agent object of the corresponding resource category taken out from the first queue must meet the following two conditions: Condition 1: The intelligent agent objects of a resource category complete the simulation of the construction process, that is, some intelligent agent objects in this resource category have completed the construction tasks currently assigned to them and are in an idle state.

[0125] Condition 2: The current number of tasks for a resource category is less than the maximum number of tasks that can be performed simultaneously, which indicates that there is still available space for this type of resource, allowing more resource agent objects to be put into work.

[0126] When these two conditions are met at the same time, the construction resource agent object of the corresponding resource category is taken out from the first queue and put into further simulation of the construction process to make full use of resources and ensure the continuity and efficiency of the construction simulation.

[0127] In a specific implementation, the process of instantiating the queue elements and delay elements in the corresponding construction process simulation model according to the construction resource distribution information specifically includes: Step D1: According to the collaborative relationship between the first resource category and the second resource category, the first construction resource intelligent agent object and the second construction resource intelligent agent object corresponding to the construction resource distribution information are matched to obtain a plurality of matching pairs; a matching pair includes: a first construction resource intelligent agent object and a second construction resource intelligent agent object; the number of the matching pairs does not exceed the maximum number of simultaneous operations; Step D2: performing a second sorting on the first construction resource agent objects that are not in the matching pair according to the arrival time or priority to obtain a second sorting result; Step D3, performing a third sorting on the second construction resource agent objects that are not in the matching pair according to the arrival time or priority, to obtain a third sorting result; Step D4, saving the second sorting result to the second queue corresponding to the queue element in the corresponding construction process simulation model, and saving the third sorting result to the third queue corresponding to the queue element in the corresponding construction process simulation model.

[0128] Among them, step D1 considers the collaborative relationship between different resource categories, pairs the related construction resource intelligent objects, and better utilizes the resources according to the collaboration, and controls the matching number not to exceed the maximum number of simultaneous working to ensure the rational use of resources. Step D1 forms a collaborative combination through matching, improves the efficiency of resource utilization, fits the resource coordination situation in actual construction, and helps to simulate the construction process more accurately.

[0129] Step D2 sorts the first construction resource agent objects that are not involved in the matching pair according to arrival time or priority to determine the order of their subsequent use.

[0130] In step D3, the second construction resource agent objects that are not in the matching pair are also sorted according to the arrival time or priority to standardize their usage order.

[0131] Step D4 stores the sorted results into the corresponding second queue and third queue respectively. By using the queue characteristics to store the resource sequence, it is possible to achieve orderly storage and management of different resources, making it convenient to subsequently retrieve resources in sequence for construction process simulation.

[0132] In summary, steps D1 to D4 reasonably match and sort the construction resource intelligent body objects according to the collaborative relationship and quantity of different resource categories in the construction resource distribution information, and save the results to the corresponding queue, so as to provide the construction process simulation model with an orderly resource allocation plan that meets the actual collaborative needs, so that the construction simulation can more accurately reflect the allocation and use of resources in the actual construction process, thereby assisting construction management and decision-making, and improving construction efficiency and quality.

[0133] Optionally, the above method may also include: when a matching pair completes the simulation of the construction process and the number of matching pairs working is less than the maximum number of matching pairs working simultaneously, taking out construction resource intelligent body objects of corresponding resource categories from the second and third queues respectively for further simulation of the construction process.

[0134] During the construction process simulation, for the resource matching pairs previously formed according to the collaborative relationship, when one of the matching pairs completes the simulation of the corresponding construction process, the number of matching pairs that are working will be checked. If the number of matching pairs that are working is less than the preset maximum number of simultaneous working pairs, it means that there is still room for new resources to continue the construction simulation. At this time, the construction resource intelligent body objects of the corresponding resource categories will be taken out from the second and third queues respectively, and they will be added to ensure that the construction process simulation can be carried out continuously and orderly, so that the entire construction simulation is more in line with the dynamic allocation and use of resources in actual construction. New matching pairs can be formed by taking out the construction resource intelligent body objects of the corresponding resource categories from the second and third queues respectively.

[0135] The delay element is used to count the duration of the construction process, while the queue element stores the sorting information of the construction resource agent objects. The state changes and operation sequence of the construction resource agent objects represented by the queue element during the construction process will affect the duration of the construction process, which is the time counted by the delay element. For example, the waiting time of the construction resource agent objects in the queue is part of the delay element statistics.

[0136] In a specific implementation, a delay element instance may be created for each construction process, and the delay element instance may be a data structure for storing and accumulating relevant time information. For example, an object containing attributes such as total duration, total waiting time, and total operation time may be created.

[0137] In addition, the total duration, the total waiting time, and the total working time can be calculated.

[0138] Calculation of the total waiting time: Based on the queue element's entry and exit times, calculate the waiting time of each construction resource agent object in the queue and add it to the total waiting time attribute of the delay element.

[0139] Calculation of operation time synthesis: According to the start time and end time of each construction operation performed by the construction resource agent object, the duration of each construction operation is calculated and added to the operation time sum attribute of the delay element.

[0140] Total duration calculation: Add the total waiting time to the total working time to get the total duration of the construction process, which is stored in the total duration attribute of the delay element.

[0141] During the construction process, as construction resource agent objects continue to enter and leave the queue and perform construction operations, the time statistics of delayed elements are continuously updated.

[0142] In an optional implementation of the present application, the construction simulation model may further include: a connection relationship between different construction process simulation models; the connection relationship specifically includes: parallel connection; The method may further include: determining the number of construction work surfaces at the construction work site according to the video image of the construction work site; and instantiating the number of parallel construction process models according to the number of construction work surfaces.

[0143] The construction simulation model covers the parallel connection relationship of different construction process simulation models. By analyzing the video images of the construction site and using image recognition and other technologies, the number of construction work surfaces can be determined based on visual features such as construction resource distribution and construction activity scope. Since each construction work surface is relatively independent and has specific construction tasks, the parallel construction process model is instantiated according to the number of construction work surfaces, so that the parallel process in the construction simulation model matches the parallel construction of multiple work surfaces in actual construction, so that the simulation is more in line with the actual construction status.

[0144] By instantiating the parallel construction process model according to the number of construction work surfaces, the fit between the construction simulation model and the actual construction can be significantly improved, and the scene of simultaneous construction of multiple construction work surfaces can be accurately simulated, providing a reliable reference for construction decision-making. At the same time, this method also helps to optimize the allocation and scheduling of construction resources, clearly present the resource requirements of each work surface, avoid resource waste, and improve utilization efficiency.

[0145] In summary, the automatic construction method of the construction simulation model based on video images of the embodiment of the present application adopts target detection technology, target tracking technology and clustering technology to analyze the video images of the construction site, so as to quickly and automatically determine the construction resource distribution information, and use the automatically determined construction resource distribution information for the instantiation of queue elements and delay elements. On the one hand, because the embodiment of the present application does not need to manually count the construction resource distribution information one by one, the collection time of the construction resource distribution information can be shortened. On the other hand, in view of the fact that the embodiment of the present application eliminates the link of manually inputting the construction resource distribution information, it is possible to save manual input time. In summary, the embodiment of the present application can improve the construction efficiency of the construction simulation model.

[0146] It should be noted that, for the method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present application are not limited by the described order of actions, because according to the embodiments of the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present application.

[0147] Based on the above embodiment, this embodiment also provides a device for automatically building a construction simulation model based on video images. Figure 8 The device may specifically include: a model building module 801, a video analysis module 802 and an instantiation module 803.

[0148] Among them, the model building module 801 is used to establish a construction simulation model for construction operations; the construction simulation model includes: a construction unit intelligent agent object, a construction resource scheduling intelligent agent object, a construction resource intelligent agent object, and a construction process simulation model corresponding to multiple construction unit intelligent agent objects; the construction process simulation model includes: one or more construction process simulation models; the construction process simulation model includes: a queue element and a delay element; the queue element is used to simulate the queuing and waiting process of the construction resource intelligent agent object in the construction process; the delay element is used to simulate the duration of the construction process; The simulation process of the construction simulation model includes: the construction unit intelligent agent object sends a resource request message to the construction resource scheduling intelligent agent object according to the corresponding construction process simulation model; the construction resource scheduling intelligent agent object sends a task issuing message to at least one selected target construction resource intelligent agent object according to the resource request message; after receiving the task issuing message, at least one target construction resource intelligent agent object moves to the target construction work surface where the construction unit intelligent agent object is located; the construction resource intelligent agent objects that meet the set conditions at the target construction work surface are placed in a queue represented by a queue element for queuing and waiting; the construction resource intelligent agent objects that do not need to wait in queue or are taken out of the queue element at the target construction work surface are used to perform construction simulation of the construction process; after completing the simulation of the construction process of the construction unit intelligent agent object, the corresponding delay element ends; The video analysis module 802 is used to determine the construction resource distribution information corresponding to the construction work surface of the construction work site by using target detection technology, target tracking technology and clustering technology according to the video image of the construction work site; The instantiation module 803 is used to instantiate the queue elements and delay elements in the corresponding construction process simulation model according to the construction resource distribution information.

[0149] Optionally, the video analysis module includes: The target detection and target tracking module is used to perform target detection on the video image, and obtain the detection frames, resource categories and identification numbers corresponding to the multiple construction resources in the video image; A clustering module, used for clustering the multiple construction resources in the video image according to the coordinates of the center points corresponding to the detection frames to obtain a plurality of clusters; the detection frames in the same cluster belong to the same construction work surface; The distribution determination module is used to determine the construction resource distribution information corresponding to the construction work surface of the construction site according to the resource category corresponding to the detection frame in the same cluster.

[0150] Optionally, the video analysis module is specifically used to send a call request to the video image analysis module when a preset call condition is met, and the video image analysis module determines the construction resource distribution information corresponding to the construction work surface of the construction work site based on the video image of the construction work site; The preset calling conditions include: Construction work commences; and / or There is an update in the construction process; and / or Changes in construction resources; and / or The next time period arrives.

[0151] Optionally, the construction simulation model further includes: a connection relationship between different construction process simulation models; the connection relationship includes: parallel connection; The device also includes: Determine the number of construction work surfaces at the construction work site based on the video images of the construction work site; According to the number of construction work surfaces, the number of parallel construction process models is instantiated.

[0152] Optionally, the setting conditions include: For a first construction resource intelligent agent object at a target construction work surface, the first construction resource intelligent agent object corresponds to a first resource category, and the number of first type of construction resource intelligent agent objects at the target construction work surface exceeds the maximum number of simultaneous operations; and / or For the first construction resource intelligent body object at the target construction work surface, the first construction resource intelligent body object corresponds to the first resource category, and the construction resource intelligent body object of the first resource category cooperates with the construction resource intelligent body object of the second resource category to jointly simulate the construction process.

[0153] Optionally, the construction resource distribution information includes: at least one resource category, and the quantity of resources corresponding to each resource category; The instantiation module includes: A first sorting module is used for, if the number of resources of a resource category in the construction resource distribution information exceeds the maximum number of simultaneous workers, to perform a first sorting on the construction resource agent objects exceeding the maximum number of simultaneous workers according to the arrival time or priority, to obtain a first sorting result; The first saving module is used to save the first sorting result to the first queue corresponding to the queue element in the corresponding construction process simulation model.

[0154] Optionally, the device further comprises: The first dequeue module is used to take out the intelligent construction resource agent object of the corresponding resource category from the first queue for further simulation of the construction process when the construction resource agent object of a resource category completes the simulation of the construction process and the current number of jobs of a resource category is less than the maximum number of simultaneous jobs.

[0155] Optionally, the construction resource distribution information includes: at least one resource category, and the quantity of resources corresponding to each resource category; The instantiation module includes: A matching module is used to match the first construction resource intelligent agent object and the second construction resource intelligent agent object corresponding to the construction resource distribution information according to the collaborative relationship between the first resource category and the second resource category, so as to obtain a plurality of matching pairs; a matching pair includes: a first construction resource intelligent agent object and a second construction resource intelligent agent object; the number of the matching pairs does not exceed the maximum number of simultaneous operations; A second sorting module is used to perform a second sorting on the first construction resource agent objects that are not in the matching pair according to the arrival time or priority to obtain a second sorting result; A third sorting module, used to perform a third sorting on the second construction resource agent objects that are not in the matching pair according to the arrival time or priority, to obtain a third sorting result; The second saving module is used to save the second sorting result to the second queue corresponding to the queue element in the corresponding construction process simulation model, and to save the third sorting result to the third queue corresponding to the queue element in the corresponding construction process simulation model.

[0156] Optionally, the device further comprises: The second dequeue module is used to take out the construction resource intelligent body objects of the corresponding resource categories from the second and third queues respectively for further simulation of the construction process when a matching pair completes the simulation of the construction process and the number of matching pairs working is less than the maximum number of matching pairs working simultaneously.

[0157] Optionally, after receiving the task issuing message, the at least one target construction resource agent object moves to the target construction work surface where the construction unit agent object is located, including: Generate a road network model based on traffic data in the construction area; Setting road attribute parameters in the road network model; the road attribute parameters include: road grade, maximum allowed speed, maximum allowed traffic density, number of lanes and road width; Setting a mark of a set area in the road network model; the set area is the starting point or end point of the transportation; the set area includes: at least one of a construction work surface, a material storage area, and an equipment parking area; Generate a path file corresponding to the target construction resource intelligent object according to the road network model, wherein the path file includes: the starting point, the end point, the passing points, and the path length of the transportation; After receiving the task issuing message, the at least one target construction resource intelligent agent object moves from the starting point to the target construction work surface where the construction unit intelligent agent object is located according to the path file.

[0158] Optionally, the device further comprises: A data structure generation module, used to generate a process data structure according to the sequential relationship between the construction processes of different construction units; the process data structure is used to describe the sequential relationship between the construction processes of different construction units; The connection module is used to connect the construction process simulation models corresponding to different construction units according to the process data structure; the connection relationship between different construction process simulation models includes: parallel connection or series connection.

[0159] Optionally, the states of the construction resource scheduling agent object include: initial state, construction task existence judgment state, waiting construction task state, service construction simulation object selection state, idle construction resource judgment state, waiting construction resource idle state, construction resource scheduling state, task issuing state, etc.; After the construction simulation model starts simulating, the state of the construction resource scheduling agent changes from the initial state to the construction task existence judgment state. If a resource request message is received from any construction unit agent object, it is considered that there is a construction task, and the state changes to the service construction simulation object selection state; if no resource request message is received, the state changes to the waiting state for the construction task, and the judgment is cyclic until a resource request message is received; When the state of the construction resource scheduling agent changes to the service construction simulation object selection state, according to the first preset rule, a target construction unit agent object is selected from the multiple construction unit agent objects that send the request, and the state changes to the idle construction resource judgment state; if there is an idle construction resource agent object, the state changes to the construction resource scheduling state; if not, the state changes to the waiting construction resource idle state, and the judgment is cyclically judged until the state of a construction resource agent changes to the idle state; When the state of the construction resource scheduling intelligent body changes to the construction resource scheduling state, according to the second preset rule, one or more target construction resource intelligent body objects are selected from multiple idle construction resource intelligent body objects, the state changes to the task issuance state, and a task issuance message is sent to the target construction resource intelligent body object; the task issuance message is used to prompt the target construction resource intelligent body object to go to the target construction work surface corresponding to the target construction unit intelligent body object to perform the corresponding construction process.

[0160] The embodiment of the present application further provides a non-volatile readable storage medium, in which one or more modules (programs) are stored. When the one or more modules are applied to a device, the device can execute instructions (instructions) of each method step in the embodiment of the present application.

[0161] The present application embodiment provides one or more machine-readable media, on which instructions are stored, and when executed by one or more processors, an electronic device executes one or more of the methods described in the above embodiments. In the present application embodiment, the electronic device includes various types of devices such as terminal devices, servers (clusters), etc.

[0162] An embodiment of the present application provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute any of the methods for automatically constructing a construction simulation model based on video images described in the above embodiments.

[0163] The embodiments of the present disclosure may be implemented as a device that uses any appropriate hardware, firmware, software, or any combination thereof to perform a desired configuration, and the device may include: electronic devices such as terminal devices and servers (clusters). Fig. 9 An exemplary apparatus 1300 that can be used to implement various embodiments described in this application is schematically illustrated.

[0164] For one embodiment, Fig. 9 An exemplary apparatus 1300 is shown having one or more processors 1302, a control module (chip set) 1304 coupled to at least one of the processor(s) 1302, a memory 1306 coupled to the control module 1304, an NVP (non-volatile memory) / storage device 1308 coupled to the control module 1304, one or more input / output devices 1310 coupled to the control module 1304, and a network interface 1312 coupled to the control module 1304.

[0165] The processor 1302 may include one or more single-core or multi-core processors, and the processor 1302 may include any combination of general-purpose processors or special-purpose processors (such as graphics processors, application processors, baseband processors, etc.). In some embodiments, the device 1300 can be used as a terminal device, server (cluster), etc. described in the embodiments of the present application.

[0166] In some embodiments, the device 1300 may include one or more computer-readable media (e.g., memory 1306 or non-volatile memory / storage device 1308) having instructions 1314 and one or more processors 1302 configured to execute the instructions 1314 in combination with the one or more computer-readable media to implement a module to perform the actions described in the present disclosure.

[0167] For one embodiment, the control module 1304 may include any suitable interface controller to provide any suitable interface to at least one of the processor(s) 1302 and / or any suitable device or component in communication with the control module 1304 .

[0168] The control module 1304 may include a memory controller module to provide an interface to the memory 1306. The memory controller module may be a hardware module, a software module, and / or a firmware module.

[0169] The memory 1306 may be used, for example, to load and store data and / or instructions 1314 for the device 1300. For one embodiment, the memory 1306 may include any suitable volatile memory, such as a suitable DRAM (Dynamic Random Access Memory). In some embodiments, the memory 1306 may include a double data rate type four synchronous dynamic random access memory.

[0170] For one embodiment, the control module 1304 may include one or more input / output controllers to provide an interface to the non-volatile memory / storage device 1308 and the input / output device(s) 1310 .

[0171] For example, non-volatile memory / storage 1308 may be used to store data and / or instructions 1314. Non-volatile memory / storage 1308 may include any suitable non-volatile memory (e.g., flash memory) and / or may include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives, one or more optical disk drives, and / or one or more digital versatile optical disk drives).

[0172] The non-volatile memory / storage device 1308 may include storage resources that are physically part of the device on which the apparatus 1300 is installed, or it may be accessible to the device without being part of the device. For example, the non-volatile memory / storage device 1308 may be accessed via (one or more) input / output devices 1310 over a network.

[0173] The input / output device(s) 1310 may provide an interface for the apparatus 1300 to communicate with any other appropriate device, and the input / output device 1310 may include a communication component, an audio component, a sensor component, etc. The network interface 1312 may provide an interface for the apparatus 1300 to communicate through one or more networks, and the apparatus 1300 may wirelessly communicate with one or more components of a wireless network according to any of one or more wireless network standards and / or protocols, for example, accessing a wireless network based on a communication standard, such as WiFi (Wireless Fidelity), 2G (2nd Generation Wireless Telephone Technology), 3G (3rd Generation Wireless Telephone Technology), 4G (4th Generation Wireless Telephone Technology), 5G (5th Generation Wireless Telephone Technology), etc., or a combination thereof for wireless communication.

[0174] For one embodiment, at least one of the processor(s) 1302 may be packaged together with the logic of one or more controllers (e.g., a memory controller module) of the control module 1304. For one embodiment, at least one of the processor(s) 1302 may be packaged together with the logic of one or more controllers of the control module 1304 to form a system-in-package. For one embodiment, at least one of the processor(s) 1302 may be integrated on the same die with the logic of one or more controllers of the control module 1304. For one embodiment, at least one of the processor(s) 1302 may be integrated on the same die with the logic of one or more controllers of the control module 1304 to form a system-on-chip.

[0175] In various embodiments, the device 1300 may be, but is not limited to, a terminal device such as a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a touch screen device, a netbook, etc.). In various embodiments, the device 1300 may have more or fewer components and / or a different architecture. For example, in some embodiments, the device 1300 includes one or more cameras, a keyboard, a liquid crystal display screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, a dedicated integrated circuit, and a speaker.

[0176] Among them, the main control chip can be used as a processor or control module in the detection device, sensor data, location information, etc. are stored in a memory or non-volatile memory / storage device, the sensor group can be used as an input / output device, and the communication interface may include a network interface.

[0177] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0178] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0179] The present application embodiment is described with reference to the flowchart and / or block diagram of the method, terminal device (system) and computer program product according to the embodiment of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, and the combination of the process and / or box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing terminal device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device produce a device for implementing the function specified in one process or multiple processes in the flowchart and / or one box or multiple boxes in the block diagram.

[0180] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device that implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0181] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce computer-implemented processing, so that the instructions executed on the computer or other programmable terminal device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.

[0182] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0183] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0184] The above is a detailed introduction to a method and device for automatically constructing a construction simulation model based on video images, an electronic device and a machine-readable medium provided by the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application sets. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A method for automatically constructing a construction simulation model based on video images, characterized in that: The method comprises: A construction simulation model is established for construction operations; the construction simulation model includes: a construction unit intelligent agent object, a construction resource scheduling intelligent agent object, a construction resource intelligent agent object, and construction process simulation models corresponding to multiple construction unit intelligent agent objects respectively; the construction process simulation model includes: one or more construction process simulation models; the construction process simulation model includes: a queue element and a delay element; the queue element is used to simulate the queuing and waiting process of the construction resource intelligent agent objects in the construction process; the delay element is used to simulate the duration of the construction process; The simulation process of the construction simulation model includes: the construction unit intelligent agent object sends a resource request message to the construction resource scheduling intelligent agent object according to the corresponding construction process simulation model; the construction resource scheduling intelligent agent object sends a task issuing message to at least one selected target construction resource intelligent agent object according to the resource request message; after receiving the task issuing message, at least one target construction resource intelligent agent object moves to the target construction work surface where the construction unit intelligent agent object is located; the construction resource intelligent agent objects that meet the set conditions at the target construction work surface are placed in a queue represented by a queue element for queuing and waiting; the construction resource intelligent agent objects that do not need to wait in queue or are taken out of the queue element at the target construction work surface are used to perform construction simulation of the construction process; after completing the simulation of the construction process of the construction unit intelligent agent object, the corresponding delay element ends; Based on the video images of the construction site, the target detection technology, target tracking technology and clustering technology are used to determine the construction resource distribution information corresponding to the construction work surface of the construction site; According to the construction resource distribution information, the queue elements and delay elements in the corresponding construction process simulation model are instantiated.

2. The method according to claim 1, characterized in that The method of determining the construction resource distribution information corresponding to the construction work surface of the construction work site by using target detection technology, target tracking technology and clustering technology based on the video image of the construction work site includes: Performing target detection and target tracking on the video image to obtain detection frames, resource categories and identification numbers corresponding to multiple construction resources in the video image; Clustering multiple construction resources in the video image according to the center point coordinates corresponding to the detection frames to obtain a plurality of clusters; the detection frames in the same cluster belong to the same construction work surface; According to the resource categories corresponding to the detection frames in the same cluster, the construction resource distribution information corresponding to the construction working surface of the construction working site is determined.

3. The method according to claim 1, characterized in that Determining the construction resource distribution information corresponding to the construction work surface of the construction work site according to the video image of the construction work site includes: When the preset calling conditions are met, a calling request is sent to the video image analysis module, and the video image analysis module determines the construction resource distribution information corresponding to the construction working surface of the construction working site based on the video image of the construction working site; The preset calling conditions include: Construction work commences; and / or There is an update in the construction process; and / or Changes in construction resources; and / or The next time period arrives.

4. The method according to claim 1, characterized in that: The construction simulation model also includes: a connection relationship between different construction process simulation models; the connection relationship includes: parallel connection; The method further comprises: Determine the number of construction work surfaces at the construction work site based on the video images of the construction work site; According to the number of construction work surfaces, the number of parallel construction process models is instantiated.

5. The method according to claim 1, characterized in that The setting conditions include: For a first construction resource intelligent agent object at a target construction work surface, the first construction resource intelligent agent object corresponds to a first resource category, and the number of first type of construction resource intelligent agent objects at the target construction work surface exceeds the maximum number of simultaneous operations; and / or For the first construction resource intelligent body object at the target construction work surface, the first construction resource intelligent body object corresponds to the first resource category, and the construction resource intelligent body object of the first resource category cooperates with the construction resource intelligent body object of the second resource category to jointly simulate the construction process.

6. The method according to claim 1, characterized in that The construction resource distribution information includes: at least one resource category and the quantity of resources corresponding to each resource category; The instantiation of queue elements and delay elements in the corresponding construction process simulation model according to the construction resource distribution information includes: If the number of resources of a resource category in the construction resource distribution information exceeds the maximum number of simultaneous workers, the construction resource agent objects exceeding the maximum number of simultaneous workers are first sorted according to the arrival time or priority to obtain a first sorting result; The first sorting result is saved to the first queue corresponding to the queue element in the corresponding construction process simulation model.

7. The method according to claim 6, characterized in that The method further comprises: When a construction resource intelligent agent object of a resource category completes the simulation of the construction process and the current number of tasks of a resource category is less than the maximum number of simultaneous tasks, the intelligent construction resource intelligent agent object of the corresponding resource category is taken out from the first queue for the simulation of the construction process.

8. The method according to claim 1, characterized in that The construction resource distribution information includes: at least one resource category and the quantity of resources corresponding to each resource category; The instantiation of queue elements and delay elements in the corresponding construction process simulation model according to the construction resource distribution information includes: According to the collaborative relationship between the first resource category and the second resource category, the first construction resource intelligent agent object and the second construction resource intelligent agent object corresponding to the construction resource distribution information are matched to obtain a plurality of matching pairs; a matching pair includes: a first construction resource intelligent agent object and a second construction resource intelligent agent object; the number of the matching pairs does not exceed the maximum number of simultaneous operations; According to the arrival time or priority, the first construction resource agent objects that are not in the matching pair are sorted in a second manner to obtain a second sorting result; Performing a third sorting on the second construction resource agent objects that are not in the matching pair according to the arrival time or priority to obtain a third sorting result; The second sorting result is saved to the second queue corresponding to the queue element in the corresponding construction process simulation model, and the third sorting result is saved to the third queue corresponding to the queue element in the corresponding construction process simulation model.

9. The method according to claim 8, characterized in that The method further comprises: When a matching pair completes the simulation of the construction process and the number of matching pairs working is less than the maximum number of matching pairs working simultaneously, construction resource agent objects of corresponding resource categories are taken out from the second and third queues respectively for the simulation of the construction process.

10. The method according to any one of claims 1 to 9, characterized in that: The method further comprises: Generate a process data structure according to the sequential relationship between the construction processes of different construction units; the process data structure is used to describe the sequential relationship between the construction processes of different construction units; According to the process data structure, the construction process simulation models corresponding to different construction units are connected; the connection relationship between different construction process simulation models includes: parallel connection or series connection.

11. The method according to any one of claims 1 to 9, characterized in that: The states of the construction resource scheduling agent object include: initial state, construction task existence judgment state, waiting construction task state, service construction simulation object selection state, idle construction resource judgment state, waiting construction resource idle state, construction resource scheduling state, task issuing state; After the construction simulation model starts simulating, the state of the construction resource scheduling agent changes from the initial state to the construction task existence judgment state. If a resource request message is received from any construction unit agent object, it is considered that there is a construction task, and the state changes to the service construction simulation object selection state; if no resource request message is received, the state changes to the waiting state for the construction task, and the judgment is cyclic until a resource request message is received; When the state of the construction resource scheduling agent changes to the service construction simulation object selection state, according to the first preset rule, a target construction unit agent object is selected from the multiple construction unit agent objects that send the request, and the state changes to the idle construction resource judgment state; if there is an idle construction resource agent object, the state changes to the construction resource scheduling state; if not, the state changes to the waiting construction resource idle state, and the judgment is cyclically judged until the state of a construction resource agent changes to the idle state; When the state of the construction resource scheduling intelligent body changes to the construction resource scheduling state, according to the second preset rule, one or more target construction resource intelligent body objects are selected from multiple idle construction resource intelligent body objects, the state changes to the task issuance state, and a task issuance message is sent to the target construction resource intelligent body object; the task issuance message is used to prompt the target construction resource intelligent body object to go to the target construction work surface corresponding to the target construction unit intelligent body object to perform the corresponding construction process.

12. A device for automatically building a construction simulation model based on video images, characterized in that: The device comprises: A model building module is used to establish a construction simulation model for construction operations; the construction simulation model includes: a construction unit intelligent agent object, a construction resource scheduling intelligent agent object, a construction resource intelligent agent object, and a construction process simulation model corresponding to a plurality of construction unit intelligent agent objects; the construction process simulation model includes: one or more construction process simulation models; the construction process simulation model includes: a queue element and a delay element; the queue element is used to simulate the queuing and waiting process of the construction resource intelligent agent objects in the construction process; the delay element is used to simulate the duration of the construction process; The simulation process of the construction simulation model includes: the construction unit intelligent agent object sends a resource request message to the construction resource scheduling intelligent agent object according to the corresponding construction process simulation model; the construction resource scheduling intelligent agent object sends a task issuing message to at least one selected target construction resource intelligent agent object according to the resource request message; after receiving the task issuing message, at least one target construction resource intelligent agent object moves to the target construction work surface where the construction unit intelligent agent object is located; the construction resource intelligent agent objects that meet the set conditions at the target construction work surface are placed in a queue represented by a queue element for queuing and waiting; the construction resource intelligent agent objects that do not need to wait in queue or are taken out of the queue element at the target construction work surface are used to perform construction simulation of the construction process; after completing the simulation of the construction process of the construction unit intelligent agent object, the corresponding delay element ends; A video analysis module is used to determine the construction resource distribution information corresponding to the construction work surface of the construction work site by using target detection technology, target tracking technology and clustering technology based on the video image of the construction work site; The instantiation module is used to instantiate the queue elements and delay elements in the corresponding construction process simulation model according to the construction resource distribution information.

13. An electronic device, characterized in that: include: processor; and A memory having executable codes stored thereon, which, when executed, causes the processor to execute the method according to any one of claims 1 to 11.

14. A machine-readable medium having executable codes stored thereon, which, when executed, causes a processor to execute the method according to any one of claims 1 to 11.

15. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the method according to any one of claims 1 to 11 is implemented.

Images