A tower crane operation method based on virtual reality

Establishing a three-dimensional model of tower crane through virtual reality technology solves the operating risks and load swing problems of operators in harsh environments, improves operating efficiency and safety, and reduces hardware costs and signal processing complexity.

CN115376378BActive Publication Date: 2024-11-19HANGZHOU DAJIE INTELLIGENT TRANSMISSION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210976477.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-15
Publication Date
2024-11-19
Estimated Expiration
2042-08-15

AI Technical Summary

Technical Problem

Tower crane operators are prone to accidents when operating in harsh environments, and load swing problems lead to unstable operation. The hardware cost of the prior art is high and the signal processing is complex, making it difficult to effectively control the load swing to improve work efficiency.

Method used

Using the tower crane operation method based on virtual reality, a three-dimensional model is established through multi-dimensional information. The operator wears the virtual reality wearable device, and the sensor data is transmitted to the device. The device communicates with the server based on the virtual reality model, simulates real operation scenarios, and provides more realistic operation touch and instructions.

Benefits of technology

It improves the proficiency and skills of operators, reduces operational risks, reduces hardware costs, simplifies signal processing, enhances load control accuracy, and reduces the probability of accidents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115376378B_ABST
    Figure CN115376378B_ABST
Patent Text Reader

Abstract

The present invention claims protection for a tower crane operation method based on virtual reality, wherein the operator of the tower crane wears a virtual reality wearable device matched with the tower crane; multiple sensors arranged on the tower crane transmit their data to the virtual reality wearable device worn by the operator; the virtual reality wearable device worn by the operator communicates with a server based on a constructed virtual reality model of the tower crane, and reconstructs a model of the real operating environment of the tower crane; and the operation method of the tower crane is represented on the virtual reality wearable device matched with the tower crane. The tower crane operation method based on virtual reality of the present invention can provide a more realistic operation touch and clearer operation instructions according to the space constraints and load constraints of the tower crane, so that the training system is more in line with the real operation scene, further improve the training personnel to feel the force feedback of the operating lever more realistically, and improve the operation technology.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the technical field of three-dimensional training system design, and relates to a three-dimensional modeling technology in a training system, and more specifically, to a tower crane operating method based on virtual reality. Background Art

[0002] At present, with the rapid development of my country's economy, there are more and more infrastructure projects. Tower cranes are a common construction equipment on construction sites. Their operation technology requirements are relatively high. If the operator is not familiar with the operation of the equipment, personal injury and property loss are likely to occur. If a realistic three-dimensional model can be established for the tower crane, the operator can be trained through virtual reality technology to improve the operator's proficiency and operating skills. The development of tower cranes is in a leading position in engineering machinery and has become one of the most important engineering machinery in engineering construction. In the existing technology, the operation of tower cranes is still inseparable from the traditional mode of on-site driving by drivers; and as we all know, tower crane drivers are a high-risk technical type of work, and accidents are easy to occur on construction sites with messy terrain. On the other hand, the working environment of tower crane drivers is usually extremely harsh. At the least, they have to endure the cold winter and hot summer, and at the worst, they have to face toxic gas, radioactive substances or smelly garbage.

[0003] Tower cranes generally have load swing problems during operation, which will limit the load amplitude change speed and rotation speed, reduce the load positioning accuracy, and also increase the labor intensity of operators. In severe cases, it will cause the load to unhook and cause accidents. Therefore, eliminating or controlling load swing is of great significance to improving the working efficiency of tower cranes and reducing production hazards in loading and unloading operations. At present, the three-dimensional swing angle detection of the tower crane load anti-swing control system is mainly composed of sensor modules composed of accelerometers, gyroscopes and other sensors to realize swing angle detection. The hardware cost is high and the signal processing is complex. Summary of the invention

[0004] The purpose of the present invention is to provide a tower crane operating method based on virtual reality, which aims to use multi-dimensional information to establish a three-dimensional model of a large tower crane so as to simulate a more realistic tower crane operating scene and further apply it to the training of tower crane operators.

[0005] The present invention claims protection for a tower crane operating method based on virtual reality, characterized in that it comprises:

[0006] The operator of the tower crane wears a virtual reality wearable device matched with the tower crane;

[0007] The multiple sensors arranged on the tower crane transmit their data to the virtual reality wearable device worn by the operator;

[0008] The virtual reality wearable device worn by the operator communicates with the server based on the constructed virtual reality model of the tower crane to reconstruct the model of the real operating environment of the tower crane;

[0009] The operation method of the tower crane is represented on a virtual reality wearable device matched with the tower crane.

[0010] Specifically, the operator of the tower crane wears a virtual reality wearable device matched with the tower crane, which specifically includes:

[0011] The virtual reality wearable device is a virtual reality glasses device, and the virtual reality glasses device carries headphones, and the headphones are inserted into the ears of the operator;

[0012] The virtual reality glasses device is equipped with a Bluetooth 5G chip, and the virtual reality glasses device performs data communication with a remote server;

[0013] The virtual reality glasses device is equipped with a construction behavior and dismantling behavior detection device. When the operator wears the virtual reality glasses device, the virtual reality glasses device is adaptively adjusted according to the tower crane conditions and environmental conditions at that time.

[0014] Specifically, when the operator wears the virtual reality glasses device, the virtual reality glasses device is adaptively adjusted according to the tower crane conditions and environmental conditions at that time, specifically including:

[0015] The tower crane condition includes a working state, and the working state includes a first working state and a second working state;

[0016] The environmental conditions include environmental weather, environmental temperature, and environmental humidity. The environmental weather includes wind speed, rain, snow, and sunshine conditions;

[0017] The ambient temperature includes ambient high temperature, ambient low temperature, and ambient room temperature;

[0018] The environmental humidity includes high humidity, low humidity and room humidity;

[0019] When the tower crane is in the first working state, adaptively adjusting the virtual reality glasses device to a standby state;

[0020] When the tower crane is in the second working state, the virtual reality glasses device is adaptively adjusted to the operating state. Further, when the ambient weather, ambient temperature, and ambient humidity in the environmental conditions are all suitable for outdoor operations, the virtual reality glasses device is further adjusted to a high power mode.

[0021] When at least one of the environmental weather, environmental temperature, and environmental humidity is not suitable for outdoor work, the virtual reality glasses device is further adjusted to a low power mode.

[0022] Specifically, the multiple sensors arranged on the tower crane transmit their data to the virtual reality wearable device worn by the operator, specifically including:

[0023] The tower crane at least includes a first sensor, a second sensor, a third sensor, a fourth sensor, a fifth sensor, and a sixth sensor;

[0024] The first sensor, the second sensor, and the third sensor obtain the working state and working mode of the tower crane;

[0025] The working state of the tower crane includes a working state and a static state;

[0026] The working mode of the tower crane includes the extension work, rotation work and support work of the components of the tower crane; the fourth sensor, the fifth sensor and the sixth sensor obtain the working environment information of the tower crane, including the sunlight intensity, temperature and humidity information of the environmental information.

[0027] Specifically, the working state of the tower crane includes a working state and a stationary state, and the working mode of the tower crane includes the extension work, the rotation work and the support work of the components of the tower crane, and further includes:

[0028] When the working state of the tower crane is a working state, setting the working state data of the tower crane to an excited state;

[0029] When the working state of the tower crane is a stationary state, setting the working state data of the tower crane to a hibernation state;

[0030] When the working mode of the tower crane is the extension work of the elements of the tower crane, setting the working state data of the tower crane as the first sensor data priority weight;

[0031] When the working mode of the tower crane is the rotational working of the elements of the tower crane, setting the working state data of the tower crane as the second sensor data priority weight;

[0032] When the working mode of the tower crane is the supporting work of the elements of the tower crane, the working state data of the tower crane is set as the third sensor data priority weight.

[0033] Specifically, the virtual reality wearable device worn by the operator communicates with the server based on the constructed virtual reality model of the tower crane to reconstruct the model of the real operating environment of the tower crane, specifically including:

[0034] The virtual reality model of the tower crane includes a crane body model of the tower crane and a working model of the tower crane;

[0035] The crane ontology model constructs a crane construction behavior operator template for the crane construction behavior. The operator template contains five attributes, including:

[0036] ID represents the operator's number, which serves as the operator's identity;

[0037] ADD represents the ADD address of the operator, which is the most basic element to distinguish operators;

[0038] ACT represents the operator's behavior, which serves as an identifier of the behavior type;

[0039] BUILDADD represents the target building of the crane selected by the operator. Different simulation servers can be selected according to the different attributes of BUILDADD;

[0040] History represents the operator's historical operation information. This attribute is used to simulate the crane model, system model and other information of the real operator.

[0041] A crane demolition behavior operator template is constructed for the crane demolition behavior. The operator template contains 7 attributes, including: operator number, coordinate position, simulation behavior, crane target building, operator authority, crane demolition behavior, and crane name;

[0042] Auth indicates the operator's authority. Depending on the authority, the cranes that can be operated and the types of operations are also different. The operator's authority is divided into three levels: system authority, general authority, and temporary authority.

[0043] TEARACT indicates the type of operation of the operator's crane demolition behavior, i.e., digging or hammering;

[0044] VEHI represents the crane name of the crane selected by the operator as the crane identification;

[0045] Create 10,000 virtual ADD addresses on the operator terminal and bind these virtual ADD addresses to the operators, that is, the ADD attribute in the individual operator template is the virtual ADD address assigned to the operator. On the premise of ensuring the differences among operators, large-scale operators are generated through the operator information template and the virtual ADD address. When generating operator behavior simulation, the exit ADD of the simulation behavior is set to the virtual ADD address.

[0046] Specifically, the virtual reality model of the tower crane includes a crane body model of the tower crane and a working model of the tower crane, and further includes:

[0047] Design crane construction behavior driver and crane dismantling behavior driver for operators' classic operation behaviors of building and dismantling respectively;

[0048] The crane construction behavior driver simulates a complete crane construction behavior process through four processes: establishing a connection, sending a request, requesting a response, and disconnecting the connection, and generates a real operation workflow including a behavior feature protocol;

[0049] The crane dismantling behavior driver simulates a complete crane dismantling behavior through six processes: establishing connection, operator login, login response, behavior selection, crane dismantling, and disconnection, and generates a real workflow containing a behavior feature protocol.

[0050] Specifically, the method for representing the operation of the tower crane on the virtual reality wearable device equipped with the tower crane specifically includes:

[0051] Receive build and tear down events;

[0052] Obtaining event information corresponding to the erection behavior and dismantling behavior events;

[0053] Based on the event information, generating virtual objects corresponding to the building behavior and dismantling behavior events in the virtual scene;

[0054] Obtaining an operator's operation on the virtual object;

[0055] According to the operation, the building behavior and dismantling behavior events are processed.

[0056] Specifically, the obtaining of event information corresponding to the erection behavior and dismantling behavior events includes:

[0057] Determine whether the construction and dismantling events meet the preset event requirements;

[0058] If the erection behavior and dismantling behavior events meet preset event requirements, event information corresponding to the erection behavior and dismantling behavior events is obtained.

[0059] Specifically, generating virtual objects corresponding to the building behavior and dismantling behavior events in a virtual scene based on the event information includes:

[0060] Determining a target position and a first display mode of the virtual object in the virtual scene;

[0061] The virtual object is generated at a target position in the virtual scene in the first display manner.

[0062] The present invention claims protection for a tower crane operation method based on virtual reality, wherein the operator of the tower crane wears a virtual reality wearable device matched with the tower crane; multiple sensors arranged on the tower crane transmit their data to the virtual reality wearable device worn by the operator; the virtual reality wearable device worn by the operator communicates with a server based on a constructed virtual reality model of the tower crane, and reconstructs a model of the real operating environment of the tower crane; and the operation method of the tower crane is represented on the virtual reality wearable device matched with the tower crane. The tower crane operation method based on virtual reality of the present invention can provide a more realistic operation touch and clearer operation instructions according to the space constraints and load constraints of the tower crane, so that the training system is more in line with the real operation scene, further improve the training personnel to feel the force feedback of the operating lever more realistically, and improve the operation technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] The accompanying drawings are used to provide further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the following specific implementation methods, they are used to explain the embodiments of the present invention, but do not constitute a limitation to the embodiments of the present invention.

[0064] Figure 1 A flowchart of a tower crane operating method based on virtual reality according to the present invention;

[0065] Figure 2 This is a work flow chart of Embodiment 1 of a tower crane operating method based on virtual reality involved in the present invention;

[0066] Figure 3 This is a work flow chart of Embodiment 2 of a tower crane operating method based on virtual reality involved in the present invention;

[0067] Figure 4 This is a workflow diagram of Embodiment 3 of a tower crane operating method based on virtual reality involved in the present invention. DETAILED DESCRIPTION

[0068] The specific implementation of the embodiment of the present invention is described in detail below in conjunction with the accompanying drawings. It should be understood that the specific implementation described here is only used to illustrate and explain the embodiment of the present invention, and is not used to limit the embodiment of the present invention.

[0069] It should be noted that if the implementation methods of the present application involve directional indications (such as up, down, left, right, front, back...), such directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0070] In addition, if there are descriptions involving "first", "second", etc. in the implementation methods of this application, the descriptions of "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various implementation methods can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0071] Refer to the attached Figure 1 The present invention claims a method for operating a tower crane based on virtual reality, which is characterized by comprising:

[0072] The operator of the tower crane wears a virtual reality wearable device matched with the tower crane;

[0073] The multiple sensors arranged on the tower crane transmit their data to the virtual reality wearable device worn by the operator;

[0074] The virtual reality wearable device worn by the operator communicates with the server based on the constructed virtual reality model of the tower crane to reconstruct the model of the real operating environment of the tower crane;

[0075] The operation method of the tower crane is represented on a virtual reality wearable device matched with the tower crane.

[0076] Specifically, the operator of the tower crane wears a virtual reality wearable device matched with the tower crane, which specifically includes:

[0077] The virtual reality wearable device is a virtual reality glasses device, and the virtual reality glasses device carries headphones, and the headphones are inserted into the ears of the operator;

[0078] The virtual reality glasses device is equipped with a Bluetooth 5G chip, and the virtual reality glasses device performs data communication with a remote server;

[0079] The virtual reality glasses device is equipped with a construction behavior and dismantling behavior detection device. When the operator wears the virtual reality glasses device, the virtual reality glasses device is adaptively adjusted according to the tower crane conditions and environmental conditions at that time.

[0080] Specifically, when the operator wears the virtual reality glasses device, the virtual reality glasses device is adaptively adjusted according to the tower crane conditions and environmental conditions at that time, specifically including:

[0081] The tower crane condition includes a working state, and the working state includes a first working state and a second working state;

[0082] The environmental conditions include environmental weather, environmental temperature, and environmental humidity. The environmental weather includes wind speed, rain, snow, and sunshine conditions;

[0083] The ambient temperature includes ambient high temperature, ambient low temperature, and ambient room temperature;

[0084] The environmental humidity includes high humidity, low humidity and room humidity;

[0085] When the tower crane is in the first working state, adaptively adjusting the virtual reality glasses device to a standby state;

[0086] When the tower crane is in the second working state, the virtual reality glasses device is adaptively adjusted to the operating state. Further, when the ambient weather, ambient temperature, and ambient humidity in the environmental conditions are all suitable for outdoor operations, the virtual reality glasses device is further adjusted to a high power mode.

[0087] When at least one of the environmental weather, environmental temperature, and environmental humidity is not suitable for outdoor work, the virtual reality glasses device is further adjusted to a low power mode.

[0088] Specifically, the multiple sensors arranged on the tower crane transmit their data to the virtual reality wearable device worn by the operator, specifically including:

[0089] The tower crane at least includes a first sensor, a second sensor, a third sensor, a fourth sensor, a fifth sensor, and a sixth sensor;

[0090] The first sensor, the second sensor, and the third sensor obtain the working state and working mode of the tower crane;

[0091] The working state of the tower crane includes a working state and a static state;

[0092] The working mode of the tower crane includes the extension work, rotation work and support work of the components of the tower crane; the fourth sensor, the fifth sensor and the sixth sensor obtain the working environment information of the tower crane, including the sunlight intensity, temperature and humidity information of the environmental information.

[0093] For details, please refer to the attached Figure 2 The working state of the tower crane includes a working state and a stationary state, and the working mode of the tower crane includes the extension work, the rotation work and the support work of the elements of the tower crane, and further includes:

[0094] When the working state of the tower crane is a working state, setting the working state data of the tower crane to an excited state;

[0095] When the working state of the tower crane is a stationary state, setting the working state data of the tower crane to a hibernation state;

[0096] When the working mode of the tower crane is the extension work of the elements of the tower crane, setting the working state data of the tower crane as the first sensor data priority weight;

[0097] When the working mode of the tower crane is the rotational working of the elements of the tower crane, setting the working state data of the tower crane as the second sensor data priority weight;

[0098] When the working mode of the tower crane is the supporting work of the elements of the tower crane, the working state data of the tower crane is set as the third sensor data priority weight.

[0099] The components of the tower crane at least include a lifting arm, a lifting transition section, a lifting foundation section, a tower body standard section, an upper support, a lower support and a tower head.

[0100] Wherein, the working state of the lifting transition section, the lifting foundation section and the tower body standard section is extension work;

[0101] The working state of the lifting arm is rotation;

[0102] The working state of the upper support, the lower support and the tower head is supporting work.

[0103] Due to the different working states of different components, the emphasis of their working states is also different. When a component is in the working mode of its own working state, the data collected by the corresponding sensor should be given a higher weight to characterize the working condition of the tower crane, which is convenient for subsequent control and maintenance.

[0104] Specifically, the virtual reality wearable device worn by the operator communicates with the server based on the constructed virtual reality model of the tower crane to reconstruct the model of the real operating environment of the tower crane, specifically including:

[0105] The virtual reality model of the tower crane includes a crane body model of the tower crane and a working model of the tower crane;

[0106] The crane ontology model constructs a crane construction behavior operator template for the crane construction behavior. The operator template contains five attributes, including:

[0107] ID represents the operator's number, which serves as the operator's identity;

[0108] ADD represents the ADD address of the operator, which is the most basic element to distinguish operators;

[0109] ACT represents the operator's behavior, which serves as an identifier of the behavior type;

[0110] BUILDADD represents the target building of the crane selected by the operator. Different simulation servers can be selected according to the different attributes of BUILDADD;

[0111] History represents the operator's historical operation information. This attribute is used to simulate the crane model, system model and other information of the real operator.

[0112] A crane demolition behavior operator template is constructed for the crane demolition behavior. The operator template contains 7 attributes, including: operator number, coordinate position, simulation behavior, crane target building, operator authority, crane demolition behavior, and crane name;

[0113] Auth indicates the operator's authority. Depending on the authority, the cranes that can be operated and the types of operations are also different. The operator's authority is divided into three levels: system authority, general authority, and temporary authority.

[0114] TEARACT indicates the type of operation of the operator's crane demolition behavior, i.e., digging or hammering;

[0115] VEHI represents the crane name of the crane selected by the operator as the crane identification;

[0116] Create 10,000 virtual ADD addresses on the operator terminal and bind these virtual ADD addresses to the operators, that is, the ADD attribute in the individual operator template is the virtual ADD address assigned to the operator. On the premise of ensuring the differences among operators, large-scale operators are generated through the operator information template and the virtual ADD address. When generating operator behavior simulation, the exit ADD of the simulation behavior is set to the virtual ADD address.

[0117]

[0118] Where d MEM represents the height of the tower crane, EW represents the retractable length of the tower crane, ω represents the rotation angle of the tower crane, λ represents the ambient wind speed, t represents the working time of the tower crane, and n d represents the adjustment coefficient, J ion represents the weight of the tower crane, G represents the gravitational constant, and D mw Indicates the ambient temperature, S mw Represents tower crane operating data.

[0119] Specifically, the virtual reality model of the tower crane includes a crane body model of the tower crane and a working model of the tower crane, and further includes:

[0120] Design crane construction behavior driver and crane dismantling behavior driver for operators' classic operation behaviors of building and dismantling respectively;

[0121] The crane construction behavior driver simulates a complete crane construction behavior process through four processes: establishing a connection, sending a request, requesting a response, and disconnecting the connection, and generates a real operation workflow including a behavior feature protocol;

[0122] After receiving the activation request, the crane building behavior driver first generates the operator simulation information according to the operator's History attribute, including the simulated operator's crane information, operating system information, etc., selects the simulation WEB server according to the BUILDADD attribute and generates a URL, then establishes a connection with the simulation WEB server, and then sends a request message to the simulation WEB server through the HTTP protocol to simulate the operator's building behavior. The simulation WEB server will respond according to the request content. After receiving the response message, the crane building behavior driver disconnects and completes a crane building behavior.

[0123] The crane dismantling behavior driver simulates a complete crane dismantling behavior through six processes: establishing connection, operator login, login response, behavior selection, crane dismantling, and disconnection, and generates a real workflow containing a behavior feature protocol.

[0124] After receiving the activation request, the crane dismantling behavior driver first selects the simulated crane server according to the operator's BUILDADD attribute and establishes a connection with the simulated crane server. One point to note here is that the crane dismantling behavior will establish two connections, the first of which is used to agree on the transmission crane port. After confirming the transmission port, the connection is disconnected, and the second connection is used to log in to the crane server, select the crane, and other crane dismantling operations. Then, the operator's authority is determined according to the operator's Auth attribute and the crane server is automatically logged in. The simulated crane server determines whether the login is successful and returns the login response information based on the operator's identity information. Then the crane dismantling behavior driver selects the corresponding crane according to the operator's TEARACT attribute and VEHI attribute to dig or hammer and dismantle the crane, realizing the change of the local crane and the crane of the simulated crane server. After the crane dismantling is completed, the connection is disconnected, and a crane dismantling behavior is completed.

[0125] In a specific embodiment, a simulated tower crane control room is established, and an operating lever similar to that for operating a tower crane is established. The mechanical movement of the operating lever can change the connected relays and other components. Through the mechanical movement of the operating lever, the size of the electrical signal is changed to realize the process of mechanical change to electrical signal change. The input electrical signal is transformed into a virtual simulation graphic through a graphics engine; the size of the electrical signal transmitted through the input module changes the movement direction and displacement size of the corresponding simulation model. The electrical signal is mainly transmitted to the graphics engine through serial communication, and then the electrical signal is transmitted to the graphics transformation program to realize the transformation of the corresponding model. The transformation space of the graphics transformation is subjected to model constraint judgment, and the result of the constraint judgment is converted into an electrical signal; the model of the graphics transformation in the graphics calculation unit is subjected to constraint judgment, including space transformation constraint and load constraint; the electrical signal in the output module is subjected to steering control, and finally the result of the steering control is fed back to the mechanical operating lever for force feedback effect.

[0126] Furthermore, operators and background monitors are constructed, in which operators are responsible for operator management, and background monitors are responsible for background monitor management. Background monitors control the number of concurrent operators by limiting the number of monitoring behaviors of background monitors in background monitors. The maximum number of monitoring behaviors of background monitors can be modified according to the requirements of simulation experiments to change the size of monitoring behaviors of background monitors and realize dynamic adjustment of the number of concurrent operator operation behaviors. The background avoids the overhead caused by the creation and destruction of background monitor monitoring behaviors by operator operation behaviors, and also avoids the unlimited increase of the number of monitoring behaviors of background monitors due to large-scale operator operation behaviors, which preempts computing resources and operation resources. The number of operator operation behaviors is used as a task buffer queue to realize batch loading of operator operation behaviors. The queue uses the first-in-first-out principle to sort the number of operator operation behaviors. After all the operator operation behavior groups are added to the operator operation behavior number, the operator operation behavior number is weighed, and the threshold is set to the maximum number of background monitor monitoring behaviors of the background monitor, which is divided into three task execution modes:

[0127] 1) When the total number of operator operation behaviors in the operator exceeds the threshold, that is, the number of operator operation behaviors is large, the operator operation behaviors are used as the task buffer queue. When the background monitor monitoring behavior is not empty, the operator operation behavior resources are obtained from the operator, and the background monitor monitoring behavior resources are obtained from the background monitor monitoring behavior. The operator is bound to the background monitor, and the subsequent simulation behavior driver is loaded into the background monitor monitoring behavior for behavior generation. When the background monitor monitoring behavior in the background monitor is consumed, the operator operation behavior, that is, the task buffer queue is blocked, waiting for the free background monitor monitoring behavior. After the operator behavior is completed, the operator is unbound from the background monitor, and the background monitor monitoring behavior is recovered to the background monitor. When there is a free background monitor monitoring behavior in the background monitor, the operator continues to be read from the operator operation behavior until the operator operation behavior is empty, that is, all operator operation behaviors have been simulated, and then the background monitor resources in the background monitor monitoring behavior are released to complete resource recovery.

[0128] 2) If the total number of operator operation behaviors among operators does not reach the threshold, that is, the operator scale is small, and the background monitor monitoring behavior resources are sufficient, then background monitors are directly assigned to all operators among the operators to perform multi-background monitor monitoring behavior tasks. After the simulation is completed, all background monitor monitoring behavior resources are directly released. This process does not require the background monitor to manage the background monitor monitoring behavior.

[0129] 3) When the operator operation behavior is empty, it indicates that there is no operator that meets the conditions and the simulation process ends directly.

[0130] Through the construction of operators, simulation business architecture, and simulation resources, a high-performance operator behavior simulation model is finally realized. This section introduces the process of using this model to simulate operator behavior. The specific implementation steps of the simulation process are as follows:

[0131] Step 1: The control module is responsible for starting the entire simulation process, sending the simulation experiment task parameters including the operator's operation behavior scale, simulation behavior type, and background monitor's monitoring behavior size to each module, and calling the operator operation behavior generation module to create the operator.

[0132] Step 2: After receiving the call instruction, the operator operation behavior generation module parses the operator operation behavior scale, simulation behavior and other information, loads the crane construction behavior operator operation behavior template and crane dismantling behavior operator operation behavior template designed in Section 4.3.1, creates the operator operation behavior and binds the virtual ADD address to the operator operation behavior to ensure that each operator has an independent ADD address, and calls the operator operation behavior division module.

[0133] Step 3: After receiving the call instruction, the operator operation behavior classification module divides the operator into different operator groups according to the operator's ACT and BUILDADD attributes, adds the operator group to the operator, and calls the background monitor management module.

[0134] Step 4: After receiving the call instruction, the background monitor management module adjusts the size of the background monitor's monitoring behavior according to the simulation task parameters, assigns different background monitors to the operator, and calls the driver loading module to generate simulation behavior.

[0135] Step 5: After receiving the call instruction, the driver loading module loads the designed crane erection behavior driver and crane dismantling behavior driver, generates operator behavior and real business workflow, thereby realizing operator behavior simulation.

[0136] Step 6: The information collection module counts the number of successful simulation operators and the time consumed by the simulation task, collects the result information and reports it.

[0137] For details, please refer to the attached Figure 3 The method of representing the operation of the tower crane on the virtual reality wearable device supporting the tower crane specifically includes:

[0138] Receive build and tear down events;

[0139] Obtaining event information corresponding to the erection behavior and dismantling behavior events;

[0140] Based on the event information, generating virtual objects corresponding to the building behavior and dismantling behavior events in the virtual scene;

[0141] Obtaining an operator's operation on the virtual object;

[0142] According to the operation, the building behavior and dismantling behavior events are processed.

[0143] Specifically, the obtaining of event information corresponding to the erection behavior and dismantling behavior events includes:

[0144] Determine whether the construction and dismantling events meet the preset event requirements;

[0145] If the erection behavior and dismantling behavior events meet preset event requirements, event information corresponding to the erection behavior and dismantling behavior events is obtained.

[0146] For details, please refer to the attached Figure 4 , generating virtual objects corresponding to the building behavior and dismantling behavior events in a virtual scene based on the event information, including:

[0147] Determining a target position and a first display mode of the virtual object in the virtual scene;

[0148] The virtual object is generated at a target position in the virtual scene in the first display manner.

[0149] The virtual object generated in the virtual scene may also match the virtual scene.

[0150] Specifically, the virtual scene can be identified first, the key scene of the virtual scene can be obtained, its type can be determined, and a virtual object belonging to the type and corresponding to the building behavior and demolition behavior events can be generated. For example: the current virtual scene is a smart residential scene, and the generated virtual object is a certain residential product. If building behavior and demolition behavior events are received in the virtual scene, based on the event information, a virtual object corresponding to the building behavior and demolition behavior events is generated in the virtual scene; when the operator performs an operation on the virtual object, the operator's operation on the virtual object is obtained, and based on the operation, the building behavior and demolition behavior events are processed, so that the processing of pending events in the virtual reality scene can be realized, and the virtual scene and the pending events can be integrated.

[0151] Those skilled in the art will appreciate that the contents disclosed in this disclosure may be subject to various modifications and improvements. For example, the various devices or components described above may be implemented by hardware, or by software, firmware, or a combination of some or all of the three.

[0152] Flowcharts are used in this disclosure to illustrate the steps of the method according to the embodiments of the present disclosure. It should be understood that the preceding or following steps are not necessarily performed precisely in order. On the contrary, various steps may be processed in reverse order or simultaneously. At the same time, other operations may also be added to these processes.

[0153] Those skilled in the art will appreciate that all or part of the steps in the above method can be completed by instructing related hardware through a computer program, and the program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk. Optionally, all or part of the steps in the above embodiment can also be implemented using one or more integrated circuits. Accordingly, each module / unit in the above embodiment can be implemented in the form of hardware or in the form of a software functional module. The present disclosure is not limited to any particular form of combination of hardware and software.

[0154] Unless otherwise defined, all terms used herein have the same meaning as commonly understood by those of ordinary skill in the art to which the present disclosure belongs. It should also be understood that terms such as those defined in common dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an idealized or highly formal sense, unless explicitly defined as such herein.

[0155] The above is an explanation of the present disclosure and should not be considered as a limitation thereof. Although several exemplary embodiments of the present disclosure are described, it will be readily understood by those skilled in the art that many modifications may be made to the exemplary embodiments without departing from the novel teachings and advantages of the present disclosure. Therefore, all such modifications are intended to be included within the scope of the present disclosure as defined in the claims. It should be understood that the above is an explanation of the present disclosure and should not be considered to be limited to the specific embodiments disclosed, and modifications to the disclosed embodiments and other embodiments are intended to be included within the scope of the appended claims. The present disclosure is defined by the claims and their equivalents.

[0156] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0157] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

Claims

1. A tower crane operation method based on virtual reality, characterized in that: include: The operator of the tower crane wears a virtual reality wearable device matched with the tower crane; The multiple sensors arranged on the tower crane transmit their data to the virtual reality wearable device worn by the operator; the virtual reality wearable device worn by the operator communicates with the server based on the constructed virtual reality model of the tower crane, and reconstructs the model of the real operating environment of the tower crane; Characterizing the operation method of the tower crane on a virtual reality wearable device equipped with the tower crane; The operator of the tower crane wears a virtual reality wearable device matched with the tower crane, which specifically includes: The virtual reality wearable device is a virtual reality glasses device, and the virtual reality glasses device carries headphones, and the headphones are inserted into the ears of the operator; The virtual reality glasses device is equipped with a Bluetooth 5G chip, and the virtual reality glasses device performs data communication with a remote server; The virtual reality glasses device is equipped with a construction behavior and dismantling behavior detection device. When the operator wears the virtual reality glasses device, the virtual reality glasses device is adaptively adjusted according to the tower crane situation and environmental conditions at that time; When the operator wears the virtual reality glasses device, the virtual reality glasses device is adaptively adjusted according to the tower crane situation and environmental situation at that time, specifically including: The tower crane condition includes a working state, and the working state includes a first working state and a second working state; the environmental condition includes environmental weather, environmental temperature, and environmental humidity, and the environmental weather includes wind speed, rain, snow, and sunshine; the environmental temperature includes environmental high temperature, environmental low temperature, and environmental room temperature; The environmental humidity includes high humidity, low humidity and room humidity; When the tower crane is in the first working state, the virtual reality glasses device is adaptively adjusted to the standby state; when the tower crane is in the second working state, the virtual reality glasses device is adaptively adjusted to the operating state, and further, when the ambient weather, ambient temperature, and ambient humidity in the environmental conditions are all suitable for outdoor operations, the virtual reality glasses device is further adjusted to a high power mode; When at least one of the environmental weather, environmental temperature, and environmental humidity is not suitable for outdoor work, the virtual reality glasses device is further adjusted to a low power mode.

2. A tower crane operating method based on virtual reality as claimed in claim 1, characterized in that: The multiple sensors arranged on the tower crane transmit their data to the virtual reality wearable device worn by the operator, specifically including: the tower crane includes at least a first sensor, a second sensor, a third sensor, a fourth sensor, a fifth sensor, and a sixth sensor; The first sensor, the second sensor, and the third sensor acquire the working state and working mode of the tower crane; the operating mode of the tower crane includes a working state and a stationary state; The working mode of the tower crane includes the extension work, rotation work and support work of the components of the tower crane; the fourth sensor, the fifth sensor and the sixth sensor obtain the working environment information of the tower crane, including the sunlight intensity, temperature and humidity information of the environmental information.

3. A tower crane operation method based on virtual reality as claimed in claim 2, characterized in that: The operation mode of the tower crane includes a working state and a stationary state, and the working mode of the tower crane includes extension work, rotation work and support work of the elements of the tower crane, and further includes: When the operation mode of the tower crane is in the working state, the operation mode data of the tower crane is set to the excited state; when the operation mode of the tower crane is in the stationary state, the operation mode data of the tower crane is set to the hibernation state; when the working mode of the tower crane is the extension work of the elements of the tower crane, the operation mode data of the tower crane is set to the first sensor data priority weight; When the working mode of the tower crane is the rotational working of the elements of the tower crane, setting the operation mode data of the tower crane as the second sensor data priority weight; When the working mode of the tower crane is the supporting work of the elements of the tower crane, the operation mode data of the tower crane is set as the third sensor data priority weight.

4. A tower crane operation method based on virtual reality as claimed in claim 1, characterized in that: The virtual reality wearable device worn by the operator communicates with the server based on the constructed virtual reality model of the tower crane to reconstruct the model of the real operating environment of the tower crane, specifically including: The virtual reality model of the tower crane includes a crane body model of the tower crane and a working model of the tower crane; The crane ontology model constructs a crane construction behavior operator template for the crane construction behavior. The operator template contains five attributes, including: ID represents the operator's number, which serves as the operator's identity; ADD represents the ADD address of the operator, which is the most basic element to distinguish operators; ACT represents the operator's behavior, which serves as an identifier of the behavior type; BUILDADD represents the target building of the crane selected by the operator. Different simulation servers can be selected according to the different attributes of BUILDADD; History represents the operator's historical operation information. This attribute is used to simulate the crane model, system model and other information of the real operator. A crane demolition behavior operator template is constructed for the crane demolition behavior. The operator template contains 7 attributes, including: operator number, coordinate position, simulation behavior, crane target building, operator authority, crane demolition behavior, and crane name; Auth indicates the operator's authority. Depending on the authority, the cranes that can be operated and the types of operations are also different. The operator's authority is divided into three levels: system authority, general authority, and temporary authority. TEARACT indicates the type of operation of the operator's crane demolition behavior, i.e., digging or hammering; VEHI represents the crane name of the crane selected by the operator as the crane identification; Create 10,000 virtual ADD addresses on the operator terminal and bind these virtual ADD addresses to the operators, that is, the ADD attribute in the individual operator template is the virtual ADD address assigned to the operator. On the premise of ensuring the differences among operators, large-scale operators are generated through the operator information template and the virtual ADD address. When generating operator behavior simulation, the exit ADD of the simulation behavior is set to the virtual ADD address.

5. A tower crane operating method based on virtual reality as claimed in claim 4, characterized in that: The virtual reality model of the tower crane includes a crane body model of the tower crane and a working model of the tower crane, and further includes: designing a crane construction behavior driver and a crane demolition behavior driver for the operator's classic operation behaviors of building a building and crane demolition respectively; The crane construction behavior driver simulates a complete crane construction behavior process through four processes: establishing a connection, sending a request, requesting a response, and disconnecting the connection, and generates a real operation workflow including a behavior feature protocol; The crane dismantling behavior driver simulates a complete crane dismantling behavior through six processes: establishing connection, operator login, login response, behavior selection, crane dismantling, and disconnection, and generates a real workflow containing a behavior feature protocol.

6. A tower crane operating method based on virtual reality as claimed in claim 1, characterized in that: The method for representing the operation of the tower crane on the virtual reality wearable device supporting the tower crane specifically includes: Receive build and tear down events; Obtaining event information corresponding to the erection behavior and dismantling behavior events; Based on the event information, a virtual object corresponding to the building behavior and dismantling behavior events is generated in a virtual scene; and an operation of an operator on the virtual object is obtained; According to the operation, the building behavior and dismantling behavior events are processed.

7. A tower crane operating method based on virtual reality as claimed in claim 6, characterized in that: The obtaining of event information corresponding to the erection behavior and dismantling behavior events includes: Determine whether the construction and dismantling events meet the preset event requirements; If the erection behavior and dismantling behavior events meet preset event requirements, event information corresponding to the erection behavior and dismantling behavior events is obtained.

8. A tower crane operating method based on virtual reality as claimed in claim 6, characterized in that: The step of generating virtual objects corresponding to the building behavior and dismantling behavior events in a virtual scene based on the event information includes: Determining a target position and a first display mode of the virtual object in the virtual scene; The virtual object is generated at a target position in the virtual scene in the first display manner.