Control methods of quay crane operation training simulation equipment
By setting up shared cameras in a 3D virtual scene and automatically adjusting the field of view based on the spreader's operating information, the problem of asynchronous images caused by independent rendering of multiple cameras was solved. This enabled real-time control of the spreader's movement and smooth zoom, improving the realism and effectiveness of remote control training for quay cranes.
Patent Information
- Application Number
- CN202611379581.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-09-07
- Publication Date
- 2026-11-10
AI Technical Summary
In existing port quay crane remote control simulation training systems, the independent rendering of multiple virtual cameras leads to asynchronous spatiotemporal images, deviations in spreader posture, and the inability of the automatic zoom function to simulate real operational logic. This results in a disconnect between the training experience and actual operation, making it difficult to meet the needs of efficient training.
Multiple virtual cameras sharing the same scene are set up in a 3D virtual scene. The camera field of view is automatically adjusted based on the lifting equipment operation information and field of view adjustment configuration information, so as to realize real-time control of the lifting equipment movement and smooth zoom, and output to the display screen.
It achieves temporal and spatial consistency of multi-camera perspectives, real-time feedback of spreader movement, and smooth zoom effect, thereby improving the authenticity and effectiveness of remote control training for quay crane operators.
Smart Images

Figure CN123072253A_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of simulation training technology, and more specifically to a control method for a quay crane operation training simulation device. Background Technology
[0002] With the development of port automation and intelligence, remote operation of quay cranes has become mainstream, and the demand for training remote control operators is increasingly urgent. Simulation training systems, due to their advantages of low cost, no risk, and repeatable training, have become the core training vehicle, with the closed-circuit television simulation system directly determining the realism of the training. In actual operations, operators rely entirely on the quay crane's multi-camera system to obtain their field of vision, and through horizontal and vertical rotation and zoom operations, combined with automatic screen switching and zoom functions, complete the entire process of container alignment, container grabbing, transfer, and container placement.
[0003] However, the closed-circuit television simulation schemes currently used in port quay crane remote control simulation training systems generally suffer from several technical defects, resulting in a serious disconnect between the training experience and real-world operation, making it difficult to meet the actual needs of efficient training. Specifically, the use of independent rendering instances for multiple virtual cameras leads to spatiotemporal asynchrony in the images from different cameras, causing deviations in the spreader's posture across different frames, failing to replicate the seamless experience of the collaborative perspective of multiple cameras in real-world operations. Furthermore, the automatic zoom function in current training systems cannot simulate the logic of automatic adjustment of closed-circuit television images during the alignment, container grabbing, transfer, and container placement stages of real quay crane operations, further widening the gap between training and practical operation, severely restricting the effectiveness and widespread application of simulation training. Summary of the Invention
[0004] In view of this, the present invention provides a control method for a quay crane operation training simulation device, which can effectively improve the training effect of remote control for quay crane operators.
[0005] To solve at least one of the above-mentioned technical problems, the present invention adopts the following technical solution:
[0006] According to an embodiment of the present invention, a control method for a quay crane operation training simulation device is provided. The quay crane operation training simulation device includes a simulation device and a handle. The simulation device is provided with a display screen, and the handle is electrically connected to the simulation device. The control method includes:
[0007] The simulation equipment establishes a three-dimensional virtual scene corresponding to the port quay crane operation environment, and sets up a virtual quay crane in the three-dimensional virtual scene. Multiple virtual cameras sharing the three-dimensional virtual scene are set up on the virtual quay crane.
[0008] The simulation equipment acquires the operator's operation signals corresponding to the handle, and controls the spreader of the virtual quay crane to perform simulated movement in the three-dimensional virtual scene based on the operation signals;
[0009] The simulation equipment acquires the spreader operation information of the virtual quay crane and the field of view adjustment configuration information of the virtual camera, and determines the target field of view parameters of the virtual camera based on the spreader operation information and the field of view adjustment configuration information;
[0010] The simulation equipment adjusts the field of view of the virtual camera based on the target field of view parameters, and acquires a virtual working image of the virtual quay crane based on the adjusted field of view;
[0011] The simulation equipment outputs a virtual work scene to a display screen for the operator to see.
[0012] In one embodiment of the present invention, setting up a virtual quay bridge in a three-dimensional virtual scene includes:
[0013] The simulation equipment acquires the configuration information of the quay crane and builds a virtual quay crane in a three-dimensional virtual scene based on the configuration information;
[0014] The simulation equipment sets up multiple virtual cameras on a virtual quay bridge and configures these virtual cameras within the same scene instance of a 3D virtual scene, allowing the multiple virtual cameras to share the 3D virtual scene.
[0015] In one embodiment of the present invention, the simulation device acquires the operator's operation signal corresponding to the handle, and controls the spreader of the virtual quay crane to perform simulated movement in a three-dimensional virtual scene based on the operation signal, including:
[0016] The simulation equipment acquires the operation signal, analyzes the operation signal, and determines the motion control parameters of the quay crane corresponding to the operation signal;
[0017] The simulation equipment controls the spreader to move in a three-dimensional virtual scene based on the motion control parameters of the quay crane.
[0018] In one embodiment of the present invention, the simulation device acquires the spreader operation information of the virtual quay crane and the field-of-view adjustment configuration information of the virtual camera, and determines the target field-of-view parameters of the virtual camera based on the spreader operation information and the field-of-view adjustment configuration information, including:
[0019] The simulation equipment determines the operating height of the spreader based on the spreader's operating information, and determines the normalized height of the spreader based on the field of view adjustment configuration information and the operating height;
[0020] The simulation equipment determines the target zoom level of the virtual camera based on normalized height and field-of-view adjustment configuration information;
[0021] The simulation equipment determines the target field-of-view parameters of the virtual camera based on the target zoom level.
[0022] In one embodiment of the present invention, the simulation device determines the operating height of the spreader based on the spreader's operating information, and determines the normalized height of the spreader based on the field-of-view adjustment configuration information and the operating height, including:
[0023] The simulation equipment determines the minimum and maximum working height of the lifting device based on the field-of-view adjustment configuration information.
[0024] The simulation equipment limits the operating height based on the minimum and maximum operating heights to determine the limited operating height.
[0025] The simulation equipment maps the limited operating height to a preset normalized range based on the minimum working height, the maximum working height, and the limited operating height, and determines the normalized height of the spreader.
[0026] In one embodiment of the present invention, the simulation device determines the target zoom level of the virtual camera based on normalized height and field-of-view adjustment configuration information, including:
[0027] The simulation device determines the zoom step size of the virtual camera based on the field of view adjustment configuration information;
[0028] The simulation device determines the total number of zoom levels for the virtual camera based on the minimum working height, the maximum working height, and the zoom step size.
[0029] The simulation device maps the normalized height to the corresponding zoom level based on the normalized height and the total number of zoom levels, thus determining the target zoom level of the virtual camera.
[0030] In one embodiment of the present invention, the simulation device determines the target field-of-view parameters of the virtual camera based on the target zoom level, including:
[0031] The simulation device obtains the previous zoom level corresponding to the virtual camera and compares the target zoom level with the previous zoom level;
[0032] When the target zoom level is different from the previous zoom level, the simulation equipment determines the target field of view parameters of the virtual camera based on the hoist operation information and field of view adjustment configuration information.
[0033] In one embodiment of the present invention, the simulation device adjusts the field of view of the virtual camera based on the target field of view parameters, and acquires a virtual operation image of the virtual quay crane based on the adjusted field of view, including:
[0034] The simulation device acquires the current field-of-view parameters of the virtual camera;
[0035] The simulation device determines the updated field-of-view parameters of the virtual camera based on the current field-of-view parameters, the target field-of-view parameters, and the preset smoothing coefficient.
[0036] The simulation equipment adjusts the field of view of the virtual camera based on the updated field of view parameters, and acquires virtual operation images of the virtual quay crane based on the adjusted field of view.
[0037] In one embodiment of the present invention, the control method of the quay crane operation training simulation equipment further includes:
[0038] The simulation device determines the correspondence between multiple virtual cameras and multiple display screens based on preset display screen allocation rules;
[0039] The simulation equipment acquires the virtual operation images captured by each virtual camera, and based on the correspondence, outputs the virtual operation images captured by each virtual camera to the corresponding display screen.
[0040] In one embodiment of the present invention, the control method for the quay crane operation training simulation equipment further includes:
[0041] The simulation equipment listens to simulation operation events in the 3D virtual scene to determine the current simulation operation status of the 3D virtual scene.
[0042] The simulation device determines the virtual camera corresponding to the simulation operation state and the display screen corresponding to the virtual camera based on the simulation operation state and the preset screen switching rules;
[0043] The simulation device acquires the virtual work footage captured by the virtual camera and outputs the virtual work footage to the display screen corresponding to the virtual camera.
[0044] The above-described technical solution of the present invention has at least one of the following beneficial effects:
[0045] The control method of the quay crane operation training simulation equipment of the present invention establishes a three-dimensional virtual scene corresponding to the port quay crane operation environment through the simulation equipment, and sets up a virtual quay crane in the three-dimensional virtual scene. Multiple virtual cameras sharing the same three-dimensional virtual scene are set on the virtual quay crane, allowing multiple virtual cameras to share the same three-dimensional virtual scene. This avoids the spatiotemporal asynchrony of images caused by independent rendering instances of each virtual camera, ensuring that the spreader posture output by each camera is consistent in time and space, realistically restoring the coherent experience of multiple cameras working together in actual quay crane operations. Simultaneously, by acquiring the operator's operation signals corresponding to the handles, the spreader of the virtual quay crane is controlled to simulate movement in the three-dimensional virtual scene based on the operation signals, achieving real-time control response to the spreader movement and ensuring that the operating feel is consistent with the real equipment. Furthermore, this invention also obtains the spreader operation information of the virtual quay crane and the field of view adjustment configuration information of the virtual camera, determines the target field of view parameters of the virtual camera based on the spreader operation information and the field of view adjustment configuration information, and adjusts the field of view of the virtual camera based on the target field of view parameters. Thus, it can automatically trigger field of view changes according to the actual operating status of the spreader and the preset field of view adjustment configuration, without the need for manual intervention by the trainee to zoom. The zoom transition process is continuous and smooth, without jumps or stutters, simulating the zoom effect of real operation, and improving the training effect of remote control of quay crane operators. Attached Figure Description
[0046] Figure 1 This is a schematic diagram of the implementation environment provided in one embodiment of the present invention;
[0047] Figure 2 This is a flowchart of a control method for a quay crane operation training simulation device in one embodiment of the present invention;
[0048] Figure 3 This is a flowchart illustrating the creation of a virtual quay bridge in one embodiment of the present invention;
[0049] Figure 4 This is a flowchart illustrating the control of the lifting device to perform simulated motion in a three-dimensional virtual scene according to one embodiment of the present invention;
[0050] Figure 5 This is a flowchart illustrating the determination of the target field-of-view parameters of a virtual camera based on the lifting device's operating information and the field-of-view adjustment configuration information, as described in one embodiment of the present invention.
[0051] Figure 6 This is a flowchart illustrating the determination of the normalized height of the lifting device in one embodiment of the present invention;
[0052] Figure 7 This is a flowchart illustrating the determination of the target zoom level of a virtual camera in one embodiment of the present invention;
[0053] Figure 8 This is a flowchart illustrating the determination of target field-of-view parameters for a virtual camera in one embodiment of the present invention;
[0054] Figure 9 This is a flowchart illustrating the acquisition of a virtual operation screen of a virtual quay crane based on an adjusted field of view in one embodiment of the present invention.
[0055] Figure 10 This is a schematic diagram of the structure of the quay crane operation training simulation device and the handle in one embodiment of the present invention;
[0056] Figure 11 This is a schematic diagram of the control device of a quay crane operation training simulation device in one embodiment of the present invention;
[0057] Figure 12 This is a schematic diagram of the structure of an electronic device provided in one embodiment of the present invention. Detailed Implementation
[0058] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the described embodiments of the present invention are within the scope of protection of the present invention.
[0059] The following describes, with reference to the accompanying drawings, a control method for a quay crane operation training simulation device according to an embodiment of the present invention.
[0060] Reference manual attached Figure 1 , Figure 1 A schematic diagram illustrating the implementation environment of the control method for the quay crane operation training simulation equipment of the present invention is shown. For example... Figure 1 As shown, the implementation environment may include a simulation device 1000 and a handle 2000. The simulation device 1000 and the handle 2000 are electrically connected. The simulation device 1000 is a dedicated simulation device for quay crane operation training. It is equipped with a display screen and integrates a computing processing unit, a graphics rendering unit, and a display output module. The simulation device 1000 can be deployed as a standalone local device in the training area or built based on a general-purpose computer (such as a personal computer or industrial control computer). The hardware configuration of the simulation device 1000 can be flexibly configured according to the actual training scenario; it only needs to have the ability to run a 3D virtual scene, process operator input, and output simulated images. The handle 2000 is equipped with motion control elements, such as joysticks, knobs, or button combinations. The operator can generate corresponding operation signals by operating the handle 2000, such as horizontal rotation signals (Pan), vertical rotation signals (Tilt), and zoom signals (Zoom). After acquiring the corresponding operation signal, the simulation device 1000 can determine the corresponding control parameters based on the operation signal, and perform simulation control of the virtual quay crane based on the control parameters, thereby realizing simulation training operation of the entire process of the quay crane.
[0061] The simulation device 1000 first establishes a 3D virtual scene corresponding to the port quay crane operation environment, and then sets up a virtual quay crane within this scene. Multiple virtual cameras sharing the same 3D virtual scene are mounted on the virtual quay crane. Because multiple virtual cameras share the same 3D virtual scene, temporal and spatial discrepancies between camera feeds are avoided, ensuring consistency in the perspectives of the multiple virtual cameras. Then, the simulation device 1000 acquires the operation signals input by the operator via the handle 2000, and controls the spreader of the virtual quay crane to simulate movement within the 3D virtual scene based on these signals. This allows the operator to control the spreader's movement in real time, providing feedback similar to that of actual quay crane operations.
[0062] Furthermore, the simulation device 1000 can acquire the spreader operation information of the virtual quay crane and the field-of-view adjustment configuration information of the virtual camera. Based on the spreader operation information and field-of-view adjustment configuration information, it determines the target field-of-view parameters of the virtual camera and further adjusts the field of view of the virtual camera based on the target field-of-view parameters. This allows for the acquisition of a virtual working image of the virtual quay crane based on the adjusted field of view, and finally outputs the virtual working image to the display screen for the operator. This enables field-of-view changes to be automatically triggered according to the work progress, with smooth transitions in field-of-view adjustments, providing visual feedback consistent with real remote control operations, effectively improving the training effect of remote control for quay crane operators.
[0063] Below, please refer to the attached instruction manual. Figure 2 This illustrates a control method for a quay crane operation training simulation device provided in an embodiment of the present invention, which can be applied to... Figure 1 The method is implemented in the analog device 1000. Specifically, the method may include the following steps:
[0064] S100: The simulation equipment establishes a three-dimensional virtual scene corresponding to the port quay crane operation environment, and sets up a virtual quay crane in the three-dimensional virtual scene.
[0065] The virtual quay bridge is equipped with multiple virtual cameras that share the three-dimensional virtual scene.
[0066] In this embodiment, the simulation equipment can first construct a three-dimensional virtual scene corresponding to the actual port quay crane operation environment, and then set up a virtual quay crane and multiple virtual cameras in this three-dimensional virtual scene. All virtual cameras use the same three-dimensional virtual scene as their virtual operating environment, thus enabling the acquisition of virtual operation footage from different perspectives based on the motion state of the same virtual quay crane during subsequent simulations. By allowing multiple virtual cameras to share the same three-dimensional virtual scene, the virtual operation footage acquired by each virtual camera has a unified spatial environment and temporal reference, avoiding temporal and spatial deviations in the footage from different virtual cameras and ensuring the consistency of the perspectives of multiple virtual cameras.
[0067] S200: The simulation device acquires the operator's operation signal corresponding to the handle, and controls the spreader of the virtual quay crane to perform simulated movement in the three-dimensional virtual scene based on the operation signal.
[0068] In this embodiment, the operator can input operation signals to the simulation device via a handle to control the movement of the virtual quay crane spreader. The simulation device, based on the received operation signals, controls the virtual quay crane spreader to perform corresponding simulated movements within a 3D virtual scene. This allows the operator to control the spreader's movement in real time, enabling the virtual spreader's motion state to change in real-time according to the operator's actions. Therefore, the operator's actual handle input can be mapped to the virtual quay crane spreader's movement, providing a motion state basis for subsequently adjusting the virtual camera's field of view based on the spreader's actual operating state, thereby improving the consistency between the simulated operation and the actual quay crane operation.
[0069] S300: The simulation equipment acquires the spreader operation information of the virtual quay crane and the field of view adjustment configuration information of the virtual camera, and determines the target field of view parameters of the virtual camera based on the spreader operation information and the field of view adjustment configuration information.
[0070] In this embodiment, during the simulated movement of the virtual quay crane's spreader according to the operator's commands, the simulation equipment further acquires spreader operation information characterizing the spreader's current operating state. Combined with pre-set virtual camera field-of-view adjustment configuration information, the required field of view for the virtual camera is determined. By associating the spreader's operating state with the field-of-view adjustment configuration, the corresponding target field-of-view parameters can be determined based on the spreader's actual operating state. This allows the virtual camera's field-of-view adjustment to automatically change with the spreader's operating state without requiring the operator to manually adjust the field of view.
[0071] The S400 simulation device adjusts the field of view of the virtual camera based on the target field of view parameters, and acquires the virtual operation screen of the virtual quay crane based on the adjusted field of view.
[0072] In this embodiment, the simulation equipment adjusts the field of view of the virtual camera according to the determined target field of view parameters, and uses the adjusted virtual camera to capture images of the virtual quay crane and spreader in the three-dimensional virtual scene to obtain the corresponding virtual operation footage. By dynamically adjusting the field of view of the virtual camera according to the operating status of the spreader, the framing range and viewing angle of the virtual operation footage can be matched with the operating status of the spreader, thereby simulating the field of view changes of the camera as the operating status changes during actual quay crane operations, and keeping the field of view adjustment process correlated with the movement process of the virtual spreader.
[0073] The S500 simulation device outputs a virtual work screen to the display screen for the operator.
[0074] In this embodiment, the simulation device can output the virtual operation footage captured by the virtual camera to a display screen, allowing the operator to observe the real-time operation status of the virtual quay crane and spreader. Since the virtual operation footage is obtained based on an adjusted field of view that matches the spreader's operating status, it provides the operator with an operational perspective that changes with the spreader's movement. This allows the operator to perform simulated operations based on visual information similar to actual remote quay crane operation, thereby improving the realism and effectiveness of quay crane operation training.
[0075] Below, regarding Figure 2 Each step in the process will be explained in detail.
[0076] (a) Establish a virtual environment and set up a virtual shore bridge in the three-dimensional virtual scene.
[0077] The following describes the steps for creating a 3D virtual scene corresponding to the port quay crane operation environment and setting up a virtual quay crane within that 3D virtual scene (i.e., step S100). Figure 3 As shown, in one embodiment of the present invention, step S100 may include the following steps S110-S120:
[0078] S110. The simulation equipment acquires the configuration information of the quay crane and establishes a virtual quay crane in a three-dimensional virtual scene based on the configuration information.
[0079] In this embodiment, the simulation device can acquire the configuration information of the actual quay crane and, based on the acquired configuration information, establish a virtual quay crane corresponding to the actual quay crane in a three-dimensional virtual scene. The configuration information may include the quay crane's structural dimensions, structural components, the location of each moving mechanism, and the initial position of the spreader. The simulation device can determine the structural form, spatial location, and relative relationships between the components of the virtual quay crane in the three-dimensional virtual scene based on the above configuration information, thereby establishing a virtual quay crane corresponding to the structure and operational status of the actual quay crane. By establishing a virtual quay crane based on the configuration information of the actual quay crane, the structural form and spatial layout of the virtual quay crane can be kept consistent with the actual quay crane, providing a foundation for subsequent simulation operators to operate the spreader and obtain virtual operational images.
[0080] S120. The simulation equipment sets up multiple virtual cameras on the virtual quay bridge and configures the multiple virtual cameras in the same scene instance of the three-dimensional virtual scene, so that the multiple virtual cameras share the three-dimensional virtual scene.
[0081] In this embodiment, the simulation device can set up multiple virtual cameras on a virtual quay crane according to the camera settings on the actual quay crane. Each virtual camera can have different installation positions, orientations, and field of view to simulate the observation angles of different cameras on the actual quay crane. Furthermore, the simulation device configures multiple virtual cameras within the same scene instance of a 3D virtual scene, ensuring that all virtual cameras render based on the virtual quay crane, spreader, and working environment within the same scene instance when capturing images. When the virtual quay crane or spreader moves within the 3D virtual scene, the multiple virtual cameras can synchronously update their captured images based on the scene state corresponding to the same scene instance. This avoids differences in scene states caused by multiple virtual cameras corresponding to different scene instances, ensuring the consistency of the virtual work images acquired by the multiple virtual cameras in time and space.
[0082] (ii) Control the spreader of the virtual quay crane to simulate movement in a three-dimensional virtual scene.
[0083] The following describes the steps (i.e., step S200) for obtaining the operator's operation signal corresponding to the handle and controlling the spreader of the virtual quay crane to perform simulated movement in a three-dimensional virtual scene based on the operation signal. Figure 4 As shown, in one embodiment of the present invention, step S200 may include the following steps S210-S220:
[0084] S210. The simulation equipment acquires the operation signal, analyzes the operation signal, and determines the motion control parameters of the quay crane corresponding to the operation signal.
[0085] In this embodiment, the handle can be equipped with motion control elements such as joysticks, knobs, and buttons. The operator generates corresponding operation signals by operating these motion control elements. These operation signals can include signals used to control different motion states of the quay crane, such as horizontal rotation signals (Pan), vertical rotation signals (Tilt), and zoom signals (Zoom). After acquiring the operation signals generated by the handle, the simulation equipment can analyze them to determine the controlled object, direction of motion, and amplitude of motion corresponding to the operation signal. Based on the analysis results, it determines the corresponding quay crane motion control parameters, converting the operator's operation on the handle into motion control parameters that can be recognized and executed by the virtual quay crane. This provides a control basis for subsequently controlling the spreader of the virtual quay crane to simulate motion.
[0086] S220: The simulation equipment controls the spreader to simulate motion in a three-dimensional virtual scene based on the motion control parameters of the quay crane.
[0087] In this embodiment, the simulation equipment can perform corresponding motion control on the spreader of the virtual quay crane based on the determined motion control parameters of the quay crane, so that the spreader performs corresponding simulated motion in the three-dimensional virtual scene according to the operator's operation intention input through the handle. For example, when the motion control parameters of the quay crane are used to characterize the horizontal movement, vertical movement, or rotation of the spreader, the simulation equipment can adjust the position or posture of the spreader in the three-dimensional virtual scene according to the corresponding control parameters, so that the motion state of the virtual spreader corresponds to the operator's handle operation, realizing the operator's real-time control of the virtual quay crane spreader. Thus, the handle operation can be combined with the motion control of the virtual quay crane, enabling the operator to complete the simulated operation of the spreader in a way similar to the actual operation of the quay crane, providing real-time operational feedback for quay crane operation training.
[0088] (iii) Determine the target field of view parameters of the virtual camera based on the lifting equipment operation information and the field of view adjustment configuration information.
[0089] The following describes the steps for obtaining the spreader operation information of the virtual quay crane and the field-of-view adjustment configuration information of the virtual camera, and determining the target field-of-view parameters of the virtual camera based on the spreader operation information and the field-of-view adjustment configuration information (i.e., step S300). Figure 5 As shown, in one embodiment of the present invention, step S300 may include the following steps S310-S330:
[0090] S310 The simulation equipment determines the operating height of the spreader based on the spreader's operating information, and determines the normalized height of the spreader based on the field of view adjustment configuration information and the operating height.
[0091] In this embodiment, the simulation device can determine the operating height of the lifting device in the 3D virtual scene based on the lifting device's operating information, and normalize the operating height by combining it with the pre-set height range in the field of view adjustment configuration information, obtaining a normalized height that characterizes the position of the lifting device's current operating height within the preset height range. By normalizing the lifting device's operating height, different actual operating heights can be mapped to a unified parameter range, providing a basis for subsequently determining the target zoom level of the virtual camera based on the lifting device's operating height. Specifically, as... Figure 6 As shown, step S310 may include the following steps S311-S313:
[0092] S311. The simulation equipment determines the minimum and maximum working height of the lifting device based on the field of view adjustment configuration information.
[0093] In this embodiment, the simulation device can acquire pre-set field-of-view adjustment configuration information of the virtual camera and determine the minimum and maximum working heights corresponding to the spreader from the field-of-view adjustment configuration information. The minimum working height characterizes the lowest permissible operating height of the spreader during quay crane operations, and the maximum working height characterizes the highest permissible operating height of the spreader during quay crane operations. The minimum and maximum working heights can be set according to the actual operating range of the quay crane and the actual observation needs of the virtual camera, thereby limiting the effective height range of the spreader participating in field-of-view adjustment.
[0094] S312. The simulation equipment performs amplitude limiting processing on the operating height based on the minimum and maximum operating heights to determine the operating height after amplitude limiting.
[0095] In this embodiment, after determining the minimum and maximum working heights of the spreader, the simulation equipment compares the current operating height, determined based on the spreader's operating information, with the minimum and maximum working heights and applies a limit to the operating height. Specifically, when the operating height is lower than the minimum working height, it is set as the minimum working height; when the operating height is higher than the maximum working height, it is set as the maximum working height; and when the operating height is between the minimum and maximum working heights, it remains unchanged. This ensures that the limited operating height always remains within the effective working range defined by the minimum and maximum working heights, preventing subsequent normalization calculations and zoom level determination from occurring when the spreader exceeds the preset working height range.
[0096] S313. The simulation equipment maps the limited operating height to a preset normalized range based on the minimum working height, the maximum working height, and the limited operating height, and determines the normalized height of the spreader.
[0097] In this embodiment, the simulation equipment can determine the effective working height range of the spreader based on the minimum and maximum working heights, and map the limited operating height to a preset normalized interval. For example, the minimum working height can be mapped to the beginning of the normalized interval, and the maximum working height to the end of the normalized interval, thereby obtaining the normalized height of the spreader. Specifically, the normalized interval can be set to 0-1, and the normalized height... The calculation formula is:
[0098]
[0099] in, The operating height after the spreader's amplitude is limited. For the highest working height, This is the minimum working height. Therefore, the normalized height corresponding to a spreader at the minimum working height is 0, the normalized height corresponding to a spreader at the maximum working height is 1, and the normalized height for spreaders between the minimum and maximum working heights is determined based on their position within the entire working height range. This allows the operating status of the spreader at different actual heights to be converted into normalized parameters within a unified range. Consequently, the determination of the zoom level no longer directly depends on the actual height value of the spreader, but is based on the position of the spreader within the preset working height range, thus facilitating unified processing of the spreader's operating status across different height ranges.
[0100] S320, the simulation device determines the target zoom level of the virtual camera based on normalized height and field-of-view adjustment configuration information.
[0101] In this embodiment, the simulation device can match the determined normalized height with the field-of-view adjustment configuration information, and determine the target zoom level of the virtual camera according to the preset zoom rule corresponding to the normalized height. By associating the normalized height of the hoist with the preset zoom rule, the zoom level of the virtual camera can be adjusted accordingly with the change of the hoist's operating height, thereby realizing the automatic change of the virtual camera's field of view with the hoist's operating state. Specifically, as shown... Figure 7 As shown, step S320 may include the following steps S321-S323:
[0102] S321. The simulation device determines the zoom step size of the virtual camera based on the field of view adjustment configuration information.
[0103] In this embodiment, the simulation device can obtain a pre-set zoom step size from the field-of-view adjustment configuration information. The zoom step size characterizes the change in spreader height between adjacent zoom levels; that is, whenever the spreader height change reaches the height range corresponding to a zoom step size, a corresponding zoom level can be adjusted. The zoom step size can be set according to the actual operating height range of the quay crane and the desired zoom precision. For example, when dividing the spreader into multiple height intervals between its minimum and maximum working heights, each height interval can correspond to a zoom level, and the height interval between adjacent height intervals can be determined by the zoom step size; the smaller the zoom step size, the finer the zoom. Therefore, by setting the zoom step size, a correspondence between the spreader's operating height and the virtual camera's zoom level can be established, and the adjustment granularity of the virtual camera's zoom level as the spreader height changes can be controlled.
[0104] S322. The analog device determines the total number of zoom levels for the virtual camera based on the minimum working height, the maximum working height, and the zoom step size.
[0105] In this embodiment, the simulation device can determine the number of zoom levels that can be divided within the effective working height range of the lifting device based on the height difference between the minimum and maximum working heights and a predetermined zoom step size. Specifically, the height range from the minimum to the maximum working height can be divided into multiple consecutive height intervals according to the zoom step size, and each height interval can be mapped to a corresponding zoom level, thereby obtaining the total number of zoom levels for the virtual camera. :
[0106]
[0107] in, This refers to the zoom step size. When the height range between the minimum and maximum working heights is fixed, a smaller zoom step size results in more zoom levels and a finer correlation between changes in hoist height and zoom levels; conversely, a larger zoom step size results in fewer zoom levels. Therefore, the fineness of the virtual camera's zoom adjustment can be configured according to the actual training scenario.
[0108] S323. The analog device maps the normalized height to the corresponding zoom level based on the normalized height and the total number of zoom levels, and determines the target zoom level of the virtual camera.
[0109] In this embodiment, the simulation device can determine the zoom level corresponding to the normalized height based on the normalized height of the hoist and the total number of zoom levels of the virtual camera, and then determine this zoom level as the target zoom level of the virtual camera. :
[0110]
[0111] Therefore, based on the position of the normalized height within a preset normalized interval, the entire normalized interval can be divided into multiple level intervals corresponding to the total number of zoom levels. The target zoom level can then be determined based on the level interval in which the current normalized height of the lifting device is located. For example, when the normalized height of the lifting device increases, it indicates that the device's position between the minimum and maximum working heights is gradually rising, and the corresponding target zoom level can gradually increase; conversely, when the normalized height of the lifting device decreases, the corresponding target zoom level can gradually decrease. Through this mapping, a correspondence between the lifting device height and the virtual camera's zoom level can be established, enabling the virtual camera to automatically determine the appropriate zoom state based on the operating height of the lifting device.
[0112] S330, the simulation device determines the target field of view parameters of the virtual camera based on the target zoom level.
[0113] In this embodiment, the simulation device can determine the target field-of-view parameters corresponding to the virtual camera based on the determined target zoom level, so that the target field-of-view parameters match the current operating height of the lifting device, and provide parameter basis for subsequent adjustment of the virtual camera's field of view. By determining the target field-of-view parameters based on the target zoom level, the zoom requirements corresponding to the lifting device's operating state can be converted into field-of-view adjustment parameters that the virtual camera can execute, thereby realizing automatic adjustment of the virtual camera's field of view. Specifically, as shown... Figure 8 As shown, step S330 may include the following steps S331-S332:
[0114] S331. The simulation device obtains the previous zoom level corresponding to the virtual camera and compares the target zoom level with the previous zoom level.
[0115] In this embodiment, the simulation device can obtain the previous zoom level of the virtual camera during the previous field-of-view adjustment process, and compare the current target zoom level determined based on the operating height of the lifting device with the previous zoom level to determine whether the current operating state of the lifting device has caused a change in the zoom level of the virtual camera. Specifically, when the target zoom level is the same as the previous zoom level, it indicates that the current height change of the lifting device has not yet reached the level that would cause a zoom level adjustment. Therefore, the current field-of-view parameters of the virtual camera can be kept unchanged, thereby avoiding frequent adjustments to the virtual camera's field of view due to minor changes in the lifting device's height. When the target zoom level is different from the previous zoom level, it indicates that the change in the operating height of the lifting device has reached the corresponding zoom adjustment condition. At this time, a new target field-of-view parameter can be further determined based on the lifting device's operating information and the field-of-view adjustment configuration information, and the field of view of the virtual camera can be adjusted accordingly.
[0116] S332. When the target zoom level is different from the previous zoom level, the simulation equipment determines the target field of view parameters of the virtual camera based on the hoist operation information and the field of view adjustment configuration information.
[0117] In this embodiment, when the target zoom level differs from the previous zoom level, the simulation device can determine the current height of the lifting equipment based on the equipment's operating information and determine the target proportion corresponding to the target zoom level based on the field-of-view adjustment configuration information. Then, based on the current height of the lifting equipment and the target proportion, it calculates the target field-of-view parameters of the virtual camera according to the perspective projection relationship. Each zoom level corresponds to a preset target proportion value, which increases with the zoom level and characterizes the target display ratio of the lifting equipment in the virtual work screen at the corresponding zoom level. The simulation device queries the corresponding relationship based on the determined target zoom level to obtain the target proportion matching that target zoom level.
[0118] Specifically, before calculating the target field of view parameters, the simulation device pre-acquires the spatial position of the virtual camera in the 3D virtual scene and calculates the spatial distance between the hoist and the virtual camera based on the current spatial coordinates of the hoist. Simultaneously, the simulation device determines the target display height of the hoist in the virtual work screen based on the product of the target proportion corresponding to the target zoom level in the field of view adjustment configuration information and the screen height of the virtual work screen. This target display height and the spatial distance use a unified unit of measurement. Then, based on the geometric constraints between the field of view angle, target display height, and object distance in the perspective projection relationship, the target field of view parameters are determined.
[0119]
[0120] in, For the target field of view parameters, To display the target height of the lifting gear in the virtual operation screen. This refers to the spatial distance between the lifting device and the virtual camera. Therefore, the target field-of-view parameters can be dynamically calculated based on changes in the lifting device's operating height, ensuring that the lifting device is presented in the virtual work scene according to the target's proportions at different operating heights.
[0121] (iv) Obtain the virtual operation screen of the virtual quay crane.
[0122] The following describes the steps (i.e., step S400) of adjusting the field of view of the virtual camera based on the target field of view parameters and acquiring a virtual working image of the virtual quay crane based on the adjusted field of view. Figure 9 As shown, in one embodiment of the present invention, step S400 may include the following steps S410-S430:
[0123] S410: The analog device acquires the current field-of-view parameters of the virtual camera.
[0124] In this embodiment, the simulation device can acquire the field-of-view parameters currently used by the virtual camera. These current field-of-view parameters characterize the field-of-view range of the virtual camera at the current moment. The current field-of-view parameters can be the currently effective field-of-view angle parameters of the virtual camera and can serve as the basis for subsequent calculations and updates to the field-of-view parameters. When the virtual camera has previously performed a field-of-view adjustment, the current field-of-view parameters can be the field-of-view parameters obtained after the last adjustment; when the virtual camera has not yet performed a field-of-view adjustment, the current field-of-view parameters can be the initial field-of-view parameters of the virtual camera. By acquiring the current field-of-view parameters, the current field-of-view state of the virtual camera can be determined, enabling subsequent field-of-view adjustments to be made gradually based on the difference between the current field of view and the target field of view, rather than directly switching the virtual camera's field of view to the target field of view.
[0125] S420: The simulation device determines the updated field-of-view parameters of the virtual camera based on the current field-of-view parameters, the target field-of-view parameters, and the preset smoothing coefficient.
[0126] In this embodiment, the simulation device can determine the updated field-of-view parameters of the virtual camera based on the difference between the current field-of-view parameters and the target field-of-view parameters, combined with a pre-set smoothing coefficient. The smoothing coefficient controls the magnitude of the change in the current field-of-view parameters towards the target field-of-view parameters; the larger the smoothing coefficient, the greater the magnitude of the change in the updated field-of-view parameters towards the target field-of-view parameters; the smaller the smoothing coefficient, the smaller the magnitude of the change in the updated field-of-view parameters towards the target field-of-view parameters.
[0127] In some embodiments, the simulation device can use interpolation to determine the updated field-of-view parameters based on the current field-of-view parameters, the target field-of-view parameters, and a smoothing coefficient. Specifically, the adjustment range of the current field-of-view parameters can be determined by the difference between the current and target field-of-view parameters and the smoothing coefficient, and then the adjusted field-of-view parameters can be used as the updated field-of-view parameters.
[0128]
[0129] in, To update the field of view parameters, These are the current field-of-view parameters. The preset smoothing coefficient, and The setting is between 0 and 1. Therefore, each field-of-view update only moves the current field-of-view parameters closer to the target field-of-view parameters by a certain margin, rather than directly switching the current field-of-view parameters to the target field-of-view parameters, thus avoiding abrupt changes in the field-of-view parameters and achieving smooth adjustment of the virtual camera's field of view.
[0130] S430: The simulation equipment adjusts the field of view of the virtual camera based on the updated field of view parameters, and acquires the virtual operation screen of the virtual quay crane based on the adjusted field of view.
[0131] In this embodiment, the simulation device can write the determined updated field-of-view parameters into the field-of-view parameter configuration of the virtual camera, so that the virtual camera adjusts its current field of view according to the updated field-of-view parameters. After completing one field-of-view parameter update, the virtual camera can capture images of the virtual quay bridge in the 3D virtual scene based on the updated field of view to obtain the corresponding virtual operation image. Furthermore, when the spreader is continuously running and there is still a difference between the target field-of-view parameters and the current field-of-view parameters, the simulation device can repeatedly execute the process of obtaining the current field-of-view parameters, determining the updated field-of-view parameters, and adjusting the virtual camera's field of view according to a preset update cycle, so that the current field-of-view parameters gradually approach the target field-of-view parameters until the virtual camera's field of view reaches the target field-of-view state. Thus, the changes in the virtual camera's field of view can be matched with the running state of the spreader, and smooth zoom can be achieved through continuous adjustment of the field-of-view parameters, avoiding obvious jumps or stutters in the virtual operation image due to sudden changes in field-of-view parameters, and improving the continuity of the virtual operation image.
[0132] (v) Output the virtual operation screen to the display screen.
[0133] The following describes the steps (i.e., step S500) for the simulation device to output a virtual operation screen to the display screen and present it to the operator.
[0134] In this embodiment, the simulation equipment outputs a virtual operation screen, adjusted for field of view, to a display screen, allowing the operator to observe the real-time operational status of the virtual quay crane and spreader. Since the virtual operation screen is acquired based on a target field of view matching the current operating status of the spreader, it provides the operator with an adaptive viewing angle that changes with the spreader's height. This ensures that the visual feedback obtained by the operator is highly consistent with the visual information in actual remote quay crane operation scenarios, thereby enhancing the realism of the simulated operation and improving the practical value and training effectiveness of quay crane operation training.
[0135] In one embodiment of the present invention, the control method of the quay crane operation training simulation device further includes: the simulation device determining the correspondence between multiple virtual cameras and multiple displays based on a preset display screen allocation rule.
[0136] Specifically, the simulation equipment can pre-acquire the display configuration information of multiple screens and the camera configuration information of multiple virtual cameras, and determine the correspondence between each virtual camera and each screen according to a preset display allocation rule. The display configuration information may include the number of screens, screen identifiers, and the screen's location on the control panel. The camera configuration information may include the number of virtual cameras, virtual camera identifiers, virtual camera viewing angles, and the location of the corresponding actual quay crane camera. The display allocation rule can be pre-set according to the layout of multiple video monitoring screens during actual remote operation of the quay crane, so that the virtual operation images captured by different virtual cameras can be displayed on the corresponding screens according to the screen layout in the actual operation scenario. The simulation equipment establishes a correspondence between virtual camera identifiers and display screen identifiers according to the above display allocation rule, thereby determining the screen corresponding to the virtual operation image captured by each virtual camera.
[0137] Furthermore, the simulation equipment can also acquire virtual work images captured by each virtual camera, and based on the correspondence, output the virtual work images captured by each virtual camera to the corresponding display screen.
[0138] Specifically, the simulation equipment can query the display screen identifier corresponding to the virtual camera identifier of the virtual operation screen, and send the virtual operation screen to the corresponding display screen for display. Thus, multiple displays can show virtual operation screens corresponding to different virtual cameras, allowing operators to simultaneously obtain operation information from different positions and perspectives of the virtual quay crane, thereby simulating the display mode of multiple monitoring screens during actual remote operation of a quay crane. Furthermore, since multiple virtual cameras share the same 3D virtual scene, the different perspectives displayed on each screen correspond to the operating status of the same virtual quay crane and the same virtual spreader, ensuring consistency of scene status across multiple displays.
[0139] In one embodiment of the present invention, the control method of the quay crane operation training simulation equipment further includes: the simulation equipment listening to simulation operation events in the three-dimensional virtual scene and determining the current simulation operation status corresponding to the three-dimensional virtual scene.
[0140] In this embodiment, the simulation equipment can continuously monitor simulation operation events in the 3D virtual scene and determine the current simulation operation status based on the detected events. These simulation operation events may include one or more of the following: spreader starts operating, spreader rises, spreader descends, spreader approaches the target container, spreader grabs the container, spreader lifts the container, container transports, and container drops. The simulation equipment can determine the current simulation operation stage of the 3D virtual scene based on the occurrence of these events and their corresponding statuses, thus obtaining the current simulation operation status. By monitoring simulation operation events in the 3D virtual scene, the simulation equipment can obtain real-time information about the progress of the quay crane simulation operation, providing a basis for selecting appropriate observation perspectives based on different operation statuses.
[0141] Furthermore, such as Figure 10 As shown, the control panel of the simulation equipment, from left to right, displays a left-side display screen, three sets of handles, and a right-side display screen. The left and right displays can show virtual operation footage captured by different virtual cameras, allowing the operator to simultaneously observe the operation from multiple perspectives. The three sets of handles are used for horizontal rotation, vertical rotation, and zooming. Based on the simulated operation state and preset screen-switching rules, the simulation equipment determines the virtual camera corresponding to the simulated operation state and the corresponding display screen, such as the left or right-side display screen. The screen-switching rules can pre-establish the correspondence between different simulated operation states, virtual cameras, and display screens, specifying the virtual camera perspectives that the operator needs to focus on observing and the display screens used to display those perspectives under different simulated operation states. For example, in a simulated operation state where the spreader approaches the target container, the virtual camera used to observe the relative position of the spreader and the target container can be determined as the corresponding virtual camera; in a simulated operation state where the spreader lifts or transports a container, the virtual camera used to observe the overall operation of the spreader and the container can be determined as the corresponding virtual camera. The simulation equipment queries preset screen-switching rules based on the current simulation operation status to determine the virtual camera and its corresponding display screen that need to be displayed. After determining the corresponding virtual camera and display screen, the simulation equipment acquires the virtual operation screen captured by the virtual camera and outputs the virtual operation screen to the corresponding display screen. Therefore, the operator does not need to manually select the viewing screen; the simulation equipment can automatically switch to the viewing angle matching the current operation stage, ensuring that key operation areas at different stages are promptly presented to the operator, thus improving the simulation accuracy of the actual remote monitoring screen switching process of the quay crane.
[0142] In summary, the control method of the quay crane operation training simulation equipment of the present invention establishes a three-dimensional virtual scene corresponding to the port quay crane operation environment through the simulation equipment, and sets up a virtual quay crane in the three-dimensional virtual scene. Multiple virtual cameras sharing the same three-dimensional virtual scene are set on the virtual quay crane, allowing multiple virtual cameras to share the same three-dimensional virtual scene. This avoids the spatiotemporal asynchrony of images caused by independent rendering instances of each virtual camera, ensuring that the spreader posture output by each camera remains consistent in time and space, realistically reproducing the coherent experience of multiple cameras working together in actual quay crane operations. Simultaneously, by acquiring the operator's operation signals corresponding to the handles, the spreader of the virtual quay crane is controlled to simulate movement in the three-dimensional virtual scene based on the operation signals, achieving real-time control response to the spreader movement and ensuring that the operating feel is consistent with the real equipment. Furthermore, this invention also obtains the spreader operation information of the virtual quay crane and the field of view adjustment configuration information of the virtual camera, determines the target field of view parameters of the virtual camera based on the spreader operation information and the field of view adjustment configuration information, and adjusts the field of view of the virtual camera based on the target field of view parameters. Thus, the field of view change can be automatically triggered according to the actual operating status of the spreader and the preset field of view adjustment configuration, without the need for the trainee to manually intervene in zooming. The zoom transition process is continuous and smooth, without jumps or stutters, simulating the zoom effect of real operation.
[0143] Reference manual attached Figure 11 This illustration shows the structure of a control device 1010 for a quay crane operation training simulation device according to an embodiment of the present invention. The quay crane operation training simulation device includes a simulation device and a handle. The simulation device is equipped with a display screen, and the handle is electrically connected to the simulation device. The control device 1010 includes:
[0144] The scene construction module 1011 is used to enable the simulation equipment to create a three-dimensional virtual scene corresponding to the port quay crane operation environment, and to set up a virtual quay crane in the three-dimensional virtual scene. Multiple virtual cameras sharing the three-dimensional virtual scene are set up on the virtual quay crane.
[0145] The control input module 1012 is used to enable the simulation device to obtain the operation signal of the operator corresponding to the handle, and control the spreader of the virtual quay crane to perform simulated movement in the three-dimensional virtual scene based on the operation signal;
[0146] The field of view determination module 1013 is used to enable the simulation equipment to acquire the spreader operation information of the virtual quay crane and the field of view adjustment configuration information of the virtual camera, and to determine the target field of view parameters of the virtual camera based on the spreader operation information and the field of view adjustment configuration information.
[0147] The field of view adjustment module 1014 is used to enable the simulation device to adjust the field of view of the virtual camera based on the target field of view parameters, and to acquire the virtual operation screen of the virtual quay bridge based on the adjusted field of view.
[0148] The screen output module 1015 is used to enable the simulation device to output the virtual operation screen to the display screen for presentation to the operator.
[0149] Another aspect of the present invention provides a quay crane operation training simulation device, including the control device of the quay crane operation training simulation device described above.
[0150] In another aspect, the present invention provides an electronic device comprising a processor and a memory, wherein the memory stores at least one instruction or at least one program, the at least one instruction or the at least one program being loaded and executed by the processor to implement the control method of the quay crane operation training simulation device as described above.
[0151] In another aspect, the present invention provides a computer-readable storage medium storing at least one instruction or at least one program, wherein the at least one instruction or at least one program is loaded and executed by a processor to implement the control method of the quay crane operation training simulation device as described above.
[0152] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus provided in the above embodiments and the corresponding method embodiments belong to the same concept, and the specific implementation process can be found in the corresponding method embodiments, which will not be repeated here.
[0153] In another aspect, the present invention provides an electronic device comprising a processor and a memory, wherein the memory stores at least one instruction or at least one program, the at least one instruction or the at least one program being loaded and executed by the processor to implement the control method of the quay crane operation training simulation device as described above.
[0154] Memory can be used to store software programs and modules. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory. Memory can primarily include a program storage area and a data storage area. The program storage area can store the operating system, application programs required for the functions, etc.; the data storage area can store data created based on the use of the device, etc. Furthermore, memory can include high-speed random access memory, and can also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, memory can also include a memory controller to provide the processor with access to the memory.
[0155] In one specific embodiment Figure 12A schematic diagram of the hardware structure of an electronic device for implementing the control method of the quay crane operation training simulation device provided in the embodiments of the present invention is shown. The electronic device can be a computer terminal, a mobile terminal, or other devices. The electronic device can also participate in or include the anomaly detection device provided in the embodiments of the present invention. Figure 11 As shown, the electronic device 1100 may include a memory 1110 of one or more computer-readable storage media, a processor 1120 of one or more processing cores, an input unit 1130, a display unit 1140, a radio frequency (RF) circuit 1150, a wireless fidelity (WiFi) module 1160, and a power supply 1170, etc. Those skilled in the art will understand that... Figure 12 The electronic device structure shown does not constitute a limitation on electronic device 1100, and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein:
[0156] The memory 1110 can be used to store software programs and modules. The processor 1120 performs various functional applications and data processing by running or executing the software programs and modules stored in the memory 1110 and calling the data stored in the memory 1110. The memory 1110 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, applications required for at least one function, etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 1110 may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, RAM, plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 1110 may also include a memory controller to provide the processor 1120 with access to the memory 1110.
[0157] The processor 1120 is the control center of the electronic device 1100. It connects various parts of the electronic device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 1110, and by calling data stored in the memory 1110, it performs various functions and processes data of the electronic device 1100, thereby providing overall monitoring of the electronic device 1100. The processor 1120 can be a central processing unit, or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.
[0158] The input unit 1130 can be used to receive input numerical or character information, and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. Specifically, the input unit 1130 may include a touch-sensitive surface 1131 and other input devices 1132. Specifically, the touch-sensitive surface 1131 may include, but is not limited to, a touchpad or a touch screen, and other input devices 1132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc.
[0159] The display unit 1140 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of electronic devices. These graphical user interfaces can be composed of graphics, text, icons, videos, and any combination thereof. The display unit 1140 may include a display panel 1141, which may optionally be configured as a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
[0160] The RF circuit 1150 can be used to receive and send signals during information transmission or calls, and the electronic device 1100 provides users with wireless broadband internet access through the WiFi module 1160. Although Figure 12 WiFi module 1160 is shown, but it is understood that it is not a necessary component of electronic device 1100 and can be omitted as needed without changing the nature of the invention.
[0161] The electronic device 1100 also includes a power supply 1170 (such as a battery) to supply power to various components. Preferably, the power supply can be logically connected to the processor 1120 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 1170 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.
[0162] It should be noted that, although not shown, the electronic device 1100 may also include a Bluetooth module, etc., which will not be described in detail here.
[0163] In another aspect, the present invention provides a computer-readable storage medium storing at least one instruction or at least one program, wherein the at least one instruction or at least one program is loaded and executed by a processor to implement the control method of the quay crane operation training simulation device as described above.
[0164] Optionally, in embodiments of the present invention, the storage medium may include, but is not limited to, various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.
[0165] One embodiment of the present invention also provides a computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the control method for the quay crane operation training simulation device provided in the various optional implementations described above.
[0166] It should be noted that the order of the above embodiments of the present invention is merely for descriptive purposes and does not represent the superiority or inferiority of the embodiments. Furthermore, specific embodiments have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims can be performed in a different order than that shown in the embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0167] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the apparatus embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.
[0168] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.
[0169] Based on the various embodiments of this application described above, in the absence of explicit denial or conflict, the technical features of one embodiment may be advantageously combined with one or more other embodiments.
[0170] Unless otherwise defined, the technical or scientific terms used in this invention shall have the ordinary meaning understood by one of ordinary skill in the art to which this invention pertains. The terms "first," "second," and similar terms used in this invention do not indicate any order, quantity, or importance, but are merely used to distinguish different components. Similarly, the terms "an" or "a" and similar terms do not indicate a quantity limitation, but rather indicate the presence of at least one. The terms "connected" or "linked" and similar terms are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up," "down," "left," "right," etc., are used only to indicate relative positional relationships; when the absolute position of the described object changes, the relative positional relationship also changes accordingly.
[0171] The above are preferred embodiments of the present invention. It should be noted that, for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.
Claims
1. A control method for a quay crane operation training simulation device, characterized in that, The quay crane operation training simulation equipment includes a simulation device and a handle. The simulation device is equipped with a display screen, and the handle is electrically connected to the simulation device. The control method includes: The simulation equipment establishes a three-dimensional virtual scene corresponding to the port quay crane operation environment, and sets up a virtual quay crane in the three-dimensional virtual scene. Multiple virtual cameras sharing the three-dimensional virtual scene are set up on the virtual quay crane. The simulation device acquires the operator's operation signal corresponding to the handle, and controls the spreader of the virtual quay crane to perform simulated movement in the three-dimensional virtual scene based on the operation signal; The simulation device acquires the spreader operation information of the virtual quay crane and the field of view adjustment configuration information of the virtual camera, and determines the target field of view parameters of the virtual camera based on the spreader operation information and the field of view adjustment configuration information; The simulation device adjusts the field of view of the virtual camera based on the target field of view parameters, and acquires a virtual working image of the virtual quay bridge based on the adjusted field of view; The simulation device outputs the virtual operation screen to the display screen for presentation to the operator.
2. The control method for the quay crane operation training simulation equipment according to claim 1, characterized in that, Setting up a virtual quay bridge in the three-dimensional virtual scene includes: The simulation device acquires the configuration information of the quay bridge and establishes the virtual quay bridge in the three-dimensional virtual scene based on the configuration information; The simulation device sets up multiple virtual cameras on the virtual quay bridge and configures the multiple virtual cameras in the same scene instance of the three-dimensional virtual scene, so that the multiple virtual cameras share the three-dimensional virtual scene.
3. The control method for the quay crane operation training simulation equipment according to claim 1, characterized in that, The simulation device acquires the operator's operation signal corresponding to the handle, and controls the spreader of the virtual quay crane to perform simulated movement in the three-dimensional virtual scene based on the operation signal, including: The simulation device acquires the operation signal, analyzes the operation signal, and determines the quay crane motion control parameters corresponding to the operation signal. The simulation equipment controls the spreader to move in the three-dimensional virtual scene based on the motion control parameters of the quay crane.
4. The control method for the quay crane operation training simulation equipment according to claim 1, characterized in that, The simulation device acquires the spreader operation information of the virtual quay crane and the field-of-view adjustment configuration information of the virtual camera, and determines the target field-of-view parameters of the virtual camera based on the spreader operation information and the field-of-view adjustment configuration information, including: The simulation device determines the operating height of the spreader based on the spreader's operating information, and determines the normalized height of the spreader based on the field of view adjustment configuration information and the operating height; The simulation device determines the target zoom level of the virtual camera based on the normalized height and the field of view adjustment configuration information; The simulation device determines the target field-of-view parameters of the virtual camera based on the target zoom level.
5. The control method for the quay crane operation training simulation equipment according to claim 4, characterized in that, The simulation device determines the operating height of the spreader based on the spreader's operating information, and determines the normalized height of the spreader based on the field-of-view adjustment configuration information and the operating height, including: The simulation device determines the minimum and maximum working height of the lifting device based on the field of view adjustment configuration information. The simulation device performs amplitude limiting processing on the operating height based on the minimum operating height and the maximum operating height to determine the limited operating height; The simulation device maps the limited operating height to a preset normalized range based on the minimum working height, the maximum working height, and the limited operating height, and determines the normalized height of the lifting device.
6. The control method for the quay crane operation training simulation equipment according to claim 5, characterized in that, The simulation device determines the target zoom level of the virtual camera based on the normalized height and the field-of-view adjustment configuration information, including: The simulation device determines the zoom step size of the virtual camera based on the field of view adjustment configuration information; The simulation device determines the total number of zoom levels of the virtual camera based on the minimum working height, the maximum working height, and the zoom step size; The simulation device maps the normalized height to the corresponding zoom level based on the normalized height and the total number of zoom levels, thereby determining the target zoom level of the virtual camera.
7. The control method for the quay crane operation training simulation equipment according to claim 4, characterized in that, The simulation device determines the target field-of-view parameters of the virtual camera based on the target zoom level, including: The simulation device obtains the previous zoom level corresponding to the virtual camera and compares the target zoom level with the previous zoom level; When the target zoom level is different from the previous zoom level, the simulation device determines the target field of view parameters of the virtual camera based on the hoist operation information and the field of view adjustment configuration information.
8. The control method for the quay crane operation training simulation equipment according to claim 1, characterized in that, The simulation device adjusts the field of view of the virtual camera based on the target field of view parameters, and acquires a virtual operational view of the virtual quay crane based on the adjusted field of view, including: The simulation device acquires the current field-of-view parameters of the virtual camera; The simulation device determines the updated field-of-view parameters of the virtual camera based on the current field-of-view parameters, the target field-of-view parameters, and a preset smoothing coefficient. The simulation device adjusts the field of view of the virtual camera based on the updated field of view parameters, and acquires the virtual operation screen of the virtual quay bridge based on the adjusted field of view.
9. The control method for the quay crane operation training simulation equipment according to claim 1, characterized in that, Also includes: The simulation device determines the correspondence between multiple virtual cameras and multiple display screens based on preset display screen allocation rules; The simulation device acquires the virtual work images captured by each of the virtual cameras, and based on the correspondence, outputs the virtual work images captured by each of the virtual cameras to the corresponding display screens.
10. The control method for the quay crane operation training simulation equipment according to claim 9, characterized in that, Also includes: The simulation device listens to simulation operation events in the three-dimensional virtual scene and determines the current simulation operation status of the three-dimensional virtual scene. The simulation device determines the virtual camera corresponding to the simulation operation state and the display screen corresponding to the virtual camera based on the simulation operation state and preset screen switching rules. The simulation device acquires the virtual work scene captured by the virtual camera and outputs the virtual work scene to the display screen corresponding to the virtual camera.
