Cabin testing method, device and equipment and storage medium

Abstract

The embodiment of the invention relates to a cabin testing method, device and equipment and a storage medium, and the method comprises the steps: responding to a triggering operation of a user on a target seat virtual control, and determining a target seat control instruction related to the target seat virtual control; a seat movement track is determined according to the target seat control instruction, and the seat movement track is sent to a cabin control server, so that the cabin control server controls a physical seat to move according to the seat movement track; in the moving process of the physical seat, first pose information of the virtual seat is obtained, second pose information, sent by the cabin control server, of the physical seat is received, and the pose of the virtual seat is adjusted according to the first pose information and the second pose information so that the pose of the virtual seat can be consistent with the pose of the physical seat. According to the embodiment of the invention, the cost of cabin testing can be reduced.

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to the technical field of cockpit testing, and in particular to a cockpit testing method, device, equipment and storage medium. BACKGROUND

[0002] Cockpit testing is a crucial link in the development process of a vehicle, aiming to ensure that the components in the vehicle cockpit can work normally and provide a good user experience.

[0003] Currently, cockpit testing is usually performed by a test personnel through a cockpit bench (e.g., including a seat, a seat control, a steering wheel, a center console, etc.) to test the cockpit (e.g., to test the seat, etc.). However, the cockpit bench needs to be built and adjusted (e.g., to change the position of the seat control, etc.) each time, which requires a large amount of hardware cost, resulting in high cockpit testing cost. SUMMARY

[0004] To solve the above technical problems or at least partially solve the above technical problems, embodiments of the present disclosure provide a cockpit testing method, device, equipment and storage medium.

[0005] A first aspect of embodiments of the present disclosure provides a cockpit testing method applied to a virtual engine server, wherein the method comprises:

[0006] In response to a triggering operation of a user on a target seat virtual control in a virtual cockpit, determining a target seat control instruction associated with the target seat virtual control;

[0007] Determining a seat motion trajectory according to the target seat control instruction, and sending the seat motion trajectory to the cockpit control server, so that the cockpit control server controls the physical seat to move according to the seat motion trajectory;

[0008] In the process of the physical seat moving, obtaining first pose information of a virtual seat, receiving second pose information of the physical seat sent by the cockpit control server, and adjusting the pose of the virtual seat according to the first pose information and the second pose information, so that the pose of the virtual seat is consistent with the pose of the physical seat.

[0009] A second aspect of embodiments of the present disclosure provides a cockpit testing method applied to a cockpit control server, wherein the method comprises:

[0010] Receiving a seat motion trajectory sent by a virtual engine server; wherein the seat motion trajectory is determined by the virtual engine server in response to a triggering operation of a user on a target seat virtual control in a virtual cockpit, determining a target seat control instruction associated with the target seat virtual control, and determining the seat motion trajectory according to the target seat control instruction.

[0011] The physical seat motion is controlled according to the seat motion track, and in the process of the physical seat motion, second pose information of the physical seat is acquired and sent to the virtual engine server, so that the virtual engine server adjusts the pose of the virtual seat according to the second pose information and first pose information of the virtual seat acquired in the process of the physical seat motion, to make the pose of the virtual seat consistent with the pose of the physical seat.

[0012] A third aspect of the embodiments of the present disclosure provides a cockpit test device applied to a virtual engine server, and the device comprises:

[0013] A first determination module is configured to determine a target seat control instruction associated with a target seat virtual control in a virtual cockpit in response to a triggering operation of the target seat virtual control by a user;

[0014] A first sending module is configured to determine a seat motion track according to the target seat control instruction, and send the seat motion track to a cockpit control server, so that the cockpit control server controls physical seat motion according to the seat motion track;

[0015] A first adjustment module is configured to acquire first pose information of a virtual seat in the process of the physical seat motion, receive second pose information of the physical seat sent by the cockpit control server, and adjust the pose of the virtual seat according to the first pose information and the second pose information, so that the pose of the virtual seat is consistent with the pose of the physical seat.

[0016] A fourth aspect of the embodiments of the present disclosure provides a cockpit test device applied to a cockpit control server, and the device comprises:

[0017] A first receiving module is configured to receive a seat motion track sent by a virtual engine server, wherein the seat motion track is determined by the virtual engine server in response to a triggering operation of a target seat virtual control in a virtual cockpit by a user, the target seat virtual control is associated with a target seat control instruction, and the seat motion track is determined according to the target seat control instruction;

[0018] A second sending module is configured to control physical seat motion according to the seat motion track, and in the process of the physical seat motion, second pose information of the physical seat is acquired and sent to the virtual engine server, so that the virtual engine server adjusts the pose of the virtual seat according to the second pose information and first pose information of the virtual seat acquired in the process of the physical seat motion, to make the pose of the virtual seat consistent with the pose of the physical seat.

[0019] A fifth aspect of this disclosure provides an electronic device comprising: a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the method of the first aspect or the method of the second aspect described above.

[0020] A sixth aspect of this disclosure provides a computer-readable storage medium storing a computer program that, when executed by a processor, can implement the method of the first aspect or the method of the second aspect described above.

[0021] The technical solution provided in this disclosure has the following advantages compared with the prior art:

[0022] This embodiment of the disclosure is capable of responding to a user's trigger operation on a target seat virtual control, determining the target seat control command associated with the target seat virtual control; determining the seat motion trajectory based on the target seat control command, and sending the seat motion trajectory to the cockpit control server, so that the cockpit control server controls the movement of the physical seat according to the seat motion trajectory; during the movement of the physical seat, acquiring the first pose information of the virtual seat, receiving the second pose information of the physical seat sent by the cockpit control server, and adjusting the pose of the virtual seat according to the first pose information and the second pose information, so that the pose of the virtual seat is consistent with the pose of the physical seat. It can be seen that by adopting the above technical solution, the movement of the physical seat can be controlled by the seat virtual control in the virtual cockpit, and during the movement of the physical seat, the pose of the virtual seat can remain synchronized with the pose of the physical seat, thereby realizing seat testing in a virtual environment. Thus, there is no need to build a complete cockpit test bench, saving raw material and processing costs. Furthermore, the adjustment of the seat virtual control does not require repeated disassembly and debugging like the physical seat control, reducing raw material and labor costs. Therefore, the cost of cockpit testing can be reduced according to this embodiment of the disclosure. Attached Figure Description

[0023] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0024] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without creative effort.

[0025] Figure 1 This is a flowchart of a cockpit testing method provided in an embodiment of this disclosure;

[0026] Figure 2 This is a logical diagram illustrating a connection test between a virtual engine server and a cockpit control server provided in an embodiment of this disclosure;

[0027] Figure 3 This is a logical schematic diagram of pose synchronization provided in an embodiment of this disclosure;

[0028] Figure 4 This is a schematic diagram illustrating the obstacle avoidance logic of a seat during movement, provided in an embodiment of this disclosure.

[0029] Figure 5 This is a logical schematic diagram of a cockpit entity control associated with a cockpit entity control projected in a virtual environment, provided by an embodiment of this disclosure;

[0030] Figure 6 This is a flowchart of a cockpit testing method provided in an embodiment of this disclosure;

[0031] Figure 7 This is a logical schematic diagram of an update communication system provided in an embodiment of this disclosure;

[0032] Figure 8 This is a schematic diagram of the structure of a cockpit testing device provided in an embodiment of this disclosure;

[0033] Figure 9 This is a schematic diagram of the structure of a cockpit testing device provided in an embodiment of this disclosure;

[0034] Figure 10 This is a schematic diagram of the structure of an electronic device according to an embodiment of this disclosure. Detailed Implementation

[0035] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0036] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0037] Figure 1 This is a flowchart illustrating a cockpit testing method provided in an embodiment of this disclosure. This method can be executed by a virtual engine server. The virtual engine server can be executively integrated into virtual reality devices such as glasses and helmets. Figure 1 As shown, the method provided in this embodiment includes the following steps:

[0038] S110, In response to the user's triggering operation on the target seat virtual control in the virtual cockpit, determine the target seat control command associated with the target seat virtual control.

[0039] In this embodiment, when a user sits in a physical seat and wears the virtual reality device, the user can see themselves sitting in a virtual cockpit. The virtual cockpit includes multiple virtual cockpit controls, which are interactive controls created in the virtual environment. These controls can simulate physical controls in the real environment (i.e., controls that the user can actually touch and press) and interact with the user. It should be noted that the specific forms of the virtual cockpit controls can include buttons, switches, sliders, etc., but are not limited to these. Furthermore, the user can adjust the virtual cockpit controls during cockpit testing, such as adjusting their specific forms, positions within the virtual cockpit, and adding or deleting them. Among these multiple virtual cockpit controls is at least one seat virtual control, which controls the movement of the physical and virtual seats. For example, a slider next to the virtual seat can be used to adjust the height of both the physical and virtual seats. If a user triggers a seat virtual control (i.e., the target seat virtual control), in response to the user's trigger operation, the virtual engine server can determine the target seat control command associated with the target seat virtual control.

[0040] In some embodiments, the virtual engine server's storage space may pre-record the seat control instructions (i.e., instructions related to physical seat control) associated with each seat virtual control. Thus, the virtual engine server can query the seat control instructions (i.e., target seat control instructions) associated with the target seat virtual control from this storage space. Of course, in other embodiments, the virtual engine server may request the target seat control instructions associated with the target seat virtual control from a cloud server. However, it is not limited to these embodiments.

[0041] S120. Determine the seat movement trajectory according to the target seat control command, and send the seat movement trajectory to the cockpit control server so that the cockpit control server controls the physical seat movement according to the seat movement trajectory.

[0042] In this embodiment, the virtual engine server can generate a seat motion trajectory corresponding to the target seat control command and send the seat motion trajectory to the cockpit control server. The seat motion trajectory describes the movement path of the virtual seat executing the target seat control command within the virtual cockpit; that is, the seat motion trajectory is a motion trajectory in the virtual environment coordinate system. Thus, the cockpit control server can convert the seat motion trajectory to the real environment coordinate system and then control the movement of the physical seat in the real environment based on the converted seat motion trajectory.

[0043] In some embodiments, determining the seat motion trajectory based on the target seat control command includes:

[0044] The target pose information of the virtual seat is determined based on the target seat control command, and then the seat motion trajectory is simulated and generated based on the current pose information and the target pose information of the virtual seat. Of course, in some other embodiments, machine learning can also be used to generate the seat motion trajectory. This disclosure does not limit this.

[0045] Optionally, before sending the seat motion trajectory to the cockpit control server, the virtual engine server and the cockpit control server can perform a connection test. After the connection test is passed, the seat motion trajectory can then be sent to the cockpit control server. This can improve the success rate of data transmission between the virtual engine server and the cockpit control server.

[0046] For example, Figure 2 This is a logical diagram illustrating a connection test between a virtual engine server and a cockpit control server provided in an embodiment of this disclosure. Figure 2 As shown, the cockpit control server starts a TCP client to wait for a connection, while the virtual engine server starts a TCP client to initiate a connection request. Both parties establish a TCP connection and begin exchanging data for verification. The receiving end verifies the data; if the verification is successful, the connection is considered successful; otherwise, the virtual engine server re-initiates the connection request. This establishes a TCP communication connection between the cockpit control server and the virtual engine server, using a data exchange and verification mechanism to confirm normal communication. If verification fails, a new connection request is initiated, ensuring the stability and reliability of the communication.

[0047] S130. During the movement of the physical seat, the first pose information of the virtual seat is obtained, the second pose information of the physical seat is received from the cockpit control server, and the pose of the virtual seat is adjusted according to the first pose information and the second pose information so that the pose of the virtual seat is consistent with the pose of the physical seat.

[0048] In this embodiment of the disclosure, as described above, the cockpit control server can control the movement of the physical seat according to the seat's motion trajectory. During the movement of the physical seat, the virtual engine server can acquire the first pose information of the virtual seat in real time, and the cockpit control server can acquire the second pose information of the physical seat in real time. Furthermore, the virtual engine server can adjust the pose of the virtual seat in real time based on the first and second pose information to ensure that the pose of the virtual seat is consistent with the pose of the physical seat. This ensures that the pose of the virtual seat seen by the user in the virtual environment is consistent with the position and movement of the physical seat they are riding in in the real environment.

[0049] Specifically, the first pose information refers to the pose information of the virtual seat in the coordinate system of the virtual environment; the second pose information refers to the pose information of the physical seat in the coordinate system of the real environment, where the pose information includes position information and attitude information.

[0050] Specifically, the pose of the virtual seat can be adjusted using spatial pose coupling algorithms (such as ICP algorithm, quaternion matching, etc.) to make the pose of the virtual seat consistent with that of the physical seat, but it is not limited to this.

[0051] For example, Figure 3 This is a logical schematic diagram of pose synchronization provided in an embodiment of this disclosure. For example... Figure 3 As shown, a real-time data link is established between the cockpit control server and the virtual engine server via the TCP / IP protocol. The second pose information of the physical seat is projected into the virtual scene after quaternion compression. The virtual seat control commands drive the physical seat to move in real time through inverse kinematics calculation. During the movement of the physical seat, the offset between the coordinate system of the virtual environment and the coordinate system of the real environment is dynamically calibrated through a spatial pose coupling algorithm to ensure that the movement of the physical seat and the projection trajectory of the virtual seat overlap in the entire time domain, thereby realizing WYSIWYG control with virtual and real linkage.

[0052] Optionally, the method further includes: during the movement of the physical seat, detecting whether the virtual seat will collide with the virtual object to be detected in the virtual cockpit based on the first posture information;

[0053] If a collision occurs, the seat motion trajectory is corrected for obstacle avoidance to obtain the corrected seat motion trajectory, and then sent to the cockpit control server so that the cockpit control server can adjust the movement of the physical seat according to the corrected seat motion trajectory.

[0054] In this embodiment of the disclosure, as described above, the cockpit control server can control the movement of the physical seat according to the seat movement trajectory. During the movement of the physical seat, the virtual engine server can obtain the first pose information of the virtual seat in real time, and detect whether the virtual seat will collide with the virtual object to be detected in the virtual cockpit in real time based on the first pose information. If a collision occurs, the seat movement trajectory is corrected for obstacle avoidance in real time to obtain the corrected seat movement trajectory. Then, the cockpit control server can control the movement of the physical seat in real time according to the corrected seat movement trajectory.

[0055] Specifically, the virtual cockpit includes at least one virtual cockpit control, multiple virtual cockpit components, and at least one virtual passenger. Virtual cockpit components refer to virtual models of various physical cockpit components (such as the steering wheel and center console) within the actual vehicle cockpit, while virtual passengers refer to virtual models used in the virtual environment to replace real passengers (such as the front passenger or rear passenger). The virtual object to be detected refers to the virtual cockpit component and / or virtual passenger that undergoes collision detection with the virtual seat.

[0056] In some embodiments, the virtual object to be detected is an active object. In this case, detecting whether the virtual seat will collide with the virtual object to be detected in the virtual cockpit based on the first pose information includes: generating at least one predicted motion trajectory of the virtual object to be detected.

[0057] For each predicted motion trajectory, based on the first pose information and the predicted motion trajectory, it is determined whether a collision will occur between the virtual seat and the virtual object to be detected.

[0058] Specifically, if the virtual object to be detected is an active object, then the virtual object to be detected has autonomous behavior or can be controlled externally to change its state.

[0059] Specifically, for virtual objects to be detected whose state can be changed by external control, their motion patterns are deterministic. Therefore, motion models (such as uniform velocity models, uniform acceleration models, and turning motion models) can be invoked to generate predicted motion trajectories (i.e., multiple trajectory points over a future period) for the virtual objects to be detected. For virtual objects to be detected with autonomous behavior, their motion patterns are indeterminate. Multiple possible predicted motion trajectories can be generated using Monte Carlo methods for random sampling, Gaussian process regression, etc., but these methods are not limited to these.

[0060] Specifically, during the movement of the physical seat, the first pose information of the virtual seat is acquired in real time, and the third pose information of the virtual object to be detected is determined in real time based on the predicted motion trajectory. Then, geometric methods are used in real time to determine whether there is overlap between the virtual seat and the virtual object to be detected based on the first pose information and the third pose information. If there is overlap, a collision will occur; otherwise, no collision will occur. But it is not limited to this.

[0061] In other embodiments, the virtual object to be detected is a static object. In this case, during the movement of the physical seat, the first pose information of the virtual seat is acquired in real time, and geometric methods are used in real time to determine whether the virtual seat and the virtual object to be detected overlap based on the first pose information and the pose information of the virtual object to be detected. If there is overlap, a collision will occur; otherwise, no collision will occur. However, this is not the only possible approach.

[0062] Of course, collision detection can also be performed by dynamically constructing a collision model based on millimeter-wave radar and joint encoder data to detect the probability of collisions around the seat. For example, Figure 4 This is a logical schematic diagram illustrating obstacle avoidance during the movement of a seat, as provided in an embodiment of this disclosure. Figure 4 As shown, a collision model can be used to detect collisions between the virtual seat and the virtual object to be tested. An adaptive trajectory planning engine is used to avoid mechanical interference and human intrusion risks in real time during movement. When a collision risk is detected, a smooth detour path (e.g., minimum safe distance ≥10cm) is intelligently generated to correct the seat's movement trajectory. This eliminates the traditional emergency stop-reset-retest process, reducing interruptions and improving the efficiency of seat adjustment testing. Furthermore, the obstacle avoidance process (i.e., detailed information on seat movement trajectory correction) can be recorded for subsequent analysis and optimization of the cockpit layout.

[0063] In this embodiment, the movement of a physical seat can be controlled by virtual seat controls within a virtual cockpit. During the movement of the physical seat, the virtual seat's posture can remain synchronized with the physical seat's posture, thus enabling seat testing in a virtual environment. This eliminates the need to build a complete cockpit test bench, saving on raw materials and processing costs. Furthermore, the adjustment of the virtual seat controls does not require repeated disassembly and debugging like physical seat controls, further reducing raw material and labor costs. Therefore, this embodiment reduces the cost of cockpit testing.

[0064] In another embodiment of this disclosure, the method further includes: receiving a target touch event sent by a cockpit control server, wherein the target touch event is generated by the cockpit control server in response to a user's triggering operation on a target cockpit physical control;

[0065] Based on the target touch event, the target cockpit virtual control associated with the target cockpit physical control is lit up, and the target cockpit control command associated with the target cockpit virtual control is determined. The positional relationship between the target cockpit physical control and the physical seat is the same as the positional relationship between the target cockpit virtual control and the virtual seat.

[0066] Control the target virtual cockpit components to execute target cockpit control commands.

[0067] In this embodiment of the disclosure, as described above, the virtual cockpit includes multiple virtual cockpit controls. Some of these virtual cockpit controls have associated physical cockpit controls (e.g., positioned around physical seats). In other words, for each physical cockpit control, a virtual cockpit control associated with it is set in the virtual environment. For the interconnected physical cockpit controls and virtual cockpit controls, the "positional relationship between the physical cockpit control and the physical seat" and the "positional relationship between the virtual cockpit control and the virtual seat" are the same; that is, the virtual cockpit control is a virtual projection of its associated physical cockpit control.

[0068] In this embodiment of the disclosure, if a user triggers a cockpit entity control (i.e., the target cockpit entity control), in response to the user's triggering operation on the target cockpit entity control, the cockpit control server can generate a target touch event for the target cockpit entity control and send the target touch event to the virtual engine server.

[0069] In some embodiments, the virtual engine server may pre-store the association relationship between cockpit physical controls and cockpit virtual controls (denoted as the first association relationship). Upon receiving a target touch event, the virtual engine server can use the first association relationship to find the cockpit virtual control associated with the target cockpit physical control (i.e., the target cockpit virtual control), and then activate the target cockpit virtual control. The user sees the target cockpit virtual control activated in the virtual environment, confirming that the triggering operation was successful. However, this is not the only possible approach.

[0070] In some embodiments, the virtual engine server may also pre-store cockpit virtual controls, cockpit control instructions (instructions related to the control of virtual cockpit components), and associations between virtual cockpit components (denoted as second associations). Thus, the virtual engine server can use the second associations to find the cockpit control instructions (i.e., target cockpit control instructions) associated with the target cockpit virtual control and the virtual cockpit component (i.e., target virtual cockpit component), and then control the target virtual cockpit component to execute the target cockpit control instructions. However, this is not the only possible approach.

[0071] Understandably, by configuring the system so that pressing a physical cockpit control triggers the corresponding virtual cockpit component to execute a cockpit control command, users can verify the rationality of the cockpit physical control layout without needing to build the corresponding physical cockpit components. This reduces costs and improves cockpit testing efficiency. Furthermore, if users find the cockpit control commands and virtual cockpit components associated with the physical cockpit controls to be unreasonable, they can quickly replace them, allowing for a new round of verification and further improving cockpit testing efficiency.

[0072] In some embodiments, the process of associating cockpit virtual controls with cockpit control commands includes: for cockpit virtual controls, in response to a user-triggered command selection operation, determining the cockpit control command selected by the user from a pre-built control command library, and associating the user-selected cockpit control command with the cockpit virtual controls.

[0073] In this embodiment of the disclosure, a control command library can be pre-built. The control command library includes multiple cockpit control commands and code that implements their control functions, which are used to drive the corresponding virtual cockpit components to complete specified operations.

[0074] Specifically, the command selection operation can be any operation that allows selecting cockpit control commands from the control command library. For example, the command selection operation includes dragging and dropping cockpit control commands from the control command library using a mouse or touch screen, but is not limited to this.

[0075] Understandably, by setting up cockpit control commands associated with cockpit virtual controls selected from the control command library, the cockpit virtual controls are bound to the code implementing the control functions of those commands. Users do not need to write code on-site, thus improving cockpit testing efficiency. Furthermore, when modifying the control functions bound to the cockpit virtual controls, users can simply reselect the cockpit control commands from the control command library, allowing for quick changes to the bound control functions and facilitating a rapid transition to a new round of testing, further enhancing cockpit testing efficiency.

[0076] In some embodiments, the number of cockpit control commands associated with the cockpit virtual control is one.

[0077] In other embodiments, the number of cockpit control commands associated with the cockpit virtual controls is multiple, wherein associating user-selected cockpit control commands with the cockpit virtual controls includes:

[0078] Combine multiple cockpit control commands selected by the user into a cockpit control command sequence;

[0079] Associate cockpit control command sequences with cockpit virtual controls.

[0080] In one example, combining multiple cockpit control commands selected by the user into a cockpit control command sequence includes: sorting the multiple cockpit control commands selected by the user in the order they were selected to obtain the cockpit control command sequence.

[0081] In another example, multiple cockpit control commands selected by the user are combined into a cockpit control command sequence, including: in response to a sorting operation triggered by the user, sorting the multiple cockpit control commands selected by the user to obtain a cockpit control command sequence.

[0082] It should be noted that, for the cockpit virtual control associated with the cockpit control command sequence, the number of cockpit virtual components associated with the cockpit virtual control can be one or more, and this disclosure does not limit this.

[0083] Specifically, if a user triggers a "cockpit virtual control associated with a cockpit control command sequence", the virtual engine server can control the corresponding cockpit virtual component to execute the cockpit control command sequence.

[0084] Understandably, by associating cockpit control command sequences with cockpit virtual controls, composite test scenarios can be quickly constructed, such as turning the steering wheel while simultaneously activating the windshield wipers. This allows for more complex cockpit testing. Furthermore, compared to traditional discrete testing methods, such as first triggering the cockpit physical control corresponding to steering wheel rotation to complete the steering wheel rotation, and then triggering the cockpit physical control corresponding to activating the windshield wipers, the composite test scenarios provided in this disclosure can seamlessly connect multiple tests, improving cockpit testing efficiency.

[0085] For example, Figure 5 This is a logical schematic diagram illustrating the projection of cockpit entity controls associated with cockpit entity controls in a virtual environment, as provided in an embodiment of this disclosure. Figure 5 As shown, a drag-and-drop signal logic editor is used to freely bind the control functions corresponding to the cockpit physical controls and the cockpit virtual controls, and then project the cockpit physical controls onto the virtual environment to obtain the cockpit virtual controls. Specifically, the camera system captures the pose information of the cockpit physical controls and sends this information to the virtual engine server through the cockpit control server. The virtual engine server places the cockpit virtual controls associated with the cockpit physical controls in the same position as the cockpit physical controls, achieving millimeter-level alignment (e.g., positional error ≤ 2cm) between the cockpit physical controls and the virtual projection (i.e., the associated cockpit virtual controls). Thus, when the user triggers the cockpit physical controls, the corresponding virtual cockpit components are driven to execute the corresponding cockpit control commands. For example, after determining the layout of the virtual seat controls is reasonable through steps S110-S130, physical seat controls (belonging to the cockpit physical controls) can be set. Then, if a user triggers a physical seat control, the cockpit control server controls the movement of the physical seat, while the virtual engine server controls the movement of the virtual seat, realizing the linkage control between the physical and virtual seats. Furthermore, during the movement of the physical and virtual seats, the position and posture information of the physical and virtual seats can be collected in real time, and the positions and postures of the two can be compared to verify whether the movement of the physical seat meets the expected design.

[0086] Figure 6This is a flowchart illustrating a cockpit testing method provided in an embodiment of this disclosure. This method can be executed by a cockpit control server. The cockpit control server can be exemplarily understood as a host computer or similar device. Figure 6 As shown, the method provided in this embodiment includes the following steps:

[0087] S610, Receive the seat motion trajectory sent by the virtual engine server; wherein, the seat motion trajectory is determined by the virtual engine server in response to the user's trigger operation on the target seat virtual control in the virtual cockpit, determining the target seat control command associated with the target seat virtual control, and determining it according to the target seat control command.

[0088] For a detailed understanding of S610, please refer to S110 and S120, which will not be repeated here.

[0089] S620. Control the movement of the physical seat according to the seat movement trajectory. During the movement of the physical seat, obtain the second pose information of the physical seat and send the second pose information to the virtual engine server so that the virtual engine server adjusts the pose of the virtual seat according to the second pose information and the first pose information of the virtual seat obtained during the movement of the physical seat so that the pose of the virtual seat is consistent with the pose of the physical seat.

[0090] For a detailed understanding of S610, please refer to S130; this disclosure will not elaborate further.

[0091] In this embodiment, the movement of a physical seat can be controlled by virtual seat controls within a virtual cockpit. During the movement of the physical seat, the virtual seat's posture can remain synchronized with the physical seat's posture, thus enabling seat testing in a virtual environment. This eliminates the need to build a complete cockpit rig, saving on raw materials and processing costs. Furthermore, the adjustment of the virtual seat controls does not require repeated disassembly and debugging like physical seat controls, further reducing raw material and labor costs. Therefore, this embodiment reduces the cost of seat testing.

[0092] In another embodiment of this disclosure, the method further includes: generating a target touch event in response to a user's triggering operation on a target cockpit physical control, and sending the target touch event to a virtual engine server.

[0093] In this way, after receiving a target touch event, the virtual engine server can light up the target cockpit virtual control associated with the target cockpit physical control, determine the target cockpit control command associated with the target cockpit virtual control, and control the target virtual cockpit component to execute the target cockpit control command. The relevant positional relationship between the target cockpit physical control and the physical seat is the same as the relevant positional relationship between the target cockpit virtual control and the virtual seat.

[0094] For a detailed explanation of this implementation method, please refer to the preceding text; it will not be repeated here.

[0095] In another embodiment of this disclosure, the method further includes: when the communication matrix is ​​updated, using a pre-trained update model to compare the new version of the communication matrix with the old version of the communication matrix, obtaining a comparison result, and updating the communication system based on the comparison result.

[0096] The communication matrix describes the communication protocol between the cockpit control server and external devices, including a pose acquisition system. The communication system supports multiple communication protocols and records the attributes of the communication signals between the cockpit control server and external devices.

[0097] Specifically, the communication matrix may include, but is not limited to, DBC, LDF and / or FIBEX files.

[0098] Specifically, external devices refer to those that communicate with the cockpit control server. External devices include pose acquisition systems, which are used to acquire the pose of the physical seats. Of course, external devices can also include virtual engine servers.

[0099] Specifically, the communication system may include, but is not limited to, the CANoe platform.

[0100] Specifically, the updated model can understand the attributes of each communication signal in the communication matrix (e.g., a communication signal represents the seat's movement speed, its unit, threshold, and other information). Furthermore, the updated model can compare the new version of the communication matrix with the old version, obtaining comparison results such as which communication signals have been added, which have been modified (e.g., changes in data type or value range), and / or which have been deleted.

[0101] Specifically, the updated model can automatically complete signal registration, bit definition reconstruction, and data type migration based on the comparison results to update the communication system. For example, it can add newly emerging communication signals to the communication system; if the position or length of a communication signal changes, its position and format in the communication frame can be redefined; if the data type changes (e.g., from integers to floating-point numbers), the updated model will also automatically adjust its processing method. But it is not limited to these.

[0102] Optionally, the method further includes: when a change in the value range of a communication signal is detected, using an update model, calculating a value range change factor based on the changed value range and the value range before the change, and storing the value range change factor in the communication system.

[0103] Specifically, after an OTA upgrade, the behavior of some communication signals may change (for example, the value range may change). The updated model observes the signal output over a period of time to understand its normal range of variation (i.e., the changed value range), and then dynamically recalculates the scaling factor and offset. This ensures that even if the signal changes, the values ​​read by the communication system remain accurate and reliable. For example, if the value range of a certain communication signal is found to change from 0 to 100 to 0 to 120, the updated model will automatically adjust its conversion formula (for example, if it was originally value = x * 1, it now becomes value = x * 1.2).

[0104] For example, Figure 7 This is a logical schematic diagram of an update communication system provided in an embodiment of this disclosure. For example... Figure 7 As shown, an AI-driven multi-protocol cognitive engine is integrated into the cockpit control server. While maintaining compatibility with the CANoe platform architecture, it integrates DBC intelligent adaptation and baseline dynamic synchronization technology. When the communication matrix (DBC / LDF / FIBEX) version is updated, the AI ​​automatically completes signal registration, bit definition reconstruction, and data type migration by comparing the semantic parsing with the old version. In the face of signal baseline drift caused by OTA (such as changes in value range scaling), it learns signal behavior patterns in real time and dynamically recalculates scaling factors / offsets. While maintaining low error in the original signal parsing, it achieves zero-intervention adaptive management of multi-bus communication protocols, solving the problems of low efficiency in manual configuration and version iteration mismatch in traditional solutions.

[0105] It is understandable that, for cockpit testing, the cockpit control server may communicate with different external devices through different protocols. Traditional multi-protocol parsing relies on discrete devices, resulting in serious redundancy, and manual protocol migration is inefficient. This disclosure achieves intelligent adaptation of the communication matrix and dynamic baseline calibration through an AI multi-protocol cognitive engine, thereby automating the entire protocol migration process, reducing device redundancy and manual intervention, and thus improving cockpit testing efficiency.

[0106] Figure 8 This is a schematic diagram of a cockpit testing device provided in an embodiment of this disclosure. This cockpit testing device can be understood as the aforementioned virtual engine server or a functional module within the aforementioned virtual engine server. Figure 8 As shown, the cockpit testing device includes:

[0107] The first determining module 810 is used to determine the target seat control command associated with the target seat virtual control in response to the user's trigger operation on the target seat virtual control in the virtual cockpit;

[0108] The first sending module 820 is used to determine the seat movement trajectory according to the target seat control command, and send the seat movement trajectory to the cockpit control server, so that the cockpit control server controls the physical seat movement according to the seat movement trajectory;

[0109] The first adjustment module 830 is used to acquire the first pose information of the virtual seat during the movement of the physical seat, receive the second pose information of the physical seat sent by the cockpit control server, and adjust the pose of the virtual seat according to the first pose information and the second pose information so that the pose of the virtual seat is consistent with the pose of the physical seat.

[0110] Optionally, the device further includes: a first collision detection device, used to detect whether the virtual seat will collide with the virtual object to be detected in the virtual cockpit based on the first pose information during the movement of the physical seat;

[0111] The first correction device is used to perform obstacle avoidance correction on the seat movement trajectory if a collision occurs, and to send the corrected seat movement trajectory to the cockpit control server so that the cockpit control server can adjust the movement of the physical seat according to the corrected seat movement trajectory.

[0112] Optionally, the first collision detection device is specifically used to generate at least one predicted motion trajectory of the virtual object to be detected if the virtual object to be detected is an active object during the movement of the physical seat.

[0113] For each of the predicted motion trajectories, based on the first pose information and the predicted motion trajectory, it is detected whether the virtual seat and the virtual object to be detected will collide.

[0114] Optionally, the device further includes: a second receiving module, configured to receive a target touch event sent by the cockpit control server, wherein the target touch event is generated by the cockpit control server in response to a user's triggering operation on a target cockpit physical control;

[0115] The second determining module is used to light up the target cockpit virtual control associated with the target cockpit physical control according to the target touch event, and determine the target cockpit control command associated with the target cockpit virtual control, wherein the relevant positional relationship between the target cockpit physical control and the physical seat is the same as the relevant positional relationship between the target cockpit virtual control and the virtual seat;

[0116] The first control module is used to control the target virtual cockpit components to execute the target cockpit control commands.

[0117] Optionally, the device further includes a first association module for associating cockpit virtual controls with cockpit control commands, wherein the first association module includes: a first selection submodule for determining, in response to a user-triggered command selection operation, the cockpit control command selected by the user from a pre-built control command library for the cockpit virtual controls;

[0118] The first association submodule is used to associate the cockpit control command selected by the user with the cockpit virtual control if the number of cockpit control commands selected by the user is one.

[0119] If the user selects multiple cockpit control commands, the cockpit control commands selected by the user are sorted according to the order in which they were selected to obtain a cockpit control command sequence.

[0120] Associate the cockpit control command sequence with the cockpit virtual controls.

[0121] The apparatus provided in this embodiment can execute the methods of any of the above embodiments, and its execution method and beneficial effects are similar, so they will not be described again here.

[0122] Figure 9 This is a schematic diagram of a cockpit testing device provided in an embodiment of this disclosure. This cockpit testing device can be understood as the aforementioned cockpit control server or a portion of the functional modules within the aforementioned cockpit control server. For example... Figure 9 As shown, the cockpit testing device includes:

[0123] The first receiving module 910 is used to receive the seat motion trajectory sent by the virtual engine server. The seat motion trajectory is determined by the virtual engine server in response to the user's trigger operation on the target seat virtual control in the virtual cockpit, determining the target seat control command associated with the target seat virtual control, and determining the target seat control command based on the target seat control command.

[0124] The second sending module 920 is used to control the movement of the physical seat according to the seat movement trajectory, and during the movement of the physical seat, to acquire the second pose information of the physical seat and send the second pose information to the virtual engine server, so that the virtual engine server adjusts the pose of the virtual seat according to the second pose information and the first pose information of the virtual seat acquired during the movement of the physical seat, so that the pose of the virtual seat is consistent with the pose of the physical seat.

[0125] Optionally, the device further includes: a first update module, used to compare the new version of the communication matrix with the old version of the communication matrix using a pre-trained update model when the communication matrix is ​​updated, obtain a comparison result, and update the communication system based on the comparison result.

[0126] Optionally, the device further includes: a first storage module, used to calculate a range change factor based on the changed range and the original range when a change in the range of the communication signal is detected, using the update model, and storing the range change factor in the communication system.

[0127] The apparatus provided in this embodiment can execute the methods of any of the above embodiments, and its execution method and beneficial effects are similar, so they will not be described again here.

[0128] This disclosure also provides an electronic device, which includes: a memory storing a computer program; and a processor for executing the computer program, wherein when the computer program is executed by the processor, it can implement the methods of any of the above embodiments.

[0129] Example, Figure 10 This is a schematic diagram of the structure of an electronic device according to an embodiment of this disclosure. See below for details. Figure 10 The diagram illustrates a structural schematic suitable for implementing the electronic device 1000 in the embodiments of this disclosure. The electronic device 1000 in the embodiments of this disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 10 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0130] like Figure 10 As shown, the electronic device 1000 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. The RAM 1003 also stores various programs and data required for the operation of the electronic device 1000. The processing unit 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0131] Typically, the following devices can be connected to the I / O interface 1005: input devices 1006 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1007 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1008 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows electronic device 1000 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 10 An electronic device 1000 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0132] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1009, or installed from storage device 1008, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.

[0133] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0134] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0135] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0136] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the method described in any of the above embodiments.

[0137] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including but not limited to object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0138] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0139] The units described in the embodiments of this disclosure can be implemented in software or hardware. The names of the units are not, in some cases, intended to limit the specific unit.

[0140] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0141] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0142] This disclosure also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it can implement the methods of any of the above embodiments. The execution method and beneficial effects are similar, and will not be described again here.

[0143] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0144] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A cockpit testing method, characterized in that, Applied to a virtual engine server, the method includes: In response to a user's triggering operation on a target seat virtual control in a virtual cockpit, the target seat control command associated with the target seat virtual control is determined; The seat movement trajectory is determined according to the target seat control command, and the seat movement trajectory is sent to the cockpit control server so that the cockpit control server controls the movement of the physical seat according to the seat movement trajectory; During the movement of the physical seat, the first pose information of the virtual seat is acquired, and the second pose information of the physical seat sent by the cockpit control server is received. The pose of the virtual seat is adjusted according to the first pose information and the second pose information so that the pose of the virtual seat is consistent with the pose of the physical seat.

2. The method according to claim 1, characterized in that, Also includes: During the movement of the physical seat, it is detected whether the virtual seat will collide with the virtual object to be detected in the virtual cockpit based on the first pose information; If a collision occurs, the seat motion trajectory is corrected for obstacle avoidance to obtain a corrected seat motion trajectory, and the corrected seat motion trajectory is sent to the cockpit control server so that the cockpit control server can adjust the movement of the physical seat according to the corrected seat motion trajectory.

3. The method according to claim 2, characterized in that, The step of detecting whether the virtual seat will collide with the virtual object to be detected in the virtual cockpit based on the first pose information includes: If the virtual object to be detected is an active object, generate at least one predicted motion trajectory of the virtual object to be detected; For each of the predicted motion trajectories, based on the first pose information and the predicted motion trajectory, it is detected whether the virtual seat and the virtual object to be detected will collide.

4. The method according to claim 1, characterized in that, Also includes: Receive target touch events sent by the cockpit control server, wherein the target touch events are generated by the cockpit control server in response to the user's trigger operation on the target cockpit physical control; Based on the target touch event, the target cockpit virtual control associated with the target cockpit physical control is lit up, and the target cockpit control command associated with the target cockpit virtual control is determined, wherein the relevant positional relationship between the target cockpit physical control and the physical seat is the same as the relevant positional relationship between the target cockpit virtual control and the virtual seat; The target virtual cockpit component is controlled to execute the target cockpit control commands.

5. The method according to claim 4, characterized in that, The process of associating cockpit virtual controls with cockpit control commands includes: For the aforementioned cockpit virtual controls, in response to a user-triggered instruction selection operation, the cockpit control instruction selected by the user is determined from a pre-built control instruction library; If the user selects only one cockpit control command, associate the selected cockpit control command with the cockpit virtual control. If the user selects multiple cockpit control commands, the cockpit control commands selected by the user are sorted according to the order in which they were selected to obtain a cockpit control command sequence. Associate the cockpit control command sequence with the cockpit virtual controls.

6. A cockpit testing method, characterized in that, Applied to a cockpit control server, the method includes: Receive the seat motion trajectory sent by the virtual engine server; wherein, the seat motion trajectory is determined by the virtual engine server in response to the user's trigger operation on the target seat virtual control in the virtual cockpit, determining the target seat control command associated with the target seat virtual control, and determining it according to the target seat control command; The movement of the physical seat is controlled according to the motion trajectory of the seat. During the movement of the physical seat, the second pose information of the physical seat is acquired and sent to the virtual engine server. The virtual engine server adjusts the pose of the virtual seat according to the second pose information and the first pose information of the virtual seat acquired during the movement of the physical seat, so that the pose of the virtual seat is consistent with the pose of the physical seat.

7. The method according to claim 6, characterized in that, Also includes: When the communication matrix is ​​updated, a pre-trained update model is used to compare the new version of the communication matrix with the old version of the communication matrix, obtain the comparison result, and update the communication system based on the comparison result.

8. The method according to claim 7, characterized in that, Also includes: When a change in the value range of the communication signal is detected, the updated model is used to calculate the value range change factor based on the changed value range and the value range before the change, and the value range change factor is stored in the communication system.

9. A cockpit testing device, characterized in that, Applied to a virtual engine server, wherein the device includes: The first determining module is used to determine the target seat control command associated with the target seat virtual control in response to the user's trigger operation on the target seat virtual control in the virtual cockpit; The first sending module is used to determine the seat movement trajectory according to the target seat control command, and send the seat movement trajectory to the cockpit control server so that the cockpit control server controls the movement of the physical seat according to the seat movement trajectory; The first adjustment module is used to acquire the first pose information of the virtual seat during the movement of the physical seat, receive the second pose information of the physical seat sent by the cockpit control server, and adjust the pose of the virtual seat according to the first pose information and the second pose information so that the pose of the virtual seat is consistent with the pose of the physical seat.

10. A cockpit testing device, characterized in that, An application to a cockpit control server, wherein the device includes: The first receiving module is used to receive the seat motion trajectory sent by the virtual engine server. The seat motion trajectory is determined by the virtual engine server in response to the user's trigger operation on the target seat virtual control in the virtual cockpit, determining the target seat control command associated with the target seat virtual control, and determining the target seat control command based on the target seat control command. The second sending module is used to control the movement of the physical seat according to the seat movement trajectory, and during the movement of the physical seat, to acquire the second pose information of the physical seat and send the second pose information to the virtual engine server, so that the virtual engine server adjusts the pose of the virtual seat according to the second pose information and the first pose information of the virtual seat acquired during the movement of the physical seat, so that the pose of the virtual seat is consistent with the pose of the physical seat.

11. An electronic device, characterized in that, include: A processor and a memory, wherein the memory stores a computer program that, when executed by the processor, performs the method of any one of claims 1-5 or the method of any one of claims 6-8.

12. A computer-readable storage medium, characterized in that, The storage medium stores a computer program that, when executed by a processor, implements the method as described in any one of claims 1-5 or the method as described in any one of claims 6-8.

Images