Control method based on VR simulation device

Abstract

The invention provides a control method based on a VR simulation device, which belongs to the technical field of VR simulation, and comprises the steps of operating to enter a game detail interface, clicking to start experience, detecting whether a safety belt of a user is connected or not, detecting whether a limit switch is normal or not, performing attitude motion and special effect output of pitching and rolling of the VR simulation device, and combining a light effect with the attitude motion and the special effect output. Corresponding position and special effect information are calculated through a somatosensory washout algorithm, a position instruction is sent to a servo controller, a pitching mechanism and a rotating mechanism are driven to work, the special effect output of the special effect controller and the light special effect are combined, and the special effect of the VR simulation device and the movie is controlled to be synchronous, so that the experiencer experiences the movie personally on the scene. The posture motion of pitching and rolling and special effect output of the VR simulation device are realized, real motion information is converted into a comfortable motion signal which can be perceived by a user and accords with human body perception characteristics, and an experiencer can experience a movie personally on the scene.

Description

Technical Field

[0001] The present invention relates to the field of VR simulation technology, and in particular to a control method based on a VR simulation device. Background Art

[0002] VR (Virtual Reality) technology is widely used in the entertainment industry, such as cinemas and commercial game consoles. It combines VR helmets to experience film and television images and special effects, bringing the audience into virtual sports scenes, giving the audience an immersive and real experience. While watching a movie in VR, adding environmental simulation can make the scene more realistic. The existing VR viewing method is just a single viewing method, which cannot realistically simulate the environmental effects in the visual scene and it is difficult to enhance the audience's experience. Summary of the invention

[0003] The present invention aims to solve the above technical problems and provides a control method based on a VR simulation device.

[0004] In order to solve the above technical problems, the technical solution provided by the present invention is:

[0005] A control method based on a VR simulation device comprises the following steps:

[0006] S1. User operation:

[0007] The user sits on the VR simulator, enters the game details interface, scans the member QR code and pays successfully, then clicks to start the experience.

[0008] S2. Safety inspection:

[0009] Check whether the user's seat belt is connected and whether the limit switch is normal;

[0010] S3, program reading:

[0011] Read out the action file and lighting file respectively;

[0012] S4. Read action file:

[0013] Read the position of the next time point in the action file, calculate the corresponding position and special effect information through the somatosensory wash-out algorithm, send the position command to the servo controller, and the special effect command to the special effect controller;

[0014] S5, gesture movement and special effects output:

[0015] The servo controller controls the operation of the one-axis servo motor and the two-axis servo motor, and combines the special effect output of the special effect controller to realize the pitch and roll posture movement and special effect output of the VR simulation device;

[0016] S6. Read the lighting file:

[0017] Read the lighting instructions for the next time in the lighting file, send the lighting instructions to the lighting controller, and output the lighting effects;

[0018] S7, VR simulation device experience:

[0019] The lighting effects are combined with posture movements and special effects output to control the VR simulation device to run synchronously with the film, allowing the experiencer to experience the film immersively.

[0020] Preferably, in step S2, if one or both of the safety belt connection and the limit switch are abnormal, an error message is displayed and the operation is terminated.

[0021] Preferably, the action file is a motion track of a simulated film, and is written and output as a motion posture of a VR simulation device.

[0022] Preferably, before sending the position instruction, it is necessary to determine whether the safety belt connection and the limit switch are normal. If not, an error is prompted and the operation is terminated.

[0023] Preferably, the security inspection method comprises the following steps:

[0024] A1. Set two variables to store the seat belt status and limit switch status;

[0025] A2. Send a command to the control card to obtain input parameters;

[0026] A3, receiving input data returned by the control card;

[0027] A4. Analyze and store the seat belt status and limit switch status, and output them to step A2.

[0028] Preferably, the method for reading an action file comprises the following steps:

[0029] B1. Set up a structure array to store location and time;

[0030] B2. Read the next line in the text file;

[0031] B3. The text of the next line is not empty, otherwise the reading ends.

[0032] B4. Store the position and time read from the line into an array and output it to step B2.

[0033] Preferably, the somatosensory washout algorithm comprises the following steps:

[0034] C1. Receive external byte array data through network protocols UDP and TCP;

[0035] C2, create variables current posture, current speed, current acceleration, and store posture, speed, and acceleration in byte data;

[0036] C3, adding posture increment and acceleration increment to enhance body perception;

[0037] C4, add variable action effects based on body sensation;

[0038] C5. Assign the above variables to the structure ActionData, convert the structure into a byte array and send it to the VR simulation device through the UDP network protocol.

[0039] Preferably, the VR simulation device includes a base plate, a fence around the base plate and a carrier, the base plate is fixedly connected to a chassis, a connecting frame is hinged on one side of the middle part of the carrier, a rotating mechanism for driving the connecting frame to rotate is installed in the chassis, and a pitch mechanism for driving the pitch adjustment of the carrier is installed on the connecting frame.

[0040] Preferably, rotation hard limiters for limiting the rotation of the connecting frame are installed on both sides of the chassis.

[0041] After adopting the above method and structure, the present invention has the following advantages:

[0042] The present invention calculates the corresponding position and special effect information through the somatosensory wash-out algorithm, sends the position instruction to the servo controller, drives the pitch mechanism and the rotation mechanism to work, and combines the special effect output and the lighting special effect of the special effect controller to realize the pitch and roll posture movement and special effect output of the VR simulation device, and converts the real motion information into a motion signal that is perceptible to the user, comfortable and in line with the human body's perception characteristics, allowing the experiencer to experience the movie in an immersive way.

[0043] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present invention will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 is a flow chart of the present invention;

[0046] Figure 2is a flow chart of the method for security inspection of the present invention;

[0047] Figure 3 is a flow chart of a method for reading an action file according to the present invention;

[0048] Figure 4 is a flow chart of the somatosensory washout algorithm of the present invention;

[0049] Figure 5 It is a structural schematic diagram of the VR simulation device of the present invention;

[0050] Figure 6 It is a top view of the VR simulation device of the present invention.

[0051] As shown in the figure: 1. Base plate; 2. Fence; 3. Carrier; 4. Chassis; 5. Connecting frame; 6. Rotation hard limit. DETAILED DESCRIPTION

[0052] Specific embodiments of the present invention will now be mentioned in detail. Although the present invention is described in conjunction with these specific embodiments, it should be appreciated that it is not intended to limit the present invention to these specific embodiments. On the contrary, these embodiments are intended to cover substitutions, changes or equivalent embodiments that may be included in the spirit and scope of the invention defined by the claims. In the following description, a large number of specific details are set forth in order to provide a comprehensive understanding of the present invention. The present invention can be implemented without some or all of these specific details. In other cases, in order not to make the present invention unnecessarily obscure, well-known process operations are not described in detail.

[0053] When used in conjunction with "including," "methods comprising," or similar language in this specification and the appended claims, the singular forms "a," "an," and "the" include plural references unless the context clearly dictates otherwise. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

[0054] The present invention is further described in detail below in conjunction with the full text.

[0055] Combined with Figure 1-Figure 6 , a control method based on a VR simulation device, comprising the following steps:

[0056] S1. User operation:

[0057] The user sits on the VR simulator, enters the game details interface, scans the member QR code and pays successfully, then clicks to start the experience;

[0058] S2. Safety inspection:

[0059] Check whether the user's seat belt is connected and whether the limit switch is normal;

[0060] S3, program reading:

[0061] Read out the action file and lighting file respectively;

[0062] S4. Read action file:

[0063] Read the position of the next time point in the action file, calculate the corresponding position and special effect information through the somatosensory wash-out algorithm, send the position command to the servo controller, and the special effect command to the special effect controller;

[0064] S5, gesture movement and special effects output:

[0065] The servo controller controls the operation of the one-axis servo motor and the two-axis servo motor, and combines the special effect output of the special effect controller to realize the pitch and roll posture movement and special effect output of the VR simulation device;

[0066] S6. Read the lighting file:

[0067] Read the lighting instructions for the next time in the lighting file, send the lighting instructions to the lighting controller, and output the lighting effects;

[0068] S7, VR simulation device experience:

[0069] The lighting effects are combined with posture movements and special effects output to control the VR simulation device to run synchronously with the film, allowing the experiencer to experience the film immersively.

[0070] In step S2, if one or both of the seat belt connection and the limit switch are abnormal, an error prompt will be given and the operation will be terminated. Before sending the position command, it is necessary to determine whether the seat belt connection and the limit switch are normal. If not, an error prompt will be given and the operation will be terminated. By determining whether the seat belt connection and the limit switch are normal before sending each position command, the safety of use is increased.

[0071] The action file is written to simulate the motion trajectory of the film and output as the motion posture of the VR simulation device to ensure that the special effects time of the simulation is consistent with that of the video, thereby improving the realism of the simulation experience.

[0072] When the present invention is specifically implemented, Figure 2 As shown, the method for security inspection includes the following steps:

[0073] A1. Set two variables to store the seat belt status and limit switch status;

[0074] A2. Send a command to the control card to obtain input parameters;

[0075] A3, receiving input data returned by the control card;

[0076] A4. Analyze and store the seat belt status and limit switch status, and output them to step A2.

[0077] When the present invention is specifically implemented, Figure 3 As shown, the method for reading an action file includes the following steps:

[0078] B1. Set up a structure array to store location and time;

[0079] B2. Read the next line in the text file;

[0080] B3. The text of the next line is not empty, otherwise the reading ends.

[0081] B4. Store the position and time read from the line into an array and output it to step B2.

[0082] When the present invention is specifically implemented, Figure 4 As shown, the somatosensory washout algorithm includes the following steps:

[0083] C1. Receive external byte array data through network protocols UDP and TCP;

[0084] C2, create variables current posture, current speed, current acceleration, and store posture, speed, and acceleration in byte data;

[0085] C3, adding posture increment and acceleration increment to enhance body perception;

[0086] C4, add variable action effects based on body sensation;

[0087] C5. Assign the above variables to the structure ActionData, convert the structure into a byte array and send it to the VR simulation device through the UDP network protocol.

[0088] The somatosensory wash-out algorithm calculates the corresponding position of the next action and is widely used in the fields of virtual reality, flight simulation, and driving simulation. The purpose is to convert real motion information into motion signals that users can perceive, are comfortable, and conform to the human perception characteristics. Through this algorithm, motion sensations such as acceleration, speed, and displacement can be simulated while avoiding causing discomfort or dizziness to users.

[0089] For example, in a flight simulator, the amplitude and frequency of movement that the simulator platform should generate are calculated based on the actual motion state of the aircraft. If the aircraft suddenly accelerates, the algorithm will control the platform to slowly generate a certain acceleration feedback instead of responding directly and violently to avoid discomfort to the user.

[0090] For example, in the simulated driving seat of a racing game, the algorithm will comprehensively consider the speed changes, turning conditions, etc. of the car, allowing the seat to produce corresponding tilt, vibration and other effects, enhancing the player's sense of immersion and reality, but will not cause physical discomfort to the player due to overly intense exercise.

[0091] The algorithm usually includes high-pass filtering, low-pass filtering and notch filtering. High-pass filtering is used to transmit high-frequency motion information, low-pass filtering is used to limit the maximum displacement and speed of the platform, and notch filtering is used to eliminate specific frequency components that may cause resonance.

[0092] By using algorithms to improve the realism and comfort of the simulation experience and control the operation of the VR simulation device, the VR experiencer can be given a real experience corresponding to the movie content.

[0093] The user enters the game details interface, scans the member QR code and pays successfully, then clicks to start the experience. The program reads the action file (the action file simulates the motion trajectory of the film and is written and output as the device's motion posture), automatically calculates and sends position instructions to each servo motor (before each sending, it determines whether the seat belt connection and each limit switch are normal. If not, an error is prompted and the operation ends) to achieve the pitch and roll posture movement of the device; at the same time, the instructions in the lighting file are automatically sent to the lighting controller to achieve the lighting effect of the device; the device is controlled to run synchronously with the film, allowing the experiencer to experience the film immersively.

[0094] When the present invention is specifically implemented, Figure 5 and Figure 6 The VR simulation device includes a base plate 1, a fence 2 around the base plate 1, and a carrier 3. The base plate 1 is fixedly connected with a chassis 4. A connecting frame 5 is hinged on one side of the middle of the carrier 3. A rotating mechanism for driving the connecting frame 5 to rotate is installed in the chassis 4. A pitch mechanism for driving the carrier 3 to pitch is installed on the connecting frame 5.

[0095] Specifically, the rotating mechanism includes a one-axis servo motor fixedly connected to the chassis 4 and an external gear slewing bearing connected to the chassis 4 by a bearing. A driving gear is installed at the output end of the one-axis servo motor. The external gear slewing bearing is meshed with the driving gear. The external gear slewing bearing is connected to the connecting frame 5. When the one-axis servo motor drives the driving gear to rotate, it drives the meshed external gear slewing bearing to rotate, and can also drive the connecting frame 5 and the carrier 3 to rotate. A seat is installed on the carrier 3, so that the seat can drive the user to rotate left and right, simulating a more realistic experience. A leg-pressing mechanism is installed in front of the seat. The leg-pressing mechanism includes a rotatable pressure rod connected by a bearing seat and a shaft. A leg-pressing rubber is installed at one end of the pressure rod close to the seat. Buckles used in conjunction with safety belts are installed on both sides of the leg-pressing rubber. There is a safety belt on the seat. The buckle is clamped on the seat belt to achieve leg-pressing limit.

[0096] Specifically, the pitch mechanism includes a two-axis servo motor, which is an electric cylinder. One end of the electric cylinder is hinged on the connecting frame 5, and the telescopic end of the electric cylinder is hinged on the lower end of the vehicle 3. The connecting frame 5 is hinged on one side of the middle part of the vehicle 3, and can be rotated through bearings and shafts. Shafts are installed on both sides of the connecting frame 5, and bearings are installed on the outside of the shaft. The outside of the bearing is connected to the vehicle 3, and the vehicle 3 can rotate on the outside of the connecting frame 5. When the piston rod of the electric cylinder is extended and retracted, the vehicle 3 can be driven to pitch through the cooperation of the bearing and the shaft, thereby simulating an upward or downward movement process.

[0097] Specifically, a servo controller, a special effect controller, a lighting controller and a power supply are installed in the chassis 4 of the present invention. The servo controller controls the operation of a one-axis servo motor and a two-axis servo motor, and combines the special effect output of the special effect controller to realize the pitch and roll posture movement and special effect output of the VR simulation device. The lighting controller can be connected to an LED light strip, send lighting instructions to the lighting controller, and output lighting effects. The special effect controller can be connected to a fan, a water pump and an air pump, etc., and can start the fan to blow air. The water outlet of the water pump can simulate rain through a nozzle, and the air pump can simulate airflow through a nozzle.

[0098] Embodiment 1:

[0099] The user enters vehicle 3, sits on the seat, operates to enter the game details interface, scans the member QR code and pays successfully, then clicks to start the experience. The device detects that the user's seat belt is connected normally and the limit switch is normal, reads the action file and the light file respectively, reads the position of the next time point in the action file, calculates the corresponding position and special effect information through the somatosensory algorithm, sends the position command to the servo controller, and sends the special effect command to the special effect controller. The servo controller controls the one-axis servo motor and the two-axis servo motor to work. The one-axis servo motor drives the drive gear to rotate, which drives the meshing external gear slewing bearing to rotate, and the short vehicle 3 rotates, so that the seat can drive the user to move. When the piston rod of the electric cylinder rotates left and right and retracts, the vehicle 3 can be driven to perform pitch motion through the cooperation of the bearing and the shaft, thereby simulating the upward or downward movement process. Combined with the special effect output of the special effect controller, the pitch and roll posture movement and special effect output of the VR simulation device are realized. The fan is started to blow air according to the specific situation, the water outlet of the water pump can simulate rain through the nozzle, and the air pump can simulate airflow through the nozzle. The lighting instructions for the next time in the lighting file are read, and the lighting instructions are sent to the lighting controller to output the lighting effects. The lighting effects are combined with the posture movement and special effect output to control the VR simulation device to run synchronously with the movie, allowing the experiencer to experience the movie immersively.

[0100] Embodiment 2:

[0101] The user enters vehicle 3, sits on the seat, and operates to enter the game details interface. After scanning the member QR code and paying successfully, click to start the experience. The device detects that the user's seat belt is connected normally and the limit switch is normal, reads the action file and the light file respectively, reads the position of the next time point in the action file, calculates the corresponding position and special effect information through the somatosensory wash-out algorithm, sends the position instruction to the servo controller, and sends the special effect instruction to the special effect controller. The servo controller controls the one-axis servo motor and the two-axis servo motor to work. The one-axis servo motor drives the driving gear to rotate, driving the meshing external gear slewing bearing to rotate, and the short vehicle 3 rotates, so that the seat can drive the user to rotate left and right. When the piston rod of the electric cylinder is extended and retracted, the vehicle 3 can be driven to pitch through the cooperation of the bearing and the shaft, thereby simulating the upward or downward movement process. Combined with the special effect output of the special effect controller, the pitch and roll posture movement and special effect output of the VR simulation device are realized. When the position of the next time point in the action file is read, the corresponding position is calculated through the somatosensory wash-out algorithm. Before sending the position instruction, it is detected that the seat belt connection is abnormal, an error is prompted, and the operation ends.

[0102] The present invention and its embodiments are described above, and such description is not restrictive. What is shown in the full text is only one of the embodiments of the present invention, and the actual structure is not limited thereto. In short, if ordinary technicians in the field are inspired by it, without departing from the purpose of the invention, they can design a structure and embodiment similar to the technical solution without creativity, which should belong to the protection scope of the present invention.

Claims

1. A control method based on a VR simulation device, characterized in that: The following steps are involved: S1. User operation: The user sits on the VR simulator, enters the game details interface, scans the member QR code and pays successfully, then clicks to start the experience; S2. Safety inspection: Check whether the user's seat belt is connected and whether the limit switch is normal; S3, program reading: Read out the action file and lighting file respectively; S4. Read action file: Read the position of the next time point in the action file, calculate the corresponding position and special effect information through the somatosensory wash-out algorithm, send the position command to the servo controller, and the special effect command to the special effect controller; S5, gesture movement and special effects output: The servo controller controls the operation of the one-axis servo motor and the two-axis servo motor, and combines the special effect output of the special effect controller to realize the pitch and roll posture movement and special effect output of the VR simulation device; S6. Read the lighting file: Read the lighting instructions for the next time in the lighting file, send the lighting instructions to the lighting controller, and output the lighting effects; S7, VR simulation device experience: The lighting effects are combined with posture movements and special effects output to control the VR simulation device to run synchronously with the film, allowing the experiencer to experience the film immersively.

2. The control method based on the VR simulation device according to claim 1, characterized in that: In step S2, if one or both of the seat belt connection and the limit switch are abnormal, an error message will be displayed and the operation will be terminated.

3. The control method based on the VR simulation device according to claim 1, characterized in that: The action file is a motion file that simulates the motion trajectory of the film and is written and output as the motion posture of the VR simulation device.

4. The control method based on the VR simulation device according to claim 1, characterized in that: Before sending the position command, it is necessary to determine whether the seat belt connection and limit switch are normal. If not, an error message will be prompted and the operation will end.

5. The control method based on the VR simulation device according to claim 1, characterized in that: The security inspection method comprises the following steps: A1. Set two variables to store the seat belt status and limit switch status; A2. Send a command to the control card to obtain input parameters; A3, receiving input data returned by the control card; A4. Analyze and store the seat belt status and limit switch status, and output them to step A2.

6. The control method based on the VR simulation device according to claim 1, characterized in that: The method for reading an action file comprises the following steps: B1. Set up a structure array to store location and time; B2. Read the next line in the text file; B3. The text of the next line is not empty, otherwise the reading ends. B4. Store the position and time read from the line into an array and output it to step B2.

7. The control method based on the VR simulation device according to claim 1, characterized in that: The somatosensory washout algorithm comprises the following steps: C1. Receive external byte array data through network protocols UDP and TCP; C2, create variables current posture, current speed, current acceleration, and store posture, speed, and acceleration in byte data; C3, adding posture increment and acceleration increment to enhance body perception; C4, add variable action effects based on body sensation; C5. Assign the above variables to the structure ActionData, convert the structure into a byte array and send it to the VR simulation device through the UDP network protocol.

8. A control method based on a VR simulation device according to any one of claims 1 to 7, characterized in that: The VR simulation device comprises a base plate (1), a fence (2) around the base plate (1) and a carrier (3); the base plate (1) is fixedly connected to a chassis (4); a connecting frame (5) is hingedly connected to one side of the middle of the carrier (3); a rotating mechanism for driving the connecting frame (5) to rotate is installed in the chassis (4); and a pitch mechanism for driving the carrier (3) to pitch and adjust is installed on the connecting frame (5).

9. A control method based on a VR simulation device according to claim 8, characterized in that: Rotational hard limiters (6) for limiting the rotation of the connecting frame (5) are installed on both sides of the chassis (4).

Images