Interaction method, storage medium and computer of power supervision VR training software

Abstract

The interactive method of the VR training software of the present application changes the fixed generation position of the information prompt box, determines the position of the information prompt box according to the position of the first control handle in the virtual space (i.e. the position of the hand of the user), so that the user can flexibly move the hand according to the current picture, thereby adjusting the position of the information prompt box, and at the same time, when the user needs to operate the prompt box, the selection cursor of the second control handle is configured in a near-finger mode (i.e. the pointing of the selection cursor is more towards the bottom surface of the virtual space), so that the user can conveniently operate the information prompt box which is closer to the main visual angle in the virtual space.

Description

Technical Field

[0001] This invention relates to the field of VR training technology, and in particular to an interactive method, storage medium, and computer for power supervision VR training software. Background Technology

[0002] In VR training software for power supervision, when a user wears a helmet, holds a controller, and logs into the virtual space, a VR screen of the power supervision construction site is displayed. This VR screen rotates with the user's helmet to provide an immersive VR effect. In addition, the controller is also virtualized as the user's hands in the virtual space. Based on the user's operation of the controller, a selection cursor is generated in the virtual space for the user to point to and select objects (such as virtual items) in the virtual space. Usually, the object to be selected is located in front of the user's field of vision. Therefore, the system is usually set so that when the user controls the controller horizontally, the selection cursor points from the position of the virtual hand to the depth direction of the virtual space (i.e., the virtual distance), so that the user can select objects in front without twisting their wrists significantly.

[0003] Meanwhile, to enhance the teaching effect, information prompts are typically embedded in the VR construction site footage to highlight precautions for the current construction operation. Furthermore, in some modes, users need to use a controller to select content within the prompts, such as in assessment modes where users need to select answers. Usually, the position of these prompts is fixed, and to avoid obstructing key construction scenes, they are typically positioned as far away from the construction area as possible. This often results in the prompts being outside the user's field of vision when facing the construction area. Figure 1 As shown, when the user faces the circular construction area in the middle of the screen, only a small portion of the information prompt box enters the user's field of vision, making it impossible for the user to clearly see the content. However, when the user turns their head to face the information prompt box, as shown... Figure 2 As shown, the user cannot see the lake surface in the construction area at this time. Therefore, if the user needs to watch the construction process and the information prompts at the same time, or needs to select information prompts while watching the construction process, they need to repeatedly rotate their head to adjust their field of vision. In the virtual space environment, frequent head rotation to adjust the field of vision can easily cause dizziness, seriously affecting the user experience of the VR training software. Summary of the Invention

[0004] The purpose of this invention is to overcome the shortcomings of the prior art and provide an interactive method for VR training software that allows users to simultaneously view the construction process and information prompts without frequently rotating their heads, thereby improving the user experience.

[0005] The objective of this invention is achieved through the following technical solution:

[0006] An interactive method for power supervision VR training software is provided, including...

[0007] Control position determination step: Obtain the spatial position information of the first control handle and calculate the position information of the first control handle in the virtual space. Determine whether the position of the first virtual handle in the virtual space is located in the display screen. If not, configure the information prompt box to a preset fixed position in the virtual space. If yes, jump to the prompt box configuration step.

[0008] Prompt box configuration steps: Configure the information prompt box to the position of the first control handle in the virtual space, determine whether there is an operation command to be performed in the prompt box. If there is no operation command to be performed, configure the selection cursor of the second control handle to the far finger mode. If there is an operation command to be performed, configure the selection cursor of the second control handle to the near finger mode.

[0009] In the far-pointing mode, the cursor is pointed further towards the bottom of the virtual space than in the near-pointing mode, and the angle between the two pointers is not less than 30°.

[0010] This includes the following steps: when a follow setting command is detected, the information prompt box is configured to follow mode—the information prompt box maintains its current relative position with the object being followed and moves with the object being followed.

[0011] The follow setting command is that the second control handle points to the information prompt box in the far-pointing mode and selects it. Under this follow command, the second control handle is configured as the object to be followed.

[0012] The follow setting command is triggered by the confirmation button on the first control handle for an extended period of time, under which the VR glasses are configured as the object to be followed.

[0013] This also includes a prompt box locking step: when a lock command is detected, the position of the prompt box is locked so that its position in the virtual space remains unchanged.

[0014] The locking command is triggered briefly by the confirmation button on the first control handle.

[0015] A computer-readable storage medium is also provided, on which an executable computer program is stored, which, when executed, enables the aforementioned interactive method of the power supervision VR training software.

[0016] A computer is also provided, including a processor and a computer-readable storage medium on which a virtual machine runs, the computer-readable storage medium being the aforementioned computer-readable storage medium.

[0017] The beneficial effects of this invention are as follows: This invention changes the way information prompt boxes are generated in a fixed position. The position of the information prompt box is determined according to the position of the first control handle in the virtual space (i.e., the position of the user's hand). In this way, the user can flexibly move their hand according to the current screen situation to adjust the position of the information prompt box. At the same time, when the user needs to operate the prompt box, the selection cursor of the second control handle is configured in a near-finger mode (i.e., the selection cursor is pointed more towards the bottom of the virtual space), which makes it easier for the user to operate the information prompt box that is closer to the main viewpoint in the virtual space. Attached Figure Description

[0018] The present invention will be further described with reference to the accompanying drawings, but the embodiments in the drawings do not constitute any limitation on the present invention. For those skilled in the art, other drawings can be obtained based on the following drawings without creative effort.

[0019] Figure 1 This is a schematic diagram of the interface of the existing technology.

[0020] Figure 2 This is a schematic diagram of another interface in the existing technology.

[0021] Figure 3 This is a schematic diagram of the interface of the present invention. Detailed Implementation

[0022] The present invention will be further described in conjunction with the following embodiments.

[0023] A specific implementation method of the interactive method of the power supervision VR training software of the present invention is as follows: Figure 3As shown, when the system needs to display an information notification box, it automatically obtains the position information of the first control handle in virtual space. The first control handle is worn on the user's left hand, and its position in virtual space moves with the user's left hand. If the first virtual handle is not displayed on the screen, the information notification box is fixed in a position far from the construction area using the traditional method. If the first virtual handle is displayed on the screen, the information notification box is positioned at the location of the first control handle in virtual space. The position of the information notification box then changes with the position of the first control handle in virtual space, i.e., it moves with the user's left hand. This allows the user to move the information notification box to a position that does not obstruct the main construction area while still being easily visible to them.

[0024] The selection cursor for the second control handle (i.e.) Figure 2 and 3 The middle finger (the straight line with the origin at the front of the information prompt box) usually points to the distance. However, in virtual space, the position of the first control handle is also relatively close to the main viewpoint. Positioning the information prompt box to the first control handle position also results in the information prompt box being close to the main viewpoint. In this case, pointing the information prompt box with the second control handle becomes difficult, requiring a significant wrist twist. Therefore, this embodiment determines whether there is an operation command waiting to be performed in the prompt box. If no operation command is waiting, the selection cursor of the second control handle is configured in a far-pointing mode. If an operation command is waiting, the selection cursor of the second control handle is configured in a near-pointing mode. In the far-pointing mode, the selection cursor points further towards the bottom of the virtual space than in the near-pointing mode, and the angle between the two points is not less than 30°. More specifically, the selection cursor of the second control handle points along the direction of the arm wearing the second control handle. In the near-pointing mode, the selection cursor of the second control handle points at a 45° angle to the arm wearing the second control handle. In this way, when there is information in the information prompt box that requires user operation, the selection cursor is shifted downwards to be closer to the main viewpoint, so that the user can easily place the selection cursor in the information prompt box without having to twist their wrist significantly.

[0025] Considering that users' left hands also need to perform other operations during learning and assessment, this system also includes a preset follow function. This allows the information prompt box to switch from following the first control pointer to following other objects. Specifically, after the follow function is activated, the relative positional relationship between the information prompt box and the new followed object remains unchanged, and it moves with the followed object. In this embodiment, there are two follow modes: First, the user points to the information prompt box and selects it in far-point mode (i.e., the prompt box has no pending operation command) using the selection cursor on the second control handle (the confirmation button on the second control handle is pressed). In this case, the second control handle is configured as the followed object. Second, the follow setting command is triggered by a prolonged press of the confirmation button on the first control handle. Under this follow command, the VR glasses are configured as the followed object (i.e., they rotate with the user's head).

[0026] In addition to the follow mode, this embodiment also allows users to fix the information prompt box to a specific location in the virtual space. When the user briefly triggers the confirmation button on the first control handle, the system recognizes the lock command and locks the position of the information prompt box, so that its position in the virtual space remains unchanged. It should be noted that the confirmation button being triggered for a long time or a short time is what is commonly referred to as "long press" and "short press" in the field of electronic information. The specific duration that constitutes a long trigger can be flexibly set by the system according to the user's general habits.

[0027] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit the scope of protection of the present invention. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the essence and scope of the technical solutions of the present invention.

Claims

1. The interactive method of the VR training software for power supervision, characterized in that... include: Control position determination step: Obtain the spatial position information of the first control handle and calculate the position information of the first control handle in the virtual space. Determine whether the position of the first virtual handle in the virtual space is located in the display screen. If not, configure the information prompt box to a preset fixed position in the virtual space. If yes, jump to the prompt box configuration step. Prompt box configuration steps: Configure the information prompt box at the position of the first control handle in the virtual space, determine whether there is an operation command to be performed in the prompt box. If there is no operation command to be performed, configure the selection cursor of the second control handle to the far-pointing mode. If there is an operation command to be performed, configure the selection cursor of the second control handle to the near-pointing mode. In the far-pointing mode, the selection cursor points further towards the bottom of the virtual space than in the near-pointing mode, and the angle between the two points is not less than 30°. Follow setting steps: When the follow setting command is detected, the information prompt box is configured to follow mode - the information prompt box maintains the current relative position relationship with the object being followed and moves with the movement of the object being followed. The follow setting command is that the second control handle points to the information prompt box in the far-pointing mode and selects it. Under this follow command, the second control handle is configured as the object being followed.

2. The interactive method of the power supervision VR training software as described in claim 1, characterized in that: The follow setting command is triggered by the confirmation button on the first control handle for an extended period of time. Under this follow command, the VR glasses are configured as the object to be followed.

3. The interactive method of the power supervision VR training software as described in claim 1, characterized in that... It also includes a prompt box locking step: when a lock command is detected, the prompt box position is locked so that its position in the virtual space remains unchanged.

4. The interactive method of the power supervision VR training software as described in claim 3, characterized in that... The locking command is triggered briefly by the confirmation button on the first control handle.

5. A computer-readable storage medium having an executable computer program stored thereon, characterized in that: When the computer program is executed, it can implement the interactive method of the power supervision VR training software as described in any one of claims 1 to 4.

6. A computer, comprising a processor and a computer-readable storage medium, wherein a virtual machine runs on the computer, characterized in that: The computer-readable storage medium is the computer-readable storage medium as described in claim 5.

Images