Virtual content display method, device and equipment
Through the virtual position movement strategy of the virtual controller, users are guided to adjust the handheld controller to a comfortable position, solving the problem of experience decline caused by the handheld controller's non-comfortable position in virtual reality, and improving the continuity and comfort of operation.
Patent Information
- Application Number
- CN202010669929.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-07-13
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2040-07-13
AI Technical Summary
In virtual reality technology, the non-comfortable position of the handheld controller causes the user experience to decline rapidly, affecting the operation effect.
Move the virtual position of the virtual controller outside the target interface, guide the user to adjust the physical position of the handheld controller to a comfortable position, ensuring that the virtual controller is moved back into the target interface, achieving operational comfort and continuity.
It effectively avoids the rapid decline in user experience, improves the comfort and continuity of operation, and improves the quality of virtual reality experience.
Smart Images

Figure CN113934290B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of artificial intelligence, and in particular to a method, device and equipment for displaying virtual content. Background Art
[0002] Virtual Reality (VR) is a high-tech technology, which can also be called virtual technology, virtual environment, spiritual technology or artificial environment, etc. It simulates a three-dimensional virtual space to provide users with simulations of vision, hearing, touch and other senses, allowing users to observe things in the virtual space instantly and without restrictions as if they were in the scene. When the user moves, complex calculations can be performed immediately to transmit accurate images of the virtual space back to create a sense of presence.
[0003] Handheld controllers are important components of virtual reality technology. Users use handheld controllers to operate the target interface in the virtual space. For example, there is a virtual controller corresponding to the handheld controller in the virtual space. When the user moves the handheld controller in the real space, the virtual controller in the virtual space also moves. When the target interface in the virtual space needs to be operated, the position of the virtual controller is moved to the target interface by moving the position of the handheld controller, so as to operate the target interface.
[0004] However, if the position of the handheld controller is not good when the virtual controller is moved to the target interface, such as the handheld controller is above the head, the user needs to lift the handheld controller. If the user lifts the handheld controller for a long time, the user experience will decline rapidly, affecting the usage experience. Summary of the invention
[0005] The present application provides a virtual content display method, the method comprising:
[0006] Displaying a virtual screen using virtual data, the virtual screen including a target interface and a virtual controller, the virtual position of the virtual controller being controlled by the physical position of the handheld controller;
[0007] When the physical position of the handheld controller moves to an initial physical position matching the target interface, moving the virtual position of the virtual controller into the target interface;
[0008] If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface;
[0009] When the physical position of the handheld controller moves from the initial physical position to the target physical position, the virtual position of the virtual controller is moved back to the target interface.
[0010] The present application provides a virtual content display method, which is applied to a virtual processing device, wherein the virtual processing device includes a display device and a handheld controller, and the method includes:
[0011] Generate a virtual screen using virtual data, and display the virtual screen through the display device; wherein the virtual screen includes a target interface and a virtual controller, and the virtual position of the virtual controller is controlled by the physical position of the handheld controller;
[0012] When the physical position of the handheld controller moves to an initial physical position matching the target interface, moving the virtual position of the virtual controller into the target interface;
[0013] If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface;
[0014] When the physical position of the handheld controller moves from the initial physical position to the target physical position, the virtual position of the virtual controller is moved back to the target interface.
[0015] The present application provides a virtual content display device, the device comprising: a display module, for displaying a virtual screen using virtual data, the virtual screen comprising a target interface and a virtual controller, the virtual position of the virtual controller being controlled by the physical position of a handheld controller;
[0016] A first processing module, configured to move the virtual position of the virtual controller to the target interface when the physical position of the handheld controller moves to an initial physical position matching the target interface;
[0017] A second processing module, configured to move the virtual position of the virtual controller outside the target interface if it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted;
[0018] The third processing module is used to move the virtual position of the virtual controller back to the target interface when the physical position of the handheld controller moves from the initial physical position to the target physical position.
[0019] The present application provides a virtual processing device, comprising:
[0020] A processor and a machine-readable storage medium, wherein the machine-readable storage medium stores a plurality of computer instructions, and when the processor executes the computer instructions, the processor performs the following processing:
[0021] Displaying a virtual screen using virtual data, the virtual screen including a target interface and a virtual controller, the virtual position of the virtual controller being controlled by the physical position of the handheld controller;
[0022] When the physical position of the handheld controller moves to an initial physical position matching the target interface, moving the virtual position of the virtual controller into the target interface;
[0023] If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface;
[0024] When the physical position of the handheld controller moves from the initial physical position to the target physical position, the virtual position of the virtual controller is moved back to the target interface.
[0025] Based on the above technical solution, in an embodiment of the present application, in a virtual reality or augmented reality scenario, when the physical position of the handheld controller is the initial physical position (i.e., a non-comfortable position, such as above the head, etc.), by moving the virtual position of the virtual controller outside the target interface, the user is prompted to move the physical position of the handheld controller from the initial physical position to the target physical position (i.e., a comfortable position, such as the waist position, etc.), so that the user can operate the target interface in a comfortable position, which can minimize the impact on the user experience, that is, it can avoid a rapid decline in the user experience and improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments of the present application or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this application. For ordinary technicians in this field, other drawings can also be obtained based on these drawings of the embodiments of the present application.
[0027] Figure 1A-Figure 1C is a schematic diagram of the positional relationship in one embodiment of the present application;
[0028] Figure 2 is a flowchart of a method for displaying virtual content in one embodiment of the present application;
[0029] Figure 3 is a flowchart of a virtual content display method in another embodiment of the present application;
[0030] Figure 4 is a flowchart of a virtual content display method in another embodiment of the present application;
[0031] Figure 5 is a schematic diagram of the structure of a virtual content display device in one embodiment of the present application;
[0032] Figure 6 It is a structural diagram of a virtual processing device in one implementation manner of the present application. DETAILED DESCRIPTION
[0033] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, rather than limiting the present application. The singular forms of "a", "said" and "the" used in the present application and claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to any or all possible combinations of one or more associated listed items.
[0034] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in the embodiments of the present application, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, in addition, the word "if" used may be interpreted as "at..." or "when..." or "in response to determination".
[0035] Before describing the technical solution of the present application, concepts related to the embodiments of the present application are first introduced.
[0036] Virtual Reality (VR): Virtual reality can also be called virtual technology, virtual environment, spiritual technology or artificial environment, etc. It simulates a three-dimensional virtual space to provide users with simulations of vision, hearing, touch and other senses, so that users can observe things in the virtual space instantly and without restrictions as if they were there. When the user moves, complex calculations can be performed immediately to transmit accurate images of the virtual space back to create a sense of presence.
[0037] Augmented Reality (AR) is a technology that cleverly integrates virtual information with the real world. It widely uses multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, sensing and other technical means to simulate computer-generated virtual information such as text, images, three-dimensional models, music, video, etc., and apply it to the real world. The two types of information complement each other to achieve "enhancement" of the real world.
[0038] Virtual data: Virtual data includes all data used to realize virtual reality or augmented reality, and different scenes correspond to different virtual data. For example, virtual data a related to scene A, virtual data b related to scene B, virtual data c related to scene C, etc.
[0039] By using virtual data a, a virtual reality world about scene A can be constructed, that is, a virtual picture about scene A is displayed. By using virtual data b, a virtual reality world about scene B can be constructed, that is, a virtual picture about scene B is displayed. By using virtual data c, an augmented reality world about scene C can be constructed, that is, a virtual picture about scene B is displayed, and so on.
[0040] Virtual images: Virtual images are all the images that users can see in the virtual reality world or augmented reality world. They can be imagined as all the images that users can see in a real environment.
[0041] Virtual processing device: A virtual processing device may include a processing device, a display device and a handheld controller. The processing device is a component in the virtual processing device used to implement processing functions. It can be implemented by terminal devices such as personal computers, laptops, mobile terminals, etc., or by a processing chip.
[0042] When implemented by a terminal device, the processing device can establish a connection with the display device, such as a wired connection or a wireless connection, and realize the communication function based on the connection. The processing device can also establish a connection with a handheld controller, such as a wired connection or a wireless connection, and realize the communication function based on the connection. Alternatively, when implemented by a processing chip, the processing device can be built into the display device, and the processing device can establish a connection with the handheld controller, such as a wired connection or a wireless connection, and realize the communication function based on the connection.
[0043] The display device is a component in a virtual processing device used to realize the display function. It can be realized by virtual reality glasses, augmented reality glasses, holographic glasses, virtual reality helmets, augmented reality helmets, head-mounted displays, etc. Taking the head-mounted display as an example, the head-mounted display (HMD) is a goggle or helmet-type device. The user visually realizes the effect of virtual reality or augmented reality through the built-in display. The head-mounted display may also include a sensor with head tracking.
[0044] The handheld controller is a component in the virtual processing device for realizing the control function. There is a virtual controller corresponding to the handheld controller in the virtual screen. For the convenience of distinction, the position of the virtual controller in the virtual screen is called the virtual position, and the position of the handheld controller in the real world is called the physical position. The virtual position of the virtual controller is controlled by the physical position of the handheld controller, that is, the user controls the virtual position of the virtual controller in the virtual screen by controlling the physical position of the handheld controller.
[0045] For example, in the initial state, the physical position of the handheld controller is the physical position P1, and the virtual position of the virtual controller is the virtual position p1. Based on the physical position P1, the handheld controller is moved to the right by a distance S1, and the physical position of the handheld controller is the physical position P2. The virtual controller is moved to the right by a distance s1, and the virtual position of the virtual controller is the virtual position p2. The proportional relationship between S1 and s1 is set according to actual needs, such as the proportional relationship between S1 and s1 is 1, 0.5, 0.8, etc., and there is no restriction on this.
[0046] On the basis of the physical position P2, the handheld controller is moved upward by a distance S1, and the physical position of the handheld controller is the physical position P3. The virtual controller is moved upward by a distance s1, and the virtual position of the virtual controller is the virtual position p3. Similarly, when the physical position of the handheld controller moves in a certain direction, the virtual position of the virtual controller also moves in that direction, and the moving distance of the physical position of the handheld controller is proportional to the moving distance of the virtual position of the virtual controller, such as the proportional relationship between S1 and s1 mentioned above.
[0047] Of course, the above method is only an example and there is no limitation to it. For example, when the physical position of the handheld controller moves upward, the virtual position of the virtual controller can move downward; when the physical position of the handheld controller moves to the left, the virtual position of the virtual controller can move to the right, and so on.
[0048] Six degrees of freedom (6DoF): Six degrees of freedom refers to the freedom of a rigid body to move in three-dimensional space. A rigid body can translate on three mutually perpendicular coordinate axes, front and back, up and down, and left and right, and can also rotate on three perpendicular axes. The three rotation directions are called pitch, yaw, and roll. For example, the virtual screen can be a virtual screen with six degrees of freedom.
[0049] Three degrees of freedom (3DoF): Three degrees of freedom refers to the freedom of a rigid body to move in three-dimensional space. Unlike six degrees of freedom, a rigid body cannot translate on three mutually perpendicular coordinate axes, front and back, up and down, and left and right, but can rotate on three perpendicular axes. The three rotation directions are called pitch, yaw, and roll. For example, the virtual screen can be a virtual screen with three degrees of freedom.
[0050] Field of View: The angle at which the eye can see the image in the virtual image.
[0051] Target interface: The virtual screen includes multiple interfaces, and the interface to be operated is called the target interface. For example, the virtual screen includes multiple commodities, each of which corresponds to an interface. When the interface of a certain commodity needs to be operated, the interface of the commodity is used as the target interface. For another example, the virtual screen includes multiple areas, each of which corresponds to an interface. When the interface of a certain area needs to be operated, the interface of the area is used as the target interface, and so on. There is no restriction on this target interface.
[0052] In the related art, the user can operate the target interface in the virtual screen through the handheld controller. For example, when the target interface in the virtual screen needs to be operated, the user moves the physical position of the handheld controller, and the virtual position of the virtual controller also moves accordingly, until the virtual position of the virtual controller moves into the target interface, then the user stops moving the physical position of the handheld controller, and on this basis, the user can operate the target interface in the virtual screen.
[0053] In a possible implementation, the target interface is within the optimal field of view (FOV) of the virtual screen, such as about 100 degrees horizontally and vertically centered on the user's viewpoint. In this case, the physical position of the handheld controller is usually in a comfortable position, such as waist position. However, in the actual virtual screen, the target interface may exceed the optimal field of view, resulting in the physical position of the handheld controller being in an uncomfortable position, such as above the head or at the foot. See Figure 1A , which is a schematic diagram of the physical position of the handheld controller in an uncomfortable position, taking the position above the head as an example.
[0054] Obviously, see Figure 1A As shown, if the physical position of the handheld controller is above the head, the user needs to lift the handheld controller, which causes a rapid decline in user experience and affects the usage experience.
[0055] In the embodiment of the present application, when the physical position of the handheld controller is an uncomfortable position, the user can be guided to move the physical position of the handheld controller to a comfortable position (such as the waist position, etc.), see Figure 1B , which is a schematic diagram of the physical position of the handheld controller in a comfortable position, taking the waist position as an example.
[0056] When the physical position of the handheld controller moves to a comfortable position, the virtual position of the virtual controller moves to the target interface. The user stops moving the physical position of the handheld controller and can operate the target interface in the virtual screen. Figure 1C As shown in FIG. 1 , the physical position of the handheld controller is in a comfortable position, and the virtual position of the virtual controller is moved to the target interface. Figure 1A-Figure 1C In the figure, the triangular area is the target interface, and the trapezoidal area and the handle area are the virtual controllers.
[0057] In summary, the user can operate the target interface in a comfortable position, which can minimize the impact on the user experience, avoid a rapid decline in the user experience, and improve the user experience.
[0058] The technical solution of the embodiments of the present application is described below in conjunction with specific embodiments.
[0059] The present application embodiment provides a virtual content display method, which can be applied to the application scenario of virtual reality, and can also be applied to the application scenario of augmented reality, see Figure 2 FIG. 1 is a flow chart of a method for displaying virtual content, which is applied to a virtual processing device. The method may include:
[0060] Step 201 : displaying a virtual screen using virtual data, wherein the virtual screen includes a target interface and a virtual controller, and the virtual position of the virtual controller is controlled by the physical position of the handheld controller.
[0061] Exemplarily, the virtual processing device can obtain virtual data, which includes all data used to realize virtual reality or augmented reality. Based on this, the virtual processing device can use the virtual data to display a virtual screen, which is all the screens that the user can see in the virtual reality world or augmented reality world. This article takes the virtual screen including the target interface and the virtual controller as an example for explanation, and does not elaborate on other elements. Figure 1A and Figure 1C As shown, a target interface and a virtual controller are shown.
[0062] Exemplarily, the virtual screen may be a virtual screen with six degrees of freedom; or, the virtual screen may be a virtual screen with three degrees of freedom, and there is no limitation on the type of the virtual screen.
[0063] Exemplarily, the user controls the virtual position of the virtual controller in the virtual screen by controlling the physical position of the handheld controller, that is, the virtual position of the virtual controller is controlled by the physical position of the handheld controller. For example, the physical position of the handheld controller is the physical position P1, and the virtual position of the virtual controller is the virtual position p1. Based on this, the handheld controller is moved to the right by a distance S1, and the physical position of the handheld controller is the physical position P2. The virtual controller is moved to the right by a distance s1, and the virtual position of the virtual controller is the virtual position p2. Then, the handheld controller is moved upward by a distance S1, and the physical position of the handheld controller is the physical position P3. The virtual controller is moved upward by a distance s1, and the virtual position of the virtual controller is the virtual position p3. And so on. Obviously, the virtual position of the virtual controller is controlled by the physical position of the handheld controller.
[0064] Step 202: When the physical position of the handheld controller moves to an initial physical position that matches the target interface, the virtual position of the virtual controller is moved into the target interface.
[0065] Exemplarily, since the virtual position of the virtual controller is controlled by the physical position of the handheld controller, the user controls the virtual position of the virtual controller in the virtual screen by controlling the physical position of the handheld controller. By continuously adjusting the physical position of the handheld controller, the virtual position of the virtual controller is continuously brought closer to the target interface in the virtual screen. Finally, when the physical position of the handheld controller moves to the initial physical position, the virtual position of the virtual controller is moved to the target interface.
[0066] For example, in the initial state, the virtual position of the virtual controller is located at the lower side of the target interface, then the physical position of the handheld controller is moved upward, and the virtual position of the virtual controller also moves upward accordingly. If the virtual position of the virtual controller has not reached the target interface, the physical position of the handheld controller continues to be moved upward, and the virtual position of the virtual controller also moves upward accordingly, and so on, until the virtual position of the virtual controller reaches the target interface. The physical position of the handheld controller at this time is called the initial physical position. That is to say, when the physical position of the handheld controller moves to the initial physical position, the virtual position of the virtual controller is moved to the target interface. At this point, the physical position movement operation of the handheld controller is completed.
[0067] For another example, in the initial state, the virtual position of the virtual controller is located at the lower left side of the target interface. The physical position of the handheld controller is moved upward and the physical position of the handheld controller is moved to the right. The virtual position of the virtual controller also moves upward and to the right, and so on, until the virtual position of the virtual controller reaches the target interface. The physical position of the handheld controller at this time is called the initial physical position.
[0068] Step 203: If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface.
[0069] Exemplarily, when the physical position of the handheld controller is the initial physical position, the virtual position of the virtual controller is already within the target interface. On this basis, if it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller does not need to be adjusted, the initial physical position of the handheld controller is maintained unchanged, and the target interface is operated. If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface.
[0070] In a possible implementation, a first position set may be preconfigured, and the first position set includes physical positions that need to be adjusted, such as uncomfortable positions, such as positions above the head or positions of the feet, etc. There is no restriction on the physical positions in the first position set, as long as they are physical positions that need to be adjusted. On this basis, it is determined whether the initial physical position of the handheld controller belongs to the first position set. If the initial physical position of the handheld controller belongs to the first position set, it is determined that the physical position of the handheld controller needs to be adjusted, and the virtual position of the virtual controller is moved outside the target interface. If the initial physical position of the handheld controller does not belong to the first position set, it is determined that the physical position of the handheld controller does not need to be adjusted.
[0071] In another possible implementation, a second position set may be preconfigured, and the second position set includes physical positions that do not need to be adjusted, such as comfortable positions, such as waist positions, chest positions, leg positions, etc. There is no restriction on the physical positions in the second position set, as long as they are physical positions that do not need to be adjusted. On this basis, it is determined whether the initial physical position of the handheld controller belongs to the second position set. If the initial physical position of the handheld controller does not belong to the second position set, it is determined that the physical position of the handheld controller needs to be adjusted, and the virtual position of the virtual controller is moved outside the target interface. If the initial physical position of the handheld controller belongs to the second position set, it is determined that the physical position of the handheld controller does not need to be adjusted.
[0072] In another possible implementation, a first position set and a second position set may be preconfigured, the first position set may include physical positions that need to be adjusted, and the second position set may include physical positions that do not need to be adjusted. On this basis, if the initial physical position of the handheld controller belongs to the first position set, it can be determined that the physical position of the handheld controller needs to be adjusted. If the initial physical position of the handheld controller belongs to the second position set, it can be determined that the physical position of the handheld controller does not need to be adjusted.
[0073] In summary, whether the physical position of the handheld controller needs to be adjusted can be determined based on the initial physical position of the handheld controller. Of course, the above methods are just a few examples and are not limited thereto.
[0074] Exemplarily, when the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller can be moved outside the target interface. Alternatively, a prompt message indicating that the physical position of the handheld controller needs to be adjusted can be sent. If a response message to the prompt message is received, and the response message indicates that the physical position of the handheld controller is agreed to be adjusted, the virtual position of the virtual controller is moved outside the target interface.
[0075] For example, when the physical position of the handheld controller needs to be adjusted, a prompt message can be sent to the user, and the prompt message is used to indicate that the physical position of the handheld controller needs to be adjusted. After the user receives the prompt message, if the user agrees to adjust the physical position of the handheld controller, a response message to the prompt message is returned, and on this basis, the virtual position of the virtual controller is moved outside the target interface.
[0076] If the user disagrees with adjusting the physical position of the handheld controller, no response message is returned, or a rejection message is returned, which is used to indicate disagreement with adjusting the physical position of the handheld controller. On this basis, the virtual position of the virtual controller will not be moved outside the target interface.
[0077] Exemplarily, the prompt message may be a user interface prompt message, and the response message may be a user interface response message. For example, a user interface is displayed in a virtual screen, and the prompt message is displayed through the user interface, asking the user whether to agree to adjust the physical position of the handheld controller. The user replies to the response message or the rejection message through the user interface, and the response message indicates that the user agrees to adjust the physical position of the handheld controller, and the rejection message indicates that the user does not agree to adjust the physical position of the handheld controller.
[0078] Exemplarily, the prompt message may be a voice prompt message, and the response message may be a voice response message. For example, a voice prompt message is sent to the user, asking the user whether the user agrees to adjust the physical position of the handheld controller. The user replies with a voice response message or a voice rejection message.
[0079] For example, the prompt message may be an animation prompt message, and the response message may be an animation response message. For example, an animation prompt message is sent to the user, asking the user whether the user agrees to adjust the physical position of the handheld controller. The user replies with an animation response message or an animation rejection message.
[0080] Step 204 , when the physical position of the handheld controller moves from the initial physical position to the target physical position, the virtual position of the virtual controller is moved back to the target interface.
[0081] Exemplarily, the target physical position may be preconfigured, and its role is that when it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the physical position of the handheld controller is moved from the initial physical position to the target physical position, and the target physical position is a preconfigured physical position. For example, the target physical position is a comfortable position, such as a waist position, a chest position, a leg position, etc., and there is no limitation to this. On this basis, step 203 and step 204 may be implemented in the following manner:
[0082] Method 1: If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the moving distance of the virtual position of the virtual controller can be determined based on the distance between the initial physical position of the handheld controller and the target physical position of the handheld controller, and the moving direction of the virtual position of the virtual controller can be determined based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller. The virtual position of the virtual controller is moved outside the target interface based on the moving distance and the moving direction. Furthermore, after the virtual position of the virtual controller is moved outside the target interface, the virtual position of the virtual controller in the virtual screen can be controlled by controlling the physical position of the handheld controller. Finally, when the physical position of the handheld controller moves from the initial physical position to the target physical position, the virtual position of the virtual controller is moved back into the target interface.
[0083] Exemplarily, the relationship between the moving distance of the physical position of the handheld controller and the moving distance of the virtual position of the virtual controller is known, such as the proportional relationship between S1 and s1 in the above example, which indicates that when the moving distance of the physical position of the handheld controller is S1, the moving distance of the virtual position of the virtual controller is s1. Based on this, the moving distance of the virtual position of the virtual controller can be determined based on the distance between the initial physical position of the handheld controller and the target physical position of the handheld controller, as well as the proportional relationship. For example, if the proportional relationship is 1, the moving distance of the virtual position of the virtual controller can be: the distance between the initial physical position and the target physical position, that is, the moving distances of the two are the same. Of course, the proportional relationship of 1 is only an example, and the implementation methods of other proportional relationships are similar, which will not be repeated here.
[0084] Exemplarily, the azimuth relationship between the initial physical position and the target physical position is inversely related to the moving direction of the virtual position of the virtual controller. Based on the inverse relationship and the azimuth relationship between the initial physical position and the target physical position, the moving direction of the virtual position of the virtual controller can be determined. For example, if the target physical position is below the initial physical position, then the azimuth relationship between the initial physical position and the target physical position is downward, and therefore, the moving direction of the virtual position of the virtual controller is determined to be upward. For another example, if the target physical position is above the initial physical position, then the azimuth relationship between the initial physical position and the target physical position is upward, and therefore, the moving direction of the virtual position of the virtual controller is determined to be downward. Of course, the above is only an example of determining the moving direction, and there is no limitation on this determination method.
[0085] Exemplarily, after obtaining the moving distance and the moving direction, the virtual position of the virtual controller is moved outside the target interface based on the moving distance and the moving direction. For example, if the moving distance is s1 and the moving direction is upward, the virtual position of the virtual controller is moved upward by s1 to move the virtual position of the virtual controller outside the target interface. For another example, if the moving distance is s2 and the moving direction is downward, the virtual position of the virtual controller is moved downward by s2 to move the virtual position of the virtual controller outside the target interface.
[0086] For example, after the virtual position of the virtual controller is moved outside the target interface, the user adjusts the physical position of the handheld controller so that the virtual position of the virtual controller is continuously closer to the target interface in the virtual screen. Finally, when the physical position of the handheld controller moves from the initial physical position to the target physical position, the virtual position of the virtual controller can be moved into the target interface.
[0087] Obviously, since the moving distance of the virtual position of the virtual controller is determined based on the distance between the initial physical position and the target physical position, the moving direction of the virtual position of the virtual controller is determined based on the azimuth relationship between the initial physical position and the target physical position, and the virtual position of the virtual controller is moved outside the target interface based on the moving distance and the moving direction, therefore, when the handheld controller moves from the initial physical position to the target physical position, the virtual position of the virtual controller can be moved to the target interface.
[0088] Method 2: If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the moving direction of the virtual position of the virtual controller is determined based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller. The virtual position of the virtual controller is moved outside the target interface based on a preset distance and the moving direction, and the preset distance represents a pre-configured distance that needs to be moved. Furthermore, after the virtual position of the virtual controller is moved outside the target interface, the virtual position of the virtual controller in the virtual screen can be controlled by controlling the physical position of the handheld controller. For example, after the physical position of the handheld controller moves from the initial physical position to a physical distance that matches the preset distance, the virtual position of the virtual controller is moved back to the target interface.
[0089] Then, it is determined whether the physical position of the handheld controller after the movement is the target physical position.
[0090] If not, the moved physical position is used as the initial physical position, and the operation of moving the virtual position of the virtual controller outside the target interface based on the preset distance and the moving direction is returned to be executed.
[0091] If so, stop moving the virtual position of the virtual controller outside the target interface and stop moving the physical position of the handheld controller. At this point, the physical position of the handheld controller moves from the initial physical position to the target physical position, and the virtual position of the virtual controller is within the target interface.
[0092] The implementation of the above method 2 is described below in conjunction with a specific application scenario.
[0093] Step a1, based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller, determine the moving direction of the virtual position of the virtual controller. The determination method is similar to method 1 and will not be repeated here. Take the moving direction of the virtual position of the virtual controller as upward as an example.
[0094] Step a2: move the virtual position of the virtual controller outside the target interface based on the preset distance and the moving direction. For example, the preset distance indicates the distance that the virtual position of the virtual controller needs to move. Assuming the preset distance is s1, the virtual position of the virtual controller is moved upward by s1.
[0095] Step a3: after the physical position of the handheld controller moves from the initial physical position to the physical distance P1, the virtual position of the virtual controller is moved back to the target interface.
[0096] For example, after the virtual position of the virtual controller is moved outside the target interface, the user adjusts the physical position of the handheld controller so that the virtual position of the virtual controller is continuously closer to the target interface in the virtual screen. Finally, when the physical position of the handheld controller moves from the initial physical position to the physical distance P1, the virtual position of the virtual controller can be moved into the target interface.
[0097] Exemplarily, the relationship between the moving distance of the physical position of the handheld controller and the moving distance of the virtual position of the virtual controller is known, such as the proportional relationship between S1 and s1 in the above example. Therefore, the distance between the physical distance P1 and the initial physical position, and the moving distance of the virtual position of the virtual controller (i.e., the preset distance) satisfy this proportional relationship, and there is no restriction on this.
[0098] Step a4: determine whether the physical position P1 of the handheld controller after movement is the target physical position.
[0099] Exemplarily, the target physical position is a pre-configured physical position, that is, the target physical position is known, therefore, after the physical position of the handheld controller moves to the physical distance P1, it is determined whether the physical position P1 is the target physical position. If yes, step a5 is executed, and if no, step a6 is executed.
[0100] Step a5, ending the moving operation of the virtual position of the virtual controller. At this point, the physical position of the handheld controller after the movement is the target physical position, and the virtual position of the virtual controller is moved to the target interface.
[0101] Step a6, based on the preset distance and moving direction (determined in step a1), the virtual position of the virtual controller is moved outside the target interface, and after the physical position of the handheld controller moves from the physical distance P1 to the physical distance P2, the virtual position of the virtual controller is moved back into the target interface.
[0102] Step a7: determine whether the physical position P2 of the handheld controller after movement is the target physical position.
[0103] If yes, go to step a5, if no, go to step a8.
[0104] Step a8, based on the preset distance and moving direction, move the virtual position of the virtual controller to outside the target interface, and after the physical position of the handheld controller moves from the physical distance P2 to the physical distance P3, move the virtual position of the virtual controller back to the target interface, and so on, until the moved physical position of the handheld controller is the target physical position, and end the movement operation of the virtual position of the virtual controller.
[0105] In a possible implementation, a query message may be sent to the user, the query message being used to inquire whether to adopt a fast adjustment strategy or a slow adjustment strategy. If a response message to the query message is received, and the response message indicates that the user adopts a fast adjustment strategy, that is, the physical position of the handheld controller is moved by a fast adjustment strategy, then the above-mentioned method 1 may be used for processing; if the response message indicates that the user adopts a slow adjustment strategy, that is, the physical position of the handheld controller is moved by a slow adjustment strategy, then the above-mentioned method 2 may be used for processing.
[0106] The inquiry message may be a user interface prompt message, and the response message may be a user interface response message. Alternatively, the inquiry message may be a voice prompt message, and the response message may be a voice response message. Alternatively, the inquiry message may be an animation prompt message, and the response message may be an animation response message.
[0107] In a possible implementation, after step 204, the target interface may be operated, and after the operation on the target interface is completed, the virtual position of the virtual controller may be moved back outside the target interface. When the physical position of the handheld controller is moved back to the initial physical position matching the target interface, the virtual position of the virtual controller is moved back into the target interface.
[0108] Exemplarily, after completing the operation on the target interface, the virtual position of the virtual controller can be directly moved outside the target interface. Alternatively, a prompt message for resetting the physical position of the handheld controller can be sent. If a response message agreeing to reset the physical position of the handheld controller is received, the virtual position of the virtual controller is moved outside the target interface again.
[0109] For example, a prompt message may be sent to the user. After the user receives the prompt message, if the user agrees to reset the physical position of the handheld controller, a response message to the prompt message is returned.
[0110] If the user disagrees with resetting the physical position of the handheld controller, no response message is returned, or a rejection message is returned, which is used to indicate disagreement with resetting the physical position of the handheld controller. On this basis, the virtual position of the virtual controller will not be moved outside the target interface.
[0111] The prompt message may be a user interface prompt message, and the response message may be a user interface response message. Alternatively, the prompt message may be a voice prompt message, and the response message may be a voice response message. Alternatively, the prompt message may be an animation prompt message, and the response message may be an animation response message.
[0112] Exemplarily, moving the virtual position of the virtual controller to the outside of the target interface and moving the virtual position of the handheld controller to the initial physical position (from the target physical position to the initial physical position) may include the following methods:
[0113] Method 1: Based on the distance between the target physical position of the handheld controller and the initial physical position of the handheld controller, determine the moving distance of the virtual position of the virtual controller, and based on the azimuth relationship between the target physical position of the handheld controller and the initial physical position of the handheld controller, determine the moving direction of the virtual position of the virtual controller. Move the virtual position of the virtual controller outside the target interface based on the moving distance and the moving direction. Furthermore, after the virtual position of the virtual controller is moved outside the target interface, the virtual position of the virtual controller in the virtual screen can be controlled by controlling the physical position of the handheld controller. Finally, when the physical position of the handheld controller moves from the target physical position to the initial physical position, the virtual position of the virtual controller is moved back to the target interface.
[0114] The implementation process of method 1 is similar to that of method 1, which will not be described in detail here. The difference is that in method 1, the movement is from the initial physical position to the target physical position, while in method 1, the movement is from the target physical position to the initial physical position. For example, the movement direction of method 1 is upward, while the movement direction of method 1 is downward.
[0115] Method 2: Determine the moving direction of the virtual position of the virtual controller based on the azimuth relationship between the target physical position of the handheld controller and the initial physical position of the handheld controller. Move the virtual position of the virtual controller outside the target interface based on a preset distance and the moving direction, where the preset distance represents a pre-configured distance to be moved. Furthermore, after the virtual position of the virtual controller is moved outside the target interface, the virtual position of the virtual controller in the virtual screen can be controlled by controlling the physical position of the handheld controller. For example, after the physical position of the handheld controller moves from the target physical position to a physical distance that matches the preset distance, the virtual position of the virtual controller is moved back into the target interface.
[0116] Then, it is determined whether the physical position of the handheld controller after the movement is the initial physical position. If not, the physical position after the movement is used as the target physical position, and the operation of moving the virtual position of the virtual controller outside the target interface based on the preset distance and the moving direction is returned. If yes, the operation of moving the virtual position of the virtual controller outside the target interface is stopped, and the movement operation of the physical position of the handheld controller is stopped. At this point, the physical position of the handheld controller moves from the target physical position to the initial physical position.
[0117] The implementation process of method 2 is similar to that of method 2, and will not be described in detail here. The difference is that in method 2, the movement is from the initial physical position to the target physical position, while in method 2, the movement is from the target physical position to the initial physical position. For example, the moving direction of method 2 is upward, and the moving direction of method 2 is downward.
[0118] In one example, the above execution order is just an example given for the convenience of description. In practical applications, the execution order between the steps can also be changed, and there is no limitation on this execution order. Moreover, in other embodiments, the steps of the corresponding method are not necessarily executed in the order shown and described in this specification, and the steps included in the method may be more or less than those described in this specification. In addition, a single step described in this specification may be decomposed into multiple steps for description in other embodiments; multiple steps described in this specification may also be combined into a single step for description in other embodiments.
[0119] Based on the above technical solution, in an embodiment of the present application, in a virtual reality or augmented reality scenario, when the physical position of the handheld controller is the initial physical position (i.e., a non-comfortable position, such as above the head, etc.), by moving the virtual position of the virtual controller outside the target interface, the user is prompted to move the physical position of the handheld controller from the initial physical position to the target physical position (i.e., a comfortable position, such as the waist position, etc.), so that the user can operate the target interface in a comfortable position, which can minimize the impact on the user experience, that is, it can avoid a rapid decline in the user experience and improve the user experience.
[0120] Based on the same application concept as the above method, the present application embodiment proposes another virtual content display method, see Figure 3 As shown, it is a flow chart of the method, which is applied to a virtual processing device, the virtual processing device may include a processing device, a display device and a handheld controller, the display device may include virtual reality glasses, augmented reality glasses, holographic glasses, virtual reality helmets, augmented reality helmets, head-mounted displays, etc. The method can be applied to the processing device in the virtual processing device, and the method may include:
[0121] Step 301, generate a virtual screen using virtual data, and display the virtual screen through a display device in a virtual processing device; wherein the virtual screen includes a target interface and a virtual controller, and the virtual position of the virtual controller is controlled by the physical position of the handheld controller.
[0122] Step 302: When the physical position of the handheld controller moves to an initial physical position that matches the target interface, the virtual position of the virtual controller is moved into the target interface.
[0123] Step 303: If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface.
[0124] Step 304, when the physical position of the handheld controller moves from the initial physical position to the target physical position, the virtual position of the virtual controller is moved back to the target interface.
[0125] Illustratively, steps 301 to 304 may refer to steps 201 to 204 and are not described in detail here.
[0126] Based on the same application concept as the above method, the present application embodiment proposes another virtual content display method, see Figure 4 FIG. 1 is a flow chart of a method for displaying virtual content. The method is applied to a virtual processing device, such as a processing device in a virtual processing device. The method may include:
[0127] Step 401, determine whether to adjust the physical position of the handheld controller. If yes, execute step 402, if not, use the initial default interaction form, and this implementation is not limited in this article.
[0128] When the physical position of the handheld controller moves to the initial physical position, the virtual position of the virtual controller is moved to the target interface, and on this basis, if it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the physical position of the handheld controller is directly determined to be adjusted. Alternatively, a prompt message is sent to indicate that the physical position of the handheld controller needs to be adjusted, and if a response message to the prompt message is received, and the response message indicates that the physical position of the handheld controller is agreed to be adjusted, the physical position of the handheld controller is determined to be adjusted, otherwise, the physical position of the handheld controller is determined not to be adjusted.
[0129] Step 402, determining the adjustment strategy for moving the physical position of the handheld controller, which adjustment strategy can be a fast adjustment strategy or a slow adjustment strategy. If the adjustment strategy is a fast adjustment strategy, then executing step 403, if the adjustment strategy is a slow adjustment strategy, then executing step 404.
[0130] Exemplarily, a query message may be sent to the user, the query message being used to inquire whether to adopt a fast adjustment strategy or a slow adjustment strategy. If a response message to the query message is received, and the response message indicates that the user adopts a fast adjustment strategy, then the adjustment strategy is determined to be a fast adjustment strategy. If the response message indicates that the user adopts a slow adjustment strategy, then the adjustment strategy is determined to be a slow adjustment strategy.
[0131] Exemplarily, the fast adjustment strategy is used to indicate that the physical position of the handheld controller is moved quickly, that is, the physical position of the handheld controller is quickly adjusted to a more comfortable position near the waist.
[0132] The slow adjustment strategy is used to indicate that the physical position of the handheld controller is moved slowly and smoothly, that is, the physical position of the handheld controller is adjusted slowly and smoothly to a more comfortable position near the waist.
[0133] Step 403, quickly move the virtual position of the virtual controller outside the target interface, guide the user to immediately adjust the physical position of the handheld controller, and move the physical position of the handheld controller to the target physical position.
[0134] Exemplarily, the implementation method of step 403 may refer to the above-mentioned method 1, which will not be described in detail here.
[0135] Step 404, slowly move the virtual position of the virtual controller to outside the target interface, guide the user to slowly adjust the physical position of the handheld controller, and move the physical position of the handheld controller to the target physical position.
[0136] Exemplarily, the implementation method of step 404 may refer to the above-mentioned method 2, which will not be described in detail here.
[0137] Exemplarily, the user immediately adjusting the physical position of the handheld controller means that the user can adjust the physical position of the handheld controller to the target physical position through one adjustment process.
[0138] Exemplarily, the user slowly adjusting the physical position of the handheld controller means that the user can adjust the physical position of the handheld controller to the target physical position through multiple adjustment processes.
[0139] Step 405: After the operation on the target interface is completed, it is determined whether the physical position of the handheld controller is reset. If so, the physical position of the handheld controller is moved back to the initial physical position and the initial default interaction mode is used. If not, the physical position of the handheld controller is kept unchanged.
[0140] After completing the operation on the target interface, a prompt message for resetting the physical position of the handheld controller may be sent. If a response message agreeing to reset the physical position of the handheld controller is received, it indicates that the physical position of the handheld controller is reset. If no response message agreeing to reset the physical position of the handheld controller is received, it indicates that the physical position of the handheld controller is not reset.
[0141] In the above embodiments, the interaction process between the virtual processing device and the user can be achieved through a UI (user interface), can also be achieved through voice, or can be achieved through a small animation, and there is no limitation to this.
[0142] Based on the above technical solution, in the embodiment of the present application, the user is given sufficient freedom to choose whether to adjust the physical position (or posture) of the handheld controller. For the virtual reality content distribution platform, it can meet the needs of different virtual reality content, and the user can choose whether to adjust the physical position of the handheld controller according to the specific situation of the content. For lightweight virtual reality games, taking applications such as virtual reality painting as an example, the user automatically adjusts the handheld controller in the real space to a comfortable position according to the position in the virtual space under guidance, providing a more optimized experience for a long-term immersive experience. After the user enters the virtual reality environment, when encountering a handheld controller that requires a more extreme interactive posture, the user can adjust the handheld controller to a more comfortable waist position according to the guidance with a large degree of freedom, ensuring that the user can have a comfortable experience in virtual reality content or virtual reality games.
[0143] Based on the same application concept as the above method, the embodiment of the present application also provides a virtual content display device, such as Figure 5 As shown, it is a structural diagram of the device, and the device includes: a display module 51, which is used to display a virtual screen using virtual data, and the virtual screen includes a target interface and a virtual controller, and the virtual position of the virtual controller is controlled by the physical position of the handheld controller; a first processing module 52, which is used to move the virtual position of the virtual controller to the target interface when the physical position of the handheld controller moves to the initial physical position matching the target interface; a second processing module 53, which is used to move the virtual position of the virtual controller outside the target interface if it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted; a third processing module 54, which is used to move the virtual position of the virtual controller back to the target interface when the physical position of the handheld controller moves from the initial physical position to the target physical position.
[0144] In a possible implementation manner, when the second processing module 53 determines that the physical position of the handheld controller needs to be adjusted based on the initial physical position of the handheld controller, it is specifically configured to:
[0145] If the initial physical position of the handheld controller belongs to a first position set, it is determined that the physical position of the handheld controller needs to be adjusted, and the first position set includes the physical position that needs to be adjusted; or,
[0146] If the initial physical position of the handheld controller does not belong to the second position set, it is determined that the physical position of the handheld controller needs to be adjusted, and the second position set includes physical positions that do not need to be adjusted.
[0147] When the second processing module 53 moves the virtual position of the virtual controller outside the target interface, it is specifically used to: send a prompt message indicating that the physical position of the handheld controller needs to be adjusted;
[0148] If a response message to the prompt message is received, and the response message indicates that the physical position of the handheld controller is agreed to be adjusted, the virtual position of the virtual controller is moved outside the target interface.
[0149] When the second processing module 53 moves the virtual position of the virtual controller outside the target interface, it is specifically used to: determine the moving distance of the virtual position of the virtual controller based on the distance between the initial physical position of the handheld controller and the target physical position of the handheld controller; determine the moving direction of the virtual position of the virtual controller based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller; and move the virtual position of the virtual controller outside the target interface based on the moving distance and the moving direction.
[0150] When the second processing module 53 moves the virtual position of the virtual controller outside the target interface, it is specifically used to: determine the moving direction of the virtual position of the virtual controller based on the orientation relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller;
[0151] The virtual position of the virtual controller is moved outside the target interface based on a preset distance and the moving direction, wherein the preset distance represents a pre-configured distance to be moved.
[0152] The second processing module 53 is also used to: after moving the virtual position of the virtual controller to outside the target interface based on the preset distance and the moving direction, after the physical position of the handheld controller moves from the initial physical position to a physical distance matching the preset distance, move the virtual position of the virtual controller back to the target interface; determine whether the physical position of the handheld controller after movement is the target physical position; if not, take the physical position after movement as the initial physical position, and return to execute the operation of moving the virtual position of the virtual controller to outside the target interface based on the preset distance and the moving direction.
[0153] Based on the same application concept as the above method, the embodiment of the present application further provides a virtual processing device, including: a processor and a machine-readable storage medium, wherein the machine-readable storage medium stores a plurality of computer instructions, and the processor performs the following processing when executing the computer instructions:
[0154] Displaying a virtual screen using virtual data, the virtual screen including a target interface and a virtual controller, the virtual position of the virtual controller being controlled by the physical position of the handheld controller;
[0155] When the physical position of the handheld controller moves to an initial physical position matching the target interface, moving the virtual position of the virtual controller into the target interface;
[0156] If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface;
[0157] When the physical position of the handheld controller moves from the initial physical position to the target physical position, the virtual position of the virtual controller is moved back to the target interface.
[0158] The present application also provides a machine-readable storage medium, on which a number of computer instructions are stored; when the computer instructions are executed, the following processing is performed:
[0159] Displaying a virtual screen using virtual data, the virtual screen including a target interface and a virtual controller, the virtual position of the virtual controller being controlled by the physical position of the handheld controller;
[0160] When the physical position of the handheld controller moves to an initial physical position matching the target interface, moving the virtual position of the virtual controller into the target interface;
[0161] If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface;
[0162] When the physical position of the handheld controller moves from the initial physical position to the target physical position, the virtual position of the virtual controller is moved back to the target interface.
[0163] See also Figure 6 As shown, it is a structural diagram of a virtual processing device proposed in an embodiment of the present application, and the virtual processing device 60 may include: a processor 61, a network interface 62, a bus 63, and a memory 64. The memory 64 may be any electronic, magnetic, optical or other physical storage device, and may contain or store information, such as executable instructions, data, etc. For example, the memory 64 may be: RAM (Radom Access Memory, random access memory), volatile memory, non-volatile memory, flash memory, storage drive (such as hard disk drive), solid state hard disk, any type of storage disk (such as optical disk, DVD, etc.).
[0164] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, a game console, a tablet computer, a wearable device or a combination of any of these devices.
[0165] For the convenience of description, the above device is described in various units according to their functions. Of course, when implementing the present application, the functions of each unit can be implemented in the same or multiple software and / or hardware.
[0166] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the embodiments of the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0167] The present application is described with reference to the flowchart and / or block diagram of the method, device (system) and computer program product according to the embodiment of the present application. It should be understood that each flow process and / or box in the flow chart and / or block diagram and the combination of the flow chart and / or box in the flow chart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processing machine or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for realizing the function specified in one flow chart or multiple flows and / or one box or multiple boxes of the block diagram.
[0168] Moreover, these computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0169] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0170] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims
1. A virtual content display method, the method comprising: Displaying a virtual screen using virtual data, the virtual screen including a target interface and a virtual controller, the virtual position of the virtual controller being controlled by the physical position of the handheld controller; When the physical position of the handheld controller moves to an initial physical position matching the target interface, moving the virtual position of the virtual controller into the target interface; If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface; When the physical position of the handheld controller moves from the initial physical position to the target physical position, moving the virtual position of the virtual controller back to the target interface; Wherein, moving the virtual position of the virtual controller outside the target interface includes: Determine the moving distance of the virtual position of the virtual controller based on the distance between the initial physical position of the handheld controller and the target physical position of the handheld controller; determine the moving direction of the virtual position of the virtual controller based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller; move the virtual position of the virtual controller outside the target interface based on the moving distance and the moving direction; Alternatively, based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller, the moving direction of the virtual position of the virtual controller is determined; based on a preset distance and the moving direction, the virtual position of the virtual controller is moved outside the target interface, and the preset distance represents a pre-configured distance to be moved.
2. The method according to claim 1, wherein determining that the physical position of the handheld controller needs to be adjusted based on the initial physical position of the handheld controller comprises: If the initial physical position of the handheld controller belongs to a first position set, it is determined that the physical position of the handheld controller needs to be adjusted, and the first position set includes the physical position that needs to be adjusted; or, If the initial physical position of the handheld controller does not belong to the second position set, it is determined that the physical position of the handheld controller needs to be adjusted, and the second position set includes physical positions that do not need to be adjusted.
3. The method according to claim 1, The step of moving the virtual position of the virtual controller outside the target interface includes: Sending a prompt message indicating that the physical position of the handheld controller needs to be adjusted; If a response message to the prompt message is received, and the response message indicates that the physical position of the handheld controller is agreed to be adjusted, the virtual position of the virtual controller is moved outside the target interface.
4. The method according to claim 1, after moving the virtual position of the virtual controller outside the target interface based on the preset distance and the moving direction, further comprising: After the physical position of the handheld controller moves from the initial physical position by a physical distance matching the preset distance, moving the virtual position of the virtual controller back into the target interface; Determining whether the physical position of the handheld controller after movement is a target physical position; If not, the moved physical position is used as the initial physical position, and the operation of moving the virtual position of the virtual controller outside the target interface based on the preset distance and the moving direction is returned to be executed.
5. The method according to claim 1, after re-moving the virtual position of the virtual controller to the target interface, the method further comprises: Performing an operation on the target interface, and after completing the operation on the target interface, re-moving the virtual position of the virtual controller to outside the target interface; When the physical position of the handheld controller is moved back to the initial physical position matching the target interface, the virtual position of the virtual controller is moved back to the target interface.
6. The method according to claim 5, The step of re-moving the virtual position of the virtual controller outside the target interface includes: Sending a prompt message for resetting the physical position of the handheld controller; If a response message agreeing to reset the physical position of the handheld controller is received, the virtual position of the virtual controller is moved outside the target interface again.
7. The method according to claim 3 or 6, The prompt message is a user interface prompt message; or, The prompt message is a voice prompt message; or, The prompt message is an animation prompt message.
8. The method according to claim 1, The virtual picture is a virtual picture with six degrees of freedom; or, The virtual picture is a virtual picture with three degrees of freedom.
9. A method for displaying virtual content, applied to a virtual processing device, the virtual processing device comprising a display device and a handheld controller, the method comprising: Generate a virtual screen using virtual data, and display the virtual screen through the display device; wherein the virtual screen includes a target interface and a virtual controller, and the virtual position of the virtual controller is controlled by the physical position of the handheld controller; When the physical position of the handheld controller moves to an initial physical position matching the target interface, moving the virtual position of the virtual controller into the target interface; If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface; When the physical position of the handheld controller moves from the initial physical position to the target physical position, moving the virtual position of the virtual controller back to the target interface; Wherein, moving the virtual position of the virtual controller outside the target interface includes: Determine the moving distance of the virtual position of the virtual controller based on the distance between the initial physical position of the handheld controller and the target physical position of the handheld controller; determine the moving direction of the virtual position of the virtual controller based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller; move the virtual position of the virtual controller outside the target interface based on the moving distance and the moving direction; Alternatively, based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller, the moving direction of the virtual position of the virtual controller is determined; based on a preset distance and the moving direction, the virtual position of the virtual controller is moved outside the target interface, and the preset distance represents a pre-configured distance to be moved.
10. The method according to claim 9, wherein the display device comprises: Virtual reality glasses, augmented reality glasses, holographic glasses, virtual reality helmet, augmented reality helmet, head mounted display.
11. A virtual content display device, the device comprising: A display module, used to display a virtual screen using virtual data, wherein the virtual screen includes a target interface and a virtual controller, and the virtual position of the virtual controller is controlled by the physical position of the handheld controller; A first processing module, configured to move the virtual position of the virtual controller to the target interface when the physical position of the handheld controller moves to an initial physical position matching the target interface; A second processing module, configured to move the virtual position of the virtual controller outside the target interface if it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted; A third processing module, configured to move the virtual position of the virtual controller back to the target interface when the physical position of the handheld controller moves from the initial physical position to the target physical position; Wherein, when the second processing module moves the virtual position of the virtual controller outside the target interface, it is specifically used to: determine the moving distance of the virtual position of the virtual controller based on the distance between the initial physical position of the handheld controller and the target physical position of the handheld controller; determine the moving direction of the virtual position of the virtual controller based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller; move the virtual position of the virtual controller outside the target interface based on the moving distance and the moving direction; Alternatively, based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller, the moving direction of the virtual position of the virtual controller is determined; based on a preset distance and the moving direction, the virtual position of the virtual controller is moved outside the target interface, and the preset distance represents a pre-configured distance to be moved.
12. A virtual processing device, comprising: A processor and a machine-readable storage medium, wherein the machine-readable storage medium stores a plurality of computer instructions, and when the processor executes the computer instructions, the processor performs the following processing: Displaying a virtual screen using virtual data, the virtual screen including a target interface and a virtual controller, the virtual position of the virtual controller being controlled by the physical position of the handheld controller; When the physical position of the handheld controller moves to an initial physical position matching the target interface, moving the virtual position of the virtual controller into the target interface; If it is determined based on the initial physical position of the handheld controller that the physical position of the handheld controller needs to be adjusted, the virtual position of the virtual controller is moved outside the target interface; When the physical position of the handheld controller moves from the initial physical position to the target physical position, moving the virtual position of the virtual controller back to the target interface; Wherein, moving the virtual position of the virtual controller outside the target interface includes: Determine the moving distance of the virtual position of the virtual controller based on the distance between the initial physical position of the handheld controller and the target physical position of the handheld controller; determine the moving direction of the virtual position of the virtual controller based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller; move the virtual position of the virtual controller outside the target interface based on the moving distance and the moving direction; Alternatively, based on the azimuth relationship between the initial physical position of the handheld controller and the target physical position of the handheld controller, the moving direction of the virtual position of the virtual controller is determined; based on a preset distance and the moving direction, the virtual position of the virtual controller is moved outside the target interface, and the preset distance represents a pre-configured distance to be moved.
