Method for providing virtual plane, host and computer readable storage medium

Abstract

The embodiment of the invention provides a method for providing a virtual plane, a host and a computer readable storage medium. The method comprises the steps of tracking a hand gesture and judging whether the hand executes a target gesture; in response to determining that the hand has performed the target gesture, providing a virtual plane at a reference height in a virtual world of the real service; and displaying a height adjustment component in the virtual world, wherein the height adjustment component is used for adjusting the height of the virtual plane in the virtual world.

Description

Technical Field

[0001] The present invention relates to a mechanism for providing real services, and in particular to a method, a host, and a computer-readable storage medium for providing a virtual plane. Background Art

[0002] In virtual reality (VR) technology, virtual desktop solutions enable users to operate another computer in a VR environment. This technology projects the user's computer desktop into the VR space, allowing them to seamlessly access and control applications, files, and other functions. The main features of virtual desktops include multitasking capabilities with multiple virtual screens, immersive experiences that reduce external distractions, and the flexibility to access the computer from anywhere without physical hardware interaction. These solutions are particularly beneficial for remote work, professional training, and immersive entertainment, using streaming technology to transmit the video and audio content of the desktop to a VR headset while providing low-latency control feedback for interactions such as clicks, drags, and keyboard inputs.

[0003] However, there is currently no better technical means to effectively configure the appearance (e.g., size and / or height) of a virtual desktop in a VR environment. Summary of the Invention

[0004] In view of this, the present invention provides a method, a host, and a computer-readable storage medium for providing a virtual plane, which can be used to solve the above technical problems.

[0005] An embodiment of the present invention provides a method for providing a virtual plane applied to a host. The method includes: the host tracking a hand gesture and determining whether the hand performs a target gesture; in response to determining that the hand has performed the target gesture, the host providing a virtual plane at a reference height in the virtual world of the real service; and the host displaying a height adjustment component in the virtual world, where the height adjustment component is used to adjust the height of the virtual plane in the virtual world.

[0006] An embodiment of the present invention provides a host, which includes a storage circuit and a processor. The storage circuit stores program code. The processor is coupled to the storage circuit and accesses the program code to perform: tracking a hand gesture and determining whether the hand performs a target gesture; in response to determining that the hand has performed the target gesture, providing a virtual plane at a reference height in the virtual world of the real service; and displaying a height adjustment component in the virtual world, where the height adjustment component is used to adjust the height of the virtual plane in the virtual world.

[0007] An embodiment of the present invention provides a non-transitory computer-readable storage medium that records an executable computer program. The executable computer program is loaded by a host to execute steps of: tracking a gesture of a hand and determining whether the hand executes a target gesture; in response to determining that the hand has executed the target gesture, providing a virtual plane at a reference height in a virtual world of a reality service; and displaying a height adjustment component in the virtual world, where the height adjustment component is used to adjust the height of the virtual plane in the virtual world. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 FIG. illustrates a schematic diagram of a host according to an embodiment of the present invention.

[0009] Figure 2 FIG. illustrates a flowchart of a method for dynamically illustrating a virtual boundary according to an embodiment of the present invention.

[0010] Figure 3 FIG. illustrates an application scenario according to an embodiment of the present invention.

[0011] Figure 4 FIG. illustrates according to Figure 3 a schematic diagram of a triggered size adjustment component.

[0012] Figure 5 FIG. illustrates according to Figure 3 a schematic diagram of a triggered height adjustment component.

[0013] Figure 6 FIG. illustrates a schematic diagram of starting a virtual desktop application according to an embodiment of the present invention.

[0014] Figure 7 FIG. illustrates a schematic diagram of determining a virtual rectangular area according to an embodiment of the present invention.

[0015] DESCRIPTION OF THE REFERENCE NUMERALS DETAILED DESCRIPTION

[0016] Referring to Figure 1 , which illustrates a schematic diagram of a host according to an embodiment of the present invention. In various embodiments, the host 100 can be any device capable of performing a tracking function (e.g., tracking from the inside out and / or from the outside in) on one or more objects to be tracked (e.g., the hand of a user of the host 100) within the tracking range of the host 100. In an embodiment of the present invention, the host 100 can be configured with a tracking camera, and the image capture range thereof corresponds to the tracking range. When an object to be tracked (e.g., a hand) is within the tracking range, the camera on the host 100 can capture an image of the object to be tracked, and the host 100 can track the posture of each object to be tracked according to the captured image, but the present invention is not limited thereto.

[0017] In some embodiments, the host 100 may track the gestures of a hand within the tracking range. In one embodiment, the host 100 may render a hand object in the visual content provided by the host 100 based on the tracked hand gestures.

[0018] In various embodiments, the host 100 may be any intelligent device and / or computer device capable of providing visual content for reality services, such as virtual reality (VR) services, augmented reality (AR) services, mixed reality (MR) services, and / or extended reality (XR) services, but the present invention is not limited thereto. In some embodiments, the host 100 may be a head-mounted display (HMD) capable of displaying / providing visual content (e.g., AR / VR / MR content) for the wearer / user to view. To better understand the concept of the present invention, it is assumed that the host 100 is an MR device (e.g., an MR HMD) for providing MR content for the user to view, but the present invention is not limited thereto.

[0019] In an embodiment where the visual content is MR content, the MR content may include a pass-through image and at least one rendered virtual object overlaid on the pass-through image. In this case, the pass-through image is used as the underlying image of the visual content.

[0020] In one embodiment, the pass-through image may be rendered by a processor 104 of the host 100, for example, based on an image captured by a front camera of the host 100. In this case, a user wearing the host 100 (e.g., an HMD) can see the real-world scene in front of the user through the pass-through image in the visual content provided by the host 100.

[0021] In one embodiment, the processor 104 may render one or more virtual objects according to an MR application currently running on the host 100, and the processor 104 may overlay the rendered virtual objects on the rendered pass-through image to form / generate visual content (e.g., MR content).

[0022] In one embodiment, the host 100 may be configured with a built-in display to display visual content for the user to view. Additionally or alternatively, the host 100 may be connected to one or more external displays, and the host 100 may transmit the visual content to the external displays for the external displays to display the visual content, but the present invention is not limited thereto.

[0023] In Figure 1 it, the host 100 includes a storage circuit 102 and a processor 104. The storage circuit 102 is a combination of one or more static or mobile random access memories (RAMs), read-only memories (ROMs), flash memories, hard disks, or any other similar devices that record a plurality of modules executable by the processor 104.

[0024] The processor 104 may be coupled to the storage circuit 102. The processor 104 may be, for example, a general-purpose processor, a special-purpose processor, a conventional processor, a digital signal processor (DSP), multiple microprocessors, one or more microprocessors associated with a DSP core, a controller, a microcontroller, an application-specific integrated circuit (ASICs), a field-programmable gate array (FPGAs) circuit, any other type of integrated circuit (IC), a state machine, a graphics processing unit (GPU), etc.

[0025] In an embodiment of the present invention, the processor 104 may access the modules and / or program codes stored in the storage circuit 102 to implement the method for providing a virtual plane provided in the present invention, which will be further discussed below.

[0026] See Figure 2 , which illustrates a flowchart of a method for dynamically displaying a virtual boundary according to an embodiment of the present invention. The method of this embodiment may be executed by the host 100 in Figure 1 , and the details of each step in Figure 2 will be described in conjunction with the components shown in Figure 1 .

[0027] In step S210, the processor 104 tracks the gesture of the hand and determines whether this hand executes a target gesture.

[0028] For better understanding, Figure 3 will be used as an example, which illustrates an application scenario according to an embodiment of the present invention, but the present invention is not limited thereto.

[0029] In Figure 3 , the scenario may correspond to the desktop configuration process of an application for real-world services, where the application may be a virtual desktop application for a mixed reality service. The desktop configuration process may allow the user to determine the configuration (e.g., size and / or position) of the virtual desktop used in the virtual desktop application, but the present invention is not limited thereto.

[0030] In this embodiment, the processor 104 may display the visual content 300 of the virtual world, where Figure 3 the virtual world in

[0031] may be assumed to be a mixed reality world, for example, but the present invention is not limited thereto. Figure 3 As can be seen from

[0032] In this embodiment, the virtual object overlaid on the background of the visual content 300 may include a window object O, which illustratively shows some indications of interacting with the mixed reality world, such as an indication to configure a virtual desktop, but the present invention is not limited thereto.

[0033] In addition, the virtual object overlaid on the background of the visual content 300 may further include a hand object 39a, which is rendered based on the gesture of the tracked hand 39 (e.g., the right hand of the user of the host 100), but the present invention is not limited thereto.

[0034] In an embodiment of the present invention, the target gesture may be assumed to be but not limited to a pinch-and-release gesture, but the present invention is not limited thereto.

[0035] In one embodiment, in response to determining that the hand 39 does not execute the target gesture, the processor 104 may continuously track the gesture of the hand 39.

[0036] On the other hand, in step S220, in response to determining that the hand 39 has executed the target gesture, the processor 104 provides a virtual plane 30 at a reference height in the virtual world (e.g., the mixed reality world) of the real service (e.g., the mixed reality service), where the reference height corresponds to the hand 39.

[0037] In Figure 3 In the left scene, when the pinch part of the pinch-and-release gesture (e.g., the target gesture) is detected, the processor 104 may display a virtual rectangular area 30a for the user to visually check whether the position of the virtual rectangular area 30a is acceptable. In this embodiment, the virtual rectangular area 30a may be understood as showing the reference appearance of the virtual desktop, but the present invention is not limited thereto.

[0038] In Figure 3 the virtual rectangular area 30a may be a virtual rectangular area displayed with a predetermined width and a predetermined length, and one corner thereof is aligned with a specific part of the hand 39 (e.g., the angle formed by the index finger and the thumb).

[0039] In this case, the user may drag the virtual rectangular area 30a to any desired position in the virtual world while maintaining the pinch part of the pinch-and-release gesture.

[0040] In Figure 3 the desired position of the virtual rectangular area 30a may be a position where the height of the virtual rectangular area 30a corresponds to the height of the real-world desktop and one side of the virtual rectangular area 30a is aligned with the edge of the real-world table, but the present invention is not limited thereto.

[0041] In one embodiment, once the user determines that the position of the virtual rectangular region 30a is acceptable (e.g., acceptable as a virtual desktop), the user can perform the release part of a pinch-and-release gesture (e.g., the target gesture), as Figure 3 shown on the right side.

[0042] In this case, the processor 104 can determine that the hand 39 has performed the target gesture and accordingly provide the virtual plane 30 (e.g., the virtual desktop) at a reference height in the virtual world. In one embodiment, the processor 104 can fix the virtual rectangular region 30a as the provided virtual plane 30, which causes the virtual plane 30 to also have a predetermined width and a predetermined length, but the present invention is not limited thereto.

[0043] In Figure 3 , the reference height can be the height at which the hand 39 is detected to be performing the target gesture. From another perspective, the processor 104 can use the height of the hand object 39a in the virtual world as the height of the provided virtual plane 30, but the present invention is not limited thereto.

[0044] In one embodiment, the processor 104 can directly provide the virtual plane 30 when detecting the target gesture without first providing the virtual rectangular region 30a. In this case, the processor 104 may not display the virtual rectangular region 30a when detecting the pinch part of the pinch-and-release gesture, but directly display the virtual plane 30 at the reference height when detecting the release part of the pinch-and-release gesture, but the present invention is not limited thereto.

[0045] In step S230, the processor 104 displays a height adjustment component 31 in the virtual world, where the height adjustment component 31 is used to adjust the height of the virtual plane 30 in the virtual world.

[0046] In an embodiment of the present invention, the height adjustment component 31 can have a first visual type, which can be adjusted / changed to provide a visual aid.

[0047] For example, the processor 104 can determine whether a first distance between the hand 39 (and / or the hand object 39a) and the height adjustment component 31 is less than a first distance threshold.

[0048] In one embodiment, in response to determining that the first distance between the hand 39 and the height adjustment component 31 is not less than the first distance threshold (e.g., Figure 3 the scenario on the right side), the processor 104 can determine the first visual type of the height adjustment component 31 as a predetermined type. In Figure 3 , the height adjustment component 31 having the predetermined type can be, for example, a transparent strip object, but the present invention is not limited thereto.

[0049] In an embodiment of the present invention, the relative position between the height adjustment component 31 and the virtual plane 30 may be fixed. That is, when the height adjustment component 31 moves (e.g., up or down), the virtual plane 30 will move accordingly (e.g., up or down).

[0050] In one embodiment, in response to determining that a first distance between the hand 39 and the height adjustment component 31 is less than a first distance threshold, the processor 104 may change a first visual type of the height adjustment component 31 to a first type. In another embodiment, in response to determining that the hand 39 has triggered the height adjustment component 31, the processor 104 may further change the first visual type of the height adjustment component 31 to a second type. These scenarios will be further described in Figure 5 which will be introduced further below.

[0051] In one embodiment, the processor 104 may further provide a size adjustment component 32, where the size adjustment component 32 is used to adjust the size of the virtual plane 30.

[0052] In an embodiment of the present invention, the size adjustment component 32 may have a second visual type, which can be adjusted / changed to provide visual assistance.

[0053] For example, the processor 104 may determine whether a second distance between the hand 39 (and / or the hand object 39a) and the size adjustment component 32 is less than a second distance threshold.

[0054] In one embodiment, in response to determining that the second distance between the hand 39 and the size adjustment component 32 is not less than the second distance threshold, the processor 104 may determine the second visual type of the size adjustment component 32 as a predetermined type. In one embodiment, the size adjustment component 32 having the predetermined type may be, for example, a transparent L-shaped object aligned with the lower right corner of the virtual plane 30, but the present invention is not limited thereto.

[0055] In one embodiment, in response to determining that the second distance between the hand 39 and the size adjustment component 32 is less than the second distance threshold (e.g., Figure 3 the scenario on the right side), the processor 104 may change the second visual type of the size adjustment component 32 to a third type 321. In Figure 3 the size adjustment component 32 having the third type 321 may be a colored L-shaped object aligned with the lower right corner of the virtual plane 30, but the present invention is not limited thereto.

[0056] In another embodiment, in response to determining that the hand 39 has triggered the size adjustment component 32, the processor 104 may further change the second visual type of the size adjustment component 32 to a fourth type.

[0057] See Figure 4 which illustrates according toFigure 3 Schematic diagram of the triggered size adjustment component shown

[0058] In this embodiment, when the second distance between the hand 39 and the size adjustment component 32 is less than the second distance threshold, the user can perform a pinching gesture to trigger the size adjustment component 32.

[0059] In this case, the processor 104 can determine that the hand 39 has triggered the size adjustment component 32, and accordingly change the second visual type of the size adjustment component 32 to the fourth type 322. In Figure 4 , the size adjustment component 32 with the fourth type 322 can be a cross-shaped object whose center is aligned with the lower right corner of the virtual plane 30, but the present invention is not limited thereto. In other embodiments, the size adjustment component 32 with the fourth type 322 can be implemented by another object having a different color or shape from the size adjustment component 32 of the third type 321, but the present invention is not limited thereto.

[0060] In this case, the user can drag the size adjustment component 32 with the fourth type 322 while maintaining the pinching gesture to adjust the size of the virtual plane 30, where the lower right corner of the virtual plane 30 will remain aligned with the center of the cross-shaped object during the user's dragging of the size adjustment component 32, but the present invention is not limited thereto.

[0061] See Figure 5 , which illustrates a schematic diagram of the triggered height adjustment component according to Figure 3 shown

[0062] In Figure 5 the left scene, it can be assumed that the processor 104 determines that the first distance between the hand 39 and the height adjustment component 31 is less than the first distance threshold, so the processor 104 can change the first visual type of the height adjustment component 31 to the first type 311. In Figure 5 , the height adjustment component 31 with the first type 311 can be a colored strip-shaped object, but the present invention is not limited thereto.

[0063] In Figure 5 the right scene, when the first distance between the hand 39 and the height adjustment component 31 is less than the first distance threshold, the user can perform a pinching gesture to trigger the height adjustment component 31.

[0064] In this case, the processor 104 can determine that the hand 39 has triggered the height adjustment component 31, and accordingly change the first visual type of the height adjustment component 31 to the second type 312. In Figure 5In [the above], the height adjustment component 31 of the second type 312 may be a colored arc-shaped object. In other embodiments, the height adjustment component 31 of the second type 312 may be implemented with another object having a color or shape different from that of the height adjustment component 31 of the first type 311, but the present invention is not limited thereto.

[0065] In this case, the user can drag the height adjustment component 31 of the second type 312 up / down while maintaining the pinch gesture to adjust the height of the virtual plane 30.

[0066] In one embodiment, after the virtual plane 30 is displayed, the processor 104 may determine whether the hand 39 has performed a confirmation gesture. In various embodiments, the confirmation gesture may be any gesture set by the designer, such as a fist gesture, but the present invention is not limited thereto.

[0067] In one embodiment, in response to determining that the hand 39 has performed a confirmation gesture, this may indicate that the size and position of the virtual plane 30 in the virtual world have been accepted by the user. In this case, the processor 104 may fix the size and position of the virtual plane 30 in the virtual world.

[0068] On the other hand, in response to determining that the hand 39 has not performed a confirmation gesture, this may indicate that the user intends to further adjust the size and position of the virtual plane 30. In this case, the processor 104 may continue to track the gesture of the hand 39, but the present invention is not limited thereto.

[0069] In Figures 3 to 5 [the above], since the scenario is assumed to be performing a desktop configuration process, the confirmation gesture can be used to end the desktop configuration process.

[0070] In this case, in response to determining that the hand has performed a confirmation gesture, the processor 104 may store the size and position of the virtual plane 30 as a desktop configuration and end the desktop configuration process.

[0071] In one embodiment, after fixing the size and position of the virtual plane 30 in the virtual world, the processor 104 may display at least one virtual object in the virtual world, where each virtual object has a fixed relative position with respect to the virtual plane 30. In this embodiment, since the size and position of the virtual plane 30 are fixed in the virtual world, at least one virtual object will be displayed at a fixed position in the virtual world.

[0072] In some embodiments, the at least one virtual object may include one or more virtual screens for displaying the content on the screens of other devices directly or indirectly connected to the host 100.

[0073] See Figure 6 , which illustrates a schematic diagram of starting a virtual desktop application according to an embodiment of the present invention.

[0074] In Figure 6 , when the virtual desktop application is launched, the processor 104 may display visual content 600 of the virtual world corresponding to the virtual desktop application. In this embodiment, the virtual world may be a mixed reality world in which perspective images are currently deactivated, but the present invention is not limited thereto. From another perspective, since the perspective images are deactivated, Figure 6 the mixed reality world in

[0075] can also be understood as a virtual reality world, but the present invention is not limited thereto.

[0076] In this embodiment, the processor 104 may display a virtual plane 30 based on the stored desktop configuration and display virtual screens 611-613 in the virtual world, where each of the virtual screens 611-613 has a fixed relative position with respect to the virtual plane 30.

[0076] In an embodiment of the present invention, the processor 104 may receive a first video stream of a first screen from a computing device and display the first video stream in the virtual screen 611. In one embodiment, the computing device may be another computer device directly or indirectly connected to the host 100, but the present invention is not limited thereto.

[0077] In one embodiment, the first video stream may display the content on the first screen (e.g., the main screen) of the computer device, but the present invention is not limited thereto.

[0078] In addition, the processor 104 may receive a second video stream of a second screen and a third video stream of a third screen from the computing device and display the second video stream and the third video stream in the virtual screens 612 and 613, respectively.

[0079] In one embodiment, the second video stream and the third video stream may display the content on the second screen (e.g., the left screen) and the third screen (e.g., the right screen) of the computer device, but the present invention is not limited thereto.

[0080] In one embodiment, the processor 104 may further display a toolbar 620 in the virtual plane 30, where the toolbar 620 may include control components 621-625.

[0081] In this embodiment, the control component 621 may be used to reconfigure the size and position of the virtual plane 30 in the virtual world. For example, when the user triggers the control component 621, the processor 104 may re-execute Figure 2 the method of Figures 3 to 5 and the process in

[0082] In this embodiment, some of the control components 621 - 625 can be used to control the computing device. For example, the control component 622 can be used to mute the computing device so that the audio signal from the computing device is not played by the host 100, but the present invention is not limited thereto.

[0083] The control component 623 can be used to enable the perspective image so that the perspective image can be provided as the background of the mixed - reality world.

[0084] The control component 624 can be used to activate the night mode of the host 100, and the control component 625 can be used to open the settings menu of the virtual desktop application, but the present invention is not limited thereto.

[0085] In some embodiments, the virtual plane 30 can be determined in a specific manner, and the relevant details will be introduced in Figure 7 this regard.

[0086] See Figure 7 , which illustrates a schematic diagram for determining a virtual rectangular area according to an embodiment of the present invention.

[0087] In one embodiment, during the period when the processor 104 starts to track the gesture of the hand 39, such as during the desktop configuration process, the processor 104 can determine whether the hand 39 has performed an L - shaped gesture.

[0088] In one embodiment, in response to determining that the hand 39 has performed an L - shaped gesture (for example, Figure 7 the gesture shown in the upper left), the processor 104 can thereby determine the first direction D1, the second direction D2, and the reference angle A1.

[0089] In this embodiment, the first direction D1 can be, for example, the direction pointed by the index finger of the hand 39, the second direction D2 can be, for example, the direction pointed by the thumb of the hand 39, and the reference angle A1 can be, for example, the angle formed by the index finger and the thumb, but the present invention is not limited thereto.

[0090] After that, the processor 104 can display a virtual rectangular area 70 including multiple corners in the virtual world, where one corner of the virtual rectangular area 70 is aligned with the reference angle A1.

[0091] In Figure 7 , the virtual rectangular area 70 can have a first side S1 extending from the reference angle A1 towards the first direction D1 by a first predetermined length 701. In addition, the virtual rectangular area 70 can have a second side S2 extending from the reference angle A1 towards the second direction D2 by a second predetermined length 702, and the height of the virtual rectangular area 70 in the virtual world corresponds to the L - shaped gesture.

[0092] In one embodiment, in response to determining a pinch-and-release gesture (e.g., a target gesture), the processor 104 may display the virtual rectangular region 70 as a provided virtual plane (e.g., Figure 3 the virtual plane 30) in the virtual world, and subsequent operations may refer to the description related to Figures 3 to 5 which will not be repeated here.

[0093] The present invention further provides a computer-readable storage medium for executing the method of providing a virtual plane. The computer-readable storage medium consists of a plurality of program instructions (e.g., setting program instructions and deployment program instructions) embodied therein. These program instructions can be loaded into and executed by the host 100 to execute the above-described method of providing a virtual plane and the functions of the host 100.

[0094] In summary, the embodiments of the present invention provide a novel way of providing a virtual plane (e.g., a virtual desktop), enabling users to configure the size and position of the virtual plane in the virtual world in a more intuitive and convenient manner.

[0095] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for providing a virtual plane, applied to a host, characterized in that, Comprising: Tracking the gesture of the hand by the host and determining by the host whether the hand has performed a target gesture; In response to determining that the hand has performed the target gesture, providing the virtual plane at a reference height in the virtual world of the real service by the host; and Displaying a height adjustment component in the virtual world by the host, wherein the height adjustment component is used to adjust the height of the virtual plane in the virtual world.

2. The method according to claim 1, further comprising: In response to determining that a first distance between the hand and the height adjustment component is less than a first distance threshold, changing a first visual type of the height adjustment component to a first type.

3. The method according to claim 2, further comprising: In response to determining that the hand has triggered the height adjustment component, changing the first visual type of the height adjustment component to a second type.

4. The method according to claim 1, wherein the virtual plane is displayed with a predetermined width and a predetermined length.

5. The method according to claim 1, further comprising: Providing a size adjustment component, wherein the size adjustment component is used to adjust the size of the virtual plane; In response to determining that a second distance between the hand and the size adjustment component is less than a second distance threshold, changing a second visual type of the size adjustment component to a third type; and In response to determining that the hand has triggered the size adjustment component, changing the second visual type of the size adjustment component to a fourth type.

6. The method according to claim 1, wherein the reference height is the height at which the hand is detected to be performing the target gesture.

7. The method according to claim 1, wherein the target gesture is a pinch and release gesture.

8. The method according to claim 1, wherein before determining whether the hand has performed the target gesture, the method further comprises: In response to determining that the hand has performed an L-shaped gesture, determining a first direction, a second direction and a reference angle accordingly; Displaying a virtual rectangular area including a plurality of corners in the virtual world, wherein one corner of the virtual rectangular area is aligned with the reference angle, the virtual rectangular area has a first side extending a first predetermined length in the first direction from the reference angle, the virtual rectangular area has a second side extending a second predetermined length in the second direction from the reference angle, and the height of the virtual rectangular area in the virtual world corresponds to the L-shaped gesture.

9. The method according to claim 8, wherein providing the virtual plane at the reference height in the virtual world of the real service comprises: Displaying the virtual rectangular area as the provided virtual plane in the virtual world.

10. The method according to claim 1, further comprising: In response to determining that the hand has performed a confirmation gesture, fixing the size and position of the virtual plane in the virtual world.

11. The method according to claim 10, wherein after fixing the size and the position of the virtual plane in the virtual world, further comprising: Display at least one virtual object in the virtual world, wherein each of the at least one virtual object has a fixed relative position with respect to the virtual plane.

12. The method according to claim 11, wherein the at least one virtual object includes a first virtual screen, and the method further comprises: Receiving a first video stream of a first screen from a computing device and displaying the first video stream in the first virtual screen.

13. The method according to claim 12, wherein the at least one virtual object further includes a second virtual screen, and the method further comprises: Receiving a second video stream of a second screen from the computing device and displaying the second video stream in the second virtual screen.

14. The method according to claim 12, wherein after fixing the size and the position of the virtual plane in the virtual world, it further comprises: Displaying a toolbar in the virtual plane, wherein the toolbar includes control components.

15. The method according to claim 14, wherein the control components are used to control the computing device.

16. The method according to claim 14, wherein the control components are used to reconfigure the size and the position of the virtual plane in the virtual world.

17. The method according to claim 10, wherein the virtual plane is a virtual desktop, the gesture is tracked during the desktop configuration process of an application of the real service, and the method further comprises: In response to determining that the hand has executed the confirmation gesture, storing the size and the position of the virtual plane as a desktop configuration and completing the desktop configuration process.

18. The method according to claim 17, wherein after completing the desktop configuration process, the method further comprises: In response to determining that the application has been launched, displaying the virtual plane based on the stored desktop configuration and displaying at least one virtual screen in the virtual world, wherein each of the at least one virtual screen has a fixed relative position with respect to the virtual plane.

19. A host, characterized in that, Comprising: A storage circuit storing program code; And A processor coupled to the storage circuit and accessing the program code to execute: Tracking the gesture of a hand and determining whether the hand has executed a target gesture; In response to determining that the hand has executed the target gesture, providing a virtual plane at a reference height in the virtual world of the real service; and Displaying a height adjustment component in the virtual world, wherein the height adjustment component is used to adjust the height of the virtual plane in the virtual world.

20. A computer-readable storage medium, characterized in that, The computer-readable storage medium records an executable computer program, and the executable computer program is loaded by a host to execute the steps of: Tracking the gesture of a hand and determining whether the hand has executed a target gesture; In response to determining that the hand has executed the target gesture, providing a virtual plane at a reference height in the virtual world of the real service; and Displaying a height adjustment component in the virtual world, wherein the height adjustment component is used to adjust the height of the virtual plane in the virtual world.

Images