Visualizing occluded data structures

Abstract

The invention relates to visualizing an occluded data structure. A method of visualizing occluded data in an augmented reality (XR), the augmented reality visualizing forward data, the occluded data being hidden behind the forward data, the method comprising: displaying a view on the augmented reality to a user on an XR device, the view comprising a 3D representation of the forward data; receiving a command from a user regarding changing a view on the augmented reality; and changing a view on the augmented reality based on the command, receiving the command including performing a gesture recognition step to detect a user performing predefined gestures, each predefined gesture being interpreted as a corresponding command for the XR device. The predefined gestures include a removal gesture corresponding to a removal command of the XR device, and upon receipt of the removal command, the view on the augmented reality is changed by removing a representation of the front data and visualizing a 3D representation of the occluded data to the user.

Description

Technical Field

[0001] This invention relates to a computer-implemented method for visualizing occluded data structures in extended reality (XR), such as augmented reality (AR), virtual reality (VR), or mixed reality (MR). Specifically, the data can be three-dimensional (3D) (or other multi-dimensional) volumetric data, such as voxels or point clouds. The method allows users of an XR system to temporarily remove visualized 3D data structures in the XR by performing intuitive gestures, revealing previously occluded 3D data located behind the removed 3D data. Removing data does not necessarily mean that the removed data is completely invisible. Instead, the data structure can be moved or rotated to an inconspicuous location, allowing simultaneous viewing of both the removed and revealed data. Background Technology

[0002] When dealing with large amounts of multidimensional volumetric data in an XR environment, human users may find it difficult to understand and interact with specific elements or portions of that data. An example is understanding and interacting with frequency (RF) data from a simulated radio network and actual measurement data from a distant location. Due to the sheer volume of data, continuous data structures present challenges in effectively visualizing the structures of interest. In XR, users can observe adjacent data structures. However, they cannot see what lies behind the data unless they change their viewpoint—for example, virtually in VR or physically in AR.

[0003] The goal is to improve users' observation and understanding of data phenomena in hidden data structures or dense data representations (voxels, point clouds, volumetric data) within a 3D XR environment. Summary of the Invention

[0004] Therefore, the object of this invention is to provide an improved method for visualizing data to a user in XR, which allows the user to view data that is currently obscured by other data.

[0005] One specific goal is to provide a way for users to control the visualization of currently occluded data in a simple and intuitive manner.

[0006] A first aspect of the invention relates to a computer-implemented method for visualizing occluded data in extended reality (XR), the XR including foreground data, the occluded data being hidden behind the foreground data. Hiding does not necessarily mean that the occluded data is unseen; it may also mean that a user may have difficulty understanding the occluded data due to the data located in front of it. The method includes the steps of: displaying a view on the XR, including a 3D representation of the foreground data, to a user of the XR device; receiving a command from the user to change the view on the XR; and changing the view on the XR according to the command.

[0007] The step of receiving a command includes performing a gesture recognition step to detect the user performing a predefined gesture, wherein each predefined gesture is interpreted as a corresponding command for the XR device. The predefined gestures include at least one removal gesture corresponding to a removal command of the XR device, wherein, upon receiving the removal command, the view on the XR is altered by at least partially removing a representation of the foreground data and visualizing the 3D representation of the occluded data to the user. The removal gesture specifies at least one of width and angle, as well as direction and depth, and removes the representation of the foreground data around a removal position defined by the specified direction, according to a specified depth, and according to either a specified width or a specified angle.

[0008] According to some implementations of the method, the occluded data and the forward data include a multidimensional data structure.

[0009] According to some implementations of the method, the XR is augmented reality (AR), wherein the view on the extended reality includes a view of the real environment surrounding the user.

[0010] According to some implementations of the method, the removal gesture includes the movement of the user's two hands.

[0011] According to some embodiments of the method, the direction is defined by the fingertips of both hands, and in particular by the position of the fingertips relative to the user's body.

[0012] According to some embodiments of the method, the step of removing the representation of the preceding data includes segmenting the representation of the preceding data at the removal position. In some embodiments, segmenting the preceding data includes moving the representation of the preceding data to the right of the removal position to the right and moving the representation of the preceding data to the left of the removal position to the left. In some embodiments, segmenting the preceding data includes compressing the representation of the preceding data. In some embodiments, segmenting the preceding data includes generating gaps in the representation of the preceding data.

[0013] According to some embodiments of the method, the step of removing a representation of the foreground data includes rendering the representation of the foreground data around the removal location as partially transparent. In some embodiments, the degree of transparency is selectable by the user using a removal gesture.

[0014] According to some embodiments, the removal gesture includes an initial position of both hands and a separation position of both hands. For example, the initial position specifies a direction, and / or the separation position specifies at least a width and a depth. In some embodiments, the initial position includes both hands touching, particularly the palms of both hands touching, and the direction is defined by the fingertips of both hands during the initial position. In some embodiments, the separation position includes both hands extending towards the forward data, and the depth is defined by the extent of the extension of both hands. In some embodiments, the separation position includes two hands separated, wherein the width is defined by the distance between the two hands during the separation position.

[0015] According to some embodiments of the method, the step of removing the representation of the preceding data includes rotating the representation of the preceding data about a rotation point, wherein the rotation point is defined by the removal position and the depth; the representation of the preceding data to the right of the removal position is rotated to the right, and the representation of the preceding data to the left of the removal position is rotated to the left; and the representation of the preceding data is rotated such that a specified rotation angle is generated.

[0016] According to some embodiments, the removal gesture includes an initial position of both hands and a rotational position of both hands, wherein the initial position specifies the direction, and / or the rotational position at least specifies the depth and the rotation angle. In some embodiments, the initial position includes both hands touching, particularly the palms of both hands touching, and the direction is defined by the fingertips of both hands while in the initial position. In some embodiments, the rotational position includes both hands extending forward, and the depth is defined by the range of extension of both hands.

[0017] According to some implementations, the rotation position includes the fingertips of both hands touching, the palms forming an indicating angle, and the rotation angle is defined by the indicating angle, for example, corresponding to the indicating angle.

[0018] According to some embodiments, the step of removing a representation of the foreground data includes spacing out the rotational representation of the foreground data, the removal gesture including exposed positions of both hands, wherein the exposed positions at least specify the width of the spacing. In some embodiments, the exposed positions include two hands separated, and the width is defined by the distance between the two hands while in the exposed positions. In some embodiments, the exposed positions include the palm forming the indicated angle.

[0019] A second aspect of the invention relates to an XR system configured to perform the method according to the first aspect, the XR system comprising: an XR device including a display device configured to display XR to a user; and a gesture recognition module configured to detect the user performing predefined gestures, wherein each of the predefined gestures is interpreted as a corresponding command for the XR device.

[0020] According to some embodiments of the XR system, the XR device is wearable, particularly XR goggles, and / or includes a controller for manipulating the XR.

[0021] According to some embodiments, the XR device includes the gesture recognition module, and in particular, the gesture recognition module includes at least one camera configured, positioned, and aligned to capture an image of the user's hand.

[0022] A third aspect of the invention relates to a computer program product comprising program code having computer-executable instructions for performing a method according to a first aspect of the invention, particularly when executed on a computing unit of an XR system according to a second aspect. Attached Figure Description

[0023] The present invention will now be described in detail with reference to exemplary embodiments in the accompanying drawings, in which:

[0024] Figure 1 An exemplary XR is shown, which is visualized from an XR device to the user of the device, in which the visualized volumetric data in front obstructs the view of other volumetric data;

[0025] Figure 2 It shows Figure 1 In the XR, some volumetric data in the foreground has been removed to allow users to view previously occluded data;

[0026] Figure 3 The initial position of an exemplary gesture that allows a user to select the data to be removed is shown;

[0027] Figure 4 This shows the usage in the context of XR. Figure 3 The initial position;

[0028] Figure 5 The second position of the first exemplary gesture is shown;

[0029] Figure 6 This shows the use of XR in the context of XR. Figure 5 The second position;

[0030] Figure 7 The second position of the second exemplary gesture is shown;

[0031] Figure 8 This shows the usage in the context of XR. Figure 7 The second position;

[0032] Figure 9 The third position of the second exemplary gesture used in the context of XR is shown;

[0033] Figure 10 A flowchart illustrating a first exemplary embodiment of the method according to the present invention is shown; and

[0034] Figure 11 A flowchart illustrating a second exemplary embodiment of the method according to the present invention is shown. Detailed Implementation

[0035] Figure 1 A person (“user”) 1 wearing a wearable extended reality device (XR device) 2 is shown. The XR device 2 is configured to display a view on extended reality (XR) to the user 1. Optionally, the XR device 2 may be part of a larger XR system and connected to an external computing unit via cable or wirelessly. For example, XR may be augmented reality (AR), where a real scene is overlaid with multidimensional volumetric data. In AR mode, the visualization data is aligned with reality based on various known technologies such as VPS, GNSS, etc. The user can then explore the data overlaid on reality. Alternatively, XR may be virtual reality (VR) or mixed reality (MR) that does not include a real scene. Multidimensional volumetric data includes visual data structures such as point clouds, voxels, meshes, or volumes.

[0036] The XR device 2 (or XR system) includes gesture recognition capabilities. Specifically, the XR device or system may include a camera. For example, the camera may be configured to capture images of a real-world scene to include the scene in real-time within the AR. The camera's field of view 21 is preferably oriented to allow the camera to capture an image of the user's hand when the user performs gesture 10. Other cameras or sensors may be provided to capture gestures outside the camera's field of view 21. The captured gestures can be recognized as commands for the XR device (or system), such as commands to change the view on the XR. Alternatively or additionally, the user 1 may wear gloves with sensors configured to detect gestures.

[0037] Optionally, the XR device can be configured to allow the user to issue commands using means other than gestures. Specifically, user-selectable icons can be visualized within the provided XR, or a handheld controller can be provided to the user. For example, these other devices can include standard on-screen controls such as a virtual hand in 3D space, a virtual joystick, icons, sliders, buttons, or manipulators (“gizmos”). Alternatively or additionally, the user can be enabled to manipulate the XR, data, and / or views using neural links.

[0038] The displayed XR includes volumetric data structures, such as radio network frequency (RF) data. The volumetric data structures of the XR are visualized in multiple layers, such that the visual layer in front obstructs the user's view of the layers behind. Because the obscured layers are invisible, the XR device 2 does not need to visualize them or even calculate them.

[0039] In the example shown, the volumetric data structure of the XR includes first data (front data) 31 visualized by the XR device 2 to the user 1, and second data (occluded data) 32 positioned behind the front data 31 and therefore invisible to the user 1. The user can issue a command to the XR device 2 to make the occluded data 32 visible—for example, by performing a corresponding gesture 10. For example, if the front data 31 and the occluded data 32 are of different data types, the user can deselect the visualization of the data type of the front data 31. However, this does not work if both are of the same data type (e.g., RF data).

[0040] Figure 2 It shows Figure 1User 1 of XR device 2 has performed a predefined gesture 10 to partially remove the foreground data 32, making previously obscured data 34 visible. This gesture allows user 1 to select the direction in which the foreground data 32 should be segmented to create a gap so that data behind the gap is visible. The gesture also allows user 1 to select the width and depth of the gap. In the example shown, based on the user's gesture, the foreground data 32 has been segmented (and thus removed) in the middle and moved left and right, leaving two columns of condensed data 33. Instead of condensing, other forms of data reduction can be applied, such as compression, shrinking, or packing. Instead of segmenting the data, the data can be manipulated in other ways, such as making the data transparent or rotating.

[0041] Figure 3 The first example of this gesture (“removal gesture”) is shown in detail at its first position (“initial position”) 11. Both palms touch, fingertips pointing away from the user's body and towards the occluded data to be visualized (and thus towards the data to be removed in front of the occluded data), thus specifying a direction (“segmentation direction”) 5. This gesture position can be recognized using the gesture recognition capabilities of the XR device, such as with a camera or gloves. Alternatively, for example, if fine gesture recognition is unavailable or insufficient, the user can initiate the gesture from a menu, causing the XR device to wait to execute the specific gesture.

[0042] Figure 4 This initial position 11 is shown in the context of a visualized XR. A user 1 performing the gesture wears an XR device 2 configured to detect the gesture. In the initial position 11 of the gesture, the user's finger points to visualized data (“forward data”) 31 in front of occluded data 32. Both the forward data 31 and the occluded data 32 include visual data structures such as point clouds, voxels, meshes, or volumes. For user 1, these can appear as a continuous, large amount of data. The XR device 2 has means for detecting the gesture performed by the user. For example, these means include a camera with a sufficiently wide field of view to capture an image of the user's hand as the user performs the gesture. Optionally, various sensors and computing devices may be involved, such as gloves, other sensors, and / or image recognition using artificial intelligence.

[0043] The XR device is configured to detect gestures and interpret them as specific commands that change the view of data. User 1 wants to view occluded data 31 instead of the currently visible data 32 in front of them. Therefore, User 1 points their fingertip to point 15 on the data 32 in front, at which point the data in front should be removed to reveal the occluded data 31 behind it. The depth 16 of the removed data 32 in front can be selected by moving the hand toward or away from the user's body, i.e., by specifying the distance 6 between the hand and the user's body.

[0044] Therefore, by bringing their hands together with fingers straight, user 1 defines an initial dividing line at point 15. The segmentation effect is activated when this initial position 11 of the gesture is detected. The data segmentation begins along the line (direction) 5 defined by the fingertips at the object closest to the user, i.e., at point 15. The initial depth 16 of the segmentation can be adjusted by moving the brought-up hand forward or backward, for example, using the elbow.

[0045] Point 15, or the resulting dividing line 34, can be displayed to user 1 by XR device 2. In the perspective view, a finger points to dividing line 34. For example, moving the hand upwards causes point 15 to move further away from the horizon. By moving the fingertip (e.g., by rotating the wrist in the desired direction), line 34 can be moved freely in any direction. In the example shown, dividing line 34 is vertical. However, alternatively, the orientation of dividing line 34 can be selected by user 1 using the initial position 11 of the gesture. For example, the dividing line can always have the same orientation as the palm, such that tilting the hand clockwise or counterclockwise will tilt dividing line 34 in the same way. Tilting the hand can result in a directly corresponding response to dividing line 34—for example, tilting the hand 45° causes dividing line 34 to tilt 45° in the same direction. Alternatively, tilting the hand can be used to cause dividing line 34 to begin rotating in the selected direction—for example, tilting the hand clockwise causes dividing line 34 to rotate clockwise until the hand returns to a vertical orientation.

[0046] Figure 5 The second position (“split position”) 12 of the first exemplary removal gesture is shown in detail. Starting from the initial position, the user moves both hands apart, creating a distance 7 between them. The fingertips of each hand still point to the data to be removed, and each hand defines a direction 5.

[0047] Optionally, from the user's perspective of viewing the data, touch points 3 can be defined on opposite sides of both hands, allowing the user to easily select objects that are farther or closer. Since farther objects are smaller, the gesture will have a larger and more pronounced effect compared to closer (and therefore larger) objects. For example, as shown here, touch points 3 can be attached to the fingernails and knuckles of both hands. These can be used to set the depth of a segmentation on an infinite dividing line. For example, this can also be used for visualizing data below ground. For this purpose, the user points downwards. To define the depth below ground, the touch points (e.g., attached to the fingernails) set a precise segmentation depth in conjunction with a depth indicator 6.

[0048] Figure 6 It shows in Figure 4The segmentation position 12 is within the context of XR. User 1 separates their hands, selecting a distance 7 between them to indicate the desired segmentation range 17: the greater the distance 7 between the hands, the wider the resulting "channel" 36. Foreground data is moved to the sides, thereby revealing the data of interest 37 behind the foreground data (i.e., previously obscured content). The moved foreground data 33 may be squeezed, compressed, or otherwise deformed in this process. As the foreground data is moved to the sides, it emerges towards the outline 35 of the data of interest 37. The segmentation depth 16 can be adjusted in real time by moving the hands forward or backward (i.e., adjusting the distance 6 between the hands and the user's body). For example, the position of the fingertips indicates the depth 16. The depth can be visually indicated by highlighted touch points on the moved foreground data 33.

[0049] The dimensions 16 and 17 of channel 36 can be controlled in real time via specific movements 6 and 7, and can be dynamically moved in any direction across the user's field of vision. In the case of the side profile of the moved data 33, the free perspective created by this effect allows the user to clearly observe the hidden data 37 from the user's perspective. The user 1 can freeze the segmentation, for example, by making a "thumbs up" gesture with both hands. Alternatively, if a touch point is activated (see...), the segmentation can be frozen. Figure 5 If the data 33 or contour 35 is moved, the two sides can closely follow the user's hand, that is, follow the movement of the hand.

[0050] Distance scales or other visual aids may be displayed to allow user 1 to better understand distances in the perspective view, such as the depth 16 and width 17 of channel 36 (e.g., according to the dividing point 15 or user 1). For example, the bottom or top plane of channel 36 created by gestures may include such distance scales.

[0051] As shown here, segmenting the foreground data can result in condensed data33: visual data structures (e.g., point clouds, voxels, meshes, volumes, etc.) are unfolded to the sides. This achieves perspective on the opaque data by squeezing it to the sides, revealing its outline and thus the data behind it. The sides of the segmented data show the fluctuating outline of the foreground data caused by the cutoff at the segmentation line. The advantage of this approach is that no data is actually removed. Instead, the data is stretched, condensed, and / or moved around, so it remains visible in its dense form. Alternatively, segmenting the foreground data can include removing portions of the foreground data, as if the user were “digging through” the foreground data to see what lies behind it. The advantage of this approach is that the visualized data is in its original state. Optionally, this removal of data can result in a view frame (or cone) within a continuous data structure. The bottom or top area left due to the data removal can be used to display distance scales.

[0052] In another alternative, segmenting the foreground data can include making some of the foreground data partially transparent, such as semi-transparent. This effect can also be applied to the XR ground to view data beneath the surface, such as data related to underground utilities. Such visualization of underground utilities is disclosed in detail in EP 3 748 583 A1. Users can then follow the... Figure 6 The size of the semi-transparent portion of the data in front is selected in the same way as the size of the gap 36 (depth 16, width 17). This allows the data in front to be viewed in its original position, while still allowing the data behind to be viewed.

[0053] The second implementation of the removal gesture is as follows Figures 7 to 9 As shown in the diagram. The initial position for removing the gesture can be the same as in the first embodiment, i.e., Figure 3 The initial position is shown in the figure.

[0054] Figure 7 An example of the second position (“rotation reverse”) 13 of the second exemplary gesture is shown in detail. From Figure 3 Starting from the initial position, the user moves both palms apart while keeping the fingertips together, creating an angle α between the palms. In this triangular position, both hands together define a direction 5 toward the data to be removed.

[0055] Figure 8 It shows in Figure 4 The rotation position 13 in the context of XR. Using the triangular shape of both hands, user 1 can open the front data with the same triangular shape, thus highlighting the side 35 of the front data 33, while still allowing the user to see the data 37 further away through the gap 36 at the further end of the segment. This is caused by rotation around the rotation point 38 placed behind the actual segment line. When the exposed rear data 37 is still further obscured by the rotated front data 33 and only a small part of the rear data is exposed, user 1 can better observe the data fluctuation between the front and rear data without changing his viewpoint. Alternatively, if the touch point is activated (see Figure 6 If the outline 35 is such that its two sides can closely follow the user's hand, that is, follow the movement of the hand.

[0056] Figure 9 It shows in Figure 4 An optional third position (“exposed position”) 14 in the context of the XR removal gesture. User 1 can increase the size of the gap 36 by moving the two blocks of the rotated front data 33 away from each other, thereby increasing the amount of exposed rear data 37. As indicated by the arrows, the rotated front data 33 follows the movement of user 1's hands and forearms. This can be achieved, for example, using a touch point (see...). Figure 5).

[0057] Figure 10 A flowchart illustrating an exemplary embodiment of method 100 according to the present invention is shown. The method begins by displaying a view on an XR (e.g., AR or VR) device to a user of an XR device (e.g., AR goggles). The device receives a command 120 to change the displayed view—for example, by registering head rotation or gestures. The XR device then changes the view 130 according to the received command and displays the changed view to the user. Changing the view may include changing the view on a data visualization or data.

[0058] Figure 11 A flowchart illustrating another exemplary embodiment of the method 100 according to the invention is shown. Again, the method begins by displaying a view on an XR (e.g., AR or VR) device (e.g., an XR device) to a user of an XR device (e.g., AR goggles). Multidimensional data structures are visualized in the XR. In the case of AR, these data structures are aligned with reality. Multidimensional data structures visualized in front of the view obstruct the view of other multidimensional data structures further back. Again, the XR device receives a command (120) to change the displayed view of the data. In this case, the user wishes to change the view by partially removing the data structures in front to make the obscured data structures visible. Receiving the command (120) includes continuously performing a gesture recognition step (122) to detect gestures performed by the user. For example, gesture recognition step (122) may utilize one or more cameras that continuously capture images of the user's hand. Detection (124) of a removal gesture performed by the user. Specifically, this may be the gesture described above regarding... Figures 3 to 9 One of the described removal gestures. A removal gesture specifies details about the removal, specifically where and how much of the foreground data should be removed. For example, the gesture can specify direction, depth, width, and / or angle. The detected removal gesture is then interpreted as the corresponding command to remove the specified foreground data.

[0059] Then, by removing the representation of the foreground data specified in 132 and by visualizing the previously occluded data structure in 134, the view on 130XR (and the data visualized therein) is changed accordingly.

[0060] Although the invention has been described above with reference to some preferred embodiments, it should be understood that many modifications and combinations of different features of the embodiments can be made. All such modifications are within the scope of the appended claims.

Claims

1. A computer-implemented method (100) for visualizing occluded data (32) in extended reality, the extended reality including foreground data (31) and the occluded data being hidden behind the foreground data (31), the method comprising the steps of: On the XR device (2), a view of the extended reality is displayed (110) to the user (1) of the XR device (2), the view including a three-dimensional representation of the foreground data (31); Receive (120) a command from the user (1) to change the view on the extended reality; as well as Based on the command, change the view on the extended reality (130). Receiving the command (120) includes performing a gesture recognition step (122) to detect (124) that the user (1) is performing a predefined gesture, wherein each of the predefined gestures is interpreted (126) as a corresponding command for the XR device (2). Its features The predefined gestures include at least one removal gesture corresponding to a removal command from the XR device (2), wherein, upon receiving the removal command, the view in the extended reality is altered (130) by at least partially removing (132) the three-dimensional representation of the foreground data (31) and visualizing (134) the three-dimensional representation of the occluded data (32) to the user (1), wherein The removal gesture specifies at least one of width (17) and angle (β), as well as direction (5) and depth (16); and Around the removal position (15) defined by the specified direction (5), the three-dimensional representation of the front data (31) is removed according to the specified depth (16) and according to the specified width (17) or the specified angle (β).

2. The method (100) according to claim 1, wherein The obscured data (32) and the forward data (31) include a multidimensional data structure; and / or The extended reality mentioned is augmented reality, in which, The view in the extended reality includes a view of the real environment surrounding the user (1).

3. The method (100) according to claim 1 or 2, wherein, The removal gesture includes the movement of the user's (1) two hands.

4. The method (100) according to any one of claims 1 to 3, wherein, The direction (5) is defined by the fingertips of both hands, and in particular by the position of the fingertips relative to the user's body.

5. The method (100) according to any one of claims 1 to 4, wherein, The step of removing (132) the three-dimensional representation of the front data (31) includes segmenting the three-dimensional representation of the front data (31) at the removal location (15), and in particular, the segmentation of the front data includes at least one of the following: Move the three-dimensional representation of the front data to the right of the removal position (15) to the right, and move the three-dimensional representation of the front data to the left of the removal position (15); The three-dimensional representation of the compressed front data; and A gap (36) is generated in the three-dimensional representation of the preceding data (31).

6. The method (100) according to any one of claims 1 to 4, wherein, The step of removing (132) the three-dimensional representation of the front data (31) includes rendering the three-dimensional representation of the front data (31) around the removal location (15) as partially transparent, wherein the degree of transparency is selectable by the user using the removal gesture.

7. The method (100) according to claim 5 or 6, wherein, The removal gesture includes: The initial positions (11) of the two hands, in particular, wherein the initial positions specify the direction (5); and The division position (12) of the two hands, wherein the division position at least specifies the width (16) and the depth (17), Especially among them The initial position (11) includes touching with both hands, particularly the palms of both hands, and the direction (5) is defined by the fingertips of both hands during the initial position (11); and / or The segmentation position (12) includes both hands extending toward the forward data (31), and the depth (16) is defined by the range (6) of the outstretched hands; and / or The split position (12) includes the two hands apart, wherein the width (17) during the split position (12) is defined by the distance (7) between the two hands.

8. The method (100) according to any one of claims 1 to 4, wherein, Removing (132) the three-dimensional representation of the front data (31) includes rotating the three-dimensional representation of the front data about a rotation point (38), wherein The rotation point (38) is defined by the removal position (15) and the depth (16); The three-dimensional representation of the front data to the right of the removal position (15) is rotated to the right, and the three-dimensional representation of the front data to the left of the removal position (15) is rotated to the left; and The three-dimensional representation of the preceding data (31) is rotated to obtain a specified rotation angle (β).

9. The method (100) according to claim 8, wherein, The removal gesture includes: The initial positions (11) of the two hands, in particular, wherein the initial positions specify the direction (5); and The rotational positions of the two hands (13), wherein the rotational positions at least specify the depth (16) and the rotation angle (β), Especially among them The initial position (11) includes touching with both hands, particularly the palms of both hands, and the direction (5) is defined by the fingertips of both hands during the initial position (11); and / or The rotational position (13) includes both hands extending toward the forward data (31), and the depth (16) is defined by the range of the two hands extending (6).

10. The method (100) according to claim 9, wherein The rotational position (13) includes touching with the fingertips of both hands, with the palms forming an indicating angle (α); and The rotation angle (β) is defined by the indication angle (α), and in particular, wherein, The rotation angle (β) corresponds to the indication angle (α).

11. The method (100) according to claim 9 or 10, wherein, Removing (132) the three-dimensional representation of the front data (31) includes spacing the rotated representation of the front data, the removal gesture including the exposed positions (14) of both hands, wherein the exposed positions at least specify the width (17) of the spacing, and in particular wherein The exposed position (14) includes the two hands apart, and the width (17) during the exposed position (14) is defined by the distance (7) between the two hands; and / or The exposed position (14) includes the palm of the hand that forms the indicated angle (α).

12. An XR system, the XR system comprising: XR device (2), the XR device including a display device configured to display extended reality to user (1); as well as A gesture recognition module is configured to detect when the user (1) performs a predefined gesture, wherein each of the predefined gestures is interpreted (124) as a corresponding command for the XR device (2). Its features The XR system is configured to perform the method according to any one of claims 1 to 11.

13. The XR system according to claim 12, wherein, The XR device (2) is wearable, particularly XR goggles; and / or The XR device (2) includes a controller and / or neural links for manipulating the extended reality.

14. The XR system according to claim 12 or 13, wherein, The XR device (2) includes the gesture recognition module, and in particular, the gesture recognition module includes at least one camera configured, positioned and aligned to capture images of the user's (1) two hands.

15. A computer program product comprising program code having computer-executable instructions for performing the method (100) according to any one of claims 1 to 11, particularly when executed on a computing unit of an XR system according to any one of claims 12 to 14.

Images