Control method and device of augmented reality equipment and electronic equipment

Abstract

The invention discloses a control method and device of augmented reality equipment and electronic equipment, and belongs to the field of augmented reality. The control method of the augmented reality device comprises the steps that under the condition that at least one virtual interaction object exists in an augmented reality space displayed by the augmented reality device, an initial interaction hot area corresponding to the virtual interaction object is generated according to position information of the virtual interaction object, and the virtual interaction object is located in the initial interaction hot area corresponding to the virtual interaction object; the initial interaction hot area of the virtual interaction object is expanded, amplified interaction hot areas are obtained, and the amplified interaction hot areas corresponding to the virtual interaction object are not overlapped; receiving a first input with an interaction focus located in a first interaction hot area, the first interaction hot area being an amplified interaction hot area corresponding to a first object, and the first object being one of the at least one virtual interaction object; in response to the first input, an interaction event associated with the first object is triggered.

Description

Technical Field

[0001] The present application belongs to the field of extended reality, and specifically relates to a control method, apparatus, electronic device, readable storage medium and computer program product of an extended reality device. Background Art

[0002] Extended Reality (XR) devices can display one or more virtual interactive objects in the extended reality space they provide. Collaborative interaction can be performed in the extended reality space based on eye control, gesture control, or handle control. In the extended reality space, if the display area of ​​the virtual interactive object is small, the accuracy of the user's interaction with the virtual interactive object will be low, which is not conducive to interaction through the extended reality device. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a control method, device and electronic device for an extended reality device, which can solve the problem that the display area of ​​a virtual interactive object is small, resulting in low accuracy in interacting with the virtual interactive object.

[0004] In a first aspect, an embodiment of the present application provides a method for controlling an extended reality device, the method comprising:

[0005] In a case where there is at least one virtual interactive object in the extended reality space displayed by the extended reality device, an initial interactive hot zone corresponding to the virtual interactive object is generated according to the position information of the virtual interactive object, and the virtual interactive object is located in the initial interactive hot zone corresponding to the virtual interactive object;

[0006] Expanding the initial interaction hot zone of the virtual interaction object to obtain an augmented interaction hot zone, whereby when there are multiple virtual interaction objects in the extended reality space, the augmented interaction hot zones corresponding to the multiple virtual interaction objects do not overlap with each other;

[0007] Receiving a first input in which an interaction focus is within a first interaction hot zone, where the first interaction hot zone is an augmented interaction hot zone corresponding to a first object, where the first object is one of at least one virtual interaction object;

[0008] In response to the first input, an interaction event associated with the first object is triggered.

[0009] In a second aspect, an embodiment of the present application provides an extended reality device, including:

[0010] A hot zone expansion module, for generating an initial interaction hot zone corresponding to the virtual interaction object according to the position information of the virtual interaction object when there is at least one virtual interaction object in the extended reality space displayed by the extended reality device, and the virtual interaction object is located in the initial interaction hot zone corresponding to the virtual interaction object;

[0011] Expanding the initial interaction hot zone of the virtual interaction object to obtain an augmented interaction hot zone, whereby when there are multiple virtual interaction objects in the extended reality space, the augmented interaction hot zones corresponding to the multiple virtual interaction objects do not overlap with each other;

[0012] A receiving module, configured to receive a first input in which an interaction focus is located in a first interaction hot zone, where the first interaction hot zone is an augmented interaction hot zone corresponding to a first object, and the first object is one of at least one virtual interaction object;

[0013] The response module is used to trigger an interaction event associated with the first object in response to the first input.

[0014] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method of the first aspect are implemented.

[0015] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method of the first aspect are implemented.

[0016] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method of the first aspect.

[0017] In a sixth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method of the first aspect.

[0018] In an embodiment of the present application, by expanding the initial interaction hot zone of the virtual interactive object displayed in the extended reality space, each virtual interactive object has an expanded interaction hot zone with a larger display area. On the basis of not changing the display size and arrangement of the virtual interactive object, it is easier to trigger the interaction event associated with the virtual interactive object by expanding the interaction hot zone, thereby reducing the frequency of misoperation, improving the accuracy of human-computer interaction, and improving the interaction effect in the extended reality space; the virtual interactive objects displayed in the extended reality space are all expanded to obtain expanded interaction hot zones, thereby eliminating the need to render the expanded interaction hot zones corresponding to each virtual interactive object according to the movement of the interaction focus, thereby reducing the amount of calculation. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a flowchart of a control method for an extended reality device provided in an embodiment of the present application;

[0020] Figure 2It is one of the partial schematic diagrams of the extended reality space of the control method of the extended reality device provided in one embodiment of the present application;

[0021] Figure 3 This is a second partial schematic diagram of an extended reality space of a control method for an extended reality device provided in an embodiment of the present application;

[0022] Figure 4 This is a third partial schematic diagram of an extended reality space of a control method for an extended reality device provided in an embodiment of the present application;

[0023] Figure 5 This is a fourth partial schematic diagram of an extended reality space of a control method for an extended reality device provided in an embodiment of the present application;

[0024] Figure 6 This is a fifth partial schematic diagram of an extended reality space of a control method for an extended reality device provided in an embodiment of the present application;

[0025] Figure 7 This is the sixth partial schematic diagram of the extended reality space of the control method of the extended reality device provided in one embodiment of the present application;

[0026] Figure 8 This is one of the schematic diagrams of changes in a part of the extended reality space of the control method of the extended reality device provided in one embodiment of the present application;

[0027] Fig. 9 This is a second schematic diagram of changes in a part of the extended reality space of the control method of the extended reality device provided in one embodiment of the present application;

[0028] Fig.10 is a schematic diagram of the structure of an extended reality device provided in an embodiment of the present application;

[0029] Fig.11 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

[0030] Fig.12 It is a schematic diagram of the hardware structure of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0032] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0033] In the following, in conjunction with the accompanying drawings, the control method, device, electronic device, readable storage medium and computer program product of the extended reality device provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0034] See also Figure 1 , an embodiment of the present application provides a method for controlling an extended reality device, the method comprising:

[0035] S110, when there is at least one virtual interactive object in the extended reality space displayed by the extended reality device, generating an initial interactive hot zone corresponding to the virtual interactive object according to position information of the virtual interactive object, and the virtual interactive object is located in the initial interactive hot zone corresponding to the virtual interactive object;

[0036] In the disclosed embodiments, the extended reality space is, for example, an XR space displayed to the user by an XR (Extended Reality) device, and the XR device includes various forms of devices such as AR (Augmented Reality) devices, VR (Virtual Reality) devices, and MR (Mixed Reality) devices. The virtual interactive objects displayed in the extended reality space include, but are not limited to, text objects, icon objects, three-dimensional model objects, and other types of interactive objects. When the virtual interactive object is a three-dimensional model, the three-dimensional model can be projected onto a reference plane along the gaze direction of the user's eyes, and the area, vertical coordinate information, and horizontal coordinate information of the projected image are generated according to the area, vertical coordinate information, and horizontal coordinate information of the three-dimensional model. When the user's head moves, the three-dimensional model is rendered in real time, the projected image of the three-dimensional model changes, and the area, vertical coordinate information, and horizontal coordinate information corresponding to the three-dimensional model change.

[0037] The interactive hotspot is an interactive area in the extended reality space. The initial interactive hotspot of the virtual interactive object in the extended reality space is pre-set. The vertical and horizontal values ​​of the virtual interactive object can be calculated through the position information of the virtual interactive object in the extended reality space, and the initial interactive hotspot is set according to the vertical and horizontal values. Figure 2 For example, the virtual interactive object 1 displayed in the extended reality space is a circular icon object, and the initial interactive hot zone 2 of the icon object is set according to the position information of the icon object. The position information of the icon object includes the coordinates in a circular area with point A as the center and a diameter of 10 cm. The initial interactive hot zone 2 of the icon object is a rectangular area with point A as the center, a length of 10 cm, and a width of 10 cm. Please refer to Figure 3 For example, the virtual interactive object 1 displayed in the extended reality space is a triangular icon object, and the initial interactive hot zone 2 of the icon object is set according to the position information of the icon object. The position information of the icon object includes the coordinates within an area with a bottom edge of 6 cm and a height of 4 cm. The area of ​​the initial interactive hot zone 2 of the icon object is a rectangular area of ​​4 cm*6 cm.

[0038] The virtual interactive object is located in the initial interactive hot zone, and the initial interactive hot zone is used to achieve interaction. When the interactive focus moves into the initial interactive hot zone, that is, the interactive focus hovers in the initial interactive hot zone, the virtual interactive object is triggered to display differently, such as highlighting, deepening, etc., to prompt the user to make a trigger operation to trigger the virtual interactive object. When the interactive focus moves into the initial interactive hot zone and the trigger operation is detected, the virtual interactive object is triggered. For example: the virtual interactive object displayed in the extended reality space is a circular icon object, and the initial interactive hot zone of the icon object is a rectangular area covering the icon object. When the interactive focus moves into the initial interactive hot zone, the user operates the handle to make a click operation, triggering the application corresponding to the icon object to open.

[0039] S120, expanding the initial interaction hot zone of the virtual interaction object to obtain an augmented interaction hot zone, wherein the augmented interaction hot zones corresponding to the virtual interaction objects do not overlap with each other.

[0040] The initial interactive hot zone can be enlarged by moving one or more boundaries of the initial interactive hot zone away from the center of the initial interactive hot zone by a preset value, or by enlarging the initial interactive hot zone at a preset ratio. The preset value can be (0-15cm], for example: 1cm, 1.1cm, 1.11cm, 1.22222, 3cm, 4cm, 8cm, 15cm. The preset ratio can be (0-1], for example: 0.1, 0.2, 0.33, 0.5, 0.8, 1.

[0041] See also Figure 4Exemplarily, the initial interaction hot zone 2 is a rectangular area with coordinate points [x1, y1], [x1, y2], [x2, y2], and [x2, y1] as vertex corners. The boundaries of the initial interaction hot zone 2 are moved outward by a preset value a, and the resulting amplified interaction hot zone 3 is a rectangular area with coordinate points [x1-a, y1-a], [x1-a, y2+a], [x2+a, y2+a], and [x2+a, y1-a] as vertex corners.

[0042] Exemplarily, the initial interaction hot zone is a rectangular area with coordinate points [x1, y1], [x1, y2], [x2, y2], and [x2, y1] as vertex points. The initial interaction hot zone is proportionally enlarged by 0.5 times, and the obtained amplified interaction hot zone is a rectangular area with coordinate points [x1-0.5(x2-x1), y1-0.5(y2-y1)], [x1-0.5(x2-x1), y2+0.5(y2-y1)], [x2+0.5(x2-x1), y2+0.5(y2-y1)], and [x2+0.5(x2-x1), y1-0.5(y2-y1)] as vertex points.

[0043] Since the virtual interactive object is located in the initial interactive hot zone, the initial interactive hot zone is expanded to obtain an amplified interactive hot zone, so that the amplified interactive hot zone has a larger display area than the initial interactive hot zone, and the virtual interactive object is located in the amplified interactive hot zone. The expanded amplified interactive hot zone has the same function as the initial interactive hot zone. Both the amplified interactive hot zone and the initial interactive hot zone can be hidden, that is, the user can view the virtual interactive object, but cannot view the amplified interactive hot zone and the initial interactive hot zone.

[0044] S130, receiving a first input in which the interaction focus is located in a first interaction hot zone, the first object is one of at least one virtual interaction object, and the first interaction hot zone is an augmented interaction hot zone corresponding to the first object.

[0045] When one virtual interactive object is displayed in the extended reality space, the virtual interactive object is the first object. When multiple virtual interactive objects are displayed in the extended reality space, any one of the multiple virtual interactive objects can be the first object. The first interactive hot zone is an amplified interactive hot zone obtained by expanding the initial interactive hot zone of the first object.

[0046] The interactive focus in the extended reality space can be the visual focus of the user's eyeball in the extended reality space, or the intersection of the corresponding indicator beam of the controller in the extended reality space, or a virtual cursor displayed in the extended reality space. The way to control the movement of the interactive focus in the extended reality space includes but is not limited to controllers, gestures, head posture control, gaze points, etc., where the controller includes but is not limited to handles. When the XR device controls the movement of the interactive focus in the extended reality space through the gaze point through eye tracking technology, the user's gaze point in the extended reality space of the XR device is obtained according to the user's eye movement information. The XR device can collect eye movement information through a photosensitive sensor, and the eye movement information includes but is not limited to the direction, distance and speed of eye movement. Exemplarily, the photosensitive sensor emits modulated pulsed infrared light, which will be reflected after encountering the user's eyeball. The position and diameter of the user's pupil are inferred by detecting the reflected light, and then the movement direction and speed of the user's eyeball are determined according to the changes in the position and diameter of the pupil.

[0047] The first input may be an input operation made by the user controlling the controller, or an input operation made by the user through gestures, head postures, and gaze points. The first input to control the interactive focus may be the interactive focus hovering in the first interactive hot zone, or it may be a single click, double click, long press, etc. input made by the controller when the interactive focus is in the first interactive hot zone, or it may be a specific gesture made, a voice command issued, etc. when the interactive focus is in the first interactive hot zone.

[0048] S140: In response to the first input, trigger an interaction event associated with the first object.

[0049] When the first input is that the interactive focus hovers over the first interactive hot zone, the interactive event associated with the first object may be that the first object is displayed with another image to indicate that the first object is selected. For example, when the interactive focus hovers over the first interactive hot zone, the display color of the first object is triggered to darken.

[0050] When the first input is a click input when the interaction focus is hovering in the first interaction hot zone, the interaction event associated with the first object can be started with the application corresponding to the first object and the menu bar displayed.

[0051] In the control method of the extended reality device provided in the present application, the initial interaction hot zone of the virtual interactive object displayed in the extended reality space is expanded so that each virtual interactive object has an expanded interaction hot zone with a larger display area. On the basis of not changing the display size and arrangement of the virtual interactive object, the expanded interaction hot zone makes it easier to trigger the interaction event associated with the virtual interactive object, thereby reducing the frequency of misoperation, improving the accuracy of human-computer interaction, and improving the interaction effect in the extended reality space. The virtual interactive objects displayed in the extended reality space are all expanded to obtain expanded interaction hot zones, thereby eliminating the need to render the expanded interaction hot zones corresponding to each virtual interactive object according to the movement of the interaction focus, thereby reducing the amount of calculation.

[0052] In some embodiments, S120 includes:

[0053] S210, expanding an initial interaction hot zone of the virtual interaction object to obtain a first interaction hot zone;

[0054] S220, when there are multiple virtual interactive objects in the extended reality space, adjust the first interactive hot zone according to the distribution area of ​​the first interactive hot zone to obtain non-overlapping augmented interactive hot zones.

[0055] S230, when there is a virtual interactive object in the extended real space, setting the first interactive hot zone as an augmented interactive hot zone;

[0056] In S210, the initial interactive hot zone may be enlarged by a preset value or a preset ratio in the aforementioned manner to obtain a first interactive hot zone.

[0057] In some embodiments, a corresponding preset ratio is determined according to the size of the virtual interactive object and / or the initial interactive hot zone, and the initial interactive hot zone is expanded to the first interactive hot zone according to the preset ratio.

[0058] In some embodiments, a corresponding preset value is determined according to the size of the virtual interactive object and / or the initial interactive hot zone, and the initial interactive hot zone is expanded to the first interactive hot zone according to the preset value.

[0059] The expansion method of the initial interactive hot zone can be determined according to the actual application scenario. For example, when the display area of ​​the initial interactive hot zone is smaller than the preset area, the initial interactive hot zone is expanded according to the preset ratio. When the display area of ​​the initial interactive hot zone is greater than or equal to the preset area, the initial interactive hot zone is expanded according to the preset value.

[0060] When there is a virtual interactive object in the extended reality space, the first interactive hot zone is set as the augmented interactive hot zone, that is, the first interactive hot zone is equal to the augmented interactive hot zone.

[0061] When there are multiple virtual interactive objects in the extended reality space, the first interactive hot zone is adjusted according to its distribution area. "Adjustment" includes but is not limited to adjusting one or more boundaries of the first interactive hot zone to a preset display range, adjusting one or more boundaries of the first interactive hot zone to within the associated virtual object, and moving one or more boundaries of the first interactive hot zone toward the center point of the virtual interactive object to reduce the area of ​​the first interactive hot zone.

[0062] The preset display range may be equal to or smaller than the user's visual range. One or more boundaries of the first interactive hot zone are adjusted to within the preset display range to prevent the user from making a first input outside the preset display range and erroneously triggering an interactive event of the first object.

[0063] In the extended reality space, not only virtual interactive objects can be displayed, but also other virtual objects. The virtual object can be a picture, text, etc., and relative to the virtual interactive object, the virtual object may not have an interactive effect. In the extended reality space, the virtual interactive object is displayed in the associated virtual object to represent that the two have an associated relationship. For example: the virtual object is a picture, and the virtual interactive object is a switching control displayed below the picture and used to switch to the next picture. Adjust one or more boundaries of the first interactive hot zone to the associated virtual object to prevent the user from making the first input outside the virtual object and accidentally triggering the interactive event of the first object.

[0064] When the distance between adjacent virtual interactive objects is close, the generated augmented interactive hotspots may overlap each other. One or more boundaries of the first interactive hotspot are moved toward the center point of the virtual interactive object to avoid the augmented interactive hotspots from overlapping each other and to avoid the first input triggering responses from two virtual interactive objects at the same time.

[0065] By adjusting the first interaction hot zone, the enlarged interaction hot zones are prevented from overlapping each other, thereby preventing the first input from triggering responses of two virtual interaction objects at the same time, reducing the frequency of erroneous operations, and improving the accuracy of human-computer interaction operations.

[0066] In some embodiments, S220 includes:

[0067] S310, when the first interaction hot zone corresponding to the second object does not overlap with other first interaction hot zones, setting the first interaction hot zone corresponding to the second object as an augmented interaction hot zone corresponding to the second object, the second object being one of the at least one virtual interaction object;

[0068] S320: When the first interaction hot zone corresponding to the second object overlaps with other first interaction hot zones, the overlapping first interaction hot zones are respectively cut to obtain an enlarged interaction hot zone.

[0069] The first object and the second object may be the same virtual interactive object or different virtual interactive objects. In the case where there are multiple virtual interactive objects in the extended reality space, any virtual interactive object may be the second object, and the first interactive hot zone of the second object does not overlap with other first interactive hot zones, and the first interactive hot zone is used as the augmented interactive hot zone of the second object. In the case where there are multiple virtual interactive objects in the extended reality space, any virtual interactive object may be the second object, and the first interactive hot zone of the second object overlaps with other first interactive hot zones, that is, the first interactive hot zone of the second object has the same area as the other first interactive hot zones. The overlapping first interactive hot zones are cropped respectively, that is, the overlapping first interactive hot zones are reduced so that the augmented interactive hot zones do not overlap with each other, so as to avoid the first input made in the overlapping area of ​​the first interactive hot zones triggering the response of two virtual interactive objects at the same time.

[0070] In some embodiments, S320 includes:

[0071] S410, determining that virtual interaction objects corresponding to two overlapping first interaction hot zones are adjacent virtual interaction objects;

[0072] S420, determining a cropping boundary according to the interval between the adjacent virtual interactive objects and a first boundary of the initial interactive hot zone, where the first boundary is a boundary of a region between the adjacent virtual interactive objects in the initial interactive hot zone of the adjacent virtual interactive objects;

[0073] S430, trimming the first interactive hot zone to a trimming boundary to obtain an amplified interactive hot zone.

[0074] When two first interaction hotspots overlap, the two first interaction hotspots are adjacent virtual interaction objects. Figure 5 , the first interaction hot zone 4a of the virtual interaction object 1a overlaps with the first interaction hot zone 4b of the virtual interaction object 1b, then the virtual interaction object 1a and the virtual interaction object 1b are virtual interaction objects to each other. Figure 6 When different regions of the first interaction hot zone 4b overlap with different first interaction hot zones 4a and 4c respectively, the first interaction hot zone 4a and the first interaction hot zone 4b are mutually adjacent virtual interaction objects, and the first interaction hot zone 4b and the first interaction hot zone 4c are mutually adjacent virtual interaction objects. Figure 7When multiple first interaction hotspots have the same overlapping area, they are adjacent virtual interaction objects in pairs. For example, if the first interaction hotspot 4a of the virtual interaction object 1a, the first interaction hotspot 4b of the virtual interaction object 1b, and the first interaction hotspot 4c of the virtual interaction object 1c overlap, the virtual interaction object 1a and the virtual interaction object 1b are virtual interaction objects, the virtual interaction object 1a and the virtual interaction object 1c are virtual interaction objects, and the virtual interaction object 1b and the virtual interaction object 1c are virtual interaction objects.

[0075] In S420, the interval distance between adjacent virtual interactive objects may be the minimum interval distance between adjacent virtual interactive objects along the direction of the line connecting the center points of the adjacent virtual interactive objects. The initial interaction hot zone of the adjacent virtual interactive objects has multiple area boundaries, wherein the area boundary located between the adjacent virtual interactive objects and arranged opposite to each other is the first boundary.

[0076] The initial interaction hotspots of adjacent virtual interaction objects do not overlap, and the first interaction hotspots generated after the initial interaction hotspots are expanded overlap, and a clipping boundary is determined according to the interval distance and the initial interaction hotspot, so that the clipping boundary is located between the boundary of the initial interaction hotspot and the boundary of the first interaction hotspot. The amplified interaction hotspot obtained through S430 has the clipping boundary. The clipping boundary of the amplified interaction hotspot moves outward from the center point of the virtual interaction object compared to the initial interaction hotspot, and the clipping boundary of the amplified interaction hotspot moves inward toward the center point of the virtual interaction object compared to the first interaction hotspot.

[0077] In some embodiments, the minimum spacing distances between the clipping boundaries and the initial interaction hotspots of adjacent virtual interactive objects are equal.

[0078] The objects displayed in the extended reality space can determine the position of the objects in the extended reality space based on the horizontal coordinates and the vertical coordinates. The initial interaction hotspot has a region boundary extending in the vertical direction and a region boundary extending in the horizontal direction. When adjacent virtual interactive objects are arranged at intervals in the vertical direction, the region boundary extending in the horizontal direction and located between the adjacent virtual interactive objects is the first boundary, and the clipping boundary extends in the horizontal direction; when adjacent virtual interactive objects are arranged at intervals in the horizontal direction, the region boundary extending in the vertical direction and located between the adjacent virtual interactive objects is the first boundary, and the clipping boundary extends in the vertical direction.

[0079] For example: See Figure 8 , among which Figure 8As shown in (a), the first interaction hot zone 4a of the virtual interaction object 1a overlaps with the first interaction hot zone 4b of the virtual interaction object 1b, the minimum vertical spacing distance between the virtual interaction object 1a and the virtual interaction object 1b is a, the region boundary of the initial interaction hot zone 2a close to the virtual interaction object 1b is the first boundary 21a, the region boundary of the initial interaction hot zone 2b close to the virtual interaction object 1a is the first boundary 21b, the horizontal coordinate of the first boundary 21a is x1, and the horizontal coordinate of the first boundary 21b is x2, as shown in FIG. Figure 8 As shown in (b), after the cropping process, the common boundary of the amplification interaction hot zone 3a and the amplification interaction hot zone 3b is the cropping boundary, and the horizontal coordinate of the cropping boundary is (x1+a).

[0080] In some embodiments, S220 includes:

[0081] S510, when the second object has an associated virtual object and a portion of the first interaction hot zone corresponding to the second object is located outside the virtual object, the first interaction hot zone corresponding to the second object is cropped to obtain an augmented interaction hot zone located within the virtual object.

[0082] In the extended reality space, not only virtual interactive objects but also virtual display objects can be displayed. The virtual object can be a picture, text, etc., and the virtual object does not interact with the virtual interactive object. The virtual object can be a virtual interactive object or a virtual display object. In the extended reality space, the virtual interactive object is displayed in the associated virtual object to represent that the two are associated. Cropping the first interactive hot zone corresponding to the second object can also be understood as adjusting one or more boundaries of the first interactive hot zone to the associated virtual object, or as deleting the part of the first interactive hot zone outside the virtual object, expanding the interactive hot zone and the virtual object to have a common area boundary, and preventing the user from making a first input outside the virtual object and accidentally triggering the interactive event of the first object.

[0083] For example, the virtual object is a text box, the virtual interactive object is a close control displayed in the text box and used to close the text box, and the first interactive hot zone is clipped to the text box.

[0084] For example: See Fig. 9 , among which Fig. 9 As shown in (a), the virtual object 5 is a container object, and the virtual interactive object 1a is an application identifier displayed in the container object 5 and used to trigger the opening of the application program. Fig. 9 As shown in (b), the first interactive hot zone 4a is cut into the container object 5 to obtain the amplified interactive hot zone 3a located in the container object 5.

[0085] In some embodiments, the location information includes horizontal coordinate information and vertical coordinate information; S210 includes:

[0086] S610, determining an amplification value according to horizontal coordinate information and vertical coordinate information of the virtual interactive object;

[0087] S620, determining a region boundary extending in a vertical direction according to the amplification value and the horizontal coordinate information of the initial interactive hot zone;

[0088] S630, determining a region boundary extending in a horizontal direction according to the amplification value and vertical coordinate information of the initial interactive hot zone;

[0089] S640: Determine a first interactive hot zone according to a region boundary in a vertical direction and a region boundary in a horizontal direction.

[0090] The virtual interactive object has vertical coordinate information along the vertical direction and horizontal coordinate information along the horizontal direction, so that the virtual interactive object can be displayed in the extended reality space according to the horizontal coordinate information and the vertical coordinate information of the virtual interactive object.

[0091] The amplification value is determined according to the horizontal coordinate information and the vertical coordinate information of the virtual interactive object, and then the boundary of the area extending in the vertical direction is determined according to the amplification value and the horizontal coordinate information of the initial interactive hot zone. The boundary of the area extending in the horizontal direction is determined according to the amplification value and the vertical coordinate information of the initial interactive hot zone, so that the initial interactive hot zone is expanded to the first interactive hot zone, which is not only related to the initial interactive hot zone, but also related to the size of the virtual interactive object, so that the initial interactive hot zones of different virtual interactive objects are expanded to different sizes, and the obtained amplified interactive hot zones meet the size of the virtual interactive objects.

[0092] In some embodiments, S610 includes:

[0093] S710, determining a maximum horizontal value according to horizontal coordinate information of the virtual interactive object;

[0094] S710, determining a maximum vertical value according to vertical coordinate information of the virtual interactive object;

[0095] S710: Set the larger value of the maximum horizontal value and the maximum vertical value as the expansion value.

[0096] The maximum horizontal value is the difference between the maximum horizontal coordinate and the minimum horizontal coordinate of the virtual interactive object, and the maximum vertical value is the difference between the maximum vertical coordinate and the minimum vertical coordinate of the virtual interactive object.

[0097] The larger of the maximum horizontal value and the maximum vertical value is set as the expansion value, so as to subsequently determine the regional boundary of the expanded interaction hot zone according to the larger of the maximum horizontal value and the maximum vertical value, and the horizontal coordinate information and the vertical coordinate information of the initial interaction hot zone, so that the initial interaction hot zones of different virtual interaction objects are expanded to different sizes, and the obtained expanded interaction hot zones conform to the size of the virtual interaction objects, eliminating the need to set different preset values ​​for different virtual interaction objects to expand the initial interaction hot zones.

[0098] For example, the maximum horizontal value of the virtual interactive object is 12cm, the maximum vertical value is 4cm, and the area of ​​the initial interactive hot zone is 12cm*4cm. Of the maximum horizontal value of 12cm and the maximum vertical value of 4cm, 12cm is the larger value, so the expansion value is set to 12cm. The area boundary of the initial interactive hot zone extending in the horizontal direction moves 12cm away from the center point of the initial interactive hot zone in the vertical direction, and the area boundary of the initial interactive hot zone extending in the vertical direction moves 12cm away from the center point of the initial interactive hot zone in the horizontal direction, and the area of ​​the expanded interactive hot zone is 36cm*28cm.

[0099] In some embodiments, S210 includes:

[0100] S810, determining virtual interaction objects whose interval distance is less than a preset interval threshold as similar virtual interaction objects;

[0101] S820, determining a region boundary extending in a vertical direction according to the interval distance between the adjacent virtual interactive objects and the horizontal coordinate information of the initial interactive hot zone;

[0102] S830, determining a region boundary extending in a horizontal direction according to the interval distances between adjacent virtual interactive objects and the vertical coordinate information of the initial interactive hot zone;

[0103] S840, determining the amplification interaction hot zone according to the region boundary in the vertical direction and the region boundary in the horizontal direction.

[0104] The preset interval threshold is a preset value. If the interval distance between two virtual interactive objects is less than the preset interval threshold, it means that the distance between the two virtual interactive objects is close, and the two virtual interactive objects are associated as close virtual interactive objects.

[0105] The region boundary extending in the vertical direction can be obtained by moving the interval distance in the horizontal direction away from the center point of the initial interactive hot zone according to the horizontal coordinate information of the initial interactive hot zone. The region boundary extending in the horizontal direction can be obtained by moving the interval distance in the vertical direction away from the center point of the initial interactive hot zone according to the horizontal coordinate information of the initial interactive hot zone. The region formed by the vertical region boundary and the horizontal region boundary is then determined as the amplified interactive hot zone.

[0106] For example, the maximum horizontal value of the adjacent virtual interactive objects is 12 cm, the maximum vertical value is 4 cm, the interval between the adjacent virtual interactive objects is 8 cm, and the area of ​​the initial interactive hot zone is 12 cm*4 cm. The region boundary of the initial interactive hot zone extending in the horizontal direction moves 8 cm away from the center point of the initial interactive hot zone in the vertical direction, and the region boundary of the initial interactive hot zone extending in the vertical direction moves 8 cm away from the center point of the initial interactive hot zone in the horizontal direction, and the area of ​​the expanded interactive hot zone is 28 cm*20 cm.

[0107] The control method of the extended reality device provided in the embodiment of the present application can be executed by the extended reality device. In the embodiment of the present application, the extended reality device provided in the embodiment of the present application is described by taking the extended reality device executing the control method of the extended reality device as an example.

[0108] See also Fig.10 , Fig.10 is a schematic diagram of the structure of an extended reality device provided by another embodiment of the present application, such as Fig.10 As shown, the extended reality device may include:

[0109] A hot zone generation module 900 is used to generate an initial interaction hot zone corresponding to the virtual interaction object according to the position information of the virtual interaction object when there is at least one virtual interaction object in the extended reality space displayed by the extended reality device, and the virtual interaction object is located in the initial interaction hot zone corresponding to the virtual interaction object;

[0110] The hot zone expansion module 901 is used to expand the initial interaction hot zone of the virtual interaction object to obtain an expanded interaction hot zone. When there are multiple virtual interaction objects in the extended real space, the expanded interaction hot zones corresponding to the multiple virtual interaction objects do not overlap each other.

[0111] A receiving module 902 is used to receive a first input in which the interaction focus is located in a first interaction hot zone, where the first interaction hot zone is an augmented interaction hot zone corresponding to a first object, and the first object is one of at least one virtual interaction object;

[0112] The response module 903 is used to trigger an interaction event associated with the first object in response to the first input.

[0113] In an embodiment of the present application, by expanding the initial interaction hot zone of the virtual interactive object displayed in the extended reality space, each virtual interactive object has an expanded interaction hot zone with a larger display area. On the basis of not changing the display size and arrangement of the virtual interactive object, it is easier to trigger the interaction event associated with the virtual interactive object by expanding the interaction hot zone, thereby reducing the frequency of misoperation, improving the accuracy of human-computer interaction, and improving the interaction effect in the extended reality space; the virtual interactive objects displayed in the extended reality space are all expanded to obtain expanded interaction hot zones, thereby eliminating the need to render the expanded interaction hot zones corresponding to each virtual interactive object according to the movement of the interaction focus, thereby reducing the amount of calculation.

[0114] In an optional example, the hot zone expansion module 901 includes:

[0115] A first amplification unit, used to expand an initial interaction hot zone of a virtual interaction object to obtain a first interaction hot zone;

[0116] An adjustment unit, configured to adjust the first interaction hot zone according to the distribution area of ​​the first interaction hot zone to obtain non-overlapping augmented interaction hot zones when there are multiple virtual interaction objects in the extended real space;

[0117] The adjustment unit is also used to set the first interaction hot zone as an augmented interaction hot zone when there is a virtual interaction object in the extended real space.

[0118] In an optional example, the adjustment unit is further configured to:

[0119] When the first interaction hot zone corresponding to the second object does not overlap with other first interaction hot zones, setting the first interaction hot zone corresponding to the second object as an augmented interaction hot zone corresponding to the second object, the second object being one of the at least one virtual interaction object;

[0120] When the first interaction hot zone corresponding to the second object overlaps with other first interaction hot zones, the overlapping first interaction hot zones are respectively clipped to obtain the enlarged interaction hot zones.

[0121] In an optional example, the adjustment unit is further used to: determine that the virtual interaction objects corresponding to the two overlapping first interaction hot zones are mutually adjacent virtual interaction objects;

[0122] Determine a cropping boundary according to the interval between adjacent virtual interactive objects and a first boundary of the initial interactive hot zone, where the first boundary is a boundary of a region between adjacent virtual interactive objects in the initial interactive hot zone of the adjacent virtual interactive objects;

[0123] The first interactive hot zone is clipped to a clipping boundary to obtain an augmented interactive hot zone, where the clipping boundary is a common boundary of the augmented interactive hot zones corresponding to adjacent virtual interactive objects.

[0124] In an optional example, the adjustment unit is further configured to:

[0125] When the second object has an associated virtual object and a portion of the first interaction hot zone corresponding to the second object is located outside the virtual object, the first interaction hot zone corresponding to the second object is cropped to obtain an augmented interaction hot zone located within the virtual object.

[0126] In an optional example, the position information includes horizontal coordinate information and vertical coordinate information; the first amplification unit is further used for:

[0127] Determine an amplification value according to horizontal coordinate information and vertical coordinate information of the virtual interactive object;

[0128] Determine the boundary of the region extending in the vertical direction according to the amplification value and the horizontal coordinate information of the initial interaction hot zone;

[0129] Determine the boundary of the region extending in the horizontal direction according to the amplification value and the vertical coordinate information of the initial interactive hot zone;

[0130] The first interactive hot zone is determined according to the region boundary in the vertical direction and the region boundary in the horizontal direction.

[0131] In an optional example, the first amplification unit is further used to: determine a maximum horizontal value according to horizontal coordinate information of the virtual interactive object;

[0132] Determine a maximum vertical value according to the vertical coordinate information of the virtual interactive object;

[0133] The larger value of the maximum horizontal value and the maximum vertical value is set as the expansion value.

[0134] In an optional example, the position information includes horizontal coordinate information and vertical coordinate information; the first amplification unit is further used for:

[0135] Determining virtual interactive objects whose interval distance is less than a preset interval threshold as similar virtual interactive objects;

[0136] Determine the boundary of the region extending in the vertical direction according to the interval distance between the adjacent virtual interactive objects and the horizontal coordinate information of the initial interactive hot zone;

[0137] Determine the boundary of the area extending in the horizontal direction according to the interval distances between adjacent virtual interactive objects and the vertical coordinate information of the initial interactive hot zone;

[0138] The amplification interaction hotspots are determined according to the vertical and horizontal region boundaries.

[0139] The extended reality device in the embodiment of the present application may be an electronic device, or a component in an electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or may be a device other than a terminal. For example, the electronic device may be an augmented reality (AR), virtual reality (VR) device, etc., which is not specifically limited in the embodiment of the present application.

[0140] The extended reality device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0141] The extended reality device provided in the embodiment of the present application can achieve Figures 1 to 9 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0142] Alternatively, if Fig.11 As shown, an embodiment of the present application further provides an electronic device 100, including a processor 101 and a memory 102, wherein the memory 102 stores programs or instructions that can be executed on the processor 101, and when the program or instructions are executed by the processor 101, the various steps of the control method embodiment of the above-mentioned extended reality device are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0143] It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

[0144] Fig.12 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0145] The electronic device 1000 includes but is not limited to components such as a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1208, a memory 1209, and a processor 1210.

[0146] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1210 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.12 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0147] The processor 1210 is used to generate an initial interaction hot zone corresponding to the virtual interaction object according to the position information of the virtual interaction object when there is at least one virtual interaction object in the extended reality space displayed by the extended reality device, and the virtual interaction object is located in the initial interaction hot zone corresponding to the virtual interaction object;

[0148] The processor 1210 is configured to expand an initial interaction hot zone of a virtual interaction object to obtain an augmented interaction hot zone. When there are multiple virtual interaction objects in the extended reality space, the augmented interaction hot zones corresponding to the multiple virtual interaction objects do not overlap with each other.

[0149] The input unit 1204 is used to receive a first input in which the interaction focus is located in a first interaction hot zone, where the first interaction hot zone is an augmented interaction hot zone corresponding to a first object, and the first object is one of the at least one virtual interaction object;

[0150] The processor 1210 is configured to trigger an interaction event associated with the first object in response to the first input.

[0151] Optionally, the processor 1210 is configured to expand an initial interaction hot zone of the virtual interaction object to obtain a first interaction hot zone;

[0152] The processor 1210 is used to adjust the first interactive hot zone according to the distribution area of ​​the first interactive hot zone to obtain non-overlapping amplified interactive hot zones.

[0153] In an embodiment of the present application, by expanding the initial interaction hot zone of the virtual interactive object displayed in the extended reality space, each virtual interactive object has an expanded interaction hot zone with a larger display area. On the basis of not changing the display size and arrangement of the virtual interactive object, it is easier to trigger the interaction event associated with the virtual interactive object by expanding the interaction hot zone, thereby reducing the frequency of misoperation, improving the accuracy of human-computer interaction, and improving the interaction effect in the extended reality space; the virtual interactive objects displayed in the extended reality space are all expanded to obtain expanded interaction hot zones, thereby eliminating the need to render the expanded interaction hot zones corresponding to each virtual interactive object according to the movement of the interaction focus, thereby reducing the amount of calculation.

[0154] Optionally, the processor 1210 is configured to expand an initial interaction hot zone of the virtual interaction object to obtain a first interaction hot zone;

[0155] The processor 1210 is configured to adjust the first interaction hot zone according to the distribution area of ​​the first interaction hot zone to obtain non-overlapping augmented interaction hot zones when there are multiple virtual interaction objects in the extended real space;

[0156] The processor 1210 is used to set the first interaction hot zone as an augmented interaction hot zone when there is a virtual interaction object in the extended real space.

[0157] Optionally, the processor 1210 is configured to set the first interaction hot zone corresponding to the second object as an augmented interaction hot zone corresponding to the second object when the first interaction hot zone corresponding to the second object does not overlap with other first interaction hot zones, and the second object is one of the at least one virtual interaction object;

[0158] The processor 1210 is configured to, when the first interaction hot zone corresponding to the second object overlaps with other first interaction hot zones, respectively cut out the overlapping first interaction hot zones to obtain the enlarged interaction hot zones.

[0159] Optionally, the processor 1210 is configured to determine that the virtual interaction objects corresponding to the two overlapping first interaction hot zones are adjacent virtual interaction objects;

[0160] The processor 1210 is configured to determine a cropping boundary according to the interval distance between adjacent virtual interactive objects and a first boundary of the initial interactive hot zone, where the first boundary is a boundary of a region between adjacent virtual interactive objects in the initial interactive hot zone of the adjacent virtual interactive objects;

[0161] The processor 1210 is configured to clip the first interaction hot zone to a clipping boundary to obtain an augmented interaction hot zone, where the clipping boundary is a common boundary of the augmented interaction hot zones corresponding to adjacent virtual interaction objects.

[0162] Optionally, the processor 1210 is used to crop the first interaction hot zone corresponding to the second object to obtain an augmented interaction hot zone located within the virtual object when the second object has an associated virtual object and a partial area of ​​the first interaction hot zone corresponding to the second object is located outside the virtual object.

[0163] Optionally, the processor 1210 is configured to determine an amplification value according to horizontal coordinate information and vertical coordinate information of the virtual interactive object;

[0164] The processor 1210 is used to determine the region boundary extending in the vertical direction according to the amplification value and the horizontal coordinate information of the initial interactive hot zone;

[0165] The processor 1210 is used to determine the boundary of the region extending in the horizontal direction according to the amplification value and the vertical coordinate information of the initial interactive hot zone;

[0166] The processor 1210 is configured to determine a first interactive hot zone according to a region boundary in a vertical direction and a region boundary in a horizontal direction.

[0167] Optionally, the processor 1210 is configured to determine a maximum horizontal value according to horizontal coordinate information of the virtual interactive object;

[0168] The processor 1210 is configured to determine a maximum vertical value according to vertical coordinate information of the virtual interactive object;

[0169] The processor 1210 is configured to set the larger one of the maximum horizontal value and the maximum vertical value as the expansion value.

[0170] Optionally, the processor 1210 is configured to determine that virtual interaction objects whose interval distance is less than a preset interval threshold are similar virtual interaction objects;

[0171] The processor 1210 is used to determine the region boundary extending in the vertical direction according to the interval distance between the adjacent virtual interactive objects and the horizontal coordinate information of the initial interactive hot zone;

[0172] The processor 1210 is configured to determine a region boundary extending in the horizontal direction according to the interval distance between adjacent virtual interactive objects and the vertical coordinate information of the initial interactive hot zone;

[0173] The processor 1210 is used to determine the amplification interaction hot zone according to the region boundary in the vertical direction and the region boundary in the horizontal direction.

[0174] It should be understood that in the embodiment of the present application, the input unit 1204 may include a graphics processor (Graphics Processing Unit, GPU) 12041 and a microphone 12042, and the graphics processor 12041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1207 includes a touch panel 12071 and at least one of other input devices 12072. The touch panel 12071 is also called a touch screen. The touch panel 12071 may include two parts: a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0175] The memory 1209 can be used to store software programs and various data. The memory 1209 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1209 may include a volatile memory or a non-volatile memory, or the memory 1209 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1209 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0176] The processor 1210 may include one or more processing units; optionally, the processor 1210 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1210.

[0177] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the control method embodiment of the above-mentioned extended reality device is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0178] The processor is the processor in the electronic device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0179] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the control method embodiment of the above-mentioned extended reality device, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0180] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0181] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the control method embodiment of the extended reality device as described above, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0182] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0183] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present application.

[0184] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A control method for an extended reality device, It is characterized in that include: In a case where there is at least one virtual interactive object in the extended reality space displayed by the extended reality device, generating an initial interactive hot zone corresponding to the virtual interactive object according to the position information of the virtual interactive object, wherein the virtual interactive object is located within the initial interactive hot zone corresponding to the virtual interactive object; Expanding the initial interaction hot zone of the virtual interaction object to obtain an augmented interaction hot zone, wherein when there are multiple virtual interaction objects in the extended reality space, the augmented interaction hot zones corresponding to the multiple virtual interaction objects do not overlap with each other; Receiving a first input in which an interaction focus is located in a first interaction hot zone, wherein the first interaction hot zone is the augmented interaction hot zone corresponding to a first object, and the first object is one of the at least one virtual interaction object; In response to the first input, an interaction event associated with the first object is triggered.

2. The control method of the extended reality device according to claim 1, It is characterized in that The step of expanding the initial interaction hot zone of the virtual interaction object to obtain an amplified interaction hot zone includes: Expanding the initial interaction hot zone of the virtual interaction object to obtain a first interaction hot zone; When there are a plurality of virtual interactive objects in the extended reality space, adjusting the first interactive hot zone according to the distribution area of ​​the first interactive hot zone to obtain the augmented interactive hot zones that do not overlap each other; When there is one virtual interactive object in the extended reality space, the first interactive hot zone is set as the augmented interactive hot zone.

3. The control method of the extended reality device according to claim 2, It is characterized in that The adjusting the first interactive hot zone according to the distribution area of ​​the first interactive hot zone to obtain the amplification interactive hot zones that do not overlap each other includes: When the first interaction hot zone corresponding to the second object does not overlap with other first interaction hot zones, setting the first interaction hot zone corresponding to the second object as the augmented interaction hot zone corresponding to the second object, the second object being one of the at least one virtual interaction object; When the first interaction hot zone corresponding to the second object overlaps with other first interaction hot zones, the overlapping first interaction hot zones are respectively clipped to obtain the amplified interaction hot zones.

4. The control method of the extended reality device according to claim 3, It is characterized in that The step of respectively cutting the first overlapping interaction hot zones to obtain the amplified interaction hot zones comprises: Determining that the virtual interactive objects corresponding to the two overlapping first interactive hot zones are mutually adjacent virtual interactive objects; Determining a cropping boundary according to the interval distance between the adjacent virtual interactive objects and a first boundary of the initial interactive hot zone, wherein the first boundary is a boundary of a region between the adjacent virtual interactive objects in the initial interactive hot zone of the adjacent virtual interactive objects; The first interactive hot zone is clipped to the clipping boundary to obtain the augmented interactive hot zone, and the clipping boundary is a common boundary of the adjacent virtual interactive objects corresponding to the augmented interactive hot zone.

5. The control method of the extended reality device according to claim 2, It is characterized in that The adjusting the first interactive hot zone according to the distribution area of ​​the first interactive hot zone to obtain the amplification interactive hot zones that do not overlap each other includes: When the second object has an associated virtual object and a partial area of ​​the first interaction hot zone corresponding to the second object is located outside the virtual object, the first interaction hot zone corresponding to the second object is cropped to obtain the augmented interaction hot zone located within the virtual object.

6. The control method of the extended reality device according to claim 2, It is characterized in that The position information includes horizontal coordinate information and vertical coordinate information; the step of expanding the initial interaction hot zone of the virtual interaction object to obtain a first interaction hot zone includes: Determining an amplification value according to horizontal coordinate information and vertical coordinate information of the virtual interactive object; Determining a region boundary extending in a vertical direction according to the amplification value and the horizontal coordinate information of the initial interactive hot zone; Determining a region boundary extending in a horizontal direction according to the amplification value and the vertical coordinate information of the initial interactive hot zone; The first interactive hot zone is determined according to the region boundary in the vertical direction and the region boundary in the horizontal direction.

7. The control method of the extended reality device according to claim 6, It is characterized in that The step of determining the augmentation value according to the horizontal coordinate information and the vertical coordinate information of the virtual interactive object includes: Determining a maximum horizontal value according to the horizontal coordinate information of the virtual interactive object; Determining a maximum vertical value according to the vertical coordinate information of the virtual interactive object; The larger one of the maximum horizontal value and the maximum vertical value is set as the expansion value.

8. The control method of the extended reality device according to claim 2, It is characterized in that The position information includes horizontal coordinate information and vertical coordinate information; the step of expanding the initial interaction hot zone of the virtual interaction object to obtain a first interaction hot zone includes: Determining that the virtual interactive objects whose interval distance is less than a preset interval threshold are the similar virtual interactive objects; Determining a region boundary extending in a vertical direction according to the interval distance between the adjacent virtual interactive objects and the horizontal coordinate information of the initial interactive hot zone; Determining a region boundary extending in a horizontal direction according to the interval distance between the adjacent virtual interactive objects and the vertical coordinate information of the initial interactive hot zone; The amplification interaction hot zone is determined according to the region boundary in the vertical direction and the region boundary in the horizontal direction.

9. An extended reality device, It is characterized in that include: A hot zone generation module, configured to generate an initial interaction hot zone corresponding to the virtual interaction object according to the position information of the virtual interaction object when there is at least one virtual interaction object in the extended reality space displayed by the extended reality device, wherein the virtual interaction object is located within the initial interaction hot zone corresponding to the virtual interaction object; A hot zone expansion module, used to expand the initial interaction hot zone of the virtual interaction object to obtain an expanded interaction hot zone, and when there are multiple virtual interaction objects in the extended reality space, the expanded interaction hot zones corresponding to the multiple virtual interaction objects do not overlap with each other; A receiving module, configured to receive a first input in which an interaction focus is located in a first interaction hot zone, wherein the first interaction hot zone is the augmented interaction hot zone corresponding to a first object, and the first object is one of the at least one virtual interaction object; A response module is used to trigger an interaction event associated with the first object in response to the first input.

10. An electronic device, It is characterized in that It includes a processor and a memory, the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the control method of the extended reality device as described in any one of claims 1 to 8 are implemented.

11. A readable storage medium, It is characterized in that The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the control method of the extended reality device as described in any one of claims 1-8 are implemented.

12. A computer program product, It is characterized in that The program product is stored in a storage medium, and the program product is executed by at least one processor to implement the steps of the control method of the extended reality device as described in any one of claims 1 to 8.

Images