Space anchor point generation method, head-mounted display device and computer readable medium

Abstract

The embodiment of the invention discloses a space anchor point generation method, head-mounted display equipment and a computer readable medium. A specific embodiment of the method comprises the following steps: in response to detection of space anchor point creation starting information acting on the head-mounted display equipment by a user, generating space anchor point position information of a to-be-generated space anchor point according to a space anchor point generation operation of the user; determining associated scene object information of the to-be-generated spatial anchor point; according to the associated scene object information, generating space anchor point attitude information of a to-be-generated space anchor point; and generating the space anchor point according to the space anchor point position information and the space anchor point attitude information. According to the implementation mode, the adaptation degree between the user requirement and the space anchor point is improved, and therefore the user experience feeling is improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of virtual vision technology, and in particular to a method for generating a spatial anchor point, a head-mounted display device, and a computer-readable medium. Background Art

[0002] Creating spatial anchors on real objects in the scene map allows the spatial anchors to change with the real objects when their positions and poses change. Currently, when generating spatial anchors, the interactive relationship between the spatial anchors and the scene objects is usually used to generate the spatial anchors: first confirm the spatial anchor pose, then associate the spatial anchor with the scene object, or first detect the real object to be associated, and then determine the spatial anchor pose.

[0003] However, in practice, it is found that when the above method is used to generate spatial anchor points, the following technical problems often occur:

[0004] When generating spatial anchors using the interactive relationship between spatial anchors and scene objects, the user's need to generate spatial anchors is not considered, and the user's interactive operations in the AR scene are not considered, resulting in a low degree of compatibility between the generated spatial anchors and the user's need for generating spatial anchors, leading to a poor user experience.

[0005] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known to a person of ordinary skill in the art. Summary of the invention

[0006] The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0007] Some embodiments of the present disclosure propose a spatial anchor point generation method, a head-mounted display device, and a computer-readable medium to solve one or more of the technical problems mentioned in the above background technology section.

[0008] In a first aspect, some embodiments of the present disclosure provide a spatial anchor point generation method, which is applied to a head-mounted display device, comprising: in response to detecting that a user acts on the head-mounted display device to start creating a spatial anchor point, generating spatial anchor point position information of a spatial anchor point to be generated according to the user's spatial anchor point generation operation; determining associated scene object information of the spatial anchor point to be generated; generating spatial anchor point posture information of the spatial anchor point to be generated according to the associated scene object information; and generating a spatial anchor point according to the spatial anchor point position information and the spatial anchor point posture information.

[0009] Optionally, the method further includes: in response to determining that the above-mentioned spatial anchor point generation operation satisfies a preset interactive operation condition, determining the interactive position information between the above-mentioned spatial anchor point generation operation and the corresponding scene object as the spatial anchor point position information.

[0010] Optionally, the method further includes: in response to determining that the above-mentioned spatial anchor point generation operation does not meet the preset interactive operation condition, determining the operation position information corresponding to the above-mentioned spatial anchor point generation operation as the spatial anchor point position information.

[0011] Optionally, the method further includes: in response to determining that the above-mentioned spatial anchor point generation operation satisfies a preset interactive operation condition, determining the scene object corresponding to the above-mentioned spatial anchor point generation operation as associated scene object information.

[0012] Optionally, the method further includes: in response to determining that the above-mentioned spatial anchor point generation operation does not meet the preset interactive operation condition and detecting the user scene object designation information, determining the designated scene object represented by the above-mentioned user scene object designation information as the associated scene object information.

[0013] Optionally, the method also includes: in response to determining that the above-mentioned spatial anchor point generation operation does not meet the preset interactive operation conditions and no user scene object specified information is detected, based on the above-mentioned spatial anchor point position information, determining the scene objects among the preset scene objects that meet the preset position conditions as associated scene object information.

[0014] Optionally, the method also includes: generating initial spatial anchor point posture information of the spatial anchor point to be generated according to the above-mentioned associated scene object information and the preset spatial anchor point generation method information; in response to detecting posture adjustment operation information corresponding to the above-mentioned initial spatial anchor point posture information, updating the above-mentioned initial spatial anchor point posture information, and obtaining the updated initial spatial anchor point posture information as the spatial anchor point posture information.

[0015] Optionally, the method further includes: in response to not detecting posture adjustment operation information corresponding to the initial spatial anchor point posture information, determining the initial spatial anchor point posture information as the spatial anchor point posture information of the spatial anchor point to be generated.

[0016] In a second aspect, some embodiments of the present disclosure provide a head-mounted display device, comprising: one or more processors; a storage device for storing one or more programs; a display screen for imaging in front of the user's eyes; when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any one of the implementation methods in the first aspect.

[0017] In a third aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method described in any one of the implementations in the first aspect.

[0018] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through a spatial anchor point generation method of some embodiments of the present disclosure, the adaptability between the generated spatial anchor point and the user's demand for generating the spatial anchor point can be improved, and the user's experience can be improved. The reason for the low adaptability between the generated spatial anchor point and the user's demand for generating the spatial anchor point, resulting in a poor user experience, is that when the spatial anchor point is generated using the interactive relationship between the spatial anchor point and the scene object, the user's demand for generating the spatial anchor point is not considered, and the user's interactive operation in the AR scene is not considered, resulting in a low adaptability between the generated spatial anchor point and the user's demand for generating the spatial anchor point, resulting in a poor user experience. Based on this, the spatial anchor point generation method of some embodiments of the present disclosure is applied to a head-mounted display device. First, in response to detecting the creation of a spatial anchor point start information of the user acting on the above-mentioned head-mounted display device, the spatial anchor point position information of the spatial anchor point to be generated is generated according to the user's spatial anchor point generation operation. Therefore, the position of the spatial anchor point can be confirmed according to the user's spatial anchor point operation, which can be used to further generate the spatial anchor point. Then, the associated scene object information of the spatial anchor point to be generated is determined. Thus, the scene object to be associated can be obtained, which is further used to associate the spatial anchor point with the scene object. Afterwards, the spatial anchor point posture information of the spatial anchor point to be generated is generated according to the above-mentioned associated scene object information. Thus, the posture information of the spatial anchor point can be obtained. Finally, the spatial anchor point is generated according to the above-mentioned spatial anchor point position information and the above-mentioned spatial anchor point posture information. Thus, the generated spatial anchor point can be obtained. This is also because the spatial anchor point is not directly generated based only on the association relationship between the scene object and the spatial anchor point to be generated. Instead, when generating the spatial anchor point, the user's interactive operation is also considered. The position of the generated spatial anchor point is generated according to the user's spatial anchor point generation operation, thereby further improving the user's demand for the generation of the spatial anchor point and the adaptability between the spatial anchor point, thereby improving the user's experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0020] Figure 1 is an exemplary system architecture diagram of a spatial anchor point generation method applying some embodiments of the present disclosure;

[0021] Figure 2 is a flow chart of some embodiments of the spatial anchor point generation method according to the present disclosure;

[0022] Figure 3 is a schematic diagram of an application scenario of the spatial anchor point generation method disclosed in the present invention;

[0023] Figure 4 is a schematic diagram of an application scenario of the spatial anchor point generation method disclosed in the present invention;

[0024] Figure 5 are flowcharts of other embodiments of the method for generating a spatial anchor point according to the present disclosure;

[0025] Figure 6 It is a schematic diagram of the hardware structure of a head-mounted display device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION

[0026] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0027] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0028] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0029] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0030] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0031] Figure 1 An exemplary system architecture 100 that can be applied to an embodiment of the method for generating a spatial anchor point applied to a head mounted display device of the present disclosure is shown.

[0032] like Figure 1 As shown, the exemplary system architecture 100 may include a head mounted display device 11 and a terminal device 12 .

[0033] The head-mounted display device 11 may include one or two display screens 111. The above-mentioned display screens are used to display a virtual interface. In addition, the head-mounted display device 11 also includes a frame 112. In some embodiments, the sensor, processing unit, memory and battery of the head-mounted display device 11 may be placed inside the frame 112. In some optional implementations of some embodiments, one or more components of the sensor, processing unit, memory and battery may also be integrated into another independent accessory (not shown), and connected to the frame 112 via a data cable 13. In some optional implementations of some embodiments, the head-mounted display device 11 may only have a display function and some sensors, and the terminal device 12 provides data processing, data storage, power supply and other capabilities.

[0034] The terminal device 12 may include a touch screen 121 , which may be used to display content. In some embodiments, the head mounted display device 11 and the terminal device 12 may be connected via a data cable 13 .

[0035] It should be understood that Figure 1 The number of head mounted display devices and terminal devices in the embodiment is only for illustration. According to the implementation requirements, any suitable number of head mounted display devices and terminal devices may be provided.

[0036] Further references Figure 2 , shows a process 200 of some embodiments of the spatial anchor point generation method according to the present disclosure. The spatial anchor point generation method comprises the following steps:

[0037] Step 201, in response to detecting the creation of spatial anchor point start information from a user acting on a head mounted display device, generating spatial anchor point position information of a to-be-generated spatial anchor point according to the user's spatial anchor point generation operation.

[0038] In some embodiments, in response to detecting the creation of spatial anchor point start information by the user acting on the head-mounted display device, the execution subject of the spatial anchor point generation method (e.g., the head-mounted display device) can generate spatial anchor point position information of the spatial anchor point to be generated according to the user's spatial anchor point generation operation. Among them, the above-mentioned spatial anchor point to be generated can represent the spatial anchor point to be generated. The above-mentioned creation of spatial anchor point start information can represent the user's request to start the creation of spatial anchor point through the target start mode. Here, the above-mentioned target start mode is not specifically limited. For example, the user can use the spatial ray to click the spatial anchor point creation control in the head-mounted display device to request the creation of a spatial anchor point, and the above-mentioned spatial anchor point creation control can represent the start button for creating a spatial anchor point. The above-mentioned spatial anchor point generation operation can represent the user's operation of creating a spatial anchor point. Here, the specific operation mode of the above-mentioned spatial anchor point generation operation is not specifically limited. The above-mentioned spatial anchor point generation operation can include gesture interaction operation and spatial ray interaction operation. The above-mentioned gesture interaction operation can represent the user's operation using gesture operation. The above-mentioned spatial ray interaction operation can represent the user's operation using the method of orientation, line of sight or ray. The gesture interaction operation may include but is not limited to one of the following: click, pinch, drag. The spatial ray interaction operation may include but is not limited to one of the following: user orientation, user line of sight, user hand extension line, hardware device ray. The spatial anchor point position information may represent the SLAM coordinates of the spatial anchor point to be generated.

[0039] In some optional implementations of some embodiments, in response to detecting the creation of spatial anchor point start information by the user acting on the head mounted display device, the execution subject may generate spatial anchor point position information of the to-be-generated spatial anchor point according to the user's spatial anchor point generation operation through the following steps:

[0040] In the first step, in response to determining that the spatial anchor point generation operation satisfies a preset interactive operation condition, the interactive position information between the spatial anchor point generation operation and the corresponding scene object is determined as the spatial anchor point position information. The preset interactive operation condition may be that the distance between the position of the to-be-generated spatial anchor point determined by the spatial anchor point generation operation and the position of the scene object is less than a preset distance. The specific value of the preset distance is not limited here. The interactive position information may characterize the contact position between the spatial anchor point generation operation and the scene object. As an example, Figure 3 The interaction position between the spatial ray G and the scene object C in the scene A shown in (4) is the spatial anchor point position information.

[0041] In the second step, in response to determining that the spatial anchor point generation operation does not meet the preset interactive operation condition, the operation position information corresponding to the spatial anchor point generation operation is determined as the spatial anchor point position information. The operation position information may represent the SLAM coordinates corresponding to the spatial anchor point generation operation. As an example, Figure 3 As shown in (2), the position of the user's gesture E can represent the operation position information, and the position of the user's gesture E is the spatial anchor point position information.

[0042] Step 202: Determine the scene object information associated with the spatial anchor point to be generated.

[0043] In some embodiments, the execution subject may determine the associated scene object information of the to-be-generated spatial anchor point. The associated scene object information may represent the scene object associated with the to-be-generated spatial anchor point. The associated scene object information may include but is not limited to one of the following: a three-dimensional object, a plane surface, or a local point cloud. Figure 3 As shown in (1), both object B and object C can represent scene objects.

[0044] In some optional implementations of some embodiments, the execution subject may determine the associated scene object information of the to-be-generated spatial anchor point through the following steps:

[0045] In the first step, in response to determining that the spatial anchor point generation operation satisfies the preset interactive operation condition, the scene object corresponding to the spatial anchor point generation operation is determined as the associated scene object information. The scene object corresponding to the spatial anchor point generation operation may be a scene object whose distance from the spatial anchor point to be generated is less than the preset distance. Figure 3 As shown in (5), object C can represent the associated scene object information.

[0046] In the second step, in response to determining that the spatial anchor point generation operation does not meet the preset interactive operation conditions and detecting the user scene object designation information, the designated scene object represented by the user scene object designation information is determined as the associated scene object information. The user scene object designation information may represent the information of the scene object selected by the user to be associated with the spatial anchor point to be generated. The designated scene object may represent the scene object selected by the user.

[0047] In the third step, in response to determining that the spatial anchor point generation operation does not meet the preset interactive operation conditions and the user scene object specified information is not detected, the scene object that meets the preset position conditions among the preset scene objects is determined as the associated scene object information according to the spatial anchor point position information. The preset position conditions can represent the scene object that is closest to the spatial anchor point to be generated. The preset scene objects among the preset scene objects can represent scene objects that are in the same scene as the spatial anchor point to be generated. Figure 3 As shown in (3), the distance between object C and the to-be-generated spatial anchor point D is the shortest, and thus object C is the associated scene object information. In practice, first, the execution subject may use the Euclidean distance formula to determine the distance between the to-be-generated spatial anchor point and each of the preset scene objects according to the position of the to-be-generated spatial anchor point and the position of each of the preset scene objects, and then determine the scene objects that meet the above position conditions as the associated scene object information.

[0048] Step 203: Generate spatial anchor point posture information of the to-be-generated spatial anchor point according to the associated scene object information.

[0049] In some embodiments, the execution subject may generate the spatial anchor point posture information of the spatial anchor point to be generated based on the associated scene object information. The spatial anchor point posture information may characterize the posture of the spatial anchor point to be generated. In practice, the execution subject may determine the x' axis of the spatial anchor point to be generated as the projection direction of the user's orientation on the xy plane of the scene object represented by the associated scene object information. The orientation of the user may characterize the orientation of the user's face. Then, the y' axis of the spatial anchor point to be generated is determined to be parallel to the direction of gravity. The direction of gravity may characterize the direction of gravity of the earth in the SLAM coordinate system. Afterwards, the z' axis of the spatial anchor point to be generated may be determined to be parallel to the z axis of the scene object represented by the associated scene object information. Thus, the coordinate axis of the spatial anchor point to be generated may be obtained as the spatial anchor point posture information of the spatial anchor point to be generated.

[0050] It should be noted that the implementation method of generating the spatial anchor point posture information of the above-mentioned spatial anchor point to be generated can refer to Figure 5 The method of generating the initial spatial anchor point posture information of the spatial anchor point to be generated as described in step 503.

[0051] Step 204: Generate a spatial anchor point according to the spatial anchor point position information and the spatial anchor point posture information.

[0052] In some embodiments, the execution subject may generate a spatial anchor point according to the spatial anchor point position information and the spatial anchor point posture information. In practice, the execution subject may create a spatial anchor point according to the spatial anchor point position information and the spatial anchor point posture information through a SLAM algorithm.

[0053] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through a spatial anchor point generation method of some embodiments of the present disclosure, the adaptability between the generated spatial anchor point and the user's demand for generating the spatial anchor point can be improved, and the user's experience can be improved. The reason for the low adaptability between the generated spatial anchor point and the user's demand for generating the spatial anchor point, resulting in a poor user experience, is that when the spatial anchor point is generated using the interactive relationship between the spatial anchor point and the scene object, the user's demand for generating the spatial anchor point is not considered, and the user's interactive operation in the AR scene is not considered, resulting in a low adaptability between the generated spatial anchor point and the user's demand for generating the spatial anchor point, resulting in a poor user experience. Based on this, the spatial anchor point generation method of some embodiments of the present disclosure is applied to a head-mounted display device. First, in response to detecting a user's selection operation on the spatial anchor point creation control in the above-mentioned head-mounted display device, the spatial anchor point position information of the spatial anchor point to be generated is generated according to the user's spatial anchor point generation operation. Therefore, the position of the spatial anchor point can be confirmed according to the user's spatial anchor point operation, which can be used to further generate the spatial anchor point. Then, the associated scene object information of the spatial anchor point to be generated is determined. Thus, the scene object to be associated can be obtained, which is further used to associate the spatial anchor point with the scene object. Afterwards, the spatial anchor point posture information of the spatial anchor point to be generated is generated according to the above-mentioned associated scene object information. Thus, the posture information of the spatial anchor point can be obtained. Finally, the spatial anchor point is generated according to the above-mentioned spatial anchor point position information and the above-mentioned spatial anchor point posture information. Thus, the generated spatial anchor point can be obtained. This is also because the spatial anchor point is not directly generated based only on the association relationship between the scene object and the spatial anchor point to be generated. Instead, when generating the spatial anchor point, the user's interactive operation is also considered. The position of the generated spatial anchor point is generated according to the user's spatial anchor point generation operation, thereby further improving the user's demand for the generation of the spatial anchor point and the adaptability between the spatial anchor point, thereby improving the user's experience.

[0054] Further references Figure 5 , which shows a process 500 of another embodiment of a method for generating a spatial anchor point. The process 300 of the method for generating a spatial anchor point comprises the following steps:

[0055] Step 501, in response to detecting the creation of spatial anchor point start information from a user acting on a head mounted display device, generating spatial anchor point position information of a to-be-generated spatial anchor point according to the user's spatial anchor point generation operation.

[0056] Step 502: Determine the scene object information associated with the spatial anchor point to be generated.

[0057] In some embodiments, the specific implementation of steps 501-502 and the technical effects brought about can be referred to Figure 2 The corresponding steps 201-202 in the embodiments are not described in detail here.

[0058] Step 503: Generate initial spatial anchor point posture information of the to-be-generated spatial anchor point according to the associated scene object information and the preset spatial anchor point generation method information.

[0059] In some embodiments, the execution subject may generate initial spatial anchor point posture information of the to-be-generated spatial anchor point based on the associated scene object information and the preset spatial anchor point generation method information. The preset spatial anchor point generation method information may represent the generation of the initial spatial anchor point posture information using the first generation method or the second generation method. The second generation method may represent the method of generating the initial spatial anchor point posture information using user information. The first generation method may represent the method of generating the initial spatial anchor point posture information using scene information.

[0060] In some optional implementations of some embodiments, the execution subject may generate initial spatial anchor point posture information of the to-be-generated spatial anchor point according to the associated scene object information and the preset spatial anchor point generation method information through the following steps:

[0061] In the first step, in response to determining that the above-mentioned preset spatial anchor point generation mode information represents the first generation mode, the above-mentioned execution subject can use the scene information to generate the initial spatial anchor point posture information. Among them, the above-mentioned scene information may include the gravity direction and the posture of the above-mentioned associated scene object information. The above-mentioned gravity direction can represent the gravity direction of the earth in the SLAM coordinate system. In practice, the above-mentioned execution subject can set the y' axis of the spatial anchor point to be generated to be parallel to the gravity direction E. Then, the z' axis of the spatial anchor point to be generated is determined to be parallel to the z axis of the above-mentioned associated scene object information, thereby determining the z' axis and y' axis of the spatial anchor point. Secondly, the above-mentioned execution subject can use the right-hand rule to determine the x' axis corresponding to the above-mentioned spatial anchor point to be generated according to the z' axis and y' axis of the above-mentioned spatial anchor point to be generated. Thus, the coordinate axis of the above-mentioned anchor point to be generated can be obtained as the corresponding initial spatial anchor point posture information. Figure 4 As shown in (b), the y' axis of the spatial anchor point to be generated may be parallel to the gravity direction E. Then, the z' axis of the spatial anchor point to be generated may be parallel to the z axis of the associated scene object information.

[0062] In the second step, in response to determining that the above-mentioned preset spatial anchor point generation method information represents the second generation method, the above-mentioned execution subject may use user information to generate initial spatial anchor point posture information. Among them, the above-mentioned user information may include user orientation information and the posture of the above-mentioned associated scene object information. The above-mentioned user orientation information may represent the user's facial orientation. In practice, first, the above-mentioned execution subject may determine the projection direction of the facial orientation represented by the above-mentioned user orientation information on the xy plane of the above-mentioned associated scene object information as the x' axis of the spatial anchor point to be generated. Then, the z' axis of the spatial anchor point to be generated is determined to be parallel to the z axis of the above-mentioned associated scene object information. Afterwards, the right-hand rule is used to determine the y' axis corresponding to the above-mentioned spatial anchor point according to the determined x' axis and z' axis of the above-mentioned anchor point to be generated. In this way, the coordinate axis of the above-mentioned anchor point to be generated can be obtained as the corresponding initial spatial anchor point posture information. Figure 4 As shown in (a), the projection direction of the above-mentioned spatial anchor point to be generated on the xy plane of the above-mentioned associated scene object information can be the x' axis of the above-mentioned spatial anchor point to be generated, and the z' axis of the above-mentioned spatial anchor point to be generated can be parallel to the z axis of the above-mentioned associated scene object information.

[0063] It should be noted that the method for generating the initial spatial anchor point posture information of the spatial anchor point to be generated is not limited here. The posture of the spatial anchor point to be generated can also be generated by using the spatial ray method, or the spatial ray method, the first generation method, and the second generation method can be combined. There is no limitation on the combined generation method, and the combined method can generate the posture of the spatial anchor point. The implementation method of generating the initial spatial anchor point posture information of the spatial anchor point to be generated can refer to Figure 2 The method described in step 203 in .

[0064] Step 504 , in response to detecting the posture adjustment operation information corresponding to the initial spatial anchor point posture information, the initial spatial anchor point posture information is updated to obtain the updated initial spatial anchor point posture information as the spatial anchor point posture information.

[0065] In some embodiments, in response to detecting the posture adjustment operation information corresponding to the above-mentioned initial space anchor point posture information, the above-mentioned execution subject may update the above-mentioned initial space anchor point posture information, and obtain the updated initial space anchor point posture information as the space anchor point posture information. Among them, the above-mentioned posture adjustment operation information may represent the operation of the user to adjust the posture of the space anchor point to be generated. Here, there is no limitation on the way in which the user adjusts the posture of the space anchor point to be generated. For example, the user may adjust the posture of the space anchor point to be generated represented by the above-mentioned initial space anchor point posture information by gesture or ray. In practice, the above-mentioned execution subject may determine the posture of the above-mentioned space anchor point to be generated adjusted by the user as the updated initial space anchor point posture information.

[0066] Optionally, after step 503, in response to not detecting the posture adjustment operation information corresponding to the initial spatial anchor point posture information, the execution subject may determine the initial spatial anchor point posture information as the spatial anchor point posture information of the spatial anchor point to be generated.

[0067] Step 505: Generate a spatial anchor point according to the spatial anchor point position information and the spatial anchor point posture information.

[0068] In some embodiments, the specific implementation of step 505 and the technical effects brought about can be referred to Figure 2 The corresponding step 204 in the embodiments will not be described in detail here.

[0069] from Figure 5 It can be seen that Figure 2 Compared with the description of some corresponding embodiments, Figure 5 The process 500 of the spatial anchor point generation method in some corresponding embodiments reflects that the final posture of the user's final adjustment of the spatial anchor point can be determined as the posture information of the spatial anchor point to be generated, thereby further reflecting the user's interaction when generating the spatial anchor point, thereby improving the matching degree between the generated spatial anchor point and the user, thereby improving the user experience.

[0070] Reference below Figure 6 , which shows a schematic diagram of the hardware structure of a head-mounted display device 600 with display function.

[0071] like Figure 6 As shown, the head mounted display device 600 includes a processing device (CPU) 501, a memory (ROM) 602, an input unit 603 and an output unit 604, wherein the processing device 601, the memory 602, the input unit 603 and the output unit 604 are connected to each other through a bus 605. Here, the method according to some embodiments of the present disclosure may be implemented as a computer program and stored in the memory 602. The processing device 601 in the head mounted display device 600 specifically implements the spatial anchor point generation function defined in the method of some embodiments of the present disclosure by calling the above-mentioned computer program stored in the memory 602. In some implementations, the input unit 603 may include devices such as a camera, a microphone, a gyroscope, an accelerometer, a magnetometer, etc., and the output unit 604 may be a device that can be used to display content, such as a display screen. The above-mentioned display screen may be a micro display screen. Therefore, when the processing device 601 calls the above-mentioned computer program to execute the spatial anchor point generation function, it may control the input unit 603 to obtain the user's gesture, voice and other operation instructions, and control the output unit 604 to display the display content.

[0072] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0073] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0074] The computer-readable medium may be included in the head-mounted display device; or it may exist independently without being assembled into the head-mounted display device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the head-mounted display device, the head-mounted display device: in response to detecting the creation of spatial anchor point start information of the user acting on the head-mounted display device, generates spatial anchor point position information of the spatial anchor point to be generated according to the user's spatial anchor point generation operation; determines the associated scene object information of the spatial anchor point to be generated; generates spatial anchor point posture information of the spatial anchor point to be generated according to the associated scene object information; generates the spatial anchor point according to the spatial anchor point position information and the spatial anchor point posture information.

[0075] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0076] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0077] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0078] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to) and the technical solutions formed.

Claims

1. A method for generating a spatial anchor point, applied to a head mounted display device, comprising: In response to detecting the creation of a spatial anchor point start information from a user acting on the head mounted display device, generating spatial anchor point position information of a to-be-generated spatial anchor point according to the user's spatial anchor point generation operation; Determine the associated scene object information of the spatial anchor point to be generated; Generate spatial anchor point posture information of the to-be-generated spatial anchor point according to the associated scene object information; A spatial anchor point is generated according to the spatial anchor point position information and the spatial anchor point posture information.

2. The method according to claim 1, wherein: The generating of spatial anchor point position information of a to-be-generated spatial anchor point according to a spatial anchor point generating operation of a user includes: In response to determining that the spatial anchor point generation operation satisfies a preset interactive operation condition, interactive position information between the spatial anchor point generation operation and a corresponding scene object is determined as spatial anchor point position information.

3. The method according to claim 1, wherein: The method further comprises: In response to determining that the spatial anchor point generation operation does not satisfy a preset interactive operation condition, the operation position information corresponding to the spatial anchor point generation operation is determined as the spatial anchor point position information.

4. The method according to claim 1, wherein: The step of determining the scene object information associated with the spatial anchor point to be generated includes: In response to determining that the spatial anchor point generation operation satisfies a preset interactive operation condition, a scene object corresponding to the spatial anchor point generation operation is determined as associated scene object information.

5. The method according to claim 1, wherein: The method further comprises: In response to determining that the spatial anchor point generation operation does not meet a preset interactive operation condition and detecting user scene object designation information, a designated scene object represented by the user scene object designation information is determined as associated scene object information.

6. The method according to claim 1, wherein: The method further comprises: In response to determining that the spatial anchor point generation operation does not meet the preset interactive operation conditions and no user scene object specified information is detected, based on the spatial anchor point position information, the scene objects that meet the preset position conditions among the preset scene objects are determined as associated scene object information.

7. The method according to claim 1, wherein: The step of generating spatial anchor point posture information of a to-be-generated spatial anchor point according to the associated scene object information comprises: Generate initial spatial anchor point posture information of the spatial anchor point to be generated according to the associated scene object information and the preset spatial anchor point generation method information; In response to detecting the posture adjustment operation information corresponding to the initial space anchor point posture information, the initial space anchor point posture information is updated to obtain the updated initial space anchor point posture information as the space anchor point posture information.

8. The method according to claim 7, wherein: The method further comprises: In response to not detecting the posture adjustment operation information corresponding to the initial spatial anchor point posture information, determining the initial spatial anchor point posture information as the spatial anchor point posture information of the spatial anchor point to be generated.

9. A head mounted display device, comprising: one or more processors; A storage device for storing one or more programs; A display screen for forming an image in front of the user's eyes; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 8.

10. A computer readable medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images