Safety area determination method and device and electronic equipment
By obtaining and using historical creation information to determine the safe location in virtual reality technology, the problem of users being difficult to accurately define safe areas in immersive interactions is solved, and convenient and accurate regeneration of safe areas is achieved, and virtual reality interaction is improved. Experience.
Patent Information
- Application Number
- CN202310584520.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-23
- Publication Date
- 2024-11-26
AI Technical Summary
In existing virtual reality technology, it is difficult for users to accurately determine the safety zone during immersive interaction, which may cause objects in the real scene to be damaged, and the safety zone needs to be redemarcated during each interaction, affecting the experience.
By obtaining historical creation information, including positioning object and the pose information of the boundary of the historical security area, determine the current pose of the positioning object, and accurately regenerate the target security area based on this information to avoid repeated demarcation process by users.
It realizes the convenient and accurate determination of the safety zone in virtual reality interaction, saves preparation time, improves user experience, and reduces the risk of collision with objects in real scenes.
Smart Images

Figure CN119024951A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of Internet technology, and in particular to a method, device and electronic device for determining a safety zone. Background Art
[0002] With the development of science and technology, virtual reality technology has also been greatly developed. Compared with traditional two-dimensional display technology, virtual reality technology has a stronger sense of immersion. Therefore, virtual reality technology has been applied in more and more fields.
[0003] When a user interacts with an immersive scene in virtual reality technology, the user may also move in the real scene. For example, when a user plays a game through virtual reality technology, the user may also move in the real scene. There may be some objects in the real scene, and the user may touch the objects in the real scene during the immersive browsing process. Summary of the invention
[0004] This disclosure section is provided to introduce concepts in a brief form, which will be described in detail in the detailed description section below. This disclosure section is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.
[0005] To prevent users from getting hurt or encountering other accidents during immersive browsing, virtual reality devices can provide a safe zone function, which can treat the area designated by the user as a safe zone. When the user (the user's head-mounted device or handle) leaves the safe zone, the head-mounted display will display the content in the world to improve the safety of interaction.
[0006] In related technologies, image recognition methods can be used to determine the relative position information between the virtual reality device and the historical safety zone. For example, feature points and descriptors (such as artificial features such as ORB descriptors and SIFT descriptors, or deep learning features such as superpoint) are extracted from the captured image, and then these feature points are matched during recognition. The relative position between the current head-mounted device and the real environment and the relative position between the real environment and the historical safety zone are solved using the matching relationship, thereby restoring the historical safety zone. That is, related technologies can infer the current safety zone by comparing the differences in images captured by the head-mounted device.
[0007] However, the implementation method disclosed in the related art is highly dependent on image similarity. When the lighting changes, objects in the real scene move (for example, the user moves a painting placed in a certain place to another position, moves an object in an orientation, etc.), or the camera perspective changes, it may not be possible to accurately infer the safe zone.
[0008] The disclosed embodiments provide a safety zone determination method, device, and electronic device, which can ensure that when a user needs to interact with virtual reality again, the previously defined safety zone can be used to regenerate the safety zone for this time, thereby avoiding the need for the user to define the safety zone each time when interacting with virtual reality. This saves the time required for the preparation stage of virtual reality interaction, thereby providing the user with a better browsing experience.
[0009] In a first aspect, an embodiment of the present disclosure provides a method for determining a safety zone, comprising: in response to detecting a safety zone creation instruction, obtaining historical creation information; the historical creation information includes posture information of a positioning object and a historical safety zone boundary, the safety zone indicating a moving area for a user to interact with a scene; determining a current posture of the positioning object; and determining a target safety zone based on the current posture of the positioning object and the historical creation information.
[0010] In a second aspect, an embodiment of the present disclosure provides a safety zone determination device, comprising: an acquisition unit, for acquiring historical creation information in response to detecting a safety zone creation instruction; the historical creation information includes posture information of a positioning object and a historical safety zone boundary, and the safety zone indicates a moving area for a user to interact with a scene; a first determination unit, for determining a current posture of the positioning object; and a second determination unit, for determining a target safety zone based on the current posture of the positioning object and the historical creation information.
[0011] In a third aspect, an embodiment of the present disclosure provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the security zone determination method as described above in the first aspect.
[0012] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the security zone determination method as described above in the first aspect.
[0013] The safety zone determination method, device, and electronic device provided by the embodiments of the present disclosure can obtain historical creation information when a safety zone creation instruction is detected, and the historical creation information can include the position information of the positioning object and the historical safety zone boundary, so that the target safety zone can be determined based on the current position and historical creation information of the positioning object. It can be seen that in the disclosed method, the current position of the positioning object can be easily and accurately obtained, and accordingly, the target safety zone can be determined more accurately and conveniently based on the current position and historical creation information of the positioning object.
[0014] In contrast, in the related art, there is a high reliance on image similarity, so that changes in illumination, observation angle, and movement of objects in the scene will affect the similarity of the image, making it difficult to accurately use the historical safety zone to determine the current safety zone in the method disclosed in the related art. However, in the method disclosed in the present invention, since the position and posture of the positioning object can be determined relatively easily and accurately, the current position and posture of the positioning object and the historical creation information can be used to conveniently and accurately determine the target safety zone. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.
[0016] Figure 1 is a flow chart of an embodiment of a method for determining a safety zone according to the present disclosure;
[0017] Figure 2 is a schematic diagram of a control handle and related accessories according to another embodiment of the safety zone determination method of the present disclosure;
[0018] Figure 3 is a structural schematic diagram of an embodiment of a safety zone determination device according to the present disclosure;
[0019] Figure 4 is an exemplary system architecture in which the security zone determination method of an embodiment of the present disclosure can be applied;
[0020] Figure 5 It is a schematic diagram of the basic structure of an electronic device provided according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0021] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0022] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.
[0023] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.
[0024] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0025] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0026] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0027] Before introducing the inventive concept of the present application, a possible application scenario of the present application is described. The present application can be applied to a virtual reality scenario, in which a user may need to wear a virtual reality head-mounted device (e.g., a VR (Virtual Reality) helmet) to interact (e.g., play games, view virtual scene information, etc.); at this time, when the user wears the virtual reality head-mounted device, he or she usually cannot accurately obtain information about the real scene in which he or she is located, so that the user may touch some objects in the real scene during the scene interaction process wearing the virtual reality head-mounted device, which brings a bad experience to the user.
[0028] Therefore, in the present disclosure, when a user performs human-computer interaction in a virtual reality scene, a safety zone can be demarcated (a safe movement area for the user during the virtual reality interaction process). When the user is about to move out of the safety zone, the user can be prompted, thereby preventing the user from moving outside the safety zone during the scene interaction and affecting the user experience.
[0029] Please refer to Figure 1 , which shows the process of an embodiment of the safety zone determination method according to the present disclosure. The safety zone determination method can be applied to a terminal device (for example, a head-mounted device for displaying virtual reality scene information). Figure 1 The safety zone determination method shown includes the following steps:
[0030] Step 101, in response to detecting a security zone creation instruction, obtaining historical creation information.
[0031] Here, the history creation information includes the position information of the positioning object and the boundary of the history safety zone, and the safety zone indicates the movement area where the user interacts with the scene.
[0032] It should be understood that the positioning object is an object in the real scene, which can be movably or fixedly set in the real scene, such as an ornament on a table, a landmark, or a hanging sign on a wall, etc. The head-mounted device can obtain the position and posture of the positioning object, and the acquisition method may include, for example: based on the pre-stored positioning object position and posture acquisition; or by performing image processing on at least one captured image containing the positioning object, and optical devices may be set on the positioning object to facilitate the head-mounted device to better identify and calculate the position and posture of the positioning object; or the positioning object determines its position and posture based on its own spatial positioning capability and transmits it to the head-mounted device for acquisition, etc.
[0033] Here, the historical creation information may include the posture information of the positioning object and the posture information of the historical safety zone boundary, and the posture information respectively indicates the position and posture of the positioning object and the historical safety zone boundary; the historical creation information may also include the relative posture information of the positioning object and the historical safety zone boundary, and the relative posture information can be used to indicate the relative posture relationship between the positioning object and the set historical safety zone boundary.
[0034] In some implementations, the pose information may include a set of coordinate points, that is, the pose information may be stored in the form of a set of coordinates of multiple points, the pose of the positioning object may be defined or calculated by the spatial coordinates of multiple points corresponding to the positioning object, and the range and pose of the safety zone may be defined or calculated by the coordinates of multiple three-dimensional points corresponding to the historical safety zone boundary. The pose information may also be stored in the form of data of the coordinates and pose of a key point. For a positioning object of known structure, the pose of the positioning object can be determined based on the coordinates of each key point of the positioning object. For a safety zone of known shape and size range, the pose of the safety zone can be determined based on the coordinates of the key points of multiple safety zones.
[0035] Here, the safe zone can indicate the moving area of the user when interacting with the scene. That is, when the user interacts with the scene in the safe zone, he usually will not touch certain objects in the real scene, which can bring an excellent experience to the user's interaction process.
[0036] In some implementations, the positioning object may be a control handle, which may be held by a user when interacting with a scene.
[0037] When the positioning object is a control handle, there is no need to set a positioning object separately, and since the terminal device displaying the virtual reality scene can obtain the position and posture of the paired handle according to the existing algorithm, no additional calculation is required. When the control handle is used as the positioning object, the non-master handle can be determined as the positioning object, thereby avoiding affecting the user operation.
[0038] It should be understood that when the positioning object is a control handle, the control handle can be used for the user to hold when interacting with the scene. For example, the user can hold the control handle to perform movement selection operations, scene switching operations, etc. Of course, the specific functions that the control handle can perform can be limited according to actual conditions.
[0039] In some implementations, after the user defines the safety zone for the first time, the position and posture of the positioning object at this time may be recorded, as well as the information of the boundary of the safety zone, so as to obtain the position and posture information of the positioning object and the control handle.
[0040] When the user needs to define the safe zone again (for example, the user needs to browse the virtual reality scene information again), the previously saved historical creation information can be obtained. Since the historical creation information includes the position information of the positioning object and the boundary of the historical safe zone, the historical creation information can be used to determine the target safe zone for this scene interaction.
[0041] As an example, when a user needs to interact with scene information, a safe zone can be demarcated, and a creation instruction can be generated at this time. For example, after the user wears a VR head-mounted device, it can be determined to generate a creation instruction.
[0042] Of course, the specific method of generating the creation instruction can also be limited according to actual conditions, and the specific method of generating the safe zone is not limited here. For example, after the user wears the VR headset, a confirmation control can be displayed, and the creation instruction is generated only after the user triggers the confirmation control.
[0043] It should be understood that the storage method and the acquisition method of the historical creation information only need to be reasonably set according to the actual situation.
[0044] Step 102: determine the current position and posture of the positioning object.
[0045] As an example, since the position and posture of the user currently wearing the virtual reality device to view the virtual reality scene may be different from the position and posture when the safety zone was historically delineated, the current posture of the positioning object may be different from the historical posture of the positioning object (it can be understood that the posture of the positioning object indicated by the posture relationship in the historical creation information may be different from the current posture of the positioning object). Therefore, in order to more accurately obtain the current safety zone boundary, it is necessary to determine the current posture of the positioning object. The determination method may include performing image processing on at least one collected image containing the positioning object, and optical devices may be set on the positioning object to facilitate the head-mounted device to better identify and calculate the position and posture of the positioning object; or the positioning object determines its posture based on its own spatial positioning capability and transmits it to the head-mounted device for acquisition, etc.
[0046] Step 103: determine the target safety zone based on the current position and historical creation information of the positioning object.
[0047] As an example, the current placement posture of the positioning object may be slightly different from the historical posture of the positioning object; therefore, in order to make the generated target safety zone more accurate, the target safety zone can be determined based on the current posture of the positioning object and historical creation information.
[0048] In some implementations, the difference between the current position and the historical position of the positioning object can be compared, and based on the difference, the boundary of the historical safety zone corresponding to the historical position can be adjusted, so that the target safety zone can be obtained.
[0049] In some implementations, when the positioning object is a control handle, the user may need to use the control handle to perform control operations (e.g., selection operations, switching operations, etc.), so the control handle may be provided with a posture sensor, so that the posture of the control handle can be conveniently and accurately determined. For example, when the control handle is provided with a posture sensor, the posture information determined by the posture sensor can be directly obtained, and the current posture of the control handle can be obtained by analysis. In this way, the posture of the control handle can be conveniently and accurately determined.
[0050] It can be seen that in the present disclosure, when a safety zone creation instruction is detected, the historical creation information can be obtained, and the historical creation information can include the position information of the positioning object and the historical safety zone boundary, so that the target safety zone can be determined based on the current position and historical creation information of the positioning object. It can be seen that in the present disclosure, the current position of the positioning object can be easily and accurately obtained, and accordingly, the target safety zone can be determined more accurately and conveniently based on the current position and historical creation information of the positioning object.
[0051] In contrast, in the related art, there is a high reliance on image similarity, so that changes in illumination, observation angle, and movement of objects in the scene will affect the similarity of the image, making it difficult to accurately use the historical safety zone to determine the current safety zone in the method disclosed in the related art. However, in the method disclosed in the present invention, since the position and posture of the positioning object can be determined relatively easily and accurately, the current position and posture of the positioning object and the historical creation information can be used to conveniently and accurately determine the target safety zone.
[0052] In some implementations, the positioning object may include an optical device, and step 102 (determining the current position of the positioning object) may specifically include:
[0053] Based on the optical device, the position and pose of the positioning object are determined.
[0054] In the process of determining the posture, the method of determining the posture based on optical devices does not need to consider the influence of ambient lighting too much, so the posture of the positioning object can be determined conveniently and efficiently.
[0055] As an example, a certain number of optical devices (e.g., infrared LED lights) can be distributed on the positioning object according to certain rules, and the virtual reality head-mounted device can determine the relative position between the head-mounted device and the positioning object according to the infrared LED lights. Of course, the distribution rules and number of optical positioning sensors can be limited according to actual conditions.
[0056] In some implementations, the historical position of the positioning object indicated by the history creation information matches or is the same as the current position of the positioning object.
[0057] The historical position of the positioning object controlled by the user matches or is identical to the current position of the positioning object, which will facilitate the matching or identicalness of the target safety zone boundary and the historical safety zone boundary. As an example, when the user historically demarcates the safety zone, the positioning object can be pre-placed in a relatively stable position, such as on a bracket or on a certain desktop, so that the posture of the positioning object remains relatively stable. When re-determining the safety zone, the user can still place the positioning object in the stable position, thereby making the position relationship information between the positioning object and the safety zone boundary determined at each moment more accurate.
[0058] As an example, the positioning object may also be an object fixed in the real scene.
[0059] In some implementations, an initial world coordinate system may be established; a set safety zone boundary may be determined; a position and posture of a positioning object and position and posture information of a set safety zone boundary may be determined in the initial world coordinate system; and historical creation information may be determined based on the position and posture of the positioning object and the position and posture information of the set safety zone boundary.
[0060] As an example, during the interaction of a virtual reality scene, the user wears a VR head mounted device, and after the VR head mounted device captures an image, a world coordinate system can be established based on the image captured by the VR head mounted device. For example, after the VR head mounted device captures the first frame of image, a world coordinate system can be established based on the first frame of image.
[0061] After the initial world coordinate system is established, the coordinate information of the safe zone boundary set by the user in the initial coordinate system and the coordinate information of the positioning object can be determined, so that the posture information of the safe zone boundary and the posture information of the positioning object in the initial coordinate system can be determined very conveniently; thus, the positional relationship between the positioning object and the safe zone boundary can be known.
[0062] In some scenarios, during the virtual reality scene interaction process, the user is provided with two control handles, one of which can be used to place at a predefined position (in this case, the handle can be understood as a positioning object), and the other control handle can be used to define the boundary of the safety zone. For example, if there is one control handle for each hand, the control handle of the non-dominant hand can be placed at a predefined position, so that the user can use the control handle of the dominant hand to set the boundary of the safety zone.
[0063] It should be noted that there are many ways to establish a world coordinate system based on video frame images. For the sake of brevity of the specification, they will not be elaborated here. It is only necessary to make reasonable limitations based on actual conditions.
[0064] In some implementations, a current world coordinate system may also be established, and the above step 103 (determining the target safety zone based on the current position and historical creation information of the positioning object) may specifically include:
[0065] Based on the current posture and historical creation information of the positioning object, the mapping relationship between the current world coordinate system and the initial world coordinate system is determined; based on the mapping relationship and the posture information of the safety zone boundary, the target safety zone is determined.
[0066] As an example, during the creation of the safety zone, the current world coordinate system can be established based on the first frame of image collected when the virtual reality device is worn, and the current position and posture of the positioning object in the current world coordinate system can be determined. In this way, the mapping relationship between the historical position and current position of the positioning object can be used to determine the mapping relationship between the current world coordinate system and the initial world coordinate system, so as to obtain the boundary information of the target safety zone.
[0067] Specifically, the target boundary information can be determined in the following ways:
[0068] in, It can be understood as the mapping relationship between the current world coordinate system and the initial world coordinate system, or it can be understood as the relative relationship between the current world coordinate system and the initial world coordinate system. ′ It can be understood as the current world coordinate system, while W can be understood as the initial world coordinate system. It can be understood as the pose in the current coordinate system, and It can be understood as the historical posture in the initial coordinate system. It can be understood as the coordinates of the safety zone boundary in the initial world coordinate system. It can be understood as the coordinates of the safety zone boundary in the target coordinate system.
[0069] It can be seen that through the above formula, the coordinate information of the target safety zone in the current world coordinate system can be solved, so that the target safety zone can be determined.
[0070] In some implementations, step 103 (determining the target safety zone based on the current position of the positioning object and the historical creation information) may further include:
[0071] The relative position information of the positioning object and the historical safety zone boundary is determined based on the historical creation information; the target safety zone is determined based on the current position and relative position information of the positioning object.
[0072] It should be understood that the relative posture information may indicate the relative posture relationship between the positioning object and the safety zone.
[0073] As an example, the relative posture information of the positioning object and the historical safety zone boundary can be directly recorded, so that a target safety zone can be easily generated. For example, when the user is interacting with the scene, a circular activity area with an area of 5 square meters is required. The positioning object is placed in the center of the activity area. When the user switches from one area to another, at this time, only the positioning object needs to be placed in the corresponding position. Then, according to the relative posture relationship between the positioning object and the safety zone boundary, a target safety zone can be determined. The target safety zone has an area of 5 square meters with the positioning object as the center. The target safety zone is determined according to the posture of the positioning object, and the current real environment may have no correlation with the real environment when the historical safety zone boundary was delineated.
[0074] It can be seen that this method of determining the target safety zone based on the relative posture information of the positioning object and the boundary of the historical safety zone can determine the target safety zone conveniently and efficiently.
[0075] In some implementations, in response to detecting an update instruction for the history creation information, the history creation information is updated based on a pose relationship between the current positioning object and the target safety zone.
[0076] As an example, the user may place the positioning object in a posture that is more in line with the user's usual placement habits. Therefore, the historical creation information may be updated based on the posture information of the current positioning object and the target safety zone.
[0077] In some implementations, after step 103 (determining the target safety zone based on the current position and historical creation information of the positioning object), it is also possible to: generate a prompt message in response to detecting that the distance between the positioning object and the boundary of the target safety zone is less than a first preset distance threshold, and / or detecting that the distance between an accessory associated with the positioning object and the boundary of the target safety zone is less than a second distance threshold.
[0078] As an example, accessories associated with the positioning object may include: VR head-mounted devices, control handles, etc. (Of course, when the positioning object is a control handle, the associated accessories may include another handle). When users interact with virtual reality scenes, they usually use positioning objects and / or accessories associated with the positioning objects.
[0079] For ease of understanding, the positioning object is used as a control handle for example. Figure 2 As shown, Figure 2 It can be understood as a schematic diagram of a control handle and related accessories in one embodiment. Figure 2 It can be seen that when browsing a virtual reality scene, the user can wear a head-mounted device and hold a control handle in each hand.
[0080] At this time, in response to detecting that the distance between the control handle and the boundary of the target safety zone is less than a first preset distance threshold, and / or detecting that the distance between the accessory associated with the control handle and the boundary of the target safety zone is less than a second distance threshold, it can be represented that the user may move out of the target safety zone at this time, and a prompt message can be generated and displayed.
[0081] Of course, the specific type of prompt information can be reasonably set according to the actual situation. For example, the scene captured by the virtual reality headset can be directly displayed at this time, so as to remind the user that the edge of the safe zone has been reached.
[0082] As an example, the specific length of the first distance threshold may be limited according to actual conditions, and correspondingly, the specific length of the second distance threshold may also be limited according to actual conditions.
[0083] It should be understood that since the world coordinate system may have been established in advance when determining the target safety zone, the coordinates of the control handle and related accessories can be determined in real time, and the coordinates of the target safety zone boundary are known. Therefore, the distance between the control handle and the target safety zone boundary and the distance between the accessories associated with the control handle and the target safety zone boundary can be determined.
[0084] Further references Figure 3 As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a device for determining a safety zone. Figure 1 Corresponding to the illustrated security zone determination method embodiment, the device can be specifically applied to various electronic devices.
[0085] like Figure 3 As shown, the safety zone determination device of this embodiment includes: an acquisition unit 301, which is used to acquire historical creation information in response to detecting a safety zone creation instruction; the above-mentioned historical creation information includes posture information of the positioning object and the historical safety zone boundary, and the above-mentioned safety zone indicates the moving area for the user to interact with the scene; a first determination unit 302, which is used to determine the current posture of the above-mentioned positioning object; and a second determination unit 303, which is used to determine the target safety zone based on the current posture of the above-mentioned positioning object and the above-mentioned historical creation information.
[0086] In some implementations, the positioning object is a control handle, and the control handle is used for the user to hold when interacting with the scene.
[0087] In some implementations, the device is also used to: establish an initial world coordinate system; determine a set safety zone boundary; determine the posture of the positioning object and the posture information of the set safety zone boundary in the initial world coordinate system; determine the historical creation information based on the posture of the positioning object and the posture information of the set safety zone boundary.
[0088] In some implementations, the above-mentioned device is also used to: establish a current world coordinate system; the above-mentioned determination unit 303 is specifically used to: determine the mapping relationship between the above-mentioned current world coordinate system and the above-mentioned initial world coordinate system based on the current posture of the above-mentioned positioning object and the above-mentioned historical creation information; determine the target safety zone based on the above-mentioned mapping relationship and the posture information of the above-mentioned safety zone boundary.
[0089] In some implementations, the determination unit 303 is further specifically used to: determine the relative posture information of the positioning object and the historical safety zone boundary based on the historical creation information; and determine the target safety zone based on the current posture of the positioning object and the relative posture information.
[0090] In some implementations, the positioning object includes an optical device, and the first determination unit 402 is further configured to determine the position and posture of the positioning object based on the optical device.
[0091] In some implementations, the apparatus is further configured to: in response to detecting an update instruction for the historical creation information, update the historical creation information based on the current position information of the positioning object and the target safety zone.
[0092] Please refer to Figure 4 , Figure 4 An exemplary system architecture is shown in which the security zone determination method according to an embodiment of the present disclosure can be applied.
[0093] like Figure 4 As shown, the system architecture may include terminal devices 401, 402, 403, a network 404, and a server 405. The network 404 may be used as a medium to provide a communication link between the terminal devices 401, 402, 403 and the server 405. The network 404 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.
[0094] The terminal devices 401, 402, 403 can interact with the server 405 through the network 404 to receive or send messages, etc. Various client applications, such as web browser applications, search applications, and news information applications, can be installed on the terminal devices 401, 402, 403. The client applications in the terminal devices 401, 402, 403 can receive user instructions and perform corresponding functions according to the user instructions, such as adding corresponding information to the information according to the user instructions.
[0095] Terminal devices 401, 402, and 403 can be hardware or software. When terminal devices 401, 402, and 403 are hardware, they can be various electronic devices with display screens and support web browsing, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Group Audio Layer 3), MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Group Audio Layer 4) players, laptops and desktop computers, XR devices (Extended reality), XR devices can include but are not limited to VR glasses, VR helmets, AR (Augmented Reality) glasses, AR helmets, etc. When terminal devices 401, 402, and 403 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, software or software modules used to provide distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.
[0096] The server 405 may be a server that provides various services, such as receiving information acquisition requests sent by the terminal devices 401, 402, and 403, acquiring display information corresponding to the information acquisition requests in various ways according to the information acquisition requests, and sending relevant data of the display information to the terminal devices 401, 402, and 403.
[0097] It should be noted that the security zone determination method provided in the embodiment of the present disclosure can be executed by a terminal device, and accordingly, the security zone determination device can be set in the terminal devices 401, 402, and 403. In addition, the security zone determination method provided in the embodiment of the present disclosure can also be executed by a server 405, and accordingly, the security zone determination device can be set in the server 405.
[0098] It should be understood that Figure 4 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.
[0099] Reference below Figure 5 , which shows an electronic device (eg, Figure 4The terminal device in the embodiment of the present disclosure may include but is not limited to XR devices (Extended Reality), which may include but are not limited to VR glasses, VR helmets, AR (Augmented Reality) glasses, AR helmets; mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0100] like Figure 5 As shown, the electronic device may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.
[0101] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although Figure 5 An electronic device having various devices is shown, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.
[0102] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
[0103] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0104] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (Hyper Text Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
[0105] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0106] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: obtains historical creation information in response to detecting a safety zone creation instruction; the historical creation information includes posture information of a positioning object and a historical safety zone boundary, and the safety zone indicates a moving area for a user to interact with the scene; determines a current posture of the positioning object; and determines a target safety zone based on the current posture of the positioning object and the historical creation information.
[0107] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).
[0108] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0109] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the acquisition unit 301 may also be described as a "unit for acquiring historical creation information".
[0110] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0111] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0112] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.
[0113] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0114] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.
Claims
1. A method for determining a safety zone, characterized in that: Applied to a virtual reality scenario, the safety zone determination method includes: In response to detecting a creation instruction for a safety zone, acquiring historical creation information; the historical creation information includes position information of a positioning object and a boundary of a historical safety zone, the safety zone indicating a moving area for a user to interact with a scene; Determining a current position of the positioning object; A target safety zone is determined based on the current position of the positioning object and the historical creation information.
2. The method according to claim 1, characterized in that The positioning object is a control handle, and the control handle is used for the user to hold when interacting with the scene.
3. The method according to claim 1, characterized in that The method further comprises: Establish the initial world coordinate system; Determine the boundaries of the set safe zone; Determine the position and posture of the positioning object and the position and posture information of the set safety zone boundary in the initial world coordinate system; The history creation information is determined based on the position and posture information of the positioning object and the set safety zone boundary.
4. The method according to claim 3, characterized in that The method further comprises: establishing a current world coordinate system, The determining of the target safety zone based on the current position of the positioning object and the historical creation information includes: Determining a mapping relationship between the current world coordinate system and the initial world coordinate system based on the current position and posture of the positioning object and the historical creation information; Based on the mapping relationship and the position information of the safety zone boundary, a target safety zone is determined.
5. The method according to claim 1, characterized in that The determining of the target safety zone based on the current position of the positioning object and the historical creation information includes: Determining relative position information of the positioning object and the boundary of the historical safety zone based on the historical creation information; A target safety zone is determined based on the current position and posture of the positioning object and the relative position and posture information.
6. The method according to claim 1, characterized in that The positioning object includes an optical device, and determining the current position and posture of the positioning object includes: Based on the optical device, a position and posture of the positioning object is determined.
7. The method according to claim 1, characterized in that The method further comprises: In response to detecting an update instruction for the history creation information, the history creation information is updated based on the current position and posture information of the positioning object and the target safety zone.
8. A safety zone determination device, characterized in that: include: An acquisition unit, configured to acquire historical creation information in response to detecting a creation instruction of a safety zone; the historical creation information includes position information of a positioning object and a boundary of a historical safety zone, wherein the safety zone indicates a moving area for a user to interact with a scene; A first determining unit, used to determine the current posture of the positioning object; The second determining unit is used to determine a target safety zone based on the current position and posture of the positioning object and the historical creation information.
9. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.
10. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
