Security zone update method, device, equipment and medium

Abstract

This application provides a method, apparatus, device, and medium for updating a safe zone. The method is applied to a virtual reality device including a camera, and includes the following steps: upon detecting a safe zone setting instruction, controlling the camera to collect surrounding environment data; determining a safe zone based on the surrounding environment data; and updating the safe zone when a first preset condition is met. This application determines an updateable safe zone and continuously updates the updateable safe zone to ensure the personal safety of users while using the VR device, providing a stronger sense of immersion for users while using the VR device, thereby providing conditions for improving the user experience.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of virtual reality technology, and in particular to a method, apparatus, device, and medium for updating a safe zone. Background Art

[0002] VR (Virtual Reality) devices provide users with an interactive virtual three-dimensional space. Through sensory units, they simulate vision, hearing, touch, and other senses, allowing users to enter a fully immersive virtual world and offer an immersive experience. However, since users cannot perceive their real environment while using VR devices, navigating obstacles in the real world poses a significant safety risk. Therefore, establishing a safe zone is crucial for users to confidently use VR devices in a virtual environment.

[0003] Currently, setting a safe zone is typically done manually by the user in a real-world environment. However, while the user is using the VR device within the safe zone, other people or objects may enter the zone. This can make the safe zone unsafe and prone to collisions, creating a dangerous situation. Furthermore, once the user moves to the edge of the safe zone, the VR device activates the see-through function, forcing the user to step out of the virtual environment and see the real world through the VR device camera, thus affecting the user experience. Summary of the Invention

[0004] The embodiments of the present application provide a method, apparatus, device, and medium for updating a safe zone. By continuously updating the safe zone, the personal safety of users when using VR devices is ensured, and the user's sense of immersion when using the VR device is enhanced, thereby providing conditions for improving the user experience.

[0005] In a first aspect, an embodiment of the present application provides a method for updating a safe zone, which is applied to a virtual reality device, wherein the virtual reality device includes a camera, including:

[0006] When a safety zone setting instruction is detected, the camera is controlled to collect surrounding environment data;

[0007] determining a safe area based on the surrounding environment data;

[0008] When a first preset condition is met, the security area is updated.

[0009] In a second aspect, an embodiment of the present application provides a safe zone updating device, configured in a virtual reality device, wherein the virtual reality device includes a camera, including:

[0010] A control module, configured to control the camera to collect surrounding environment data when a safety zone setting instruction is detected;

[0011] A determination module, configured to determine a safe area based on the surrounding environment data;

[0012] An updating module is configured to update the security area when a first preset condition is met.

[0013] In a third aspect, an embodiment of the present application provides an electronic device, including:

[0014] A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the security area updating method described in the embodiment of the first aspect.

[0015] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium for storing a computer program, wherein the computer program enables a computer to execute the security area updating method as described in the embodiment of the first aspect.

[0016] In a fifth aspect, an embodiment of the present application provides a computer program product comprising program instructions, which, when executed on an electronic device, enables the electronic device to execute the security area update method as described in the embodiment of the first aspect.

[0017] The technical solutions disclosed in the embodiments of this application have at least the following beneficial effects:

[0018] When a safe zone setting instruction is detected, the camera is controlled to collect surrounding environment data to determine a safe zone based on the surrounding environment data, and the safe zone is updated when a first preset condition is met. This application determines an updateable safe zone and continuously updates the updateable safe zone to ensure the personal safety of users when using VR devices, making users more immersed in VR devices, thereby providing conditions for improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0020] Figure 1 This is a flowchart of a method for updating a security zone provided in an embodiment of the present application;

[0021] Figure 2This is a flowchart of another method for updating a security zone provided in an embodiment of the present application;

[0022] Figure 3 1 is a flow chart of another method for updating a security zone provided in an embodiment of the present application;

[0023] Figure 4 This is a flowchart of a specific security zone update method provided in an embodiment of the present application;

[0024] Figure 5 This is a schematic block diagram of a security zone updating device provided in an embodiment of the present application;

[0025] Figure 6 is a schematic block diagram of an electronic device provided in an embodiment of the present application;

[0026] Figure 7 This is a schematic block diagram of an electronic device provided in an embodiment of the present application, which is an HMD. DETAILED DESCRIPTION

[0027] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0028] It should be noted that the terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

[0029] This application is applicable to the scenario of setting a safe area when using VR (Virtual Reality) equipment. Taking into account the current setting of a safe area, it is based on the real environment, and the user manually sets a safe area. However, because the user uses the VR device in the safe area, other people or objects may enter the safe area, causing the safe area to no longer be safe, causing danger. In addition, once the user moves to the edge of the safe area, the VR device will automatically turn on the perspective function, forcing the user to walk out of the virtual environment, thereby affecting the user experience. Therefore, in response to this problem, this application designs a safe area update method, through which the safe area is continuously updated to ensure the personal safety of the user when using the VR device, so that the user has a stronger sense of immersion when using the VR device, and provides conditions for improving the user experience.

[0030] To facilitate understanding of the embodiments of the present application, before describing each embodiment of the present application, some concepts involved in all embodiments of the present application are first appropriately explained as follows:

[0031] 1) Virtual Reality (VR) is a technology for creating and experiencing a virtual world. It computationally generates a virtual environment based on multi-source information (the VR mentioned in this article includes at least visual perception, and can also include auditory perception, tactile perception, motion perception, and even taste perception, olfactory perception, etc.). It achieves the simulation of the fusion of virtual environments, interactive three-dimensional dynamic vision and entity behavior, immersing users in a simulated virtual reality environment, and realizing applications in various virtual environments such as maps, games, videos, education, medical care, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair.

[0032] 2) Virtual reality devices (VR devices), terminals that achieve virtual reality effects, can usually be provided in the form of glasses, head-mounted displays (HMDs), or contact lenses to achieve visual perception and other forms of perception. Of course, the form of virtual reality devices is not limited to this and can be further miniaturized or enlarged according to actual needs.

[0033] Optionally, the virtual reality devices described in the embodiments of this application may include but are not limited to the following types:

[0034] 2.1) PC-based virtual reality (PCVR) devices use the PC to perform calculations and output data related to virtual reality functions. External PC-based virtual reality devices use the data output by the PC to achieve virtual reality effects.

[0035] 2.2) Mobile VR devices support the configuration of mobile terminals (such as smartphones) in various ways (such as head-mounted displays with dedicated card slots). Through wired or wireless connection with the mobile terminal, the mobile terminal performs relevant calculations for VR functions and outputs data to the mobile VR device, such as viewing VR videos through the mobile terminal's app.

[0036] 2.3) All-in-one virtual reality devices have a processor for performing relevant calculations for virtual functions, and thus have independent virtual reality input and output functions. They do not need to be connected to a PC or mobile terminal and have a high degree of freedom of use.

[0037] After introducing some concepts involved in the embodiments of the present application, a method for updating a security zone provided in the embodiments of the present application is described in detail below with reference to the accompanying drawings.

[0038] Figure 1 The figure is a flow chart of a method for updating a security zone provided in an embodiment of the present application. This embodiment of the present application is applicable to scenarios where security zones are updated. The method for updating a security zone can be executed by a security zone update device configured on a virtual reality device to control the security zone update process. The virtual reality device may be, but is not realistically, a VR all-in-one device, VR glasses, a VR helmet, or a VR goggles.

[0039] like Figure 1 As shown, the method for updating the security zone may include the following steps:

[0040] S101, when a safety area setting instruction is detected, the camera is controlled to collect surrounding environment data.

[0041] Among them, the safe area refers to the area where users can move when experiencing VR virtual scenes.

[0042] The surrounding environment data is three-dimensional data or point cloud data.

[0043] In the embodiment of the present application, the camera can be any device that can collect information about the surrounding environment, such as a depth camera, a binocular camera, or a fisheye camera, etc., and there is no specific limitation on it here.

[0044] Optionally, after the user wears the VR device, the VR device can be turned on. When the VR device detects a startup command sent by the user, it performs a startup operation. Furthermore, after successful startup, the VR device can display a safe area setting interface to the user, allowing the user to set a safe area. While displaying the safe area setting interface to the user, this application can also play a voice reminder message such as "Please set a safe area" to the user to help the user set a safe area in a timely manner according to the voice reminder message.

[0045] The security zone settings interface may include: dynamic security zone options and fixed security zone options. In this application, dynamic security zones refer to areas that can change, i.e., update security zones, while fixed security zones refer to areas that cannot change. Once set, these areas will not change unless the security zone is reset.

[0046] It should be understood that, whether it is an updateable security area or a fixed security area, the area can be of any shape, such as a circle, a semicircle or an irregular shape, etc., and this embodiment does not impose any specific limitation on this.

[0047] When it is detected that the user has selected the dynamic safe area option in the safe area setting interface, this application can turn on the camera and guide the user to move in a circle with the VR device as the center so that the camera can collect the surrounding environment data of the user's current location.

[0048] Among them, guiding the user to rotate a circle with the VR device as the center can be by displaying a text message of "rotate a circle with the current position" on the display screen, and / or playing a voice message of "rotate a circle with the current position" through the speaker, etc., and this application does not impose any specific restrictions on this.

[0049] In other words, the user performs corresponding actions according to the guidance information to achieve the purpose of assisting the camera to collect surrounding environment data, thereby laying the foundation for the subsequent determination of a safe and reliable safety area.

[0050] S102: Determine a safe area based on surrounding environment data.

[0051] In the embodiment of the present application, the security area specifically refers to an updateable security area.

[0052] Considering that there may be stools, tables, and other types of obstacles around the user's current location, when determining a safe area based on the surrounding environment data, the application can first determine an area without obstacles based on the surrounding environment data, and then determine a safe area based on the area without obstacles.

[0053] As an optional implementation, the present application can identify the surrounding environment data to determine whether there are obstacles in the surrounding environment centered on the user's current location. If there are obstacles, the area where the obstacles are located is removed from the surrounding environment to obtain an obstacle-free area. The obstacle-free area is then used as the target area, and a safe area is determined based on the target area. The number of obstacle-free areas can be at least one.

[0054] In other words, the present application determines a safe area based on the surrounding environment, specifically including: determining at least one target area without obstacles based on the surrounding environment data; and determining a safe area based on the target area.

[0055] In this embodiment, determining a safe area based on a target area may include the following situations:

[0056] In the first case,

[0057] Treat any target area as a safe zone.

[0058] Considering that the safety area can be an area of ​​any shape and size, this application can use any target area as a safety area according to usage requirements.

[0059] For example, if the user wants to set a larger safety zone, then multiple target areas can be merged into one area according to the user's setting requirements, and the merged area can be used as the safety zone; alternatively, the user can select any target area from the determined target areas and use the target area as the safety zone; alternatively, the application can automatically merge all target areas into one area and use the target area as the target area, etc. This application does not impose specific restrictions on this.

[0060] The second case,

[0061] A safe area is determined from the target area according to a preset safe area size.

[0062] Among them, the preset safe area size can be the area size actively input by the user when setting the safe area; or, it can be the area size of the VR device's factory default configuration, which is not restricted here.

[0063] For example, the present application may first determine whether each target area meets the requirements based on the preset safe area size. If the size of any target area meets the preset safe area size, then the target area may be used as the safe area. If the sizes of all target areas do not meet the preset safe area size, then the present application may merge all target areas to obtain a merged target area. Then, based on the preset safe area size, the safe area is determined from the merged target areas.

[0064] In an optional implementation of this application, after determining a safe area based on the surrounding environment captured by the camera, the application can optionally add the acquisition time to the environmental data corresponding to the safe area to generate a safe area map. This safe area map can then provide guidance and other auxiliary functions for subsequent users during the use of VR devices.

[0065] S103: When a first preset condition is met, the security area is updated.

[0066] The first preset condition may be any rule or indicator for determining whether to update the security area, and may be flexibly set according to usage requirements, and is not limited here.

[0067] Optionally, the first preset condition in the present application may include at least one of the following: the distance between the user's current location and the boundary of the safe area is less than a first distance threshold; the distance to the moment the safe area is determined reaches a preset time length; the distance between the user's current location and any obstacle in the safe area is less than a second distance threshold; the user's positioning is lost.

[0068] The first distance threshold and the second distance threshold may be the same value or different values, and may be adaptively set according to the update accuracy requirements, and are not specifically limited here. For example, assuming that the first distance threshold and the second distance threshold are the same value, they may be set to 30 centimeters (cm) or 35 cm, etc. For another example, assuming that the first distance threshold and the second distance threshold are different values, the first distance threshold may be set to 30 cm, and the second distance threshold may be set to 40 cm, etc., and this application does not make specific restrictions here.

[0069] The preset duration can be flexibly set according to the safety zone requirements and is not limited here. For example, the preset duration can be set to 5 minutes or 10 minutes.

[0070] For example, after determining the safe area, the user can use the VR device in the safe area to experience the virtual reality scene. In order to ensure the personal safety and immersive experience of the user when using the VR device, the present application can control the camera to collect environmental data within the corresponding viewing angle in real time during the user's use of the VR device, and determine whether the distance between the user's current position and the boundary of the safe area is less than a first distance threshold, determine whether the distance between the user's current position and any obstacle in the safe area is less than a second distance threshold, and determine whether the user's positioning is lost; and also control the timer to determine the duration of the safe area and determine whether the statistical duration reaches a preset duration.

[0071] If the distance between the user's current location and the safe zone boundary is less than a first distance threshold, the distance between the user's current location and any obstacle within the safe zone is less than a second distance threshold, the time between the user's current location and the safe zone is a preset duration, and / or the user's location is lost, the safe zone is no longer safe and presents a safety hazard. At this point, a safe zone update operation can be performed to obtain an updated safe zone.

[0072] In an optional implementation, when updating the safe zone, the present application can control the camera to collect environmental data within its current field of view and, based on this environmental data, determine an obstacle-free environmental area. The safe zone is then updated based on the obstacle-free environmental area to obtain an updated safe zone. For example, the obstacle-free environmental area can be used as the updated safe zone, or the obstacle-free environmental area can be merged into the safe zone to obtain an updated safe zone.

[0073] If it is determined that the distance between the user's current position and the boundary of the safe area is not less than the first distance threshold, the distance between the user's current position and any obstacle in the safe area is less than the second distance threshold, the time from the moment the safe area is determined has not reached the preset time, and / or it is determined that the user's position is not lost, then it means that the safe area is currently relatively safe. At this time, the VR device can continue to be used in the safe area, while continuing to control the camera to collect environmental data within its own field of view, and controlling the timer to continue to count the time information for determining the safe area.

[0074] That is, once it is determined that any of the above-mentioned first pre-set conditions are met during the user's use of the VR device, the present application can trigger a safe zone update operation. By updating the safe zone, the user is always operating the VR device in an obstacle-free area. This not only effectively ensures the user's personal safety during the virtual reality experience, but also prevents sudden interruptions to the virtual scene that would affect the user's immersive experience. Furthermore, the present application's safe zone updates are imperceptible to the user, further enhancing the user experience.

[0075] In an optional implementation of the present application, after the present application updates the safe area, it may optionally supplement the safe area map based on the environmental data corresponding to the updated safe area and the corresponding collection time, so as to achieve the purpose of continuously improving the safe area map, thereby laying the foundation for providing guidance and other auxiliary functions for subsequent users in the process of using VR equipment.

[0076] It is understood that this application determines an updateable safe zone based on data about the user's surrounding environment and continuously updates this updateable safe zone while the user is using the VR device. This ensures that the user is always in a safe zone free of obstacles, effectively ensuring personal safety during the virtual reality experience without sudden interruptions to the virtual scene that could affect the user's immersive experience. Furthermore, this application's updates to the safe zone are imperceptible to the user, further enhancing the user experience.

[0077] The safe zone updating method provided in this application, when a safe zone setting instruction is detected, controls the camera to collect surrounding environment data to determine a safe zone based on the surrounding environment data, and updates the safe zone when a first preset condition is met. This application determines an updateable safe zone and continuously updates the updateable safe zone to ensure the personal safety of users when using VR devices, making users more immersed in VR devices, thereby providing conditions for improving the user experience.

[0078] From the above description, it can be seen that this application continuously updates the safe area so that the user can always use the VR device in a safe area.

[0079] On the basis of the above embodiment, the embodiment of the present application further optimizes the updating of the security area when the first preset condition is met. Figure 2 , the above-mentioned optimization process of the security area update method provided by this application is specifically described.

[0080] like Figure 2 As shown, the method may include the following steps:

[0081] S201, when a safety area setting instruction is detected, the camera is controlled to collect surrounding environment data.

[0082] S202: Determine a safe area based on surrounding environment data.

[0083] S203: When a first preset condition is met, the camera is controlled to collect environmental data within the current viewing angle.

[0084] Considering that when a user uses a VR device in a safe area to experience a virtual reality scene, there is always the possibility that obstacles may enter the safe area, or the user may move to the boundary of the safe area and then move out of the safe area due to excessive use. Therefore, when a user uses a VR device in a safe area, the present application can control the camera in real time to collect environmental data within its current viewing angle to determine whether the distance between the user's current position and the boundary of the safe area is less than a first distance threshold, and whether the distance between the user's current position and any obstacle in the safe area is less than a second distance threshold to determine whether the user's positioning has been lost; at the same time, it also controls the timer to determine the duration of the safe area and determine whether the statistical duration has reached a preset duration.

[0085] When it is determined that the distance between the user's current location and the boundary of the safe area is less than a first distance threshold, the distance between the user's current location and any obstacle in the safe area is less than a second distance threshold, the time from the moment the safe area is determined reaches a preset length, and / or it is determined that the user's location is lost, it indicates that the safe area may no longer be safe. In this case, the present application can control the camera to collect multiple frames of environmental data within its current viewing angle through background control while the user is using the VR device, laying the foundation for updating the safe area based on the multiple frames of environmental data.

[0086] In other words, when this application determines that the safe area may not be safe, it controls the camera in the background to collect environmental data, providing a basis for ensuring that the safe area is updated without the user's perception while using the VR device normally.

[0087] S204: Update the safety zone according to the environmental data.

[0088] For example, when updating the safe zone based on environmental data collected by the camera, the environmental data may be first identified to determine an obstacle-free environmental zone. The safe zone is then updated based on the obstacle-free environmental zone to obtain an updated safe zone. Identifying environmental data to determine an obstacle-free environmental zone is conventional in the art and will not be elaborated upon here.

[0089] The safe area is updated according to the environment area without obstacles to obtain the updated safe area, which may include the following methods:

[0090] Method 1

[0091] The environmental area is merged into the security area to obtain an updated security area.

[0092] It should be understood that by merging the environment area without obstacles into the safe area, not only the personal safety of users using VR devices is guaranteed, but the safe area can also be further expanded, allowing users to flexibly use VR devices in a larger safe area.

[0093] Method 2

[0094] The environmental area is used as the updated safe area.

[0095] Considering that when the user moves near the boundary of the safe area, there may be a risk of moving out of the safe area at any time. Then the environmental area determined based on the environmental data collected by the camera at this time may be an environmental area other than the safe area. In this case, the present application can directly use the environmental area as the updated safe area, so that when the user moves from the safe area to the updated safe area, the user can continue to use the VR device in the updated safe area.

[0096] After the safe area is updated, the user can continue to use the VR device in the updated safe area. Moreover, while the user is using the VR device, the present application can also continue to control the camera in real time to collect environmental data within its current new viewing angle. Then, based on the environmental data collected by the camera, determine whether the distance between the user's current position and the boundary of the safe area is less than the first distance threshold, determine whether the distance between the user's current position and any obstacle in the safe area is less than the second distance threshold, and determine whether the user's positioning is lost; at the same time, control the timer to determine the length of the safe area, and determine whether the statistical length reaches the preset length. When it is determined that the distance between the user's current position and the boundary of the safe area is less than the first distance threshold, the distance between the user's current position and any obstacle in the safe area is less than the second distance threshold, determine whether the user's positioning is lost, and / or when it is determined that the statistical length reaches the preset length, continue to update the safe area based on the latest environmental data collected by the camera.

[0097] The method for updating the safe area provided by the present application, when a safe area setting instruction is detected, controls the camera to collect surrounding environment data to determine the safe area based on the surrounding environment data, and updates the safe area when the first preset condition is met. The present application determines an updateable safe area and continuously updates the updateable safe area to ensure the personal safety of users when using VR equipment, so that users have a stronger sense of immersion when using VR equipment, thereby providing conditions for improving the user experience. Moreover, the present application is imperceptible to the user during the update of the safe area, that is, the safe area is updated through background control, thereby further improving the user experience.

[0098] In another implementation of the present application, considering that when a user uses a VR device, after updating the safe area, when the updated safe area needs to be updated again, if it is determined that the update termination condition (i.e., the second preset condition) is met, the user may not be able to continue to use the VR device normally. Then, at this time, a reminder message can be output to the user so that the user can perform corresponding operations based on the reminder message, thereby ensuring that the user can continue to use the VR device normally. Figure 3, the above-mentioned process of sending reminder information of the security area update method provided in the embodiment of the present application is explained.

[0099] like Figure 3 As shown, the method may include the following steps:

[0100] S301, when a safety area setting instruction is detected, the camera is controlled to collect surrounding environment data.

[0101] S302: Determine a safe area based on surrounding environment data.

[0102] S303: When a first preset condition is met, the security area is updated to obtain an updated security area.

[0103] S304: When updating the updated security area, if a second preset condition is met, outputting a reminder message.

[0104] In an embodiment of the present application, the second preset condition includes at least one of the following: the distance between the user's current position and the real space boundary is less than a third distance threshold; the number of times the user's positioning is lost is greater than a preset number threshold.

[0105] Among them, the third distance threshold and the preset number threshold can be flexibly set according to actual usage requirements, and no specific restrictions are made here.

[0106] It should be noted that the real space in this application refers to any real space where the user uses VR equipment, such as a room at home, an exhibition hall or a classroom, etc., and there is no specific restriction on it here.

[0107] The reminder information includes: reminder information for paying attention to safety and reminder information for adjusting the use area.

[0108] Taking into account that the user will continue to move during the use of VR equipment, and the VR equipment will continue to update the safe area as the user moves. However, when the user moves to the boundary of the safe area, and the boundary of the safe area is the boundary of the real space (real scene), such as near the wall of the bedroom; or when the user's positioning information cannot be obtained for many times, the updated safe area needs to be updated again, but it is determined that the second preset condition (update termination condition) has been met. Then, at this time, this application may no longer be able to continue to update the safe area. Therefore, in order to avoid safety accidents such as users colliding with walls or falling, this application can automatically trigger the early warning function to send reminder information to the user, so that the user pays attention to safety and adjusts the use area according to the reminder information to protect the user's personal safety.

[0109] In this embodiment, the reminder information output to the user can be output as a voice reminder information through voice broadcast; and / or, through an external device, such as a motor in a handle or bracelet, etc., to output a vibration reminder information to the user; and / or, in text form, a text reminder information pops up on a display screen, etc. This application does not impose any specific restrictions on this.

[0110] Furthermore, while sending a reminder message to the user, as an optional implementation method, the present application may also display a safety zone map corresponding to the last updated safety zone in any area of ​​the display screen, or in the form of a floating window on the display screen, so that the user can adjust the usage area based on the safety zone map. The safety zone map corresponding to the last updated safety zone is a regional map generated based on the environmental data corresponding to the first safety zone through the last safety zone.

[0111] For example, when a user adjusts their usage area based on the safe zone map displayed on the display screen, the application can also control the camera to collect real-time environmental data within the viewing angle corresponding to the user's movement process, and determine a new safe zone based on the environmental data, so that the user can continue to use the VR device in the new safe zone. In addition, the application can also determine the user's real-time location based on the environmental data and display the user's moving location on the safe zone map, thereby helping the user understand their current location in real time.

[0112] As another optional implementation method, in addition to displaying the safety zone map corresponding to the last updated safety zone in any area of ​​the display screen or in the form of a floating window on the display screen, the present application can also mark the most recent historical safety zone in the safety zone map so that the user can trigger the most recent historical safety zone. Furthermore, based on the user's trigger operation, the present application generates a movement path from the user's current location to the most recent historical safety zone and displays the movement path, so that the user can move to the most recent historical safety zone according to the movement path. The trigger can be, but is not limited to: click and selection.

[0113] Considering that obstacles may exist in any area of ​​real space at any time, in order to avoid danger when the user moves from the current position to the most recent historical safe area due to obstacles in the movement path or obstacles in the most recent historical safe area, the present application can also control the camera to collect environmental data within the viewing angle corresponding to the user's movement in real time during the user's movement, and determine a new safe area based on the environmental data, so that the user can continue to use the VR device in the new safe area.

[0114] As another optional implementation, the present application can also continuously send guidance information to the user, such as "turn left" or "turn right," so that the user can change direction according to the guidance information. During the user's change of direction, the camera is controlled to collect real-time environmental data within the camera's corresponding viewing angle during the user's change of direction. Then, based on this environmental data, a new safe area is determined, allowing the user to continue using the VR device in the new safe area.

[0115] That is to say, when this application determines that the user may not be able to continue to use the VR device normally, it outputs a reminder message to the user so that the user can adjust the usage area in time, thereby ensuring that the user can continue to use the VR device without suddenly being separated from the virtual scene, resulting in a poor user experience.

[0116] The method for updating the safe area provided by the present application controls the camera to collect surrounding environment data when a safe area setting instruction is detected, so as to determine the safe area based on the surrounding environment data, and to update the safe area when the first preset condition is met. The present application determines an updateable safe area and continuously updates the updateable safe area to ensure the personal safety of the user when using the VR device, so that the user has a stronger sense of immersion when using the VR device, thereby providing conditions for improving the user experience. In addition, the present application also updates the updated safe area again, and if it is determined that the second preset condition is met, a reminder message is output to the user, so that the user can take corresponding measures based on the reminder message, thereby ensuring that the user can continue to use the VR device normally without suddenly being separated from the virtual scene, resulting in a poor user experience.

[0117] The following describes the security zone updating method provided by this application in conjunction with an application scenario.

[0118] like Figure 4 As shown, the method may include the following steps:

[0119] S401, when a start operation triggered by a user is detected, a security zone setting interface and a voice prompt message of "Please set the security zone" are displayed to the user.

[0120] Among them, the security zone setting interface includes two options: dynamic security setting and fixed security zone setting.

[0121] S402, when it is detected that the user has triggered the "dynamic safety zone setting" option, the camera is turned on and a prompt message of "scanning the surrounding environment" is displayed and / or played to the user. Then, the user moves in a circle with the VR device as the center according to the prompt message, so that the camera collects surrounding environment data.

[0122] S403, when receiving the "scan completed" option triggered by the user, it is determined that the surrounding environment data scanning is completed, and at this time, a safe range is determined based on the scanned surrounding environment data, and a safe area is determined based on the safe range.

[0123] The safe range is the area without obstacles.

[0124] In other words, the present application can determine a safe area based on an area without obstacles.

[0125] As an optional implementation solution, after determining the safe area, the present application also generates a safe area map in combination with current time information.

[0126] S404: When the user experiences the VR scene in the determined safe area, the camera is controlled in real time to collect environmental data within the current field of view and to count the setting time of the safe area in real time.

[0127] S405: If it is determined based on the collected environmental data that the distance between the user's current position and the boundary of the safe area is less than the first distance threshold, the camera is controlled to collect the latest environmental data within the current viewing angle, and the safe area is updated according to the collected latest environmental data.

[0128] S406, after the safe area is updated, the camera is continued to be controlled to collect environmental data within the current field of view in real time and to count the safe area setting duration in real time. When it is determined based on the collected environmental data that the updated safe area needs to be updated again, if the user's current position is determined based on the collected environmental data to be near the boundary of the real space, that is, the update termination condition is met, a reminder message is output to the user. Otherwise, 405 is continued to be executed.

[0129] S407: When it is detected that the user has triggered the "fixed security area setting" option, the security area parameters input by the user are obtained, and a fixed security area is set according to the security area parameters.

[0130] S408, when the user experiences the VR scene in a determined fixed safe area, the camera is controlled in real time to collect environmental data within the current field of view. When the distance between the user's current position and any obstacle in the fixed safe area is less than the distance threshold, the perspective function is activated.

[0131] That is to say, according to the method for updating the safety area provided in the embodiment of the present application, by determining an updateable safety area, continuous updating operations are performed through the updateable safety area to ensure the personal safety of users when using VR devices, so that users have a stronger sense of immersion when using VR devices, thereby providing conditions for improving the user experience.

[0132] Please refer to the attached Figure 5 , a safe zone updating device proposed in an embodiment of the present application is described. It should be noted that the safe zone updating device provided in this application can be configured in a virtual reality device. Among these virtual reality devices, but not practical, can be: an all-in-one VR device, VR glasses, a VR helmet, and VR goggles, etc.

[0133] Figure 5 This is a schematic block diagram of a security zone update device provided by an embodiment of the present application. Figure 5 As shown, the security zone updating device 500 includes: a control module 510 , a determination module 520 and an updating module 530 .

[0134] The control module 510 is configured to control the camera to collect surrounding environment data when a safety zone setting instruction is detected;

[0135] A determination module 520 is configured to determine a safe area based on the surrounding environment data;

[0136] The updating module 530 is configured to update the security area when a first preset condition is met.

[0137] In an optional implementation of the embodiment of the present application, the update module 530 includes: a control unit and an update unit;

[0138] The control unit is used to control the camera to collect environmental data within the current viewing angle;

[0139] An updating unit is configured to update the security area according to the environmental data.

[0140] In an optional implementation of the embodiment of the present application, the updating unit is specifically configured to:

[0141] determining an environmental area without obstacles based on the environmental data;

[0142] The security area is updated according to the environmental area to obtain an updated security area.

[0143] In an optional implementation of the embodiment of the present application, the updating unit is further configured to:

[0144] Merging the environmental area into the security area to obtain an updated security area;

[0145] or,

[0146] The environmental area is used as the updated safe area.

[0147] In an optional implementation of the embodiment of the present application, the first preset condition includes at least one of the following:

[0148] The distance between the user's current location and the boundary of the safety zone is less than a first distance threshold;

[0149] The distance to the safe zone is determined to reach a preset time;

[0150] The distance between the user's current location and any obstacle in the safety area is less than a second distance threshold;

[0151] User location is lost.

[0152] In an optional implementation of the embodiment of the present application, the determination module 520 includes: a determination unit;

[0153] The determining unit is configured to determine at least one target area without obstacles based on the surrounding environment data; and determine a safe area based on the target area.

[0154] In an optional implementation of the embodiment of the present application, the determining unit is specifically configured to:

[0155] Treat any of the target areas as a safe area;

[0156] or,

[0157] A safe area is determined from the target area according to a preset safe area size.

[0158] In an optional implementation of the embodiment of the present application, the apparatus 500 further includes: an information output module;

[0159] The information output module is configured to output reminder information when updating the updated security area if a second preset condition is met.

[0160] In an optional implementation of the embodiment of the present application, the second preset condition includes at least one of the following:

[0161] The distance between the user's current position and the boundary of the real space is less than a third distance threshold;

[0162] The number of times the user's positioning is lost exceeds the preset threshold.

[0163] In an optional implementation of the embodiment of the present application, the apparatus 500 further includes: a map generation module:

[0164] Among them, the map generation module is used to add the collection time to the environmental data corresponding to the safe area and generate a safe area map.

[0165] The safe zone updating device provided in an embodiment of the present application, when detecting a safe zone setting instruction, controls a camera to collect surrounding environment data to determine a safe zone based on the surrounding environment data, and updates the safe zone when a first preset condition is met. This application determines an updateable safe zone and continuously updates the updateable safe zone to ensure the personal safety of users when using VR devices, making users more immersed in VR devices, thereby providing conditions for improving the user experience.

[0166] It should be understood that the device embodiment and the aforementioned method embodiment may correspond to each other, and similar descriptions may refer to the method embodiment. To avoid repetition, no further details will be given here. Specifically, Figure 5 The apparatus 500 shown may perform Figure 1 The corresponding method embodiments, and the aforementioned and other operations and / or functions of each module in the apparatus 500 are respectively to implement Figure 1 For the sake of brevity, the corresponding processes in each method are not repeated here.

[0167] The above describes the device 500 of the embodiment of the present application from the perspective of functional modules in conjunction with the accompanying drawings. It should be understood that the functional module can be implemented in hardware form, can be implemented by instructions in software form, and can also be implemented by a combination of hardware and software modules. Specifically, the steps of the first aspect method embodiment in the embodiment of the present application can be completed by the hardware integrated logic circuit and / or software form instructions in the processor, and the steps of the first aspect method disclosed in conjunction with the embodiment of the present application can be directly embodied as being executed by a hardware decoding processor, or can be executed by a combination of hardware and software modules in the decoding processor. Optionally, the software module can be located in a mature storage medium in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps in the above-mentioned first aspect method embodiment in conjunction with its hardware.

[0168] Figure 6 1 is a schematic block diagram of an electronic device provided in an embodiment of the present application, wherein the electronic device is a virtual reality device.

[0169] like Figure 6 As shown, the electronic device 600 may include:

[0170] The memory 610 and the processor 620 are configured to store computer programs and transmit the program code to the processor 620. In other words, the processor 620 can call and run the computer program from the memory 610 to implement the security zone update method in the embodiment of the present application.

[0171] For example, the processor 620 may be configured to execute the above-mentioned security area updating method embodiment according to the instructions in the computer program.

[0172] In some embodiments of the present application, the processor 620 may include but is not limited to:

[0173] General-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.

[0174] In some embodiments of the present application, the memory 610 includes but is not limited to:

[0175] Volatile memory and / or non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus random access memory (DR RAM).

[0176] In some embodiments of the present application, the computer program may be divided into one or more modules, which are stored in the memory 610 and executed by the processor 620 to implement the security zone update method provided by the present application. The one or more modules may be a series of computer program instruction segments capable of performing specific functions, and the instruction segments are used to describe the execution process of the computer program in the electronic device.

[0177] like Figure 6 As shown, the electronic device may further include:

[0178] The transceiver 630 may be connected to the processor 620 or the memory 610 .

[0179] The processor 620 may control the transceiver 630 to communicate with other devices. Specifically, the processor 620 may send information or data to other devices or receive information or data sent by other devices. The transceiver 630 may include a transmitter and a receiver. The transceiver 630 may further include one or more antennas.

[0180] It should be understood that the various components in the electronic device are connected via a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.

[0181] In the embodiment of the present application, when the electronic device is an HMD in a VR all-in-one machine, the embodiment of the present application provides a schematic block diagram of the HMD, such as Figure 7 shown.

[0182] like Figure 7 As shown, the main functional modules of the HMD 700 may include but are not limited to the following: a detection module 710 , a feedback module 720 , a sensor 730 , a control module 740 , and a modeling module 750 .

[0183] The detection module 710 is configured to use various sensors to detect user operation commands or instructions sent by the controller and apply them to the virtual environment. For example, it can continuously update the image displayed on the display screen based on the user's line of sight, enabling user interaction with the virtual environment and the scene. For example, the display content can be continuously updated based on the detected direction of the user's head rotation.

[0184] The feedback module 720 is configured to receive data from sensors and provide real-time feedback to the user. For example, the feedback module 720 can generate a feedback instruction based on the user operation data and output the feedback instruction.

[0185] On the one hand, the sensor 730 is configured to receive operation commands from the user and apply them to the virtual environment; on the other hand, it is configured to provide the results generated after the operation to the user in the form of various feedback.

[0186] The control module 740 is configured to control sensors and various input / output devices, including obtaining user data such as motion and voice, and outputting sensory data such as images, vibrations, temperature, and sound, to affect the user, the virtual environment, and the real world. For example, the control module 740 can obtain user gestures, voice, etc.

[0187] The modeling module 750 is configured to construct a three-dimensional model of the virtual environment, and may also include various feedback mechanisms such as sound and touch in the three-dimensional model.

[0188] It should be understood that the various functional modules in the HMD 700 are connected via a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus, and a status signal bus.

[0189] The present application also provides a computer storage medium having a computer program stored thereon, which enables the computer to perform the method of the above method embodiment when the computer program is executed by the computer.

[0190] An embodiment of the present application further provides a computer program product comprising program instructions, which, when executed on an electronic device, enables the electronic device to execute the method of the above method embodiment.

[0191] When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (DVD)), or a semiconductor medium (e.g., a solid state drive (SSD)).

[0192] Those skilled in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0193] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules is merely a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0194] Modules described as separate components may or may not be physically separate, and components displayed as modules may or may not be physical modules, i.e., they may be located in one place or distributed across multiple network elements. Some or all of the modules may be selected based on actual needs to achieve the purpose of the present embodiment. For example, the functional modules in the various embodiments of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into a single module.

[0195] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A method for updating a security zone, characterized in that: Applied to a virtual reality device, the virtual reality device including a camera, including: When a dynamic safety zone setting instruction is detected, controlling the camera to collect surrounding environment data; Determine a safe area according to the surrounding environment data, wherein the safe area is a dynamic safe area; When a first preset condition is met, the safe area is updated, and the updating of the safe area includes: controlling the camera to collect environmental data within the current viewing angle, determining an environmental area without obstacles based on the environmental data, and using the environmental area without obstacles as an updated safe area, or merging the environmental area without obstacles into the safe area to obtain an updated safe area, wherein the first preset condition includes at least one of the following: the distance from the moment the safe area is determined reaches a preset time length; the user positioning is lost.

2. The method according to claim 1, characterized in that The first preset condition also includes at least one of the following: The distance between the user's current location and the boundary of the safety area is less than a first distance threshold; The distance between the user's current location and any obstacle in the safety area is less than a second distance threshold.

3. The method according to claim 1, characterized in that Determining a safe area based on the surrounding environment data includes: determining at least one target area without obstacles based on the surrounding environment data; A safe area is determined according to the target area.

4. The method according to claim 3, characterized in that Determine a safe area based on the target area, including: Treat any of the target areas as a safe area; or, A safe area is determined from the target area according to a preset safe area size.

5. The method according to any one of claims 1 to 4, characterized in that Also includes: When the updated security area is updated, if the second preset condition is met, a reminder message is output.

6. The method according to claim 5, characterized in that The second preset condition includes at least one of the following: The distance between the user's current position and the boundary of the real space is less than a third distance threshold; The number of times the user's positioning is lost exceeds the preset threshold.

7. The method according to any one of claims 1 to 4, characterized in that Also includes: Add the collection time to the environmental data corresponding to the safe area to generate a safe area map.

8. A device for updating a security area, characterized in that: Configured in a virtual reality device, the virtual reality device includes a camera, including: A control module, configured to control the camera to collect surrounding environment data when a dynamic safety zone setting instruction is detected; A determination module, configured to determine a safe area according to the surrounding environment data, wherein the safe area is a dynamic safe area; An updating module is configured to update the safety zone when a first preset condition is met, wherein updating the safety zone includes: controlling the camera to collect environmental data within a current viewing angle, determining an environmental area without obstacles based on the environmental data, and using the environmental area without obstacles as an updated safety zone, or merging the environmental area without obstacles into the safety zone to obtain an updated safety zone, wherein the first preset condition includes at least one of the following: a preset time length is reached from the moment the safety zone is determined; and user positioning is lost.

9. An electronic device, characterized in that: include: A processor and a memory, the memory being used to store a computer program, the processor being used to call and run the computer program stored in the memory to execute the security area updating method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that Used to store a computer program, wherein the computer program causes a computer to execute the security area updating method according to any one of claims 1 to 7.

11. A computer program product comprising program instructions, characterized in that When the program instructions are executed on an electronic device, the electronic device is caused to execute the security area updating method according to any one of claims 1 to 7.

Images