Prompt method and device of VR equipment, equipment and computer readable storage medium
Patent Information
- Application Number
- CN202311194182.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-15
- Publication Date
- 2026-09-15
- Estimated Expiration
- 2043-09-15
AI Technical Summary
目前,在VR设备的使用过程中,VR设备中的头戴式显示装置佩戴时会遮住用户双眼,在用户手持手柄进行操作时,由于看不到周围环境,而容易发生碰撞产生危险,特别是在玩VR游戏时,动作幅度往往较大,在家中有小孩和宠物时,容易造成误伤
[0035]In this embodiment of the invention, a distance sensor is installed in the controller of the VR device to detect the first distance data of objects in the surrounding environment of the VR device, providing a data basis for obstacle avoidance prompts. Then, by acquiring the first position information of the head-mounted display device relative to the controller, the second position information of the user's body relative to the controller is determined based on the first position information, thereby estimating the position of the user's body relative to the controller. Then, based on the second position information, the distance data corresponding to the user's body in the first distance data is filtered out to obtain the second distance data, thereby excluding the distance data corresponding to the user's body from the detected distance data, thus avoiding the user's body from being identified as an obstacle. Finally, when an obstacle with a distance of less than a preset distance is detected based on the second distance data, a prompt message is output, enabling the user to slow down their movements or promptly check the surrounding environment to avoid touching obstacles and causing danger.
Smart Images

Figure CN117369628B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of virtual reality technology, and in particular to a prompting method, apparatus, device, and computer-readable storage medium for a VR device. Background Technology
[0002] With the continuous development of virtual reality technology, VR devices are becoming increasingly sophisticated, providing users with a richer and more realistic visual experience. However, during the use of VR devices, the head-mounted display often obstructs the user's vision. When the user is operating the device with the controllers, the inability to see the surrounding environment increases the risk of collisions and potential hazards, especially when playing VR games where movements are often large. This poses a risk of accidental injury, particularly if there are children or pets at home. Summary of the Invention
[0003] The main objective of this invention is to provide a prompting method, apparatus, device, and computer-readable storage medium for VR devices, aiming to propose a prompting scheme for VR devices to prevent users from colliding and causing danger while using VR devices.
[0004] To achieve the above objectives, the present invention provides a prompting method for a VR device, the VR device including a head-mounted display and a controller, wherein the controller is provided with at least one distance sensor, and the prompting method for the VR device includes:
[0005] The distance sensor detects the first distance data of surrounding objects in the environment where the VR device is located;
[0006] Acquire first position information of the head-mounted display device relative to the handle device, and determine second position information of the user's body relative to the handle device based on the first position information;
[0007] Based on the second location information, the distance data corresponding to the user's body in the first distance data is filtered out to obtain the second distance data;
[0008] When an obstacle is detected based on the second distance data and the distance between it and the handle device is less than a preset distance, a prompt message is output.
[0009] Optionally, the first distance data includes distance data in various directions around the handle device, the first position information includes a first direction of the head-mounted display device relative to the handle device, and the step of determining the second position information of the user's body relative to the handle device based on the first position information includes:
[0010] The first direction is expanded according to a preset expansion coefficient to obtain a direction range, and the second position information of the user's body relative to the handle device is obtained according to the direction range;
[0011] The step of filtering out the distance data corresponding to the user's body from the first distance data based on the second location information to obtain the second distance data includes:
[0012] The distance data within the stated direction range is filtered out from the first distance data to obtain the second distance data.
[0013] Optionally, the first direction is represented by the azimuth and pitch angles of the head-mounted display device relative to the handle device, and the preset expansion coefficient includes an azimuth expansion coefficient and a pitch expansion coefficient. The step of expanding the first direction according to the preset expansion coefficient to obtain the direction range includes:
[0014] The azimuth angle is expanded according to the azimuth angle expansion coefficient to obtain the azimuth angle range;
[0015] The pitch angle is expanded according to the azimuth expansion factor to obtain the pitch angle range, and the azimuth angle range and the pitch angle range are used as the expanded direction range.
[0016] Optionally, the second location information includes a first distance between the user's body and the handle device, and the step of filtering out distance data within the direction range from the first distance data to obtain the second distance data includes:
[0017] Filter out distance data in the first distance data that are greater than or equal to the first distance and within the stated direction range to obtain the second distance data.
[0018] Optionally, the first position information further includes a second distance between the head-mounted display device and the handle device, and the step of determining the second position information of the user's body relative to the handle device based on the first position information further includes:
[0019] The first distance is calculated based on the second distance and the first direction.
[0020] Optionally, the prompting method of the VR device further includes:
[0021] Receive sensitivity setting instructions;
[0022] The preset distance is set according to the sensitivity indicated in the sensitivity setting instruction; the higher the sensitivity, the smaller the preset distance.
[0023] Optionally, the step of outputting the prompt information includes:
[0024] The prompt information is displayed on the screen of the head-mounted display device; or,
[0025] The prompt message is played through the speaker of the head-mounted display device; or...
[0026] Control the vibration component in the head-mounted display device or the handle device to vibrate, using vibration as a prompt; or,
[0027] The indicator light in the handle device is controlled to flash, and the flashing of the indicator light serves as a prompt.
[0028] To achieve the above objectives, the present invention also provides a prompting device for a VR device, the VR device including a head-mounted display and a controller, wherein the controller is provided with at least one distance sensor, and the prompting device for the VR device includes:
[0029] The detection module is used to detect the first distance data of surrounding objects in the environment where the VR device is located through the distance sensor;
[0030] The determining module is used to acquire first position information of the head-mounted display device relative to the handle device, and determine second position information of the user's body relative to the handle device based on the first position information;
[0031] The filtering module is used to filter out the distance data corresponding to the user's body in the first distance data based on the second location information, so as to obtain the second distance data;
[0032] The prompting module is used to output a prompting message when it detects an obstacle whose distance to the handle device is less than a preset distance based on the second distance data.
[0033] To achieve the above objectives, the present invention also provides a prompting device for a VR device, comprising: a memory, a processor, and a prompting program for the VR device stored in the memory and executable on the processor. When the prompting program for the VR device is executed by the processor, it implements the steps of the above-described prompting method for the VR device.
[0034] In addition, to achieve the above objectives, the present invention also proposes a computer-readable storage medium storing a prompting program for a VR device, wherein when the prompting program for the VR device is executed by a processor, it implements the steps of the above-described prompting method for the VR device.
[0035] In this embodiment of the invention, a distance sensor is installed in the controller of the VR device to detect the first distance data of objects in the surrounding environment of the VR device, providing a data basis for obstacle avoidance prompts. Then, by acquiring the first position information of the head-mounted display device relative to the controller, the second position information of the user's body relative to the controller is determined based on the first position information, thereby estimating the position of the user's body relative to the controller. Then, based on the second position information, the distance data corresponding to the user's body in the first distance data is filtered out to obtain the second distance data, thereby excluding the distance data corresponding to the user's body from the detected distance data, thus avoiding the user's body from being identified as an obstacle. Finally, when an obstacle with a distance of less than a preset distance is detected based on the second distance data, a prompt message is output, enabling the user to slow down their movements or promptly check the surrounding environment to avoid touching obstacles and causing danger. Attached Figure Description
[0036] Figure 1 This is a flowchart illustrating the first embodiment of the VR device prompting method of the present invention;
[0037] Figure 2 This is a schematic diagram illustrating the directional range of a user's body relative to a handle device according to an embodiment of the present invention;
[0038] Figure 3 This is a schematic diagram illustrating the distance between a user's body and a handle device according to an embodiment of the present invention;
[0039] Figure 4 This is a schematic diagram of the functional modules of a preferred embodiment of the prompting device of the VR device of the present invention.
[0040] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0041] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
[0042] Reference Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the prompting method for the VR device of the present invention.
[0043] This invention provides an embodiment of a prompting method for VR devices. It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order. This invention's VR device prompting method is applied to VR devices. For ease of description, the execution entities of the method steps in each embodiment are omitted below. In this embodiment, the VR device prompting method includes steps S10 to S40:
[0044] Step S10: Detect first distance data of surrounding objects in the environment where the VR device is located using the distance sensor.
[0045] The VR device includes a head-mounted display and a controller, wherein the controller is equipped with at least one proximity sensor.
[0046] VR devices include a head-mounted display and controllers. There may be one or two controllers; this embodiment is not limited, and for ease of description, a single controller will be used as an example. The controller may include at least one distance sensor for detecting objects in the VR device's environment. This sensor can be an infrared distance sensor or an ultrasonic distance sensor, etc., and the specific implementation is not limited in this embodiment. For example, in one feasible implementation, an infrared distance sensor can be included in the controller. The infrared distance sensor emits infrared light and receives infrared light reflected from surrounding objects, calculating the distance from the surrounding objects to the controller based on the emission and reception times.
[0047] The distance data of surrounding objects in the environment where the VR device is located is detected by the distance sensor (hereinafter referred to as the first distance data for distinction). The first distance data may include the distance from objects in various directions around the controller to the controller. That is, the first distance data may include the distance values corresponding to each direction.
[0048] In specific implementations, the distance sensor can be controlled to start detecting distance after the VR device is detected to be powered on, or it can be controlled to start detecting distance after the user triggers an obstacle detection command based on the human-computer interaction device in the VR device, or it can be controlled to start detecting distance when the VR device is detected to be running a game program.
[0049] Step S20: Obtain the first position information of the head-mounted display device relative to the handle device, and determine the second position information of the user's body relative to the handle device based on the first position information.
[0050] A communication connection can be established between the handle device and the head-mounted display device. Based on this communication connection, the position information of the head-mounted display device relative to the handle device (hereinafter referred to as the first position information for distinction) can be obtained. The first position information may include the orientation of the head-mounted display device relative to the handle device, or it may further include the distance from the head-mounted display device to the handle device.
[0051] When a user wears a head-mounted display device, the position of the head-mounted display device relative to the handle device can, to some extent, represent the position of the user's body relative to the handle device. Therefore, in this embodiment, the position information of the user's body relative to the handle device (hereinafter referred to as the second position information for distinction) can be determined based on the first position information of the head-mounted display device relative to the handle device. Since the user's body size is relatively large compared to the handle device, it cannot be considered as a single point. Therefore, the second position information may include the directional range of the user's body relative to the handle device, or it may further include the shortest distance of the user's body relative to the handle device.
[0052] In specific implementations, there are many ways to determine the second position information based on the first position information, and this embodiment does not impose any limitations. For example, in one feasible implementation, a conversion method between the position information of the head-mounted display device relative to the handle device and the position information of the user's body relative to the handle device can be preset according to the positional relationship between the head-mounted display device and the user's body, and then the first position information can be converted into the second position information according to the conversion relationship.
[0053] Step S30: Filter out the distance data corresponding to the user's body in the first distance data based on the second location information to obtain the second distance data.
[0054] After obtaining the second location information, the distance data corresponding to the user's body in the first distance data can be filtered out based on the second location information. The remaining distance data after filtering is called the second distance data for distinction. The distance data corresponding to the user's body can be distance data determined based on the directional range in the second location information, or distance data determined based on the shortest distance in the second location information. The purpose of filtering out the distance data corresponding to the user's body in the first distance data is to exclude the user's body, avoid identifying the user's body as an obstacle, and thus avoid false prompts.
[0055] Step S40: When an obstacle is detected based on the second distance data and the distance between it and the handle device is less than a preset distance, a prompt message is output.
[0056] The second distance data includes distance data relative to the controller device from other objects in the VR device's surrounding environment, excluding the user's body. After obtaining the second distance data, it is possible to detect whether there are obstacles whose distance to the controller device is less than a preset distance. In specific embodiments, there are various ways to detect whether there are obstacles whose distance to the controller device is less than the preset distance based on the second distance data. For example, the distance values in each direction of the second distance data can be compared with the preset distance. If at least one distance value is less than the preset distance, then it is determined that there is an obstacle whose distance to the controller device is less than the preset distance.
[0057] If an obstacle is detected at a distance less than a preset distance from the handle device, a warning message is output, allowing the user to slow down their movements or promptly check their surroundings to avoid touching the obstacle and causing danger. There are many ways to output the warning message, and this embodiment does not impose any limitations.
[0058] For example, in one feasible embodiment, the prompt information can be displayed on the screen of the head-mounted display device, or played through the speaker of the head-mounted display device, or the vibration component in the head-mounted display device or the handle device can be controlled to vibrate, using vibration as a prompt information, or the indicator light in the handle device can be controlled to flash, using the flashing of the indicator light as a prompt information. In one feasible embodiment, a correspondence between distance and vibration level can be preset, that is, different vibration levels can be used to represent the distance between the obstacle and the handle device. For example, the greater the distance, the higher the vibration level. The higher the vibration level, the greater the amplitude of the vibration, and the stronger the vibration felt by the user. This allows the user to determine the approximate distance of the obstacle based on the perceived vibration level, and take timely obstacle avoidance measures to avoid danger in the event of a strong vibration. Based on this correspondence, the vibration level corresponding to the minimum distance in the second distance data (called the target vibration level for distinction) can be determined, and the vibration component in the handle device can be controlled to vibrate according to the target vibration level, thereby prompting the user that there is an obstacle around.
[0059] In one feasible embodiment, the prompting method of the VR device further includes steps S50 to S60:
[0060] Step S50: Receive sensitivity setting command.
[0061] Step S60: Set the preset distance according to the sensitivity indicated in the sensitivity setting instruction. The higher the sensitivity, the smaller the preset distance.
[0062] It can receive sensitivity setting commands for obstacle detection triggered by the user's human-computer interaction component based on the VR device. The human-computer interaction component can be implemented in hardware or software, and this embodiment is not limited to either.
[0063] In this embodiment, a distance sensor is installed in the VR device's controller to detect the first distance data of objects in the surrounding environment, providing a data basis for obstacle avoidance prompts. Then, by acquiring the first position information of the head-mounted display device relative to the controller, and determining the second position information of the user's body relative to the controller based on the first position information, the position of the user's body relative to the controller is estimated. Next, based on the second position information, the distance data corresponding to the user's body in the first distance data is filtered out to obtain the second distance data. This process excludes the distance data corresponding to the user's body from the detected distance data, thus avoiding the user's body being identified as an obstacle. Finally, when an obstacle with a distance less than a preset distance is detected based on the second distance data, a prompt message is output, allowing the user to slow down their movements or promptly check their surroundings to avoid touching obstacles and causing danger.
[0064] Based on the first embodiment described above, a second embodiment of the prompting method for the VR device of the present invention is proposed. In this embodiment, the step of determining the second position information of the user's body relative to the controller device based on the first position information in step S20 includes step S201, and step S30 includes step S301.
[0065] Step S201: Expand the first direction according to a preset expansion coefficient to obtain a direction range, and obtain the second position information of the user's body relative to the handle device based on the direction range.
[0066] In this embodiment, the first distance data may include distance data in various directions around the handle device. The directional range that the distance sensor can detect can be preset as needed, depending on the type of distance sensor used and the number of distance sensors set. In this embodiment, no limitation is imposed.
[0067] The first position information may include the direction of the head-mounted display device relative to the handle device (hereinafter referred to as the first direction for distinction). After obtaining the first direction, it can be expanded according to a preset expansion factor to obtain a direction range. It should be noted that the direction can be represented in various data forms, which is not limited in this embodiment. For example, it can be represented by an angle; correspondingly, there are many data forms for the preset expansion factor. The preset expansion factor can be set in advance according to the positional relationship between the head-mounted display device and the user's body when the user wears the head-mounted display device, as well as the size of the user's body. This is not limited in this embodiment. The reason for expanding the first direction according to the preset expansion factor is that when obtaining the first position information of the head-mounted display device relative to the handle device, the head-mounted display device is regarded as a point. However, the user's body size is large and cannot be regarded as a point relative to the handle device. Therefore, by expanding the first direction according to the preset expansion factor, the direction range of the user's body relative to the handle device can be estimated, which makes it easier to accurately exclude the user's body from obstacles.
[0068] Step S301: Filter out the distance data within the direction range in the first distance data to obtain the second distance data.
[0069] After obtaining the directional range corresponding to the user's body, the second distance data can be obtained by filtering out the distance data within that directional range from the first distance data, thereby avoiding the user's body being identified as an obstacle and thus avoiding false prompts.
[0070] In one feasible embodiment, the step of expanding the first direction according to a preset expansion coefficient to obtain the direction range in step S201 includes steps S2011 to S2012:
[0071] Step S2011: Expand the azimuth angle according to the azimuth angle expansion coefficient to obtain the azimuth angle range.
[0072] Step S2012: Expand the pitch angle according to the azimuth expansion coefficient to obtain the pitch angle range, and use the azimuth range and pitch angle range as the expanded direction range.
[0073] In one feasible embodiment, the first direction can be represented by the azimuth and pitch angles of the head-mounted display device relative to the handle device. Preset expansion factors may include azimuth expansion factors and pitch expansion factors. These factors can be preset based on the positional relationship between the head-mounted display device and the user's body when the user wears the head-mounted display device, as well as the user's body dimensions. It should be noted that the azimuth expansion factor is used to expand the azimuth angle into an angular range. In this embodiment, the method of expanding the azimuth angle using the azimuth expansion factor is not limited. For example, the azimuth expansion factor includes two coefficients: an upward expansion factor and a downward expansion factor. Subtracting the downward expansion factor from the azimuth angle yields the lower limit of the azimuth angle range, and adding the downward expansion factor to the azimuth angle yields the upper limit of the azimuth angle range. The upward and downward expansion factors can be the same and can be set according to the width of the user's body. Since the head-mounted display is worn on the user's head, with the user's body below it, the pitch angle expansion factor can include only a downward expansion factor. The pitch angle is used as the upper limit of the expanded pitch angle range, and the lower limit of the pitch angle range is obtained by subtracting the downward expansion factor from the pitch angle. The downward expansion factor can be set according to the user's body height. The user's body width and height can be pre-measured average human width and height, or they can be measured by the user and input into the VR device through a human-computer interaction device. The VR device converts the width and height into azimuth and pitch angle expansion factors according to a pre-set conversion formula. Figure 2 The diagram schematically shows the range of pitch angle and azimuth angle obtained by expanding the pitch angle and azimuth angle. The direction is represented by lines in the diagram. P1 and P2 can be regarded as the direction lines corresponding to the upper and lower limits of the pitch angle range, respectively. P3 and P4 can be regarded as the direction lines corresponding to the upper and lower limits of the azimuth angle range, respectively. P1 can be regarded as the direction line corresponding to the first direction of the head-mounted display device relative to the handle device.
[0074] In this embodiment, by expanding the first direction of the head-mounted display device relative to the handle device according to a preset expansion range, the direction range of the user's body relative to the handle device is obtained, thereby achieving an accurate estimation of the direction of the user's body relative to the handle device. By filtering out the distance data of this direction range from the first distance data, the second distance data is obtained, thereby accurately excluding the user's body from obstacles and avoiding the situation where the user's body is identified as an obstacle and causes false prompts.
[0075] In one feasible implementation, step S301 includes:
[0076] Step S3011: Filter out distance data in the first distance data that are greater than or equal to the first distance and within the direction range to obtain the second distance data.
[0077] To further improve the accuracy of obstacle recognition, the second location information can include the distance between the user's body and the controller (hereinafter referred to as the first distance for distinction). Distance data greater than or equal to the first distance and within the direction corresponding to the user's body can be filtered out, and the remaining data is used as the second distance data. It should be noted that during VR device use, obstacles may appear between the controller and the user's body. In this case, the obstacle and the user's body are roughly in the same direction relative to the controller, but the obstacle is closer to the controller. Therefore, by filtering out distance data greater than or equal to the first distance and within the direction corresponding to the user's body, obstacles appearing between the controller and the user's body can be avoided from being mistaken for the user's body and filtered out, thereby improving the accuracy of obstacle recognition. This allows for more precise obstacle warnings to the user, preventing collisions and potential hazards.
[0078] In one feasible embodiment, the first position information may further include the distance between the head-mounted display device and the handle device (hereinafter referred to as the second distance for distinction), and the step of determining the second position information of the user's body relative to the handle device based on the first position information in step S20 further includes:
[0079] Step S202: Calculate the first distance based on the second distance and the first direction.
[0080] The first distance can refer to the shortest distance between the user's body and the handle device. The first distance can be calculated based on the first direction and the second distance between the head-mounted device and the handle device. For example, when the first direction is represented by pitch angle and azimuth angle, the pitch angle is represented by θ and the second distance is represented by L2. Then the first distance L1 = L2 * cosθ. Figure 3 The diagram illustrates the relationship between the first direction, the first distance, and the second distance, where θ represents the pitch angle. It should be noted that φ is a right angle, but for ease of understanding, it is not drawn as a right angle in the diagram.
[0081] Furthermore, this invention also proposes a prompting device for a VR device, the VR device including a head-mounted display and a controller, wherein the controller is equipped with at least one distance sensor, for reference. Figure 4 The prompting device for VR devices includes:
[0082] The detection module 10 is used to detect the first distance data of surrounding objects in the environment where the VR device is located through the distance sensor;
[0083] The determining module 20 is used to acquire first position information of the head-mounted display device relative to the handle device, and determine second position information of the user's body relative to the handle device based on the first position information;
[0084] The filtering module 30 is used to filter out the distance data corresponding to the user's body in the first distance data based on the second location information, so as to obtain the second distance data;
[0085] The prompting module 40 is used to output a prompting message when it detects an obstacle whose distance to the handle device is less than a preset distance based on the second distance data.
[0086] In one feasible embodiment, the first distance data includes distance data in various directions around the handle device, the first position information includes a first direction of the head-mounted display device relative to the handle device, and the determining module 20 is further configured to:
[0087] The first direction is expanded according to a preset expansion coefficient to obtain a direction range, and the second position information of the user's body relative to the handle device is obtained according to the direction range;
[0088] The filtering module 30 is also used for:
[0089] The distance data within the stated direction range is filtered out from the first distance data to obtain the second distance data.
[0090] In one feasible embodiment, the first direction is represented by the azimuth and pitch angles of the head-mounted display device relative to the handle device, the preset expansion coefficients include azimuth expansion coefficients and pitch expansion coefficients, and the determining module 20 is further configured to:
[0091] The azimuth angle is expanded according to the azimuth angle expansion coefficient to obtain the azimuth angle range;
[0092] The pitch angle is expanded according to the azimuth expansion factor to obtain the pitch angle range, and the azimuth angle range and the pitch angle range are used as the expanded direction range.
[0093] In one feasible embodiment, the second location information includes a first distance of the user's body relative to the handle device, and the filtering module 30 is further configured to:
[0094] Filter out distance data in the first distance data that are greater than or equal to the first distance and within the stated direction range to obtain the second distance data.
[0095] In one feasible embodiment, the first position information further includes a second distance between the head-mounted display device and the handle device, and the determining module 20 is further configured to:
[0096] The first distance is calculated based on the second distance and the first direction.
[0097] In one feasible embodiment, the prompting device of the VR device further includes:
[0098] The receiving module is used to receive sensitivity setting instructions;
[0099] The setting module is used to set the preset distance according to the sensitivity indicated in the sensitivity setting instruction. The higher the sensitivity, the smaller the preset distance.
[0100] In one feasible embodiment, the prompting module 40 is further configured to:
[0101] The prompt information is displayed on the screen of the head-mounted display device; or,
[0102] The prompt message is played through the speaker of the head-mounted display device; or...
[0103] Control the vibration component in the head-mounted display device or the handle device to vibrate, using vibration as a prompt; or,
[0104] The indicator light in the handle device is controlled to flash, and the flashing of the indicator light serves as a prompt.
[0105] The VR device of this invention can be a VR device, which includes a head-mounted display and a controller. The controller includes at least one proximity sensor. The VR device also includes a main control module and a memory. The main control module may include a microprocessor, an audio decoding unit, a power supply and power management unit, sensors required by the system, and other active or passive components (which can be replaced, removed, or added according to actual functions) to realize the function of receiving and playing wireless audio. The memory may store the prompting program of the VR device, and the microprocessor can be used to call the prompting program of the VR device stored in the memory and perform the following operations:
[0106] The distance sensor detects the first distance data of surrounding objects in the environment where the VR device is located;
[0107] Acquire first position information of the head-mounted display device relative to the handle device, and determine second position information of the user's body relative to the handle device based on the first position information;
[0108] Based on the second location information, the distance data corresponding to the user's body in the first distance data is filtered out to obtain the second distance data;
[0109] When an obstacle is detected based on the second distance data and the distance between it and the handle device is less than a preset distance, a prompt message is output.
[0110] In one feasible implementation, the first distance data includes distance data in various directions around the handle device, the first position information includes a first direction of the head-mounted display device relative to the handle device, and the operation of determining the second position information of the user's body relative to the handle device based on the first position information includes:
[0111] The first direction is expanded according to a preset expansion coefficient to obtain a direction range, and the second position information of the user's body relative to the handle device is obtained according to the direction range;
[0112] The operation of filtering out the distance data corresponding to the user's body from the first distance data based on the second location information to obtain the second distance data includes:
[0113] The distance data within the stated direction range is filtered out from the first distance data to obtain the second distance data.
[0114] In one feasible embodiment, the first direction is represented by the azimuth and pitch angles of the head-mounted display device relative to the handle device, and the preset expansion coefficient includes an azimuth expansion coefficient and a pitch expansion coefficient. The operation of expanding the first direction according to the preset expansion coefficient to obtain the direction range includes:
[0115] The azimuth angle is expanded according to the azimuth angle expansion coefficient to obtain the azimuth angle range;
[0116] The pitch angle is expanded according to the azimuth expansion factor to obtain the pitch angle range, and the azimuth angle range and the pitch angle range are used as the expanded direction range.
[0117] In one feasible implementation, the second location information includes a first distance of the user's body relative to the handle device, and the operation of filtering out distance data within the directional range from the first distance data to obtain the second distance data includes:
[0118] Filter out distance data in the first distance data that are greater than or equal to the first distance and within the stated direction range to obtain the second distance data.
[0119] In one feasible implementation, the first position information further includes a second distance between the head-mounted display device and the handle device, and the operation of determining the second position information of the user's body relative to the handle device based on the first position information further includes:
[0120] The first distance is calculated based on the second distance and the first direction.
[0121] In one feasible implementation, the microprocessor can also be used to invoke the prompting program of the VR device stored in memory, and perform the following operations:
[0122] Receive sensitivity setting instructions;
[0123] The preset distance is set according to the sensitivity indicated in the sensitivity setting instruction; the higher the sensitivity, the smaller the preset distance.
[0124] In one feasible implementation, the operation of outputting the prompt information includes:
[0125] The prompt information is displayed on the screen of the head-mounted display device; or,
[0126] The prompt message is played through the speaker of the head-mounted display device; or...
[0127] Control the vibration component in the head-mounted display device or the handle device to vibrate, using vibration as a prompt; or,
[0128] The indicator light in the handle device is controlled to flash, and the flashing of the indicator light serves as a prompt.
[0129] The various embodiments of the prompting device and computer-readable storage medium of the VR device of the present invention can be referred to the various embodiments of the prompting method of the VR device of the present invention, and will not be repeated here.
[0130] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0131] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0132] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods of the various embodiments of the present invention.
[0133] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.
Claims
1. A prompting method for a VR device, characterized in that, The VR device includes a head-mounted display and a controller, wherein the controller is equipped with at least one proximity sensor, and the VR device provides prompts via: The distance sensor detects first distance data of surrounding objects in the environment where the VR device is located, and the first distance data includes distance data in various directions around the controller device; The system acquires first position information of the head-mounted display device relative to the handle device, the first position information including a first direction of the head-mounted display device relative to the handle device, and determines second position information of the user's body relative to the handle device based on the first position information. The step of determining the second position information of the user's body relative to the handle device based on the first position information includes: The first direction is expanded according to a preset expansion coefficient to obtain a direction range, and the second position information of the user's body relative to the handle device is obtained according to the direction range; The step of filtering out the distance data corresponding to the user's body from the first distance data based on the second location information to obtain the second distance data includes: Filter out the distance data within the specified direction from the first distance data to obtain the second distance data; Based on the second location information, the distance data corresponding to the user's body in the first distance data is filtered out to obtain the second distance data; When an obstacle is detected based on the second distance data and the distance between it and the handle device is less than a preset distance, a prompt message is output.
2. The VR device prompting method as described in claim 1, characterized in that, The first direction is represented by the azimuth and pitch angles of the head-mounted display device relative to the handle device. The preset expansion coefficients include azimuth expansion coefficients and pitch expansion coefficients. The step of expanding the first direction according to the preset expansion coefficients to obtain the direction range includes: The azimuth angle is expanded according to the azimuth angle expansion coefficient to obtain the azimuth angle range; The pitch angle is expanded according to the azimuth expansion factor to obtain the pitch angle range, and the azimuth angle range and the pitch angle range are used as the expanded direction range.
3. The VR device prompting method as described in claim 1, characterized in that, The second location information includes a first distance between the user's body and the handle device. The step of filtering out distance data within the direction range from the first distance data to obtain the second distance data includes: Filter out distance data in the first distance data that are greater than or equal to the first distance and within the stated direction range to obtain the second distance data.
4. The VR device prompting method as described in claim 3, characterized in that, The first position information also includes a second distance between the head-mounted display device and the handle device, and the step of determining the second position information of the user's body relative to the handle device based on the first position information further includes: The first distance is calculated based on the second distance and the first direction.
5. The VR device prompting method as described in claim 1, characterized in that, The VR device's prompting method also includes: Receive sensitivity setting instructions; The preset distance is set according to the sensitivity indicated in the sensitivity setting instruction; the higher the sensitivity, the smaller the preset distance.
6. The prompting method for a VR device as described in any one of claims 1 to 5, characterized in that, The steps for outputting the prompt information include: The prompt information is displayed on the screen of the head-mounted display device; or, The prompt message is played through the speaker of the head-mounted display device; or... Control the vibration component in the head-mounted display device or the handle device to vibrate, using vibration as a prompt; or, The indicator light in the handle device is controlled to flash, and the flashing of the indicator light serves as a prompt.
7. A prompting device for a VR device, characterized in that, The VR device includes a head-mounted display and a controller, wherein the controller is equipped with at least one proximity sensor, and the VR device's prompting device includes: The detection module is used to detect first distance data of surrounding objects in the environment where the VR device is located through the distance sensor. The first distance data includes distance data in various directions around the controller device. The determining module is used to acquire first position information of the head-mounted display device relative to the handle device, the first position information including a first direction of the head-mounted display device relative to the handle device, and to determine second position information of the user's body relative to the handle device based on the first position information. Specifically, the determining module is used to expand the first direction according to a preset expansion coefficient to obtain a direction range, and to obtain the second position information of the user's body relative to the handle device based on the direction range. The determining module is also used to filter out distance data in the first distance data within the direction range to obtain second distance data. The filtering module is used to filter out the distance data corresponding to the user's body in the first distance data based on the second location information, so as to obtain the second distance data; The prompting module is used to output a prompting message when it detects an obstacle whose distance to the handle device is less than a preset distance based on the second distance data.
8. A prompting device for a VR device, characterized in that, The VR device prompting device includes: a memory, a processor, and a VR device prompting program stored in the memory and executable on the processor. When the VR device prompting program is executed by the processor, it implements the steps of the VR device prompting method as described in any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a prompting program for a VR device, which, when executed by a processor, implements the steps of the prompting method for a VR device as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Obstacle early warning method and device, electronic equipment and readable storage medium
CN114863650A
Collision early warning method and device, head-mounted equipment, head-mounted system and medium
CN116153021A