A positioning method, apparatus, device and medium of a handheld device

Abstract

The application discloses a positioning method, device, equipment and medium of a handheld device. When the smart wearable device detects that the state of the smart wearable device is changed from a worn state to an unworn state, a first scene image is captured. When the strength change of the wireless signal fed back by the handheld device exceeds a set threshold, the current first wireless signal strength is recorded and a second scene image is captured. When the smart wearable device detects that the state of the smart wearable device is changed from the unworn state to the worn state, the second wireless signal strength fed back by the handheld device is acquired. The first scene image and the second scene image can reflect the scene position of the handheld device. According to the change of the deviation of the first wireless signal strength and the second wireless signal strength, the change of the distance between the handheld device and the smart wearable device can be determined. Therefore, the handheld device can be positioned based on the first wireless signal strength, the second wireless signal strength and the first scene image and the second scene image, and the rapid searching of the handheld device is realized.

Description

TECHNICAL FIELD

[0001] The present application relates to the virtual reality technical field, in particular to a handheld device positioning method, device, equipment and computer readable storage medium. BACKGROUND

[0002] Virtual reality technology (VR) is a new practical technology developed in the 20th century. Virtual reality technology includes computer, electronic information, simulation technology, and its basic implementation is mainly based on computer technology, which utilizes and integrates three-dimensional graphics technology, multimedia technology, simulation technology, display technology, servo technology and other latest developments of various high-tech technologies, and generates a virtual world with realistic three-dimensional vision, touch, smell and other sensory experiences through computers and other devices, so that people in the virtual world have a sense of being there. With the continuous development of social productive forces and scientific technology, the demand for VR technology is increasing in various industries.

[0003] The current popular VR products on the market have a head-mounted device and a handheld device. The handheld device is generally a pair of VR handles, which allows users to experience the virtual world brought by the VR product and interact with the scene by operating the VR handles.

[0004] However, the handheld device and the head-mounted device are separately designed, and the user may place the two devices far apart, which makes it inconvenient to find them later. The head-mounted device is larger in size and is not easily moved, so it is easier to find. However, the handheld device is more likely to be blocked by obstacles or placed randomly by the user, making it inconvenient to find when using.

[0005] Therefore, how to quickly find the handheld device is a problem to be solved by those skilled in the art. SUMMARY

[0006] The purpose of the embodiments of the present application is to provide a handheld device positioning method, device, equipment and computer readable storage medium, which can quickly find the handheld device.

[0007] To solve the above technical problems, the embodiments of the present application provide a handheld device positioning method, which comprises:

[0008] In the case of detecting that the state of the handheld device is converted from the wearing state to the non-wearing state, a first scene image is captured;

[0009] In the case of detecting that the strength change of the wireless signal feedback by the handheld device exceeds a set threshold, the current first wireless signal strength is recorded and a second scene image is captured;

[0010] In a case where it is detected that the head-mounted device is switched from the non-wearing state to the wearing state, a current second wireless signal strength is acquired;

[0011] The handheld device is positioned based on the first wireless signal strength, the second wireless signal strength, and the first scene image and the second scene image, so as to determine a position where the handheld device is located.

[0012] Optionally, the positioning of the handheld device based on the first wireless signal strength, the second wireless signal strength, and the first scene image and the second scene image, so as to determine a position where the handheld device is located comprises:

[0013] It is judged whether the first scene image and the second scene image meet the positioning requirement of the handheld device;

[0014] In a case where the first scene image and the second scene image meet the positioning requirement of the handheld device, a position image corresponding to the handheld device is determined according to the position of the handheld device in the first scene image and the second scene image, and the position image is displayed on the display screen;

[0015] In a case where the first scene image and the second scene image do not meet the positioning requirement of the handheld device, a movement granularity is determined according to the deviation of the first wireless signal strength and the second wireless signal strength; the movement granularity is displayed on the display screen, so that the user moves the head-mounted device according to the movement granularity until it is determined that the wireless signal strength transmitted from the handheld device to the head-mounted device is greater than a target signal strength, and a position corresponding to the wireless signal strength is taken as the position where the handheld device is located.

[0016] Optionally, the judgment of whether the first scene image and the second scene image meet the positioning requirement of the handheld device comprises:

[0017] The first scene image and the second scene image are subjected to recognition of the handheld device;

[0018] In a case where the first scene image and the second scene image both contain the handheld device, or in a case where the first scene image does not contain the handheld device and the second scene image contains the handheld device, it is determined that the first scene image and the second scene image meet the positioning requirement of the handheld device;

[0019] in a case where the second scene image contains the handheld device, judging whether an obstacle exists at a position in the second scene image that matches the target position in the first scene image based on a target position of the handheld device in the first scene image;

[0020] in a case where the position in the second scene image that matches the target position contains an obstacle, determining that the first scene image and the second scene image meet positioning requirements of the handheld device;

[0021] in a case where the position in the second scene image that matches the target position does not contain an obstacle, or in a case where neither the first scene image nor the second scene image contains the handheld device, determining that the first scene image and the second scene image do not meet the positioning requirements of the handheld device.

[0022] Optionally, the determining the movement granularity according to the deviation of the first wireless signal strength and the second wireless signal strength comprises:

[0023] calculating a difference between the second wireless signal strength and the first wireless signal strength;

[0024] in a case where the difference is greater than or equal to a first threshold value, selecting a first step distance as the movement granularity, the first step distance being a preset value;

[0025] in a case where the difference is less than the first threshold value, selecting a second step distance as the movement granularity, the first step distance being a preset value and the second step distance being a preset value, the first step distance being less than the second step distance.

[0026] Optionally, the method further comprises, after the displaying the movement granularity on the display screen:

[0027] in a process in which the user moves the head-mounted device according to the movement granularity, detecting the wireless signal strength fed back by the handheld device in real time;

[0028] in a case where a current wireless signal strength fed back by the handheld device is greater than or equal to a second threshold value, determining a distance value between the head-mounted device and the handheld device based on the current wireless signal strength, and displaying the distance value on the display screen, so that the user positions the handheld device based on the distance value;

[0029] in a case where the current wireless signal strength fed back by the handheld device is always less than the second threshold value, displaying prompt information indicating that an obstacle exists on the display screen.

[0030] Optionally, in a case where the handheld device comprises a left handle and a right handle, the method further comprises, after the displaying the movement granularity on the display screen:

[0031] In the process that the user moves the head-mounted device according to the movement granularity, it is judged whether the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle satisfy a set consistency condition;

[0032] In the case that the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle satisfy the set consistency condition, it is determined that the left handle and the right handle are placed at the same position;

[0033] In the case that the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle do not satisfy the set consistency condition, it is determined that the left handle and the right handle are placed at different positions.

[0034] Optionally, in the case that it is determined that the left handle and the right handle are placed at different positions, the second wireless signal strength includes the second wireless signal strength corresponding to the left handle and the second wireless signal strength corresponding to the right handle;

[0035] Correspondingly, the determination of the movement granularity according to the deviation of the first wireless signal strength and the second wireless signal strength includes:

[0036] determination of the first movement granularity corresponding to the left handle according to the deviation of the first wireless signal strength and the second wireless signal strength corresponding to the left handle;

[0037] determination of the second movement granularity corresponding to the right handle according to the deviation of the first wireless signal strength and the second wireless signal strength corresponding to the right handle.

[0038] Embodiments of the present application also provide a positioning device of a handheld device, which comprises a first photographing unit, a recording unit, a second photographing unit, an acquisition unit and a positioning unit.

[0039] The first photographing unit is configured to photograph a first scene image when it is detected that the state of the handheld device is changed from a worn state to an unworn state.

[0040] The recording unit is configured to record a current first wireless signal strength when it is detected that the intensity change of the wireless signal fed back by the handheld device exceeds a set threshold.

[0041] The second photographing unit is configured to photograph a second scene image.

[0042] The acquisition unit is configured to acquire a current second wireless signal strength when it is detected that the state of the handheld device is changed from the unworn state to the worn state.

[0043] The positioning unit is configured to position the handheld device based on the first wireless signal strength, the second wireless signal strength, and the first scene image and the second scene image, so as to determine a position where the handheld device is located.

[0044] Optionally, the positioning unit comprises a judging subunit, an image determining subunit, a displaying subunit, a granularity determining subunit, and a subunit.

[0045] The judging subunit is configured to judge whether the first scene image and the second scene image meet the positioning requirement of the handheld device.

[0046] The image determining subunit is configured to determine a position image corresponding to the handheld device according to the position of the handheld device in the first scene image and the second scene image, in a case where the first scene image and the second scene image meet the positioning requirement of the handheld device.

[0047] The displaying subunit is configured to display the position image on a display screen.

[0048] The granularity determining subunit is configured to determine a moving granularity according to the deviation of the first wireless signal strength and the second wireless signal strength, in a case where the first scene image and the second scene image do not meet the positioning requirement of the handheld device.

[0049] The displaying subunit is further configured to display the moving granularity on the display screen, so as to facilitate a user to move the handheld device according to the moving granularity.

[0050] The subunit is configured to determine a position corresponding to a wireless signal strength transmitted by the handheld device to the head-mounted device as the position where the handheld device is located, until the wireless signal strength is greater than a target signal strength.

[0051] Optionally, the judging subunit is configured to identify the handheld device in the first scene image and the second scene image.

[0052] In a case where the first scene image and the second scene image both contain the handheld device, or in a case where the first scene image does not contain the handheld device and the second scene image contains the handheld device, it is judged that the first scene image and the second scene image meet the positioning requirement of the handheld device.

[0053] In a case where the first scene image contains the handheld device and the second scene image does not contain the handheld device, it is judged whether a position matched with a target position of the handheld device in the first scene image in the second scene image exists an obstacle based on the target position.

[0054] In a case where an obstacle exists at the position in the second scene image that matches the target position, it is determined that the first scene image and the second scene image meet the positioning requirement of the handheld device;

[0055] In a case where an obstacle does not exist at the position in the second scene image that matches the target position, or in a case where the handheld device is not contained in the first scene image and the second scene image, it is determined that the first scene image and the second scene image do not meet the positioning requirement of the handheld device.

[0056] Optionally, the granularity determination subunit is configured to calculate a difference between the second wireless signal strength and the first wireless signal strength.

[0057] In a case where the difference is greater than or equal to a first threshold value, a first step distance set as a moving granularity is selected;

[0058] In a case where the difference is less than the first threshold value, a second step distance set as a moving granularity is selected; and a value of the first step distance is less than a value of the second step distance.

[0059] Optionally, the apparatus further includes a detection unit.

[0060] The detection unit is configured to detect, in real time, the wireless signal strength fed back by the handheld device during movement of the head-mounted device by the user according to the moving granularity.

[0061] The display subunit is further configured to, in a case where the current wireless signal strength fed back by the handheld device is greater than or equal to a second threshold value, determine a distance value between the head-mounted device and the handheld device based on the current wireless signal strength, and display the distance value on the display screen, so as to facilitate the user to locate the handheld device based on the distance value; and in a case where the current wireless signal strength fed back by the handheld device is always less than the second threshold value, display, on the display screen, prompt information indicating that an obstacle is shielding.

[0062] Optionally, in a case where the handheld device includes a left handle and a right handle, the apparatus further includes a strength judgment unit, a first determination unit, and a second determination unit.

[0063] The strength judgment unit is configured to judge, during movement of the head-mounted device by the user according to the moving granularity, whether the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle meet a set consistency condition.

[0064] The first determining unit is configured to determine that the left handle and the right handle are placed at the same position when the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle satisfy a set consistency condition.

[0065] The second determining unit is configured to determine that the left handle and the right handle are placed at different positions when the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle do not satisfy the set consistency condition.

[0066] Optionally, the second wireless signal strength includes the second wireless signal strength corresponding to the left handle and the second wireless signal strength corresponding to the right handle when it is determined that the left handle and the right handle are placed at different positions.

[0067] Correspondingly, the granularity determining sub-unit determines the first moving granularity corresponding to the left handle according to the deviation of the first wireless signal strength and the second wireless signal strength corresponding to the left handle, and determines the second moving granularity corresponding to the right handle according to the deviation of the first wireless signal strength and the second wireless signal strength corresponding to the right handle.

[0068] Embodiments of the present application further provide an electronic device, which comprises:

[0069] a memory configured to store a computer program;

[0070] a processor configured to execute the computer program to implement the steps of the positioning method of the handheld device.

[0071] Embodiments of the present application further provide a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the steps of the positioning method of the handheld device.

[0072] It can be seen from the technical solution that, when the smart wearable device detects that the smart wearable device is switched from the wearing state to the non-wearing state, it indicates that the user needs to take off the smart wearable device and place it aside at this moment, in order to facilitate subsequent searching, the first scene image can be captured at this moment. When the intensity change of the wireless signal fed back by the handheld device exceeds the set threshold, it indicates that the handheld device is blocked by an obstacle or is moved away from the smart wearable device, in order to facilitate tracking the position of the handheld device, the current first wireless signal intensity can be recorded and the second scene image can be captured. When the smart wearable device is switched from the non-wearing state to the wearing state, it indicates that the user has the demand to use the smart wearable device and the handheld device, the second wireless signal intensity fed back by the handheld device at the current moment can be acquired. According to the first scene image and the second scene image, the handheld device can be quickly located in the scene position where the handheld device is located in the case that the handheld device is contained in the image; in the case that the handheld device is not contained in the image, the second wireless signal intensity will change in the process that the user moves the smart wearable device, according to the change of the deviation between the first wireless signal intensity and the second wireless signal intensity, the change of the distance between the handheld device and the smart wearable device can be determined. Therefore, based on the first wireless signal intensity, the second wireless signal intensity, and the first scene image and the second scene image, the handheld device can be positioned, and the position where the handheld device is located can be determined. In the technical solution, the scene image is captured and the wireless signal intensity is acquired at different stages, which can provide effective guidance for the user to search for the handheld device, facilitate the user to quickly locate the approximate position where the handheld device is located, and realize the quick searching for the handheld device. BRIEF DESCRIPTION OF DRAWINGS

[0073] In order to more clearly illustrate the embodiments of the present application, the drawings needed in the embodiments will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0074] Figure 1 A flowchart of a handheld device positioning method provided by an embodiment of the present application;

[0075] Figure 2 A flowchart of a method for determining the position of a handheld device based on an image and a signal intensity provided by an embodiment of the present application;

[0076] Figure 3 A structural schematic diagram of a handheld device positioning apparatus provided by an embodiment of the present application;

[0077] Figure 4 A structural diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0078] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0079] The terms “include” and “have” and any variations thereof in the specification and claims of the present application and the above drawings are intended to cover the non-exclusive inclusion. For example, a process, method, system, product, or device including a series of steps or units is not limited to the listed steps or units, but can include steps or units not listed.

[0080] In order for those skilled in the art to better understand the technical solutions of the present application, the present application will be further described in detail below with reference to the drawings and specific embodiments.

[0081] Next, a positioning method of a handheld device provided by the embodiments of the present application is described in detail. Figure 1 The flowchart of the positioning method of the handheld device provided by the embodiments of the present application, the method comprises:

[0082] S101: In the case of detecting that the self is converted from the wearing state to the unwearing state, a first scene image is captured.

[0083] In the embodiments of the present application, the positioning of the handheld device can be realized by the smart wearable device interacting with the handheld device. The type of the smart wearable device can be various, and in the VR field, the smart wearable device is often a head-mounted device, and accordingly, the handheld device includes a left handle and a right handle.

[0084] In a specific implementation, a distance sensor (P-Sensor) can be deployed on the smart wearable device. The P-Sensor can sense the distance between the smart wearable device and the human body, so as to determine the state of the smart wearable device. The state can include two states of wearing and unwearing.

[0085] In the case of detecting that the self is converted from the wearing state to the unwearing state, it indicates that the user takes off the smart wearable device at this time. The smart wearable device often works together with the handheld device, and when the user takes off the smart wearable device, the handheld device is often put down together. In order to facilitate tracking the position of the handheld device, a first scene image can be captured at this time.

[0086] S102: In a case where it is detected that the change of the intensity of the wireless signal fed back by the handheld device exceeds a set threshold, a current first wireless signal intensity is recorded and a second scene image is captured.

[0087] In practical applications, the smart wearable device and the handheld device are of a separated design. In the embodiments of the present application, wireless communication modules can be arranged in the smart wearable device and the handheld device, and the distance between the smart wearable device and the handheld device can be determined based on the intensity of the wireless signal fed back by each wireless communication module. The wireless communication module can be a Bluetooth module or a wifi module, etc. For the convenience of introduction, the Bluetooth module is taken as an example for the subsequent description.

[0088] Compared with the smart wearable device, the handheld device is more compact and convenient. In practical applications, there can be a case where the user carries the handheld device to move or the handheld device is blocked by an obstacle. In these two cases, the intensity of the wireless signal fed back by the handheld device to the smart wearable device will decrease. In order to facilitate the subsequent quick search for the handheld device, in a case where it is detected that the change of the intensity of the wireless signal fed back by the handheld device exceeds a set threshold, a current first wireless signal intensity is recorded and a second scene image is captured.

[0089] The specific value of the set threshold can be set based on actual requirements, which is not limited here.

[0090] In a case where it is detected that the change of the intensity of the wireless signal fed back by the handheld device exceeds a set threshold, it indicates that the intensity of the wireless signal fed back by the handheld device has changed obviously. The reasons for the obvious change of the wireless signal intensity mainly include that the handheld device is blocked by an obstacle or the handheld device is moved away from the smart wearable device by the user. The second scene image can provide a reference for analyzing the position of the handheld device. The first wireless signal intensity can provide a distance basis for the subsequent search for the handheld device.

[0091] S103: In a case where it is detected that the smart wearable device is converted from an unworn state to a worn state, a current second wireless signal intensity is acquired.

[0092] In a case where it is detected that the smart wearable device is converted from an unworn state to a worn state, it indicates that the user has a demand to use the smart wearable device and the handheld device. At this time, the second wireless signal intensity fed back by the handheld device can be acquired.

[0093] S104: The handheld device is positioned based on the first wireless signal intensity, the second wireless signal intensity, and the first scene image and the second scene image, so as to determine the position where the handheld device is located.

[0094] By analyzing the first and second scene images, it's possible to determine whether a handheld device is present in the image. If the handheld device is present, its location within the scene can be quickly determined. If the handheld device is not present in the image, the strength of the second wireless signal will change as the user moves the smart wearable device. Based on the changes in the deviation between the first and second wireless signal strengths, the distance between the handheld device and the smart wearable device can be determined, thus allowing the handheld device to be located.

[0095] As can be seen from the above technical solution, when the smart wearable device detects a change from a worn state to a non-worn state, it indicates that the user needs to remove the smart wearable device and place it aside. To facilitate subsequent retrieval, a first scene image can be captured at this time. If the strength change of the wireless signal from the handheld device exceeds a set threshold, it indicates that the handheld device is obstructed by an obstacle or moved away from the smart wearable device by the user. To facilitate tracking the handheld device's location, the current first wireless signal strength can be recorded and a second scene image can be captured. If the device detects a change from a non-worn state to a worn state, it indicates that the user needs to use both the smart wearable device and the handheld device. At this time, the current second wireless signal strength from the handheld device can be obtained. Based on the first and second scene images, if the handheld device is included in the image, its location can be quickly determined. If the handheld device is not included in the image, the second wireless signal strength will change as the user moves the smart wearable device. Based on the change in the deviation between the first and second wireless signal strengths, the change in distance between the handheld device and the smart wearable device can be determined. Therefore, based on the first wireless signal strength, the second wireless signal strength, and the first and second scene images, the handheld device can be located, thereby determining its position. In this technical solution, by capturing scene images and acquiring wireless signal strength at different stages, effective guidance can be provided to users to find the handheld device, facilitating quick location of the device's approximate location and enabling rapid retrieval.

[0096] In this embodiment of the application, the location of the handheld device can be determined by selecting a matching method based on whether the first scene image and the second scene image contain the handheld device. Figure 2 A flowchart illustrating a method for determining the location of a handheld device based on image and signal strength, provided in this application embodiment, is included.

[0097] S201: Determine whether the first scene image and the second scene image meet the positioning requirements of the handheld device.

[0098] In a practical implementation, handheld device recognition can be performed on the first scene image and the second scene image.

[0099] If both the first and second scene images contain the handheld device, or if the first scene image does not contain the handheld device but the second scene image does, it means that the handheld device can be quickly located based on its position in the second scene image. Therefore, if both the first and second scene images contain the handheld device, or if the first scene image does not contain the handheld device but the second scene image does, it can be determined that the first and second scene images meet the positioning requirements of the handheld device. If the first and second scene images meet the positioning requirements of the handheld device, S202 can be executed.

[0100] Taking a smart wearable device as a head-mounted device as an example, if the first scene image contains the handheld device but the second scene image does not contain the handheld device, it means that the handheld device is blocked or has been moved out of the range that the head-mounted device's camera can capture. In this case, based on the target position of the handheld device in the first scene image, it can be determined whether there is an obstacle at the position in the second scene image that matches the target position.

[0101] If there is an obstacle at the location matching the target position in the second scene image, it means that the handheld device is very likely to be obscured by the obstacle. In this case, the handheld device can be quickly located based on the location of the handheld device in the first scene image. Therefore, if there is an obstacle at the location matching the target position in the second scene image, it can be determined that the first scene image and the second scene image meet the positioning requirements of the handheld device, and S202 can be executed at this time.

[0102] If there are no obstacles at the location matching the target position in the second scene image, or if neither the first nor the second scene image contains the handheld device, it indicates that further positioning of the handheld device is required based on the strength of the wireless signal. Therefore, if there are no obstacles at the location matching the target position in the second scene image, or if neither the first nor the second scene image contains the handheld device, it can be determined that the first and second scene images do not meet the positioning requirements of the handheld device.

[0103] If the first scene image and the second scene image do not meet the positioning requirements of the handheld device, S203 can be executed.

[0104] S202: Based on the position of the handheld device in the first scene image and the second scene image, determine the position image corresponding to the handheld device and display the position image on the display screen.

[0105] If the first scene image and the second scene image meet the positioning requirements of the handheld device, the position of the handheld device in the first scene image or the second scene image can be analyzed. In order to facilitate the user's search, the position image corresponding to the position of the handheld device can be extracted from the scene image and displayed on the display screen. The user can quickly find the handheld device based on the position image.

[0106] S203: Determine the movement particle size based on the deviation between the first wireless signal strength and the second wireless signal strength.

[0107] If the first scene image and the second scene image do not meet the positioning requirements of the handheld device, the movement granularity can be determined based on the deviation between the first wireless signal strength and the second wireless signal strength.

[0108] Movement granularity refers to the distance a user moves in a single movement while wearing a head-mounted device.

[0109] If the difference between the first and second wireless signal strengths is small, it indicates that the handheld device is far from the head-mounted device, so the movement granularity can be selected to be larger.

[0110] Since the strength of the first wireless signal is already relatively low, and the difference between the strength of the first wireless signal and the strength of the second wireless signal is relatively large, it indicates that the value of the second wireless signal strength is relatively large. Accordingly, it can be determined that the distance between the handheld device and the head-mounted device is relatively close at this time, so the movement granularity can be selected to be smaller.

[0111] In a practical implementation, the difference between the second wireless signal strength and the first wireless signal strength can be calculated.

[0112] If the difference is greater than or equal to the first threshold, a set first step distance can be selected as the movement granularity; if the difference is less than the first threshold, a set second step distance can be selected as the movement granularity; wherein, the value of the first step distance is less than the value of the second step distance.

[0113] The value of the first threshold can be flexibly set based on actual needs, and is not limited here.

[0114] S204: Display the movement granularity on the screen so that the user can move the head-mounted device according to the movement granularity until it is determined that the wireless signal strength transmitted from the handheld device to the head-mounted device is greater than the target signal strength, and take the position corresponding to the wireless signal strength as the position of the handheld device.

[0115] The head-mounted device is equipped with a display screen, which shows the movement granularity to provide a basis for the user to move while wearing the head-mounted device.

[0116] During the movement of the head-mounted device, the changes in the wireless signal strength fed back by the handheld device can be detected in real time. When it is determined that the wireless signal strength is greater than the target signal strength, it means that the distance between the head-mounted device and the handheld device is very close. The location of the head-mounted device when the wireless signal strength is generated can be approximated as the location of the handheld device. The user can then search for the handheld device in the vicinity of that location.

[0117] The target signal strength can be set based on the wireless signal strength generated by the head-mounted device and the handheld device when there are no obstructions and the distance is relatively short. For example, the wireless signal strength generated by the head-mounted device and the handheld device when there are no obstructions and the distance is 1m can be used as the target signal strength. When a wireless signal strength greater than the target signal strength is determined, the location of the head-mounted device when that wireless signal strength is generated is approximated as the location of the handheld device, and the user can search for the handheld device within a 1m radius of that location.

[0118] As the user moves the headset in granular motion, the wireless signal strength reported by the handheld device can be monitored in real time. As the wireless signal strength increases, it indicates that the headset and handheld device are getting closer, making the collected wireless signal more valuable. Therefore, if the current wireless signal strength reported by the handheld device is greater than or equal to a second threshold, the distance between the headset and handheld device can be determined based on the current wireless signal strength and displayed on the screen to help the user locate the handheld device. The value of the second threshold can be set based on actual needs; it can be less than or equal to the target signal strength, and is not limited here.

[0119] Determining distance based on wireless signal strength is a relatively mature technology and will not be elaborated upon here.

[0120] If the current wireless signal strength reported by the handheld device is consistently below the second threshold, it indicates that the handheld device is obstructed by an obstacle. Since the obstruction significantly affects the wireless signal strength reported by the handheld device, it is not conducive to the user locating the handheld device based on changes in the reported wireless signal strength. Therefore, when the current wireless signal strength reported by the handheld device is consistently below the second threshold, an obstacle obstruction warning can be displayed on the screen. This allows the user to check under various objects during the search process to see if the handheld device is obstructed, thus facilitating a faster retrieval of the handheld device.

[0121] Considering that handheld devices generally include a left handle and a right handle in practical applications, the strength of the wireless signals fed back by the left and right handles can be used to determine whether the left and right handles are placed together, thereby locating and finding the left and right handles.

[0122] In the specific implementation, as the user moves the head-mounted device according to the granularity of movement, it is determined whether the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle meet the set consistency conditions.

[0123] If the wireless signal strength fed back by the left and right controllers meets the set consistency condition, it can be determined that the left and right controllers are placed in the same position. At this time, the location can be found by locating the controller based on the wireless signal strength fed back by either controller.

[0124] If the wireless signal strength reported by the left and right controllers does not meet the set consistency conditions, it can be determined that the left and right controllers are placed in different locations. In this case, it is necessary to locate them separately based on the wireless signal strength reported by each controller.

[0125] When it is determined that the left and right controllers are placed in different positions, the second wireless signal strength includes the second wireless signal strength corresponding to the left controller and the second wireless signal strength corresponding to the right controller.

[0126] Accordingly, when determining the movement granularity, the first movement granularity corresponding to the left handle can be determined based on the deviation between the first wireless signal strength and the second wireless signal strength corresponding to the left handle; and the second movement granularity corresponding to the right handle can be determined based on the deviation between the first wireless signal strength and the second wireless signal strength corresponding to the right handle.

[0127] After determining the movement granularity corresponding to each handle, you can first find the left handle based on the first movement granularity, and then find the right handle based on the second movement granularity; or you can first find the right handle based on the second movement granularity, and then find the left handle based on the first movement granularity.

[0128] In this embodiment, the strength of the wireless signals fed back by the left and right controllers determines whether they are placed together. When the left and right controllers are placed together, their location can be determined based on the wireless signal fed back by either controller. When the left and right controllers are not placed together, their respective movement granularity can be determined based on the wireless signals fed back by both controllers, thereby enabling the location of the left and right controllers separately.

[0129] Figure 3 This is a schematic diagram of the structure of a positioning device for a handheld device provided in an embodiment of this application. The device includes a first shooting unit 31, a recording unit 32, a second shooting unit 33, an acquisition unit 34, and a positioning unit 35.

[0130] The first shooting unit 31 is used to capture a first scene image when it detects that it has changed from a wearing state to a non-wearing state;

[0131] The recording unit 32 is used to record the current first wireless signal strength when the strength change of the wireless signal fed back by the handheld device exceeds a set threshold.

[0132] The second shooting unit 33 is used to capture images of the second scene;

[0133] The acquisition unit 34 is used to acquire the current second wireless signal strength when it detects that it has changed from an unworn state to a worn state;

[0134] The positioning unit 35 is used to locate the handheld device based on the first wireless signal strength, the second wireless signal strength, the first scene image, and the second scene image, so as to determine the location of the handheld device.

[0135] Optionally, the positioning unit includes a judgment subunit, an image determination subunit, a display subunit, a granularity determination subunit, and an as a subunit;

[0136] The judgment subunit is used to determine whether the first scene image and the second scene image meet the positioning requirements of the handheld device.

[0137] The image determination subunit is used to determine the position image corresponding to the handheld device based on the position of the handheld device in the first scene image and the second scene image, provided that the positioning requirements of the handheld device are met by the first scene image and the second scene image.

[0138] The display sub-unit is used to display a position image on the screen;

[0139] The granularity determination subunit is used to determine the movement granularity based on the deviation between the first wireless signal strength and the second wireless signal strength when the first scene image and the second scene image do not meet the positioning requirements of the handheld device.

[0140] The display subunit is also used to show the movement granularity via a display screen, so that users can move the head-mounted device according to the movement granularity;

[0141] As a sub-unit, it is used to determine the location of the handheld device until it is determined that the strength of the wireless signal transmitted from the handheld device to the head-mounted device is greater than the target signal strength, and then take the location corresponding to the wireless signal strength as the location of the handheld device.

[0142] Optionally, the judgment subunit is used to identify the handheld device in the first scene image and the second scene image;

[0143] If both the first scene image and the second scene image contain a handheld device, or if the first scene image does not contain a handheld device but the second scene image does contain a handheld device, then the first scene image and the second scene image are determined to meet the positioning requirements of the handheld device.

[0144] If the first scene image contains a handheld device and the second scene image does not contain a handheld device, based on the target position of the handheld device in the first scene image, determine whether there is an obstacle at the position in the second scene image that matches the target position;

[0145] If there is an obstacle at the location in the second scene image that matches the target location, it is determined that the first scene image and the second scene image meet the positioning requirements of the handheld device.

[0146] If there are no obstacles at the location matching the target position in the second scene image, or if neither the first scene image nor the second scene image contains the handheld device, it is determined that the first scene image and the second scene image do not meet the positioning requirements of the handheld device.

[0147] Optionally, the granularity determination subunit is used to calculate the difference between the second wireless signal strength and the first wireless signal strength;

[0148] If the difference is greater than or equal to the first threshold, the set first step distance is selected as the movement granularity.

[0149] If the difference is less than the first threshold, the set second step distance is selected as the movement granularity; wherein, the value of the first step distance is less than the value of the second step distance.

[0150] Optionally, it also includes a detection unit;

[0151] The detection unit is used to detect the strength of the wireless signal fed back by the handheld device in real time as the user moves the head-mounted device according to the granularity of movement;

[0152] The display subunit is also used to determine the distance between the head-mounted device and the handheld device based on the current wireless signal strength when the current wireless signal strength reported by the handheld device is greater than or equal to the second threshold, and to display the distance value on the display screen so that the user can locate the handheld device based on the distance value; if the current wireless signal strength reported by the handheld device is always less than the second threshold, a prompt message indicating that there is an obstacle is displayed on the display screen.

[0153] Optionally, when the handheld device includes a left handle and a right handle, the device further includes an intensity determination unit, a first determination unit, and a second determination unit;

[0154] The strength judgment unit is used to determine whether the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle meet the set consistency conditions when the user moves the head-mounted device according to the movement granularity.

[0155] The first determination unit is used to determine that the left and right handles are placed in the same position if the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle meet the set consistency conditions.

[0156] The second determination unit is used to determine that the left and right controllers are placed in different positions when the wireless signal strength fed back by the left controller and the wireless signal strength fed back by the right controller do not meet the set consistency conditions.

[0157] Optionally, if it is determined that the left and right handles are placed in different positions, the second wireless signal strength includes the second wireless signal strength corresponding to the left handle and the second wireless signal strength corresponding to the right handle.

[0158] Accordingly, the granularity determination subunit determines the first movement granularity corresponding to the left handle based on the deviation between the first wireless signal strength and the second wireless signal strength corresponding to the left handle; and determines the second movement granularity corresponding to the right handle based on the deviation between the first wireless signal strength and the second wireless signal strength corresponding to the right handle.

[0159] Figure 3 The description of the features in the corresponding embodiments can be found in [reference needed]. Figure 1 and Figure 2 The relevant descriptions of the corresponding embodiments will not be repeated here.

[0160] As can be seen from the above technical solution, when the smart wearable device detects a change from a worn state to a non-worn state, it indicates that the user needs to remove the smart wearable device and place it aside. To facilitate subsequent retrieval, a first scene image can be captured at this time. If the strength change of the wireless signal from the handheld device exceeds a set threshold, it indicates that the handheld device is obstructed by an obstacle or moved away from the smart wearable device by the user. To facilitate tracking the handheld device's location, the current first wireless signal strength can be recorded and a second scene image can be captured. If the device detects a change from a non-worn state to a worn state, it indicates that the user needs to use both the smart wearable device and the handheld device. At this time, the current second wireless signal strength from the handheld device can be obtained. Based on the first and second scene images, if the handheld device is included in the image, its location can be quickly determined. If the handheld device is not included in the image, the second wireless signal strength will change as the user moves the smart wearable device. Based on the change in the deviation between the first and second wireless signal strengths, the change in distance between the handheld device and the smart wearable device can be determined. Therefore, based on the first wireless signal strength, the second wireless signal strength, and the first and second scene images, the handheld device can be located, thereby determining its position. In this technical solution, by capturing scene images and acquiring wireless signal strength at different stages, effective guidance can be provided to users to find the handheld device, facilitating quick location of the device's approximate location and enabling rapid retrieval.

[0161] Figure 4 A structural diagram of an electronic device provided in an embodiment of this application, such as... Figure 4 As shown, the electronic device includes: a memory 20 for storing computer programs;

[0162] The processor 21 is used to execute a computer program to implement the steps of the positioning method of the handheld device as described in the above embodiments.

[0163] The electronic devices provided in this embodiment may include, but are not limited to, head-mounted smart devices, smartphones, tablets, laptops, or desktop computers.

[0164] The processor 21 may include one or more processing cores, such as a quad-core processor or an octa-core processor. The processor 21 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 21 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor 21 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, the processor 21 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0165] The memory 20 may include one or more computer-readable storage media, which may be non-transitory. The memory 20 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In this embodiment, the memory 20 is used to store at least the following computer program 201, which, after being loaded and executed by the processor 21, is capable of implementing the relevant steps of the handheld device positioning method disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202 and data 203, and the storage method may be temporary or permanent storage. The operating system 202 may include Windows, Unix, Linux, etc. The data 203 may include, but is not limited to, setting thresholds.

[0166] In some embodiments, the electronic device may further include a display screen 22, an input / output interface 23, a communication interface 24, a power supply 25, and a communication bus 26.

[0167] Those skilled in the art will understand that Figure 4 The structures shown do not constitute a limitation on electronic devices and may include more or fewer components than those shown.

[0168] It is understood that if the positioning method of the handheld device in the above embodiments is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and executes all or part of the steps of the methods in the various embodiments of this application. The aforementioned storage medium includes: USB flash drive, mobile hard disk, read-only memory (ROM), random access memory (RAM), electrically erasable programmable ROM, register, hard disk, removable disk, CD-ROM, magnetic disk, or optical disk, and other media capable of storing program code.

[0169] Based on this, embodiments of the present invention also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the positioning method for the handheld device described above.

[0170] The foregoing has provided a detailed description of a positioning method, apparatus, device, and computer-readable storage medium for a handheld device according to embodiments of this application. The various embodiments are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to in the method section.

[0171] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0172] The foregoing has provided a detailed description of a positioning method, apparatus, device, and computer-readable storage medium for a handheld device. Specific examples have been used to illustrate the principles and implementation methods of the invention. The descriptions of these embodiments are merely illustrative of the method and its core ideas. It should be noted that those skilled in the art can make various improvements and modifications to this application without departing from the principles of the invention, and these improvements and modifications also fall within the scope of protection of the claims of this application.

Claims

1. A positioning method for a handheld device, characterized in that, include: Upon detecting a change in its wearing state to an unwearing state, the system captures an image of the first scene. If the strength change of the wireless signal fed back by the handheld device exceeds a set threshold, record the current first wireless signal strength and take a second scene image; Upon detecting a change from an unworn state to a worn state, the current second wireless signal strength is obtained; Based on the first wireless signal strength, the second wireless signal strength, the first scene image, and the second scene image, the handheld device is located to determine its position. The step of locating the handheld device based on the first wireless signal strength, the second wireless signal strength, the first scene image, and the second scene image to determine the location of the handheld device includes: Determine whether the first scene image and the second scene image meet the positioning requirements of the handheld device; If the first scene image and the second scene image meet the positioning requirements of the handheld device, the position image corresponding to the handheld device is determined based on the position of the handheld device in the first scene image and the second scene image, and the position image is displayed on the display screen. If the first scene image and the second scene image do not meet the positioning requirements of the handheld device, the movement granularity is determined based on the deviation between the first wireless signal strength and the second wireless signal strength. The movement granularity is displayed on the screen so that the user can move the head-mounted device according to the movement granularity until it is determined that the wireless signal strength transmitted from the handheld device to the head-mounted device is greater than the target signal strength. The position corresponding to the wireless signal strength is then taken as the position of the handheld device.

2. The positioning method for a handheld device according to claim 1, characterized in that, The step of determining whether the first scene image and the second scene image meet the positioning requirements of the handheld device includes: The handheld device is identified in the first scene image and the second scene image; If both the first scene image and the second scene image contain the handheld device, or if the first scene image does not contain the handheld device but the second scene image does contain the handheld device, then it is determined that the first scene image and the second scene image meet the positioning requirements of the handheld device. If the first scene image contains the handheld device and the second scene image does not contain the handheld device, based on the target position of the handheld device in the first scene image, it is determined whether there is an obstacle at the position in the second scene image that matches the target position; If an obstacle exists at the location in the second scene image that matches the target location, it is determined that the first scene image and the second scene image meet the positioning requirements of the handheld device. If there is no obstacle at the location matching the target position in the second scene image, or if neither the first scene image nor the second scene image contains the handheld device, it is determined that the first scene image and the second scene image do not meet the positioning requirements of the handheld device.

3. The positioning method for a handheld device according to claim 1, characterized in that, Determining the movement particle size based on the deviation between the first wireless signal strength and the second wireless signal strength includes: Calculate the difference between the second wireless signal strength and the first wireless signal strength; If the difference is greater than or equal to the first threshold, the set first step distance is selected as the movement granularity; If the difference is less than the first threshold, a set second step distance is selected as the movement granularity; wherein the value of the first step distance is less than the value of the second step distance.

4. The positioning method for a handheld device according to claim 1, characterized in that, Following the display of the movement granularity on the screen, the method further includes: As the user moves the head-mounted device according to the stated movement granularity, the strength of the wireless signal fed back by the handheld device is detected in real time. If the current wireless signal strength reported by the handheld device is greater than or equal to a second threshold, the distance between the head-mounted device and the handheld device is determined based on the current wireless signal strength, and the distance value is displayed on the display screen so that the user can locate the handheld device based on the distance value. If the current wireless signal strength reported by the handheld device is consistently lower than the second threshold, a warning message indicating that there is an obstacle blocking the signal will be displayed on the screen.

5. The positioning method for a handheld device according to claim 1, characterized in that, In the case where the handheld device includes a left handle and a right handle, the method further includes, after displaying the movement granularity on the screen: During the process of the user moving the head-mounted device according to the specified movement granularity, it is determined whether the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle meet the set consistency conditions. If the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle meet the set consistency condition, it is determined that the left handle and the right handle are placed in the same position. If the wireless signal strength fed back by the left handle and the wireless signal strength fed back by the right handle do not meet the set consistency condition, it is determined that the left handle and the right handle are placed in different positions.

6. The positioning method for a handheld device according to claim 5, characterized in that, If it is determined that the left handle and the right handle are placed in different positions, the second wireless signal strength includes the second wireless signal strength corresponding to the left handle and the second wireless signal strength corresponding to the right handle; Accordingly, determining the movement granularity based on the deviation between the first wireless signal strength and the second wireless signal strength includes: Based on the deviation between the first wireless signal strength and the second wireless signal strength corresponding to the left handle, the first movement particle corresponding to the left handle is determined; Based on the deviation between the first wireless signal strength and the second wireless signal strength corresponding to the right handle, the second movement particle size corresponding to the right handle is determined.

7. A positioning device for a handheld device, characterized in that, It includes a first shooting unit, a recording unit, a second shooting unit, an acquisition unit, and a positioning unit; The first imaging unit is used to capture a first scene image when it detects that it has changed from a wearing state to a non-wearing state; The recording unit is used to record the current first wireless signal strength when the strength change of the wireless signal fed back by the handheld device exceeds a set threshold. The second shooting unit is used to capture images of the second scene; The acquisition unit is used to acquire the current second wireless signal strength when it detects that it has changed from an unworn state to a worn state. The positioning unit is used to locate the handheld device based on the first wireless signal strength, the second wireless signal strength, the first scene image, and the second scene image, so as to determine the location of the handheld device. The positioning unit includes a judgment subunit, an image determination subunit, a display subunit, a granularity determination subunit, and a servo subunit; The judgment subunit is used to determine whether the first scene image and the second scene image meet the positioning requirements of the handheld device; The image determination subunit is used to determine the position image corresponding to the handheld device based on the position of the handheld device in the first scene image and the second scene image, provided that the first scene image and the second scene image meet the positioning requirements of the handheld device. The display subunit is used to display the location image on the display screen; The granularity determination subunit is used to determine the movement granularity based on the deviation between the first wireless signal strength and the second wireless signal strength when the first scene image and the second scene image do not meet the positioning requirements of the handheld device. The display subunit is also used to display the movement granularity on a display screen so that the user can move the head-mounted device according to the movement granularity. The sub-unit is used to determine the location of the handheld device until it is determined that the strength of the wireless signal transmitted from the handheld device to the head-mounted device is greater than the target signal strength, and then takes the location corresponding to the wireless signal strength as the location of the handheld device.

8. An electronic device, characterized in that, include: Memory, used to store computer programs; A processor for executing the computer program to implement the steps of the positioning method for the handheld device as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the positioning method for the handheld device as described in any one of claims 1 to 6.

Images