Positioning method and device, electronic device and storage medium

By determining the jitter value of the electronic device and collecting image information, the problem of device jitter affecting positioning accuracy is solved, the positioning accuracy and user experience are improved, and the needs of various sports scenarios are adapted.

CN112950714BActive Publication Date: 2024-11-26SHENZHEN TETRAS AI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110214931.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-02-25
Publication Date
2024-11-26
Estimated Expiration
2041-02-25

AI Technical Summary

Technical Problem

In visual positioning technology, jitter of electronic devices causes a decrease in image quality, which in turn affects positioning accuracy. It is difficult for the prior art to effectively deal with the positioning problem of the device in a jittered state.

Method used

By determining the jitter value of the electronic device, image information is collected according to the degree of jitter, and prompt information is output in the jitter state to guide the user to adjust the device status, ensure the quality of image acquisition, and thereby improve positioning accuracy.

Benefits of technology

It improves positioning accuracy and user experience, reduces the power loss caused by long-term invalid positioning of the equipment, and adapts to the positioning needs of various sports scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112950714B_ABST
    Figure CN112950714B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a positioning method and device, an electronic device and a storage medium, the method comprising: determining a first jitter value of the electronic device, the first jitter value being used to characterize the degree of jitter of the electronic device; collecting image information according to the first jitter value of the electronic device to obtain a target image, the target image comprising an environmental image of the environment in which the electronic device is located; locating the electronic device according to the target image to obtain the position information of the electronic device. The embodiments of the present disclosure can improve the positioning accuracy.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a positioning method and device, an electronic device, and a storage medium. Background Art

[0002] VPS (visual positioning service) technology can locate the user's position in the reconstructed space through image analysis, that is, the position of the user's mobile phone in the real world space. VPS technology can accurately locate the user even indoors without satellite signals. Summary of the invention

[0003] The present disclosure proposes a technical solution for positioning.

[0004] According to one aspect of the present disclosure, a positioning method is provided, which is applied to an electronic device, and the method includes:

[0005] Determining a first jitter value of the electronic device, where the first jitter value is used to characterize a jitter degree of the electronic device;

[0006] Collecting image information according to the first jitter value of the electronic device to obtain a target image, wherein the target image includes an environment image of the environment in which the electronic device is located;

[0007] The electronic device is positioned according to the target image to obtain location information of the electronic device.

[0008] The positioning method provided by the embodiment of the present disclosure can collect target images according to a first jitter value used to characterize the jitter degree of the electronic device, that is, the quality of collected image information can be measured according to the jitter degree of the electronic device, which can improve the quality of the collected target image and further improve the positioning accuracy.

[0009] In a possible implementation, collecting image information according to the first shaking state of the electronic device to obtain a target image includes:

[0010] When the first jitter value is less than a jitter threshold, image information is collected to obtain the target image.

[0011] The positioning method provided by the embodiment of the present disclosure has a good quality of the target image collected when the first jitter value is less than the jitter threshold, and can improve the positioning accuracy of the electronic device.

[0012] In a possible implementation manner, collecting image information according to the first jitter value of the electronic device to obtain a target image includes:

[0013] When the first jitter value is greater than or equal to a jitter threshold, outputting prompt information, wherein the prompt information is used to instruct to keep the electronic device in a stable state;

[0014] Determining a second jitter value of the electronic device;

[0015] When the second jitter value is less than the jitter threshold, image information is collected to obtain the target image.

[0016] The positioning method provided in the embodiment of the present disclosure can guide the user to adjust the shaking degree of the electronic device through prompt information when the electronic device is in a shaking state, thereby improving the user experience through interaction, and further improving the positioning efficiency and positioning accuracy.

[0017] In a possible implementation manner, determining the first jitter value of the electronic device includes:

[0018] Acquire IMU information of the inertial sensor of the electronic device;

[0019] A first jitter value of the electronic device is determined according to the IMU information.

[0020] The positioning method provided by the embodiment of the present disclosure can determine the first jitter value of the electronic device through IMU information, and then capture the target image according to the first jitter value, which can improve the quality of the captured target image and further improve the positioning accuracy.

[0021] In a possible implementation manner, determining a first jitter value of the electronic device according to the IMU information includes:

[0022] Determine at least one of a rate of change of a pitch angle, a rate of change of a yaw angle, and a rate of change of a roll angle of the electronic device according to the IMU information;

[0023] A first jitter value of the electronic device is determined according to at least one of a rate of change of a pitch angle, a rate of change of a yaw angle, and a rate of change of a roll angle of the electronic device.

[0024] The positioning method provided by the embodiment of the present disclosure can determine the first jitter value of the electronic device through IMU information, and then capture the target image according to the first jitter value, which can improve the quality of the captured target image and further improve the positioning accuracy.

[0025] In a possible implementation manner, determining a first jitter value of the electronic device according to the IMU information includes:

[0026] Determine the rate of change of the acceleration value of the electronic device in each direction according to the IMU information;

[0027] A first jitter value of the electronic device is determined according to at least one of the rates of change of acceleration values ​​of the electronic device in various directions.

[0028] The positioning method provided by the embodiment of the present disclosure can determine the first jitter value of the electronic device through IMU information, and then capture the target image according to the first jitter value, which can improve the quality of the captured target image and further improve the positioning accuracy.

[0029] In a possible implementation, the method further includes:

[0030] Determining a jitter amplitude of the electronic device according to a first jitter value of the electronic device;

[0031] According to the jitter amplitude, corresponding prompt information is generated.

[0032] The positioning method provided by the embodiment of the present disclosure can enable the user to perceive the jitter amplitude of the electronic device in an interactive manner through prompt information, so as to facilitate the user to control the jitter amplitude of the electronic device and improve the user experience.

[0033] In a possible implementation manner, the prompt information includes at least one of voice information, text information, picture information, video information, animation information, and vibration prompt.

[0034] The positioning method provided by the embodiment of the present disclosure can prompt the user to adjust the amplitude of the electronic device in an appropriate manner, thereby improving positioning efficiency and positioning accuracy and improving user experience.

[0035] In a possible implementation, the method further includes:

[0036] When the display time of the prompt information is longer than the display time threshold, the prompt information is closed and the user switches to the initial positioning interface.

[0037] The positioning method provided by the embodiment of the present disclosure can alleviate the problem of power consumption caused by an electronic device being in an invalid positioning process for a long time, and can save power of the electronic device.

[0038] According to one aspect of the present disclosure, a positioning device is provided, which is applied to an electronic device, including:

[0039] A first determining module, configured to determine a first jitter value of the electronic device, wherein the first jitter value is used to characterize a jitter degree of the electronic device;

[0040] A collection module, used for collecting image information according to the first jitter value of the electronic device to obtain a target image, wherein the target image includes an environment image of the environment in which the electronic device is located;

[0041] The positioning module is used to locate the electronic device according to the target image to obtain the position information of the electronic device.

[0042] In a possible implementation, the acquisition module is further used to:

[0043] When the first jitter value is less than a jitter threshold, image information is collected to obtain the target image.

[0044] In a possible implementation, the acquisition module is further used to:

[0045] When the first jitter value is greater than or equal to a jitter threshold, outputting prompt information, wherein the prompt information is used to instruct to keep the electronic device in a stable state;

[0046] Determining a second jitter value of the electronic device;

[0047] When the second jitter value is less than the jitter threshold, image information is collected to obtain the target image.

[0048] In a possible implementation manner, the first determining module is further configured to:

[0049] Acquire IMU information of the inertial sensor of the electronic device;

[0050] A first jitter value of the electronic device is determined according to the IMU information.

[0051] In a possible implementation manner, the first determining module is further configured to:

[0052] Determine at least one of a rate of change of a pitch angle, a rate of change of a yaw angle, and a rate of change of a roll angle of the electronic device according to the IMU information;

[0053] A first jitter value of the electronic device is determined according to at least one of a rate of change of a pitch angle, a rate of change of a yaw angle, and a rate of change of a roll angle of the electronic device.

[0054] In a possible implementation manner, the first determining module is further configured to:

[0055] Determine the rate of change of the acceleration value of the electronic device in each direction according to the IMU information;

[0056] A first jitter value of the electronic device is determined according to at least one of the rates of change of acceleration values ​​of the electronic device in various directions.

[0057] In a possible implementation manner, the device further includes:

[0058] A second determining module, configured to determine a jitter amplitude of the electronic device according to a first jitter value of the electronic device;

[0059] A generating module is used to generate corresponding prompt information according to the jitter amplitude.

[0060] In a possible implementation manner, the prompt information includes at least one of voice information, text information, picture information, video information, animation information, and vibration prompt.

[0061] In a possible implementation manner, the device further includes:

[0062] The jump module is used to close the prompt information and jump to the positioning initial interface when the display time of the prompt information is greater than the display time threshold.

[0063] According to one aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to call the instructions stored in the memory to execute the above method.

[0064] According to one aspect of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor.

[0065] In an embodiment of the present disclosure, after determining the first jitter value of the electronic device, image information can be collected according to the first jitter value of the electronic device, so as to visually locate the electronic device according to the collected target image and obtain the position information of the electronic device. According to the positioning method and device, electronic device and storage medium provided by the embodiment of the present disclosure, the target image can be collected according to the first jitter value used to characterize the jitter degree of the electronic device, that is, the quality of the collected image information can be measured according to the jitter degree of the electronic device, the quality of the collected target image can be improved, and then the positioning accuracy can be improved.

[0066] It should be understood that the above general description and the following detailed description are exemplary and explanatory only and do not limit the present disclosure. Other features and aspects of the present disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used to illustrate the technical solutions of the present disclosure together with the specification.

[0068] Figure 1 A flowchart showing a positioning method according to an embodiment of the present disclosure is shown;

[0069] Figure 2 A block diagram showing a positioning device according to an embodiment of the present disclosure is shown;

[0070] Figure 3 A block diagram of an electronic device 800 according to an embodiment of the present disclosure is shown;

[0071] Figure 4 A block diagram of an electronic device 1900 according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0072] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0073] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0074] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0075] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.

[0076] In the VPS positioning process, the quality of the image has a great impact on the positioning accuracy. High-quality images contain rich and accurate image feature information. Therefore, when high-quality images are used for positioning, the positioning accuracy is higher and the location information is more accurate. On the contrary, when low-quality images are used for positioning, the positioning accuracy is lower and the location information is less accurate. Therefore, how to obtain high-quality images to improve positioning accuracy is an issue that should be focused on in VPS positioning.

[0077] The disclosed embodiments provide a positioning method, which can determine the shaking condition of an electronic device, and further determine whether the image information collected by the electronic device at the current moment is suitable for VPS positioning according to the shaking condition of the electronic device. Because when the electronic device is in a shaking state, the collected image information may be relatively fuzzy, and the feature information is not rich enough, which will lead to low positioning accuracy during positioning. Therefore, positioning is performed only when the electronic device is in a stable state through the collected image information, and when the electronic device is in a shaking state, a prompt message can be generated and displayed, and the prompt message can be used to remind the user to keep the electronic device stable, so that the image information can be collected when the electronic device is in a stable state, and VPS positioning is performed based on the collected image information.

[0078] Exemplarily, a first jitter value of the electronic device can be determined, and the first jitter value can be used to characterize the degree of jitter of the electronic device. When the first jitter value of the electronic device is less than the jitter threshold, image information can be collected to obtain a target image, and VPS positioning can be performed based on the collected target image. Alternatively, when the first jitter value of the electronic device is greater than or equal to the jitter threshold, a prompt message can be generated to remind the user to keep the electronic device in a stable state through the prompt message, and the second jitter value of the electronic device can continue to be determined. When the second jitter value of the electronic device is less than the jitter threshold, image information is collected, and VPS positioning is performed based on the collected target image.

[0079] In this way, the positioning method provided by the embodiment of the present disclosure can collect target images for positioning through the jitter of the electronic device, thereby improving the quality of the collected target images and further improving the positioning accuracy.

[0080] Figure 1A flowchart of a positioning method according to an embodiment of the present disclosure is shown, and the positioning method can be executed by an electronic device such as a terminal device or a server, and the terminal device can be a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (Personal Digital Assistant, PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. The method can be implemented by a processor calling a computer-readable instruction stored in a memory. Alternatively, the method can be executed by a server.

[0081] like Figure 1 As shown, the positioning method may include:

[0082] In step S11, a first jitter value of the electronic device is determined, where the first jitter value is used to characterize the jitter degree of the electronic device.

[0083] For example, before collecting the target image for positioning, the electronic device can determine the degree of jitter of the electronic device. Exemplarily, since the IMU sensor of the electronic device can capture the movement of the electronic device, the first jitter value of the electronic device can be determined according to the sensor data information of the IMU sensor in the electronic device, so as to characterize the degree of jitter of the electronic device by the first jitter value. Among them, the more severe the jitter degree of the electronic device (or the higher the jitter degree), the larger the corresponding first jitter value. The disclosed embodiments do not specifically limit the first jitter value. Any value that can characterize the jitter degree of the electronic device can be used as the first jitter value. Accordingly, the disclosed embodiments do not specifically limit the method for determining the first jitter value.

[0084] In step S12, image information is collected according to the first jitter value of the electronic device to obtain a target image, where the target image includes an environment image of the environment in which the electronic device is located.

[0085] For example, the degree of jitter of the electronic device can be obtained based on the first jitter value of the electronic device, so as to determine whether the image information collected by the electronic device at the current moment is suitable for VPS positioning based on the first jitter value, and then collect image information based on the first jitter value to obtain the target image.

[0086] Exemplarily, when the first jitter value of the electronic device indicates that the current jitter level of the electronic device is small or that the electronic device is currently in a stable state, it can be determined that the image information collected by the electronic device at the current moment is relatively clear, that is, the image information quality is good, and the electronic device can collect the target image and perform visual positioning based on the collected target image; when the first jitter value of the electronic device indicates that the current jitter level of the electronic device is large, it can be determined that the image information collected by the electronic device at the current moment is relatively fuzzy and of poor quality, so it is necessary to collect image information for visual positioning after the electronic device is in a stable state to obtain image information with better quality. Among them, the image information includes the environmental image of the environment in which the electronic device is located, and can also include information such as the collection time and the jitter value of the electronic device at the collection time.

[0087] In step S13, the electronic device is positioned according to the target image to obtain location information of the electronic device.

[0088] For example, after the electronic device acquires the target image, the electronic device can be VPS positioned according to the target image to obtain the location information of the electronic device. Exemplarily, the visual positioning process of the electronic device can be implemented by the electronic device end, or, after the electronic device uploads the target image to the server end, the server end can position the electronic device according to the target image to obtain the location information of the electronic device.

[0089] For example, when the electronic device is not connected to the network or the electronic device is connected to the network but the network quality is poor, the electronic device can perform visual positioning based on the target image to obtain the location information of the electronic device. Alternatively, when the electronic device is connected to the network and the network quality is good, the electronic device can send the collected target image and the current focal length of the electronic device and other information to the server, and the server performs VPS positioning of the electronic device based on the target image to obtain the location information of the electronic device.

[0090] In this way, after determining the first jitter value of the electronic device, image information can be collected according to the first jitter value of the electronic device, so as to visually locate the electronic device according to the collected target image, and obtain the position information of the electronic device. According to the positioning method provided by the embodiment of the present disclosure, the target image can be collected according to the first jitter value used to characterize the jitter degree of the electronic device, that is, the quality of the collected image information can be measured according to the jitter degree of the electronic device, the quality of the collected target image can be improved, and then the positioning accuracy can be improved.

[0091] In a possible implementation, collecting image information according to the first shaking state of the electronic device to obtain a target image may include:

[0092] When the first jitter value is less than a jitter threshold, image information is collected to obtain the target image.

[0093] For example, the jitter threshold may be a value used to measure whether the first jitter value of the electronic device meets the image acquisition requirements. When the first jitter value is less than the jitter threshold, it can be determined that the first jitter value meets the image acquisition requirements, that is, the image information collected by the electronic device at the current moment is relatively clear, and the feature information in the image information is rich and accurate, so the quality of the image information is good and can be used for VPS positioning. Therefore, the electronic device can use the image information collected at the current moment as the target image, obtain a high-quality target image, and perform visual positioning based on the target image, thereby improving the positioning accuracy of the electronic device.

[0094] In a possible implementation manner, collecting image information according to the first jitter value of the electronic device to obtain a target image may include:

[0095] When the first jitter value is greater than or equal to the jitter threshold, outputting prompt information, wherein the prompt information is used to instruct to keep the electronic device in a stable state;

[0096] Determining a second jitter value of the electronic device;

[0097] When the second jitter value is less than the jitter threshold, image information is collected to obtain the target image.

[0098] For example, when the first jitter value is greater than or equal to the jitter threshold, it can be determined that the first jitter value does not meet the image acquisition requirements, that is, the image information collected by the electronic device at the current moment is relatively blurred, and the feature information in the image information is relatively sparse and has low precision, so the quality is poor. Therefore, a prompt message can be output by the electronic device, and the prompt message can be used to instruct the user to keep the electronic device in a stable state, so as to collect image information when the second jitter value of the electronic device is less than the jitter threshold, so as to collect a high-quality target image.

[0099] In a possible implementation manner, the prompt information may include at least one of voice information, text information, picture information, video information, animation information, and vibration prompt.

[0100] For example, a voice message may be played through an audio device, and / or at least one of text, picture, video, and animation information may be displayed through a display interface, and / or a vibration message may be generated through a vibration device to remind the user that the electronic device is currently shaking and to keep the electronic device in a stable state. In this way, prompt information may be output in an appropriate output manner to prompt the user, so that the user can quickly receive the prompt information, perceive the shaking state of the electronic device in a timely manner, and adjust the shaking state, thereby improving the user experience.

[0101] Exemplarily, the second jitter value of the electronic device can be determined in real time, or the second jitter value of the electronic device can be determined after a preset interval; wherein the second jitter value is similar to the first jitter value and is also used to characterize the degree of jitter of the electronic device. The more severe the jitter of the electronic device, the greater the second jitter value. If the second jitter value of the electronic device is less than the jitter threshold, the target image is collected and visual positioning is performed based on the target image. Alternatively, if the second jitter value is greater than or equal to the jitter threshold, the prompt information is continuously output until the second jitter value of the determined electronic device is less than the jitter threshold, and then image information is collected to obtain the target image, and visual positioning is performed based on the target image.

[0102] In a possible implementation, the method may further include:

[0103] When the display time of the prompt information is longer than the display time threshold, the prompt information is closed and the user switches to the initial positioning interface.

[0104] For example, the display duration of the prompt information is within the display time range, and the display time range can be a preset time range. For example: the display time range is: (t1, t2), that is, the prompt information is displayed for at least t1 seconds and at most t2 seconds, where t2 is the display time threshold. After the prompt information is displayed for t1 seconds, the second jitter value of the electronic device can be re-determined. If the second jitter value is greater than or equal to the jitter threshold, then after t1 seconds, the above process of measuring the second jitter value can be repeated until the second jitter value of the electronic device is less than the jitter threshold, or the display duration of the prompt information reaches t2 seconds, and the prompt information is closed.

[0105] If the second jitter value is less than the jitter threshold, image information can be collected and positioning can be performed based on the collected target image; if the output duration of the prompt information reaches t2 seconds, it can jump to the initial positioning interface, and generate and display explanation information, which can be used to notify the user that the positioning failed, and the reason for the positioning failure is that the electronic device is shaking, reminding the user to keep the electronic device in a stable state and restart the positioning operation.

[0106] It should be noted that the jitter threshold used to measure whether the jitter value of the electronic device meets the image acquisition requirements can be a preset value or a dynamically determined value.

[0107] Exemplarily, the electronic device may record the historical jitter values ​​of the electronic device within a preset time interval, and may determine the jitter threshold of the electronic device based on the historical jitter values. For example: when the historical jitter values ​​of the electronic device within the preset time interval are all large, a first jitter threshold may be set; or, when the historical jitter values ​​of the electronic device within the preset time interval are all small, a second jitter threshold may be set, wherein the first jitter threshold is greater than the second jitter threshold. In this way, the quality of the collected target image and the positioning accuracy can be improved while adapting to the actual motion scene in which the electronic device is located, thereby improving the user experience.

[0108] In this way, the user can be guided by prompt information to adjust the degree of jitter of the electronic device, and the user experience can be improved through interaction, and the positioning efficiency and positioning accuracy can be further improved.

[0109] In a possible implementation, the electronic device can cache the image information collected within a preset time interval and the first jitter value corresponding to the image information collection. When the output duration of the prompt information reaches t2 seconds, the frame of image information with the smallest first jitter value in the cached image information can be determined as the target image, and then positioning is performed based on the target image. In this way, the user can locate the electronic device in a scene with continuous bumps and shakes, adapt to various positioning scenarios, improve the positioning accuracy in the bumpy scenario, and improve the user experience.

[0110] In a possible implementation manner, determining the first jitter value of the electronic device may include:

[0111] Acquire IMU information of the inertial sensor of the electronic device;

[0112] A first jitter value of the electronic device is determined according to the IMU information.

[0113] For example, the inertial sensor IMU information of the electronic device's IMU (Inertial Measurement Unit) can be obtained, including information such as the acceleration and angular velocity of the electronic device. Then, the first jitter value of the electronic device can be determined based on the IMU information. Exemplarily, taking the acceleration of the electronic device as an example, the acceleration value of the electronic device on the x, y, and z axes can be obtained, and the maximum value of the obtained acceleration values ​​can be used as the first jitter value. Alternatively, the acceleration values ​​on the x, y, and z axes can be squared and summed to obtain the first jitter value of the electronic device. The method for determining the first jitter value of the electronic device is not specifically limited in the disclosed embodiments.

[0114] In a possible implementation manner, determining the first jitter value of the electronic device according to the IMU information may include:

[0115] Determine at least one of a rate of change of a pitch angle, a rate of change of a yaw angle, and a rate of change of a roll angle of the electronic device according to the IMU information;

[0116] A first jitter value of the electronic device is determined according to at least one of a rate of change of a pitch angle, a rate of change of a yaw angle, and a rate of change of a roll angle of the electronic device.

[0117] For example, at least one of the pitch angle, yaw angle and roll angle of the electronic device can be obtained based on the information collected by the gravity sensor in the IMU information of the electronic device, wherein the pitch angle is the angle of rotation of the electronic device around the x-axis, the yaw angle is the angle of rotation of the electronic device around the y-axis, and the roll angle is the angle of rotation of the electronic device around the z-axis.

[0118] The value of at least one of the current pitch angle, yaw angle and roll angle of the electronic device can be compared with the value of at least one of the pitch angle, yaw angle and roll angle at the previous moment to obtain at least one of the change rate of the pitch angle, the change rate of the yaw angle and the change rate of the roll angle of the electronic device. For example, after obtaining the pitch angle 1, yaw angle 1 and roll angle 1 of the electronic device at the current moment t1, they can be subtracted from the pitch angle 2, yaw angle 2 and roll angle 2 at the previous moment t2 to obtain the change rate of the pitch angle, the change rate of the yaw angle and the change rate of the roll angle of the electronic device.

[0119] Exemplarily, after obtaining the change rate of the pitch angle, the change rate of the yaw angle, and the change rate of the roll angle of the electronic device, the one with the largest absolute value among the above-mentioned change rate of the pitch angle, the change rate of the yaw angle, and the change rate of the roll angle can be used as the first jitter value of the electronic device. For example, when the absolute value of the change rate of the pitch angle is the largest, the absolute value of the pitch angle of the electronic device can be used as the first jitter value of the electronic device. And when the first jitter value is greater than or equal to the jitter threshold, it is determined that the electronic device is in a jitter state.

[0120] As another example, after obtaining the rate of change of the pitch angle, the rate of change of the yaw angle, and the rate of change of the roll angle of the electronic device, the rate of change of the pitch angle, the rate of change of the yaw angle, and the rate of change of the roll angle can be squared and summed respectively, and the sum obtained is used as the first jitter value of the electronic device, and when the first jitter value is greater than or equal to the jitter threshold, it is determined that the electronic device is in a jitter state.

[0121] In a possible implementation, determining the first jitter value of the electronic device according to the IMU information may include:

[0122] Determine the rate of change of the acceleration value of the electronic device in each direction according to the IMU information;

[0123] A first jitter value of the electronic device is determined according to at least one of the rates of change of acceleration values ​​of the electronic device in various directions.

[0124] For example, after obtaining the IMU information of the electronic device, the rate of change of the acceleration value of the electronic device in each direction can be obtained according to the IMU information, for example, obtaining the rate of change of the acceleration value of the electronic device on the three axes of X, Y, and Z. For example, after obtaining the acceleration 1 of the X axis, the acceleration 1 of the Y axis, and the acceleration 1 of the Z axis of the electronic device at the current moment, the acceleration 2 of the X axis, the acceleration 2 of the Y axis, and the acceleration 2 of the Z axis at the previous moment t2 can be subtracted to obtain the rate of change of the acceleration value of the electronic device on the three axes of X, Y, and Z.

[0125] The maximum value of the acquired rate of change of the acceleration value may be used as the first jitter value. Alternatively, the rate of change of the acceleration values ​​on the three axes X, Y, and Z may be squared and summed to obtain the first jitter value of the electronic device. The method for determining the first jitter value of the electronic device is not specifically limited in the embodiments of the present disclosure. In a possible implementation, the method may further include:

[0126] Determining a jitter amplitude of the electronic device according to a first jitter value of the electronic device;

[0127] According to the jitter amplitude, corresponding prompt information is generated.

[0128] For example, the jitter amplitude of the electronic device can be determined according to the first jitter value of the electronic device. For example: when the first jitter value is within the first jitter amplitude range, it can be determined that the electronic device is in the first jitter amplitude; or when the first jitter value is within the second jitter amplitude range, it can be determined that the electronic device is in the second jitter amplitude. . .

[0129] After determining the jitter amplitude, corresponding prompt information can be generated according to the jitter amplitude. Exemplarily, semantic information, text information, video information, animation information, etc. corresponding to the jitter amplitude can be generated, wherein the generated semantic information, text information, video information, animation information, etc. may include the jitter amplitude of the electronic device. For example: voice information can show different jitter amplitudes through different volume levels, different prompt sounds, etc. Exemplarily, the larger the jitter amplitude, the higher the volume corresponding to the voice information and the more urgent the prompt sound. Text information can show different jitter amplitudes through different font sizes, different font colors, etc. Exemplarily, the larger the jitter amplitude, the darker the font color in the text information and the larger the font. Video information and animation information can show different jitter amplitudes through the actions of the displayed jittering object. Exemplarily, the larger the jitter amplitude, the more violent the jittering action of the jittering object.

[0130] Alternatively, the vibration of the electronic device can be controlled according to the vibration amplitude, and the larger the vibration amplitude, the more intense the corresponding vibration. In this way, the user can be made aware of the vibration amplitude of the electronic device in an interactive manner through prompt information, which facilitates the user to control the vibration amplitude of the electronic device and improves the user experience.

[0131] The disclosed embodiments can be applied to scenarios such as positioning, AR navigation, and AR games, and can determine the jitter value of the electronic device before acquiring the target image for positioning. When the jitter value of the electronic device indicates that the electronic device is currently in a jittering state, a corresponding prompt message can be output, and the user can be guided to keep the electronic device in a stable state through the prompt message, so as to take a target image with better quality, and improve the image quality of the acquired target image from the perspective of the interactive process, thereby improving the success rate and accuracy of positioning, and greatly improving the user experience.

[0132] It can be understood that the above-mentioned various method embodiments mentioned in the present disclosure can be combined with each other to form a combined embodiment without violating the principle logic. Due to space limitations, the present disclosure will not repeat them. It can be understood by those skilled in the art that in the above-mentioned method of the specific implementation method, the specific execution order of each step should be determined according to its function and possible internal logic.

[0133] In addition, the present disclosure also provides a positioning device, an electronic device, a computer-readable storage medium, and a program, all of which can be used to implement any positioning method provided by the present disclosure. The corresponding technical solutions and descriptions are referred to the corresponding records in the method part and will not be repeated here.

[0134] Figure 2 A block diagram of a positioning device according to an embodiment of the present disclosure is shown as follows: Figure 2 As shown, the device comprises:

[0135] A first determining module 21 may be used to determine a first jitter value of the electronic device, where the first jitter value is used to characterize a jitter degree of the electronic device;

[0136] The acquisition module 22 may be configured to acquire image information according to the first jitter value of the electronic device to obtain a target image, wherein the target image includes an environment image of an environment in which the electronic device is located;

[0137] The positioning module 23 may be used to locate the electronic device according to the target image to obtain the position information of the electronic device.

[0138] In this way, after determining the first jitter value of the electronic device, image information can be collected according to the first jitter value of the electronic device, so as to visually locate the electronic device according to the collected target image, and obtain the position information of the electronic device. According to the positioning device provided by the embodiment of the present disclosure, the target image can be collected according to the first jitter value used to characterize the jitter degree of the electronic device, that is, the quality of the collected image information can be measured according to the jitter degree of the electronic device, the quality of the collected target image can be improved, and then the positioning accuracy can be improved.

[0139] In a possible implementation, the acquisition module 22 may also be used to:

[0140] When the first jitter value is less than a jitter threshold, image information is collected to obtain the target image.

[0141] In a possible implementation, the acquisition module 22 may also be used to:

[0142] When the first jitter value is greater than or equal to a jitter threshold, outputting prompt information, wherein the prompt information is used to instruct to keep the electronic device in a stable state;

[0143] Determining a second jitter value of the electronic device;

[0144] When the second jitter value is less than the jitter threshold, image information is collected to obtain the target image.

[0145] In a possible implementation, the first determining module 21 may also be used to:

[0146] Acquire IMU information of the inertial sensor of the electronic device;

[0147] A first jitter value of the electronic device is determined according to the IMU information.

[0148] In a possible implementation, the first determining module 21 may also be used to:

[0149] Determine at least one of a rate of change of a pitch angle, a rate of change of a yaw angle, and a rate of change of a roll angle of the electronic device according to the IMU information;

[0150] A first jitter value of the electronic device is determined according to at least one of a rate of change of a pitch angle, a rate of change of a yaw angle, and a rate of change of a roll angle of the electronic device.

[0151] In a possible implementation, the first determining module 21 may also be used to:

[0152] Determine the rate of change of the acceleration value of the electronic device in each direction according to the IMU information;

[0153] A first jitter value of the electronic device is determined according to at least one of the rates of change of acceleration values ​​of the electronic device in various directions.

[0154] In a possible implementation, the device may further include:

[0155] A second determination module may be configured to determine a jitter amplitude of the electronic device according to a first jitter value of the electronic device;

[0156] The generating module can be used to generate corresponding prompt information according to the jitter amplitude.

[0157] In a possible implementation manner, the prompt information may include at least one of voice information, text information, picture information, video information, animation information, and vibration prompt.

[0158] In a possible implementation, the device may further include:

[0159] The jump module is used to close the prompt information and jump to the positioning initial interface when the display time of the prompt information is greater than the display time threshold.

[0160] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0161] The embodiment of the present disclosure also provides a computer-readable storage medium, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the above method is implemented. The computer-readable storage medium may be a non-volatile computer-readable storage medium.

[0162] An embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to execute the above method.

[0163] The embodiments of the present disclosure also provide a computer program product, including a computer-readable code. When the computer-readable code is executed on a device, a processor in the device executes instructions for implementing the positioning method provided in any of the above embodiments.

[0164] The embodiments of the present disclosure also provide another computer program product for storing computer-readable instructions, which, when executed, enable a computer to perform the operations of the positioning method provided in any of the above embodiments.

[0165] The electronic device may be provided as a terminal, a server, or a device in other forms.

[0166] Figure 3 A block diagram of an electronic device 800 according to an embodiment of the present disclosure is shown. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

[0167] Reference Figure 3 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0168] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0169] The memory 804 is configured to store various types of data to support operations on the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0170] The power supply component 806 provides power to the various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

[0171] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0172] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0173] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0174] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the electronic device 800, the relative positioning of the components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0175] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as a wireless network (WiFi), a second generation mobile communication technology (2G) or a third generation mobile communication technology (3G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0176] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0177] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions, which can be executed by a processor 820 of an electronic device 800 to perform the above method.

[0178] Figure 4 1 is a block diagram of an electronic device 1900 according to an embodiment of the present disclosure. For example, the electronic device 1900 may be provided as a server. Figure 4 , the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions executable by the processing component 1922, such as an application. The application stored in the memory 1932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

[0179] The electronic device 1900 may also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input / output (I / O) interface 1958. The electronic device 1900 may operate based on an operating system stored in the memory 1932, such as a Microsoft Server operating system (Windows Server 2003). TM ), a graphical user interface operating system launched by Apple (Mac OSX TM ), a multi-user, multi-process computer operating system (Unix TM ), a free and open source Unix-like operating system (Linux TM ), an open source Unix-like operating system (FreeBSD TM ) or similar.

[0180] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to perform the above method.

[0181] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0182] Computer readable storage medium can be a tangible device that can hold and store instructions used by an instruction execution device. Computer readable storage medium can be, for example, (but not limited to) an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (non-exhaustive list) of computer readable storage medium include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, for example, a punch card or a convex structure in a groove on which instructions are stored, and any suitable combination thereof. The computer readable storage medium used here is not interpreted as a transient signal itself, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagated by a waveguide or other transmission medium (for example, a light pulse by an optical fiber cable), or an electrical signal transmitted by a wire.

[0183] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0184] The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be customized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

[0185] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0186] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0187] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0188] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.

[0189] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (SDK) and the like.

[0190] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A positioning method, characterized in that: Applied to electronic equipment, the method comprises: Determining a first jitter value of the electronic device, where the first jitter value is used to characterize a jitter degree of the electronic device; Collecting image information according to the first jitter value of the electronic device to obtain a target image, wherein the target image includes an environment image of the environment in which the electronic device is located; Positioning the electronic device according to the target image to obtain location information of the electronic device; Wherein, determining the first jitter value of the electronic device includes: Acquire IMU information of an inertial sensor of the electronic device; Determine at least one of a rate of change of a pitch angle, a rate of change of a yaw angle, a rate of change of a roll angle, and a rate of change of acceleration values ​​of the electronic device in various directions according to the IMU information; A first jitter value of the electronic device is determined according to at least one of a change rate of a pitch angle, a change rate of a yaw angle, a change rate of a roll angle, and a change rate of acceleration values ​​of the electronic device in various directions.

2. The method according to claim 1, characterized in that The collecting image information according to the first shaking state of the electronic device to obtain a target image includes: When the first jitter value is less than a jitter threshold, image information is collected to obtain the target image.

3. The method according to claim 1 or 2, characterized in that: The collecting image information according to the first jitter value of the electronic device to obtain a target image includes: When the first jitter value is greater than or equal to a jitter threshold, outputting prompt information, wherein the prompt information is used to instruct to keep the electronic device in a stable state; Determining a second jitter value of the electronic device; When the second jitter value is less than the jitter threshold, image information is collected to obtain the target image.

4. The method according to claim 1 or 2, characterized in that: The method further comprises: Determining a jitter amplitude of the electronic device according to a first jitter value of the electronic device; According to the jitter amplitude, corresponding prompt information is generated.

5. The method according to claim 3, characterized in that: The prompt information includes at least one of voice information, text information, picture information, video information, animation information, and vibration prompt.

6. The method according to claim 3, characterized in that: The method further comprises: When the display time of the prompt information is longer than the display time threshold, the prompt information is closed and the user is redirected to the initial positioning interface.

7. A positioning device, characterized in that: Applied to electronic equipment, the device comprises: A first determining module, configured to determine a first jitter value of the electronic device, wherein the first jitter value is used to characterize a jitter degree of the electronic device; A collection module, used for collecting image information according to the first jitter value of the electronic device to obtain a target image, wherein the target image includes an environment image of the environment in which the electronic device is located; A positioning module, used to locate the electronic device according to the target image to obtain the position information of the electronic device; Wherein, determining the first jitter value of the electronic device includes: Acquire IMU information of an inertial sensor of the electronic device; Determine at least one of a rate of change of a pitch angle, a rate of change of a yaw angle, a rate of change of a roll angle, and a rate of change of acceleration values ​​of the electronic device in various directions according to the IMU information; A first jitter value of the electronic device is determined according to at least one of a change rate of a pitch angle, a change rate of a yaw angle, a change rate of a roll angle, and a change rate of acceleration values ​​of the electronic device in various directions.

8. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to call the instructions stored in the memory to execute the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 6 is implemented.