Motion track monitoring method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses an action track monitoring method and device, equipment and a storage medium, and the method comprises the steps: obtaining a first distance and at least one second distance of electronic equipment at a target moment, the first distance being the distance between the electronic equipment and a reference plane at the target moment, and the second distance being the distance between the electronic equipment and the reference plane; the second distance is the distance between the electronic equipment and the wearable equipment at the target moment, and the wearable equipment is equipment worn by the user; determining position information of the electronic equipment at the target moment according to the first distance and the at least one second distance; according to multiple pieces of position information corresponding to the preset duration, the action track of the user in the preset duration is determined, and the multiple pieces of position information are position information corresponding to multiple continuous target moments included in the preset duration. And comprehensive monitoring of different actions of the user can be realized.

Description

Technical Field

[0001] The embodiments of the present application relate to information processing technology, and relate to but are not limited to a motion trajectory monitoring method and apparatus, equipment, and storage medium. Background Art

[0002] In recent years, consumer electronic devices have become increasingly popular among consumers. Devices such as headphones, smart bracelets, smart watches, smart glasses, speakers, etc. are all mainstream electronic devices.

[0003] When a user uses an electronic device, the electronic device can monitor his or her own behavior and present the user's movement trajectory to the user or other users. Generally, the electronic device can monitor the user's movement trajectory through the motion sensor set by itself, but when the user's movement is relatively slow, this monitoring method cannot achieve a good effect.

[0004] Therefore, how to conduct a more comprehensive monitoring of different actions of users is an urgent problem to be solved. Summary of the invention

[0005] In view of this, the motion trajectory monitoring method, device, equipment, and storage medium provided in the embodiments of the present application can realize comprehensive monitoring of the user's motion trajectory. The motion trajectory monitoring method, device, equipment, and storage medium provided in the embodiments of the present application are implemented as follows:

[0006] The motion trajectory monitoring method provided in the embodiment of the present application includes:

[0007] Acquire a first distance and at least one second distance of an electronic device at a target time, wherein the first distance is the distance between the electronic device and a reference surface at the target time, and the second distance is the distance between the electronic device and a wearable device at the target time, wherein the wearable device is a device worn by a user;

[0008] Determine the location information of the electronic device at the target time according to the first distance and the at least one second distance;

[0009] According to a plurality of position information corresponding to a preset time length, a movement trajectory of the user within the preset time length is determined, wherein the plurality of position information is position information corresponding to a plurality of consecutive target moments included in the preset time length.

[0010] In some embodiments, the electronic device is provided with a motion sensor, and before acquiring at least one second distance of the electronic device at the target time, the method further includes:

[0011] Collecting acceleration data and angular velocity data of the electronic device at the target time by the motion sensor;

[0012] Determine the acceleration value and angular velocity value of the electronic device according to the acceleration data and the angular velocity data;

[0013] When the acceleration value is less than a first threshold value and / or the angular velocity value is less than a second threshold value, at least one second distance of the electronic device at a target time is acquired.

[0014] In some embodiments, the electronic device is provided with a first acoustic-optic sensor, the wearable device is provided with a second acoustic-optic sensor, and the acquiring at least one second distance of the electronic device at the target time includes:

[0015] Acquire a first time point when the first acoustic and optical sensor transmits an acoustic and optical signal to the wearable device;

[0016] Acquire a second time point when the wearable device receives the sound and light signal;

[0017] At least one second distance of the electronic device at the target time is determined according to the first time point, the second time point and the propagation speed of the acoustic and optical signals.

[0018] In some embodiments, the wearable device includes a first component and a second component, the first component and the second component are relatively located on both sides of the user's face, and the at least one second distance includes two second distances, the two second distances are the distance of the electronic device relative to the first component and the distance of the electronic device relative to the second component;

[0019] The determining, according to the first distance and the at least one second distance, the location information of the electronic device at the target time includes:

[0020] Acquire a third distance between the first component and the second component;

[0021] Taking the center of the user's face as the origin, the position information of the electronic device relative to the origin at the target time is determined according to the first distance, the two second distances and the third distance.

[0022] In some embodiments, taking the center of the user's face as the origin and determining the position information of the electronic device relative to the origin at the target time according to the first distance, the two second distances and the third distance includes:

[0023] Taking the first distance as the coordinate value of the electronic device relative to the origin in the vertical direction at the target time; and,

[0024] According to the proportional relationship between the two second distances and the third distance, the coordinate value of the electronic device in the horizontal axis direction and the coordinate value in the vertical axis direction relative to the origin at the target time are determined.

[0025] In some embodiments, the electronic device is provided with a barometer, and obtaining a first distance between the electronic device and a reference surface at the target time includes:

[0026] The first distance between the electronic device and the reference surface at the target time is measured by the barometer.

[0027] In some embodiments, the electronic device is provided with a motion sensor, and determining the position information of the electronic device at the target time according to the first distance and the at least one second distance includes:

[0028] Collecting acceleration data and angular velocity data of the electronic device at the target time through the motion sensor;

[0029] Determining initial position information of the electronic device according to the acceleration data and the angular velocity data;

[0030] The initial position information is corrected according to the first distance and the at least one second distance to obtain the position information of the electronic device at the target time.

[0031] In some embodiments, the second distance is one, and determining the location information of the electronic device at the target time according to the first distance and the second distance includes:

[0032] Acquiring an initial position of the electronic device at an initial time by means of the motion sensor, wherein the initial time is a time when the acceleration value of the electronic device is less than a first threshold value and / or the angular velocity value is less than a second threshold value;

[0033] When it is determined that the second distance is the same as the distance between the electronic device and the wearable device at the initial moment, obtaining a moving speed of the electronic device from the initial position to the position at the target moment;

[0034] The location information of the electronic device at the target time is determined according to the first distance, the initial time, the target time and the moving speed.

[0035] In some embodiments, determining the location information of the electronic device at the target time according to the first distance, the initial time, the target time, and the moving speed includes:

[0036] determining a time difference between the initial time and the target time;

[0037] Acquiring, by means of the motion sensor, a moving direction of the electronic device from the initial position to the position at the target time;

[0038] Determine the displacement difference between the initial position and the position at the target time according to the time difference and the moving speed;

[0039] Taking the first distance as the coordinate value of the electronic device in the vertical direction at the target time;

[0040] The coordinate value of the electronic device in the horizontal axis direction and the coordinate value in the vertical axis direction at the target time are determined according to the initial position, the displacement difference and the moving direction.

[0041] The motion trajectory monitoring device provided in the embodiment of the present application includes:

[0042] an acquisition module, configured to acquire a first distance and at least one second distance of the electronic device at a target time, wherein the first distance is the distance between the electronic device and a reference surface at the target time, and the second distance is the distance between the electronic device and a wearable device at the target time, wherein the wearable device is a device worn by a user;

[0043] A first determining module, configured to determine the location information of the electronic device at the target time according to the first distance and the at least one second distance;

[0044] The second determination module is used to determine the movement trajectory of the user within the preset time period according to multiple position information corresponding to the preset time period, and the multiple position information is the position information corresponding to multiple consecutive target moments included in the preset time period.

[0045] The computer device provided in the embodiment of the present application includes a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, the method described in the embodiment of the present application is implemented.

[0046] The computer-readable storage medium provided in the embodiment of the present application stores a computer program thereon, and when the computer program is executed by a processor, the method provided in the embodiment of the present application is implemented.

[0047] The motion trajectory monitoring method, device, computer device and computer-readable storage medium provided in the embodiments of the present application obtain a first distance and at least one second distance of the electronic device at the target moment, where the first distance is the distance between the electronic device and a reference surface at the target moment, and the second distance is the distance between the electronic device and a wearable device worn by the user at the target moment; determine the position information of the electronic device at the target moment based on the first distance and the at least one second distance; and determine the motion trajectory of the user within the preset time length based on multiple position information corresponding to multiple consecutive target moments included in the preset time length.

[0048] The motion trajectory monitoring method provided in the embodiment of the present application can obtain at least one second distance between the electronic device and the wearable device, and obtain the first distance between the electronic device and the reference surface through the wearable device worn by the user as an auxiliary device when the user's motion is relatively slow and it is difficult to monitor the user's motion trajectory through the built-in motion sensor of the electronic device, and determine the current position information of the electronic device based on the first distance and at least one second distance. In this way, by obtaining the position information of multiple consecutive moments, the user's motion trajectory during this period can be determined, thereby realizing comprehensive monitoring of the user's motion trajectory and solving the technical problems raised in the background technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application.

[0050] Figure 1 An application scenario diagram of the motion trajectory monitoring method provided in an embodiment of the present application;

[0051] Figure 2 A schematic diagram of the implementation process of the motion trajectory monitoring method provided in the embodiment of the present application;

[0052] Figure 3 An application scenario diagram of the motion trajectory monitoring method provided in an embodiment of the present application;

[0053] Figure 4 A schematic diagram of the implementation process of the motion trajectory monitoring method provided in the embodiment of the present application;

[0054] Figure 5 A schematic diagram of the implementation flow of the distance acquisition method provided in the embodiment of the present application;

[0055] Figure 6 A schematic diagram of a distance acquisition method provided in an embodiment of the present application;

[0056] Figure 7A schematic diagram of the implementation flow of the location information determination method provided in an embodiment of the present application;

[0057] Figure 8 A schematic diagram of the implementation flow of the location information determination method provided in an embodiment of the present application;

[0058] Fig. 9 A schematic diagram of the implementation flow of the location information determination method provided in an embodiment of the present application;

[0059] Fig.10 A schematic diagram of the implementation flow of the location information determination method provided in an embodiment of the present application;

[0060] Fig.11 A schematic diagram of the implementation flow of the location information determination method provided in an embodiment of the present application;

[0061] Fig.12 A schematic diagram of the structure of the motion trajectory monitoring device provided in an embodiment of the present application;

[0062] Fig.13 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0063] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the specific technical solution of the present application will be further described in detail below in conjunction with the drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application, but are not used to limit the scope of the present application.

[0064] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0065] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0066] It should be pointed out that the terms "first\second\third" involved in the embodiments of the present application are used to distinguish similar or different objects, and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0067] An embodiment of the present application provides a motion trajectory monitoring method, which is applied to an electronic device. Figure 1FIG. 1 is an application scenario diagram of a motion trajectory monitoring method provided in an embodiment. Figure 1 As shown, the user can carry, wear or use an electronic device 10, which may include but is not limited to a mobile phone, a wearable device (such as a smart watch, a smart bracelet, smart glasses, etc.), a tablet computer, a laptop computer, a vehicle terminal, a PC (Personal Computer), etc. The function implemented by the method can be implemented by calling a program code by a processor in the electronic device, and of course the program code can be stored in a computer storage medium. It can be seen that the electronic device at least includes a processor and a storage medium.

[0068] Figure 2 The following is a schematic diagram of the implementation process of the motion trajectory monitoring method provided in the embodiment of the present application. Figure 2 As shown, the method may include the following steps 201 to 203:

[0069] Step 201, obtaining a first distance and at least one second distance of the electronic device at the target time, wherein the first distance is the distance between the electronic device and a reference surface at the target time, and the second distance is the distance between the electronic device and a wearable device at the target time, where the wearable device is a device worn by a user.

[0070] Understandably, electronic devices in the related art can generally monitor the relative motion in space in the electronic device through their built-in motion sensors, such as six-axis sensors. However, this monitoring method cannot effectively identify the action when the electronic device is moving at a uniform and slow speed, that is, when the acceleration of the electronic device in a straight line is insufficient. When users perform activities involving a large number of subtle and slow movements, such as Tai Chi, writing in the air, etc., they cannot be well identified by motion sensors.

[0071] Based on this, in an embodiment of the present application, a method for monitoring the location information of an electronic device by using a wearable device worn by a user as an auxiliary device is proposed to achieve comprehensive monitoring of the user's movement trajectory.

[0072] In the embodiments of the present application, there is no limitation on the specific type of wearable device, such as a smart headset, a smart bracelet, smart glasses, etc. The smart headset may include a wireless headset and a wired headset. Among them, the wireless headset may be an earbud-type, in-ear, head-mounted, earmuff-type or ear-hook-type headset. The wireless headset may include a first component and a second component worn on the left ear and right ear of the user, respectively. Among them, the first component and the second component may be connected by a connecting line, such as a neckband wireless headset; the first component and the second component may also be two independent parts, such as a true wireless stereo (TWS) headset.

[0073] In the embodiment of the present application, the number of second distances between the electronic device and the wearable device at the target time is related to the type of the wearable device. For example, when the wearable device is a smart headset or smart glasses, the second distance may be the distance between the electronic device and the components located on both sides of the user's face, that is, the second distance may be two; when the wearable device is VR glasses, the second distance may be the distance between the electronic device and the center point of the wearable device, that is, the second distance is one.

[0074] In the embodiment of the present application, there is no limitation on the specific type of the reference plane. For example, the reference plane may be the ground, and the first distance is the distance between the electronic device and the ground.

[0075] It should be noted that, in order to facilitate the implementation of the motion trajectory monitoring method provided in the embodiments of the present application, in some embodiments, the electronic device can be used as a storage device for the wearable device. Figure 3 As shown, the electronic device is a watch, and the wearable device is an earphone. The watch can be used as a storage device for the earphone, and the wireless earphone can be stored in the watch as a whole. In this way, it is convenient for users to carry and facilitate the implementation of the motion trajectory monitoring method provided in this application.

[0076] Step 202: Determine location information of the electronic device at a target time according to the first distance and at least one second distance.

[0077] After obtaining a first distance between the electronic device and the reference surface at the target time, and at least one second distance between the electronic device and the wearable device at the target time, the position information (x, y, z) of the electronic device at the target time can be determined based on the above distance values.

[0078] It should be noted that the type of location information of the electronic device at the target time is not limited in the embodiments of the present application. For example, the location information may be relative location information or absolute location information. When the location information is relative location information, the location information of the electronic device at the target time may be the relative location information of the electronic device relative to the wearable device at the target time; when the location information is absolute location information, the location information of the electronic device at the target time may be the absolute location information of the electronic device relative to the earth coordinate system at the target time.

[0079] In the embodiment of the present application, the number of the second distances is not limited, and the second distance may be one, two, or more.

[0080] When the second distance is two, step 202 may be implemented by executing steps 701 to 702 in the following embodiment.

[0081] When the second distance is one, step 202 may be implemented by executing steps 801 to 802 in the following embodiment.

[0082] Alternatively, in some embodiments, step 202 may also be implemented by executing steps 1101 to 1103 in the following embodiments.

[0083] Step 203, determining the user's motion trajectory within the preset time length according to the multiple position information corresponding to the preset time length, where the multiple position information is the position information corresponding to multiple consecutive target moments included in the preset time length.

[0084] Here, the method of obtaining the position information corresponding to each target moment is the same as the method described in the above steps 201 to 202. After obtaining the position information corresponding to multiple target moments within the preset time, the user's movement trajectory within the preset time can be determined based on the continuous change of the position information.

[0085] In the embodiment of the present application, by obtaining the first distance and at least one second distance of the electronic device at the target moment, the first distance is the distance between the electronic device and the reference surface at the target moment, and the second distance is the distance between the electronic device and the wearable device at the target moment; according to the first distance and at least one second distance, the position information of the electronic device at the target moment is determined; according to the multiple position information corresponding to the multiple consecutive target moments included in the preset time length, the user's motion trajectory within the preset time length is determined. In this way, when the user's movements are relatively slow and it is difficult to monitor the user's motion trajectory through the built-in motion sensor of the electronic device, the user's motion trajectory can be determined based on the acquired distance between the electronic device and the wearable device and the distance between the electronic device and the reference surface, thereby realizing comprehensive monitoring of the user's motion trajectory.

[0086] Figure 4 The following is a schematic diagram of the implementation process of the motion trajectory monitoring method provided in the embodiment of the present application. Figure 4 As shown, the method may include the following steps 401 to 406:

[0087] Step 401: collect acceleration data and angular velocity data of the electronic device at a target time through a motion sensor provided in the electronic device.

[0088] In the embodiment of the present application, there is no limitation on the specific type of the motion sensor. For example, the motion sensor may be an acceleration sensor, a gyroscope sensor, a six-axis sensor, etc.

[0089] In a preferred embodiment, the motion sensor may be a six-axis sensor. The so-called six-axis sensor refers to an integration of a three-axis acceleration sensor and a three-axis gyro sensor to detect acceleration data and angular velocity data of an object, thereby calculating the real-time position information of the object.

[0090] Step 402: Determine the acceleration value and angular velocity value of the electronic device according to the acceleration data and the angular velocity data.

[0091] After the acceleration data and angular velocity data of the electronic device at the target time are collected, the acceleration value of the electronic device at the target time can be determined according to the acceleration data, and the angular velocity value of the electronic device at the target time can be determined according to the angular velocity data.

[0092] Step 403: When the acceleration value is less than the first threshold value and / or the angular velocity value is less than the second threshold value, obtaining at least one second distance of the electronic device at the target time.

[0093] It is understandable that when a user uses an electronic device to perform uniform linear motion, such as when the user is doing Tai Chi or writing in the air, the acceleration value during the motion tends to 0, or the angular velocity value tends to 0. In this case, it is impossible to obtain valid acceleration values ​​and / or angular velocity values ​​by relying solely on the motion sensor, and it is also impossible to directly determine the position information of the electronic device at the target time based on the motion sensor.

[0094] Based on this, in an embodiment of the present application, when the motion sensor detects that the acceleration value of the electronic device at the target moment is small, and / or the angular velocity value is small, at least one second distance of the electronic device at the target moment and the first distance between the electronic device and the reference surface at the target moment can be obtained, thereby determining the position information of the electronic device at the target moment based on the at least one second distance and the first distance.

[0095] Here, there is no limitation on the values ​​of the first threshold and the second threshold, which can be set arbitrarily according to actual needs. For example, in a preferred embodiment, both the first threshold and the second threshold can be set to 0.

[0096] In some embodiments, the electronic device is provided with a first acoustic and optical sensor, and the wearable device is provided with a second acoustic and optical sensor. To obtain at least one second distance of the electronic device at the target time, steps 501 to 503 in the following embodiments can be performed:

[0097] Step 501: Obtain a first time point when a first acoustic-optical sensor transmits an acoustic-optical signal to a wearable device.

[0098] In the embodiment of the present application, the type of the acoustic and optical sensor is not limited, for example, the acoustic and optical sensor may be an ultrasonic sensor, or the acoustic and optical sensor may also be a light sensor, etc. Among them, the ultrasonic sensor may emit ultrasonic waves, and the light sensor may emit light.

[0099] In some embodiments, the wearable device may also be provided with a processor, a wireless connection module, an audio module and a power module; the electronic device may also be provided with a processor, a wireless connection module, a touch screen, a power module, etc.

[0100] In this way, Figure 6 As shown, after the electronic device 601 collects acceleration data and angular velocity data based on the motion sensor, the acceleration value and angular velocity value of the electronic device 601 can be determined by the processor, and when the acceleration value is less than a first threshold value and / or the angular velocity value is less than a second threshold value, the first sound and light sensor is turned on to transmit a sound wave signal or a light signal to the wearable device 602, and the first time point when the sound wave signal or the light signal is transmitted is recorded.

[0101] Step 502, obtaining a second time point when the wearable device receives the sound and light signal.

[0102] Here, when the wearable device receives the sound and light signal emitted by the electronic device based on the second sound and light sensor set by the wearable device, a second time point (receiving time point) is generated and the second time point can be fed back to the electronic device.

[0103] In an embodiment of the present application, the wearable device can maintain a communication connection with the electronic device through wireless communication technology. Here, the specific type of wireless communication technology is not limited. For example, the wireless communication technology can be Bluetooth (bluetooth, BT), such as traditional Bluetooth or low-power BLE Bluetooth; it can also be a wireless local area network (wireless local area networks, WLAN), such as a wireless fidelity (wireless fidelity, WiFi) network; it can also be Zigbee, frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR), or general 2.4G / 5G frequency band wireless communication technology communication technology, etc.

[0104] Step 503: Determine at least one second distance of the electronic device at the target time according to the first time point, the second time point and the propagation speed of the acoustic and optical signals.

[0105] It can be understood that the transmission speed of the sound wave signal or the light signal is fixed. In this way, when the electronic device receives the second time point feedback from the wearable device, it can calculate at least one second distance between the target time in the electronic device and the wearable device based on the acquired first time point, the second time point and the propagation speed of the sound and light signal.

[0106] Step 404: Obtain a first distance between the electronic device and the reference surface at the target time.

[0107] In some embodiments, a barometer may also be provided in the electronic device, so that the first distance between the electronic device and the reference surface at the target time can be measured by the barometer.

[0108] In a preferred embodiment, the reference surface is the ground, and the first distance is the distance between the electronic device and the ground at the target time.

[0109] Step 405: Determine the location information of the electronic device at the target time according to the first distance and at least one second distance.

[0110] In the embodiment of the present application, the number of the second distances is not limited, and the second distance may be one, two, or more.

[0111] Among them, when the second distance is two, such as Figure 6 As shown, the two second distances are the distance between the electronic device and the first component and the distance between the electronic device and the second component. The first component and the second component are components in the wearable device, and the first component and the second component are relatively located on both sides of the user's face.

[0112] Based on this, step 405 can be implemented by executing steps 701 to 702 in the following embodiment:

[0113] Step 701, obtaining a third distance between a first component and a second component.

[0114] In the embodiment of the present application, the method for obtaining the third distance between the first component and the second component is not limited. For example, in an optional embodiment, a sensor for detecting distance can also be provided in the first component and the second component to accurately measure the third distance between the first component and the second component.

[0115] In another optional embodiment, if the first component and the second component are small in volume, the distance between the two sides of the user's face can be used as the third distance. When obtaining the distance between the two sides of the user's face, it can be obtained through human factors big data analysis.

[0116] Step 702, taking the center of the user's face as the origin, and determining the position information of the electronic device relative to the origin at the target time according to the first distance, the two second distances and the third distance.

[0117] In the embodiment of the present application, the determined position information of the electronic device may be relative position information of the electronic device relative to a fixed point, or may be absolute position information of the electronic device relative to a geodetic coordinate system.

[0118] Here, the position information of the electronic device is taken as relative position information as an example for explanation. Assuming that the user's head remains relatively stable, the user's facial center can be used as the origin to determine the position information of the electronic device relative to the user's facial center at the target moment.

[0119] In some embodiments, step 702 may be implemented by executing steps 801 to 802 in the following embodiments:

[0120] Step 801: taking the first distance as the vertical coordinate value of the electronic device relative to the origin at the target time.

[0121] Please refer to Figure 6 The first distance may be the distance between the electronic device and the ground at the target moment, which may be used as the vertical coordinate z of the electronic device at the target moment.

[0122] Step 802: Determine the coordinate value of the electronic device in the horizontal axis direction and the coordinate value in the vertical axis direction relative to the origin at the target time according to the proportional relationship between the two second distances and the third distance.

[0123] Please continue to refer to Figure 6 , the two second distances are the distances between the electronic device and the wearable device (two earphones), and the third distance is the distance between the wearable devices (two earphones). After obtaining these three distances, the coordinate value x in the horizontal axis direction and the coordinate value y in the vertical axis direction of the electronic device relative to the origin at the target time can be determined based on the triangle formed by the three distances and the proportional relationship between the three distances.

[0124] When the second distance is one, step 405 can be implemented by executing steps 901 to 903 in the following embodiment:

[0125] Step 901, obtaining an initial position of the electronic device at an initial moment through a motion sensor provided in the electronic device, where the initial moment is a moment when the acceleration value of the electronic device is less than a first threshold value and / or the angular velocity value is less than a second threshold value.

[0126] It is understandable that if the wearable device is identified as a separate module, there is only one first distance between the electronic device and the wearable device. In this case, if only one first distance is relied upon, the position information of the electronic device at the target time cannot be determined.

[0127] Based on this, in an embodiment of the present application, when there is only one second distance, and when the electronic device detects that its current acceleration value and / or angular velocity value is small based on the motion sensor, then this moment can be used as the initial moment for executing the motion trajectory monitoring method provided in the embodiment of the present application, and the initial position of the electronic device at this initial moment is determined through the motion sensor, and the initial position is used as a reference position to determine the position information of the electronic device at the target moment based on the acquired first distance and initial position.

[0128] Step 902: When it is determined that the second distance is the same as the distance between the electronic device and the wearable device at the initial moment, obtain a moving speed of the electronic device from the initial position to the position at the target moment.

[0129] It should be noted that in this embodiment, the distance between the electronic device and the wearable device at the initial moment can be considered to be the same as the second distance between the electronic device and the wearable device at the target moment, that is, the motion trajectory of the electronic device is a circular motion with the user as the center point.

[0130] In this case, the moving speed of the electronic device from the initial position to the position at the target time can be obtained.

[0131] Step 903: Determine the location information of the electronic device at the target time according to the first distance, the initial time, the target time and the moving speed.

[0132] In some embodiments, step 903 may also be implemented by executing steps 1001 to 1004 in the following embodiments:

[0133] Step 1001, determine the time difference between the initial time and the target time.

[0134] Here, the time difference between the initial time and the target time is the moving time length of the electronic device from the initial position to the position at the target time.

[0135] Step 1002: Acquire the moving direction of the electronic device from the initial position to the position at the target time through a motion sensor.

[0136] Step 1003, determining the displacement difference between the initial position and the position at the target time according to the time difference and the moving speed.

[0137] Step 1004, taking the first distance as the vertical coordinate value of the electronic device at the target time, and determining the horizontal and vertical coordinate values ​​of the electronic device at the target time according to the initial position, displacement difference and moving direction.

[0138] Here, after obtaining the displacement difference of the electronic device from the initial position to the position at the target moment, that is, the moving distance of the electronic device, the coordinate value x of the electronic device in the horizontal axis direction and the coordinate value y of the electronic device in the vertical axis direction at the target moment can be determined based on the moving distance, the initial position and the moving direction of the electronic device.

[0139] In some embodiments, to improve the calculation accuracy of the location information of the electronic device at the target time, step 405 may also be implemented by executing steps 1101 to 1103 in the following embodiments:

[0140] Step 1101, collecting acceleration data and angular velocity data of the electronic device at the target time through a motion sensor.

[0141] Step 1102: Determine the initial position information of the electronic device according to the acceleration data and the angular velocity data.

[0142] Step 1103: Correct the initial position information according to the first distance and at least one second distance to obtain the position information of the electronic device at the target time.

[0143] Here, an initial position information of the electronic device at the target moment can be first determined based on the motion sensor. If the initial position information is not accurate enough, after obtaining a first distance between the electronic device and the reference surface at the target moment, and at least one second distance between the electronic device and the wearable device at the target moment, the initial position information can be corrected based on the first distance and at least one second distance to obtain the position information of the electronic device at the target moment, thereby improving the calculation accuracy of the position information of the electronic device at the target moment and improving the positioning accuracy.

[0144] Step 406, determining the user's motion trajectory within the preset time length according to the multiple position information corresponding to the preset time length, where the multiple position information is the position information corresponding to multiple consecutive target moments included in the preset time length.

[0145] In an embodiment of the present application, when the acceleration value and / or angular velocity value of the electronic device is determined to be small based on the motion sensor provided in the electronic device, the first distance between the electronic device and the reference surface at the target time, and at least one second distance between the electronic device and the wearable device at the target time can be obtained, and the position information at the target time can be determined based on the above distances, thereby determining the user's motion trajectory based on multiple position information. In this way, when the user's movements are relatively slow and it is difficult to monitor the user's motion trajectory through the built-in motion sensor of the electronic device, the user's motion trajectory can be determined based on the distance between the electronic device and the wearable device and the distance between the electronic device and the reference surface, thereby achieving comprehensive monitoring of the user's motion trajectory.

[0146] It should be understood that, although the steps in the above-mentioned flowcharts are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the above-mentioned flowcharts may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0147] Based on the foregoing embodiments, an embodiment of the present application provides a motion trajectory monitoring device, which includes the modules included and the units included in the modules, which can be implemented by a processor; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0148] Fig.12 A schematic diagram of the structure of the motion trajectory monitoring device provided in the embodiment of the present application is shown in FIG. Fig.12 As shown, the device 1200 includes an acquisition module 1201, a first determination module 1202 and a second determination module 1203, wherein:

[0149] An acquisition module 1201 is used to acquire a first distance and at least one second distance of the electronic device at a target time, wherein the first distance is the distance between the electronic device and a reference surface at the target time, and the second distance is the distance between the electronic device and a wearable device at the target time, wherein the wearable device is a device worn by a user;

[0150] A first determining module 1202, configured to determine the location information of the electronic device at the target time according to the first distance and the at least one second distance;

[0151] The second determination module 1203 is used to determine the movement trajectory of the user within the preset time period according to multiple position information corresponding to the preset time period, and the multiple position information is the position information corresponding to multiple consecutive target moments included in the preset time period.

[0152] In some embodiments, a motion sensor is provided in the electronic device, and the device also includes a collection module, wherein the collection module is used to collect acceleration data and angular velocity data of the electronic device at the target moment through the motion sensor; the acquisition module is specifically used to determine the acceleration value and angular velocity value of the electronic device based on the acceleration data and the angular velocity data; when the acceleration value is less than a first threshold value and / or the angular velocity value is less than a second threshold value, obtain at least one second distance of the electronic device at the target moment.

[0153] In some embodiments, a first acoustic-optic sensor is provided in the electronic device, and a second acoustic-optic sensor is provided in the wearable device. The acquisition module 1201 is specifically used to obtain a first time point when the first acoustic-optic sensor transmits an acoustic-optic signal to the wearable device; obtain a second time point when the wearable device receives the acoustic-optic signal; and determine at least one second distance of the electronic device at the target time according to the first time point, the second time point and the propagation speed of the acoustic-optic signal.

[0154] In some embodiments, the wearable device includes a first component and a second component, the first component and the second component are relatively located on both sides of the user's face, the at least one second distance includes two second distances, the two second distances are the distance of the electronic device relative to the first component and the distance of the electronic device relative to the second component; the acquisition module 1201 is also used to obtain a third distance between the first component and the second component; the first determination module 1202 is specifically used to determine the position information of the electronic device relative to the origin at the target moment based on the first distance, the two second distances and the third distance, with the center of the user's face as the origin.

[0155] In some embodiments, the first determination module 1202 is specifically used to use the first distance as the coordinate value of the electronic device in the vertical direction relative to the origin at the target moment; and determine the coordinate value of the electronic device in the horizontal direction and the coordinate value in the vertical direction relative to the origin at the target moment based on the proportional relationship between the two second distances and the third distance.

[0156] In some embodiments, the electronic device is provided with a barometer, and the acquisition module 1201 is specifically configured to measure a first distance between the electronic device and a reference surface at the target time by using the barometer.

[0157] In some embodiments, the electronic device is provided with a motion sensor, and the acquisition module is used to acquire the acceleration data and angular velocity data of the electronic device at the target moment through the motion sensor; the first determination module 1202 is specifically used to determine the initial position information of the electronic device according to the acceleration data and the angular velocity data; according to the first distance and the at least one second distance, the initial position information is corrected to obtain the position information of the electronic device at the target moment.

[0158] In some embodiments, the second distance is one, and the acquisition module 1201 is further used to acquire the initial position of the electronic device at an initial moment through the motion sensor, and the initial moment is the moment when the acceleration value of the electronic device is less than the first threshold value and / or the angular velocity value is less than the second threshold value; when it is determined that the second distance is the same as the distance between the electronic device and the wearable device at the initial moment, acquire the moving speed of the electronic device from the initial position to the position at the target moment;

[0159] The first determining module 1201 is further configured to determine the location information of the electronic device at the target time according to the first distance, the initial time, the target time and the moving speed.

[0160] In some embodiments, the first determination module 1201 is specifically used to determine the time difference between the initial moment and the target moment; obtain the moving direction of the electronic device from the initial position to the position at the target moment through the motion sensor; determine the displacement difference between the initial position and the position at the target moment according to the time difference and the moving speed; use the first distance as the vertical coordinate value of the electronic device at the target moment; determine the coordinate value of the electronic device in the horizontal direction and the coordinate value in the vertical direction at the target moment according to the initial position, the displacement difference and the moving direction.

[0161] The description of the above device embodiment is similar to the description of the above method embodiment, and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of the present application, please refer to the description of the method embodiment of the present application for understanding.

[0162] It should be noted that in the embodiments of this application Fig.12The division of modules in the motion trajectory monitoring device shown is schematic and is only a logical functional division. There may be other division methods in actual implementation. In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or it can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit. It can also be implemented in the form of a combination of software and hardware.

[0163] It should be noted that in the embodiment of the present application, if the above method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application can be essentially or partly embodied in the form of a software product that contributes to the relevant technology. The computer software product is stored in a storage medium, including several instructions to enable an electronic device to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific combination of hardware and software.

[0164] The embodiment of the present application provides a computer device, which may be a server, and its internal structure diagram may be as follows: Fig.13 As shown. The computer device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, the above method is implemented.

[0165] An embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps in the method provided in the above embodiment are implemented.

[0166] An embodiment of the present application provides a computer program product including instructions, which, when executed on a computer, enables the computer to execute the steps of the method provided in the above method embodiment.

[0167] Those skilled in the art will understand that Fig.13The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0168] In one embodiment, the motion trajectory monitoring device provided by the present application can be implemented in the form of a computer program. The computer program can be Fig.13 The computer device shown in the figure can be run. The memory of the computer device can store various program modules constituting the above-mentioned device. The computer program composed of various program modules enables the processor to execute the steps of the method of each embodiment of the present application described in this specification.

[0169] It should be noted here that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium, storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0170] It should be understood that "one embodiment" or "an embodiment" or "some embodiments" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in one embodiment" or "in some embodiments" appearing throughout the specification may not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments. The above description of each embodiment tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. For the sake of brevity, this article will not repeat them.

[0171] The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there may be three relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist at the same time, and object B exists alone.

[0172] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0173] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as: multiple modules or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or modules can be electrical, mechanical or other forms.

[0174] The modules described above as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules; they may be located in one place or distributed on multiple network units; some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0175] In addition, all functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may be a separate unit, or two or more modules may be integrated into one unit; the above-mentioned integrated modules may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0176] A person skilled in the art can understand that all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, etc., various media that can store program codes.

[0177] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling an electronic device to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0178] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0179] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0180] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0181] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A motion trajectory monitoring method, characterized in that: Applied to electronic equipment, the method comprises: Acquire a first distance and at least one second distance of the electronic device at a target time, wherein the first distance is the distance between the electronic device and a reference surface at the target time, and the second distance is the distance between the electronic device and a wearable device at the target time, wherein the wearable device is a device worn by a user; Determine the location information of the electronic device at the target time according to the first distance and the at least one second distance; According to a plurality of position information corresponding to a preset time length, a movement trajectory of the user within the preset time length is determined, wherein the plurality of position information is position information corresponding to a plurality of consecutive target moments included in the preset time length.

2. The method according to claim 1, characterized in that The electronic device is provided with a motion sensor, and before acquiring at least one second distance of the electronic device at the target time, the method further includes: Collecting acceleration data and angular velocity data of the electronic device at the target time by the motion sensor; Determining an acceleration value and an angular velocity value of the electronic device according to the acceleration data and the angular velocity data; When the acceleration value is less than a first threshold value and / or the angular velocity value is less than a second threshold value, at least one second distance of the electronic device at a target time is acquired.

3. The method according to claim 1 or 2, characterized in that: The electronic device is provided with a first acoustic-optic sensor, the wearable device is provided with a second acoustic-optic sensor, and the acquiring at least one second distance of the electronic device at a target time includes: Acquire a first time point when the first acoustic and optical sensor transmits an acoustic and optical signal to the wearable device; Acquire a second time point when the wearable device receives the sound and light signal; At least one second distance of the electronic device at the target time is determined according to the first time point, the second time point and the propagation speed of the acoustic and optical signals.

4. The method according to claim 3, characterized in that The wearable device includes a first component and a second component, the first component and the second component are relatively located on both sides of the user's face, the at least one second distance includes two second distances, and the two second distances are the distance of the electronic device relative to the first component and the distance of the electronic device relative to the second component; The determining, according to the first distance and the at least one second distance, the location information of the electronic device at the target time includes: Acquire a third distance between the first component and the second component; Taking the center of the user's face as the origin, the position information of the electronic device relative to the origin at the target time is determined according to the first distance, the two second distances and the third distance.

5. The method according to claim 4, characterized in that The method of taking the center of the user's face as the origin and determining the position information of the electronic device relative to the origin at the target time according to the first distance, the two second distances and the third distance includes: Taking the first distance as the coordinate value of the electronic device relative to the origin in the vertical direction at the target time; and, According to the proportional relationship between the two second distances and the third distance, the coordinate value of the electronic device in the horizontal axis direction and the coordinate value in the vertical axis direction relative to the origin at the target time are determined.

6. The method according to claim 1, characterized in that The electronic device is provided with a barometer, and obtaining a first distance between the electronic device and a reference surface at the target time includes: The barometer is used to measure a first distance between the electronic device and a reference surface at the target time.

7. The method according to claim 1, characterized in that The electronic device is provided with a motion sensor, and determining the position information of the electronic device at the target time according to the first distance and the at least one second distance includes: Collecting acceleration data and angular velocity data of the electronic device at the target time through the motion sensor; Determining initial position information of the electronic device according to the acceleration data and the angular velocity data; The initial position information is corrected according to the first distance and the at least one second distance to obtain the position information of the electronic device at the target time.

8. The method according to claim 2, characterized in that: The second distance is one, and determining the location information of the electronic device at the target time according to the first distance and the second distance includes: Acquiring an initial position of the electronic device at an initial time by means of the motion sensor, wherein the initial time is a time when the acceleration value of the electronic device is less than a first threshold value and / or the angular velocity value is less than a second threshold value; When it is determined that the second distance is the same as the distance between the electronic device and the wearable device at the initial moment, obtaining a moving speed of the electronic device from the initial position to the position at the target moment; The location information of the electronic device at the target time is determined according to the first distance, the initial time, the target time and the moving speed.

9. The method according to claim 8, characterized in that The determining, according to the first distance, the initial time, the target time, and the moving speed, the location information of the electronic device at the target time includes: determining a time difference between the initial time and the target time; Acquiring, by means of the motion sensor, a moving direction of the electronic device from the initial position to the position at the target time; Determine the displacement difference between the initial position and the position at the target time according to the time difference and the moving speed; Taking the first distance as the coordinate value of the electronic device in the vertical direction at the target time; The coordinate value of the electronic device in the horizontal axis direction and the coordinate value in the vertical axis direction at the target time are determined according to the initial position, the displacement difference and the moving direction.

10. A motion trajectory monitoring device, characterized in that: include: an acquisition module, configured to acquire a first distance and at least one second distance of the electronic device at a target time, wherein the first distance is the distance between the electronic device and a reference surface at the target time, and the second distance is the distance between the electronic device and a wearable device at the target time, wherein the wearable device is a device worn by a user; A first determining module, configured to determine the location information of the electronic device at the target time according to the first distance and the at least one second distance; The second determination module is used to determine the movement trajectory of the user within the preset time period according to multiple position information corresponding to the preset time period, and the multiple position information is the position information corresponding to multiple consecutive target moments included in the preset time period.

11. A computer device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, characterized in that: When the processor executes the program, the steps of the method according to any one of claims 1 to 9 are implemented.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

Images