Intelligent equipment searching method and device, computer equipment and storage medium

Abstract

The embodiment of the invention provides an intelligent equipment searching method and device, computer equipment and a storage medium. The method is applied to the intelligent mobile terminal, and comprises the following steps: sending a group of sound wave searching signals by using a built-in loudspeaker of the intelligent mobile terminal; obtaining angle information of each frame of sent sound wave search signal by using an inertial measurement unit arranged in the intelligent mobile terminal, and determining energy intensity of each frame of sound wave search signal based on recording data fed back by the intelligent equipment; wherein the recording data is fed back to the intelligent mobile terminal after a microphone of the intelligent equipment monitors the sound wave searching signal; and determining the angle information corresponding to the sound wave searching signal with the maximum energy intensity as the orientation of the intelligent equipment. According to the technical scheme provided by the embodiment of the invention, the convenience of finding the intelligent equipment by a user through the intelligent mobile terminal can be improved to a certain extent.

Description

Technical Field

[0001] The embodiments of this specification relate to the field of device search, and specifically to a method, apparatus, computer device and storage medium for searching a smart device. Background Art

[0002] Currently, there are more and more users of small electronic devices such as Bluetooth headsets. However, since these small smart devices are often forgotten in places where users cannot find them, users need to spend a long time to find them. In the prior art, the method of finding small smart devices such as headsets can determine the distance between the smart mobile terminal and the small electronic device based on the strength of the Bluetooth signal. However, this distance-based calculation method cannot indicate the direction of the small electronic device, so the user needs to walk around to clearly know the distance between the smart mobile terminal and the small electronic device, so as to find the small electronic device. Summary of the invention

[0003] In view of this, multiple embodiments of this specification are dedicated to providing an ultrasound-based software activation method, apparatus, computer device, storage medium and computer program product to improve the convenience of users using smart mobile terminals to find smart devices to a certain extent.

[0004] The embodiment of this specification proposes a method for searching a smart device, which is applied to a smart mobile terminal, and the method includes: using a built-in speaker of the smart mobile terminal to send a group of sound wave search signals; using a built-in inertial measurement unit of the smart mobile terminal to obtain angle information of each frame of the sound wave search signal sent; determining the energy intensity of each frame of the sound wave search signal based on the recording data fed back by the smart device; wherein the recording data is the data fed back to the smart mobile terminal by the microphone of the smart device after detecting the sound wave search signal; and determining the angle information corresponding to the sound wave search signal with the largest energy intensity as the orientation of the smart device.

[0005] The implementation mode of this specification proposes a method for searching a smart device, which is applied to a smart device, wherein the smart device includes a microphone, and the method includes: using the microphone of the smart device to receive a group of sound wave search signals sent by a smart mobile terminal; feeding back the sound wave search signal to the smart mobile terminal, so that the smart mobile terminal determines the direction of the smart device according to the energy intensity of the received sound wave search signal.

[0006] The embodiment of this specification proposes a searching device for a smart device, which is applied to a smart mobile terminal, and the searching device for a smart device comprises: a signal sending module, which is used to send a group of sound wave search signals by using a built-in speaker of the smart mobile terminal; an angle acquisition module, which is used to obtain the angle information of each frame of the sound wave search signal sent by using an inertial measurement unit built into the smart mobile terminal; an intensity determination module, which is used to determine the energy intensity of each frame of the sound wave search signal based on the recording data fed back by the smart device; wherein the recording data is the data fed back to the smart mobile terminal by the microphone of the smart device after detecting the sound wave search signal; and an orientation determination module, which is used to determine the angle information corresponding to the sound wave search signal with the largest energy intensity as the orientation of the smart device.

[0007] The implementation mode of this specification proposes a searching device for a smart device, which is applied to a smart device, and the searching device for a smart device comprises: a signal receiving module, which is used to receive a set of sound wave search signals sent by a smart mobile terminal using a microphone of the smart device; and a signal feedback module, which is used to feed back the sound wave search signal to the smart mobile terminal, so that the smart mobile terminal determines the direction of the smart device according to the energy intensity of the received sound wave search signal.

[0008] An embodiment of the present specification provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the method described in the above embodiment when executing the computer program.

[0009] The embodiments of this specification provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the method described in the above embodiments is implemented.

[0010] The embodiments of this specification provide a computer program product, including computer instructions, and the computer instructions are used to enable a computer to execute the method described in the above embodiments.

[0011] The implementation method of this specification sends a sound wave signal and then uses the inertial measurement unit built into the smart mobile terminal to obtain the angle information when the smart mobile terminal sends each frame of the sound wave signal. After receiving the sound wave signal, the smart device can record the sound wave signal and transmit it to the smart mobile terminal. The smart mobile terminal can analyze the energy of the received recording, and determine the angle information corresponding to the frame of ultrasonic signal with the strongest energy as the orientation of the smart device, and then find the smart device based on the orientation, so that the orientation information of the smart device can be directly obtained without the user walking around to perceive, which improves the convenience of users using smart mobile terminals to find smart devices to a certain extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 Shown is a schematic flow chart of a method for searching a smart device provided in one embodiment.

[0013] Figure 2 Shown is a schematic diagram of a process of searching for a smart device provided by another embodiment.

[0014] Figure 3 Shown is a schematic diagram of a searching device for a smart device provided in one embodiment.

[0015] Figure 4 Shown is a schematic diagram of a searching device for a smart device provided in another embodiment.

[0016] Figure 5 Shown is a schematic diagram of a computer device provided by an embodiment. DETAILED DESCRIPTION

[0017] In order to enable those skilled in the art to better understand the solution of this specification, the technical solution in the implementation of this specification will be clearly and completely described below in conjunction with the drawings in the implementation of this specification. Obviously, the described implementation is only a part of the implementation of this specification, not all of the implementations. Based on the implementation in this specification, all other implementations obtained by ordinary technicians in this field without creative work are within the scope of protection of this specification.

[0018] At present, there are more and more users of smaller electronic devices such as Bluetooth headsets. However, since these small smart devices are often forgotten in places where users cannot find them, users need to spend a long time looking for them. In the prior art, the method of finding small smart devices such as headsets can determine the distance between the smart mobile terminal and the small electronic device based on the strength of the Bluetooth signal. However, this distance-based calculation method cannot indicate the direction of the small electronic device, so the user needs to walk around to know in which direction the small smart device is, so as to find the small electronic device. Another way is to let the Bluetooth headset make a sound, and then the user uses the ear to distinguish in which direction the headset is. However, since the volume of the headset is generally low, it is sometimes difficult for the user to distinguish in which direction the headset is.

[0019] Therefore, the implementation manner of this specification proposes a method for finding a smart device using angle information, which can improve the convenience of users finding smart devices using smart mobile terminals to a certain extent, thereby improving user experience.

[0020] See also Figure 1The embodiment of this specification provides a method for searching a smart device, which is applied to a smart mobile terminal and may include the following steps.

[0021] Step S110: using the built-in speaker of the smart mobile terminal to send a set of sound wave search signals.

[0022] In this embodiment, the smart mobile terminal can be a relatively light smart device such as a mobile phone, a tablet computer, a smart watch, a smart ring, etc. The smart mobile terminal has a built-in inertial measurement unit (IMU), which can obtain the motion posture data of the smart mobile terminal. The smart device can be a small electronic device such as a smart headset and a smart pen.

[0023] In this embodiment, the sound wave search signal is a group of sound wave signals sent by the smart mobile terminal, and the group of sound wave signals may include multiple frames of sound signals.

[0024] Step S120: using the inertial measurement unit built into the smart mobile terminal to obtain the angle information of each frame of the sound wave search signal sent.

[0025] In this embodiment, IMU is a powerful tool that can measure and track the motion and posture of an object in real time and is widely used in various fields. By combining sensors such as accelerometers, gyroscopes and magnetometers, it can provide very accurate motion detection. IMU is usually composed of the following sensors: Accelerometer: used to measure the linear acceleration of an object in all directions (for example, acceleration along the X, Y, and Z axes). Through the accelerometer, the IMU can sense the movement, tilt angle and gravity changes of the object. Gyroscope: used to measure the angular velocity of an object, that is, the rotation speed of an object around a specific axis. Through the gyroscope, the IMU can obtain the rotation information of the object (such as rotation around the X-axis, Y-axis, and Z-axis). Magnetometer: used to measure the magnetic field strength around an object and can be used to determine the direction of the object. IMU collects data from sensors such as accelerometers and gyroscopes, combined with advanced algorithms (such as Kalman filters, complementary filters, etc.), and calculates the motion state and direction of the object in real time. The accelerometer can measure the linear acceleration of an object. Based on these acceleration data, the speed and position of the object can be calculated. The gyroscope can provide the rotation speed of an object. By integrating these angular velocity data, the angular (attitude) change of the object can be calculated. The magnetometer can provide the orientation of the object relative to the earth's magnetic field by measuring the strength and direction of the earth's magnetic field, thereby helping to correct the errors of the accelerometer and gyroscope, especially in the long-term use process, to avoid drift.

[0026] In this embodiment, while sending the sound wave search signal, each frame of the sound wave signal can correspond to an angle information, and then the frame of the sound wave signal and the angle information can be stored correspondingly for use in subsequent steps.

[0027] Step S130: determining the energy intensity of each frame of the sound wave search signal based on the recording data fed back by the smart device; wherein the recording data is fed back to the smart mobile terminal by the microphone of the smart device after detecting the sound wave search signal.

[0028] In this embodiment, the smart device keeps the microphone in a listening state, and after receiving the sound wave search signal, the sound wave search signal can be recorded, and then the recorded sound wave search signal is fed back to the smart mobile terminal via Bluetooth or WiFi. After receiving the recording data, the smart mobile terminal will perform energy intensity analysis on the sound wave search signals and determine the energy intensity of each frame of the ultrasonic search signal.

[0029] Step S140: determining the angle information corresponding to the sound wave search signal with the largest energy intensity as the position of the smart device.

[0030] In this embodiment, since sound waves lose energy during propagation and are converted into heat energy, the closer the distance between the smart device and the smart mobile terminal is, the greater the energy intensity is. The angle of the sound wave search signal sent when the user holds the smart mobile terminal and swings it is constantly changing. When the energy recorded by the smart device is the strongest, it means that the distance between the smart mobile terminal and the smart device is the smallest. At this time, the direction indicated by the speaker of the mobile terminal is the direction of the smart device. Therefore, the user can find the smart device in this direction without having to walk around and then judge where the device is based on the energy of the Bluetooth signal, which improves the efficiency and convenience of users finding smart devices to a certain extent.

[0031] In some embodiments, the method may also include: determining the orientation of the smart device as an initial angle, and adjusting the position of the smart mobile terminal based on the initial angle; executing a loop process until the initial angle is within a preset deviation range of the target angle; wherein the preset deviation range of the target angle points to finding the position of the smart device; the loop process may include controlling the smart mobile terminal to wave within the initial angle range, and using a built-in speaker of the smart mobile terminal to send a set of sound wave search signals, and using a built-in inertial measurement unit of the smart mobile terminal to obtain the angle information of each frame of the sound wave search signal sent; determining the energy intensity of each frame of the sound wave search signal based on the recorded data fed back by the smart device; and determining the angle information corresponding to the sound wave search signal with the largest energy intensity as the initial angle of the smart device.

[0032] In this embodiment, since one indication may indicate the approximate location of the smart device, the user may continue to wave the smart mobile terminal while moving towards the smart device, and use the method described in the above embodiment to further determine the location of the smart device until the user finds the smart device.

[0033] In a specific embodiment, the smart mobile terminal is a mobile phone, and the smart device is a headset. The user wants to use the mobile phone to find the location of the headset. First, the user waves the mobile phone and sends a sound wave search signal while the user is waving the mobile phone. At this time, the IMU can also obtain the angle signal of each frame of the sound wave search signal. After receiving the sound wave search signal, the headset will record the sound wave search signal and transmit the sound wave search signal back to the smart device via Bluetooth. The mobile phone can determine the angle when the signal strength is the maximum as the initial angle α0 based on the recording data sent back by the headset. Then, based on the initial angle α0, the headset is searched, and the angle correction β0 is performed relative to the initial angle α0, so as to obtain the first corrected angle (α0-β0), and then (α0-β0) is used as the initial angle, and the above correction operation is performed to obtain the corrected angle β1. At this time, the corrected initial angle is (α0-β0-β1), so the corrected angle after n corrections is β n-1 , we can get the target angle (α0-β0-β1-…-β n-1 ) to find the headset.

[0034] In some embodiments, the acoustic search signal is an ultrasonic signal.

[0035] In this embodiment, an ultrasonic signal refers to a sound wave signal with a frequency higher than the human hearing range (usually above 20kHz). Ultrasonic energy is concentrated, and strong directional propagation can be achieved. Usually, ultrasonic signals form a narrower beam, which is convenient for detecting specific areas or objects. Ultrasonic waves are affected by changes in the medium during propagation, and reflection, refraction and scattering phenomena occur. According to the strength and delay of the reflected signal, information such as the distance, shape and internal structure of the object can be judged. The propagation of ultrasonic waves will attenuate due to factors such as absorption, scattering and propagation distance of the medium. Especially in the air, the attenuation of ultrasonic waves is more obvious. Therefore, the use of ultrasonic signals can more accurately determine the location of the smart device. And ultrasonic waves are inaudible sounds. When ultrasonic signals are used as sound wave search signals, they will not interfere with the human ear.

[0036] See also Figure 2 The embodiment of this specification provides a method for searching a smart device, which is applied to a smart device and may include the following steps.

[0037] Step S210: using the microphone of the smart device to receive a set of sound wave search signals sent by the smart mobile terminal.

[0038] Step S220: Feedback the acoustic wave search signal to the smart mobile terminal, so that the smart mobile terminal determines the direction of the smart device according to the energy intensity of the received acoustic wave search signal.

[0039] The other interpretations of the ultrasound-based software activation method on the smart device side are basically the same as the method for finding the smart device on the smart mobile terminal side. Therefore, the nouns, methods and specific effects specifically described in the above embodiments will not be repeated here. For detailed understanding, please refer to the description in the above specific embodiments.

[0040] See also Figure 3 In some implementations, a device for searching for a smart device may be provided. The device for searching for a smart device is applied to a smart mobile terminal. The device for searching for a smart device may include: a signal sending module, an angle acquisition module, an intensity determination module, and an orientation determination module.

[0041] The signal sending module is used to send a set of sound wave search signals using the built-in speaker of the smart mobile terminal.

[0042] The angle acquisition module is used to use the inertial measurement unit built into the smart mobile terminal to acquire the angle information of each frame of the sound wave search signal sent.

[0043] The intensity determination module is used to determine the energy intensity of each frame of the sound wave search signal based on the recording data fed back by the smart device; wherein the recording data is fed back to the smart mobile terminal by the microphone of the smart device after detecting the sound wave search signal.

[0044] The orientation determination module is used to determine the angle information corresponding to the sound wave search signal with the largest energy intensity as the orientation of the smart device.

[0045] See also Figure 4 In some implementations, a device for searching a smart device may be provided. The device for searching a smart device is applied to a smart device. The device for searching a smart device may include: a signal receiving module and a signal feedback module.

[0046] The signal receiving module is used to use the microphone of the smart device to receive a group of sound wave search signals sent by the smart mobile terminal.

[0047] The signal feedback module is used to feed back the acoustic search signal to the smart mobile terminal, so that the smart mobile terminal determines the direction of the smart device according to the energy intensity of the received acoustic search signal.

[0048] The specific functions and effects achieved by the search device of the smart device can be explained in reference to other embodiments of this specification, and will not be repeated here. The various modules in the search device of the smart device can be implemented in whole or in part by software, hardware, and a combination thereof. The modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0049] See also Figure 5 In some implementations, a computer device may be provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the method steps in the implementation are implemented.

[0050] In some embodiments, a computer-readable storage medium may be provided, on which a computer program is stored. When the computer program is executed by a processor, the method steps in the embodiments are implemented.

[0051] In some implementations, a computer program product may be provided, including computer instructions, wherein the computer instructions are used to enable a computer to execute the method described in the above implementations.

[0052] Those of ordinary skill in the art can understand that all or part of the processes in the implementation method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the implementation methods of the methods described. Among them, any reference to memory, storage, database or other media used in the various implementations provided in this specification may include at least one of non-volatile and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0053] It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0054] The descriptions of the various embodiments of this specification are made in a progressive manner. Different embodiments focus on describing the parts that are different from other embodiments. After reading this specification, a person skilled in the art can know that the various embodiments in this specification, as well as the various technical features disclosed in the embodiments, can be combined in more ways. To make the description concise, not all possible combinations of the various technical features in the embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0055] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0056] The multiple embodiments in this specification emphasize the parts that are different from other embodiments, and the various embodiments can be explained in comparison with each other. Any combination of the multiple embodiments in this specification by technicians in the relevant field based on general technical knowledge is included in the disclosure scope of this specification.

[0057] The above description is only an implementation method of this case and is not intended to limit the scope of protection of the claims of this case. For those skilled in the art, this case may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this case should be included in the scope of the claims of this case.

Claims

1. A method for searching a smart device, characterized in that: The method is applied to a smart mobile terminal, and the method comprises: Using a built-in speaker of the smart mobile terminal to send a set of sound wave search signals; Using the inertial measurement unit built into the smart mobile terminal to obtain the angle information of each frame of the acoustic search signal sent; Determine the energy intensity of each frame of the sound wave search signal based on the recording data fed back by the smart device; wherein the recording data is fed back to the smart mobile terminal by the microphone of the smart device after detecting the sound wave search signal; The angle information corresponding to the sound wave search signal with the largest energy intensity is determined as the orientation of the smart device.

2. The method according to claim 1, characterized in that The method further comprises: Determine the orientation of the smart device as an initial angle, and adjust the position of the smart mobile terminal based on the initial angle; Execute a loop process until the initial angle is within a preset deviation range of the target angle; wherein the preset deviation range of the target angle points to finding the position of the smart device; the loop process includes: Control the smart mobile terminal to wave within the range of the initial angle, and use a built-in speaker of the smart mobile terminal to send a set of sound wave search signals, and use a built-in inertial measurement unit of the smart mobile terminal to obtain angle information of each frame of the sent sound wave search signal; Determine the energy intensity of each frame of the sound wave search signal based on the recording data fed back by the smart device; The angle information corresponding to the sound wave search signal with the largest energy intensity is determined as the initial angle of the smart device.

3. The method according to claim 1, characterized in that The acoustic search signal is an ultrasonic signal.

4. A method for searching a smart device, characterized in that: The method is applied to a smart device, the smart device includes a microphone, and the method includes: Using the microphone of the smart device to receive a set of sound wave search signals sent by the smart mobile terminal; The acoustic wave search signal is fed back to the smart mobile terminal, so that the smart mobile terminal determines the direction of the smart device according to the energy intensity of the received acoustic wave search signal.

5. A device for searching a smart device, characterized in that: The smart device search device is applied to a smart mobile terminal, and the smart device search device includes: A signal sending module, used to send a set of sound wave search signals using a built-in speaker of the smart mobile terminal; An angle acquisition module, used to acquire angle information of each frame of the sent sound wave search signal by using the inertial measurement unit built into the smart mobile terminal; An intensity determination module, used to determine the energy intensity of each frame of the sound wave search signal based on the recording data fed back by the smart device; wherein the recording data is fed back to the smart mobile terminal by the microphone of the smart device after detecting the sound wave search signal; The orientation determination module is used to determine the angle information corresponding to the sound wave search signal with the largest energy intensity as the orientation of the smart device.

6. A device for finding a smart device, characterized in that: The smart device search device is applied to the smart device, and the smart device search device includes: A signal receiving module, used to receive a set of sound wave search signals sent by the smart mobile terminal using the microphone of the smart device; The signal feedback module is used to feed back the acoustic search signal to the smart mobile terminal, so that the smart mobile terminal determines the direction of the smart device according to the energy intensity of the received acoustic search signal.

7. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 3 or 4 is implemented.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 3 or 4 is implemented.

9. A computer program product, characterized in that The method comprises computer instructions for causing a computer to execute the method according to any one of claims 1 to 3 or 4.

Images