Earphone retrieving method and device, terminal equipment and computer readable storage medium

Abstract

The invention is suitable for the technical field of earphone positioning, and provides a binaural earphone retrieving method and device, terminal equipment and a computer readable storage medium, and the method comprises the steps: detecting a phase difference value of signal transmission with a second earphone in the binaural earphone; determining a first distance between the earphone and the second earphone according to the phase difference value; and retrieving the second earphone according to the first distance. According to the method, the position of the earphone can be effectively determined when the earphone is far away from the user, so that the user can retrieve the far earphone.

Description

Technical Field

[0001] The present application belongs to the field of earphone positioning technology, and in particular, relates to a method, device, terminal equipment and computer-readable storage medium for retrieving binaural earphones. Background Art

[0002] Headphones play an increasingly important role in modern life, such as enjoying music, watching videos or receiving voice guidance, etc. Although headphones are very important in daily life, they are easy to lose, such as in crowded indoor scenic spots, especially during sightseeing, headphones are easy to fall out of pockets or bags.

[0003] The related technology generally adopts some anti-lost devices to help users track lost items such as headphones, and locate them through Bluetooth signals. However, in a noisy indoor environment, the interference caused by the environment may be large, affecting the Bluetooth signal, resulting in the inability to effectively and accurately locate the headphones. Summary of the invention The embodiments of the present application provide a binaural headset retrieval method, apparatus, terminal device, and computer-readable storage medium, which can effectively and accurately locate the headset.

[0004] In a first aspect, an embodiment of the present application provides a method for retrieving binaural earphones, comprising: Detecting a phase difference in signal transmission with a second earphone; determining a first distance between the second earphone and the second earphone according to the phase difference value; The second earphone is retrieved according to the first distance to prevent the second earphone from being lost.

[0005] In an embodiment of the present application, in wireless communication, the phase difference of signal transmission can be used to determine the relative position between two devices. Specifically, when a signal is sent from one device (e.g., a first headset) to another device (e.g., a second headset), the phase of the signal changes due to the different transmission distances. By measuring the phase difference of the received signal, the distance between the two devices can be inferred. The phase difference measurement method is relatively insensitive to environmental interference, can provide stable positioning results in complex environments, can effectively detect and determine the position of the second headset, and improve the positioning accuracy of the headset, thereby achieving more accurate device management and user experience.

[0006] In a possible implementation manner of the first aspect, retrieving the second headset according to the first distance includes: Determine status information of the second headset according to the first distance; wherein the status information includes a distance status and a lost status; The first position of the second earphone is determined according to the status information of the second earphone.

[0007] In the embodiment of the present application, by determining the status information of the second earphone (away status or lost status) according to different ranges of the first distance, the user experience can be significantly improved.

[0008] In a possible implementation manner of the first aspect, determining the status information of the second headset according to the first distance includes: If it is detected that the first distance is greater than a first threshold and less than a second threshold, determining that the state information of the second headset is a distance state; If it is detected that the first distance is greater than a second threshold, it is determined that the status information of the second headset is in a lost state.

[0009] In an embodiment of the present application, different thresholds are used to distinguish the away state and the lost state of the headset, so that the user can understand the current situation of the headset more accurately and take corresponding measures. By setting different thresholds, false alarms caused by distance fluctuations can be reduced, thereby improving the reliability of the system and the user's trust.

[0010] In a possible implementation manner of the first aspect, the method further includes: If the first distance to the second earphone is not detected, it is determined that the status information of the second earphone is a lost status.

[0011] In a possible implementation manner of the first aspect, the method further includes: When the state information of the second earphone is a distant state, detecting a second distance between the second earphone and the second earphone; determining a movement trajectory of the second earphone according to the second distance; The motion trajectory is sent to the first terminal device to provide an anti-lost reminder to the user.

[0012] In an embodiment of the present application, when the earphones are in a distant state, distance detection is continuously performed to promptly detect further movement of the earphones and prevent the earphones from moving further away or being lost. By recording the movement trajectory of the earphones, detailed path information can be provided and the movement trajectory can be sent to the first terminal device. The user can receive an anti-loss reminder in real time and take timely measures to retrieve the earphones.

[0013] In a possible implementation manner of the first aspect, the method further includes: When the status information of the second earphone is the away state, the communication mode between the first earphone and the second earphone is switched to the voice connection mode; wherein, in the voice connection mode, the user of the first earphone and the user of the second earphone interact through voice.

[0014] In an embodiment of the present application, when the earphones are in a distant state, through the voice connection mode, the user can interact with the other party in real time by voice, confirm the location and status of the earphones, and reduce the risk of losing the earphones. The voice connection mode allows both parties to perform two-way confirmation to ensure that the earphones are not forgotten or lost, thereby improving the anti-loss effect.

[0015] In a possible implementation manner of the first aspect, the method further includes: When the status information of the second earphone is a lost state, the first location information sent by the first terminal device is obtained; wherein the first location information is the location information sent by the second earphone to the second terminal device via a broadcast mode, and the second terminal device sends the location information to the first terminal device via a communication network between the second terminal device and the first terminal device.

[0016] In the above method, through the broadcast mode, the second earphone can send its location information in real time, and the second terminal device acts as a relay to transmit the location information to the first terminal device, ensuring that the location information can be smoothly transmitted even when direct communication between the second earphone and the first terminal device is limited.

[0017] In a possible implementation manner of the first aspect, the method further includes: The application scenario is that when visiting an indoor scenic spot, the first earphone and the second earphone are respectively worn on two tourists traveling together, and the first earphone is connected to a first terminal device carried by the tourists. When it is detected that the second earphone is in a distant state, the first earphone prompts the direction and distance information of the traveling tourist to the first terminal device through the mobile phone, and in the voice connection mode, the two tourists can communicate their location information in real time so as to get closer to each other.

[0018] In a possible implementation manner of the first aspect, the method further includes: The application scenario is that in a crowded outdoor place, when the first earphone detects that the second earphone is lost, the second earphone sends location information to the surrounding broadcast receiving devices through the broadcast mode. The broadcast receiving device transmits the location information to the first terminal device connected to the first earphone. The first terminal device guides the user to the location of the second earphone through voice and map positioning.

[0019] In a second aspect, an embodiment of the present application provides a binaural headset positioning system, including: a first terminal device, a first headset, a second headset, and a second terminal device; The first earphone is used to implement the binaural earphone retrieval method as described in any one of the first aspects above.

[0020] In a second aspect, an embodiment of the present application provides a binaural earphone positioning device, comprising: A detection module, used to detect a phase difference between the signal transmission with the second earphone; a determination module, configured to determine a first distance between the first earphone and the second earphone according to the phase difference value; A positioning module is used to position the second earphone according to the first distance.

[0021] In a fourth aspect, an embodiment of the present application provides a terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the binaural headset retrieval method as described in any one of the first aspects above is implemented.

[0022] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the binaural headset retrieval method as described in any one of the above-mentioned first aspects is implemented.

[0023] In a sixth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on a terminal device, the terminal device executes the binaural headset retrieval method described in any one of the above-mentioned first aspects.

[0024] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0026] Figure 1 is a schematic diagram of a binaural earphone positioning system provided in an embodiment of the present application; Figure 2 It is a flowchart of a method for retrieving binaural headphones provided in an embodiment of the present application; Figure 3 This is a schematic diagram of the process of determining the headset status information provided by the embodiment of the present application Figure 1 ; Figure 4 This is a schematic diagram of the process of determining the headset status information provided by the embodiment of the present application Figure 2 ; Figure 5 is a schematic diagram of a flow chart of feedback of earphone motion trajectory provided in an embodiment of the present application; Figure 6It is a general structural block diagram of binaural earphone positioning provided by an embodiment of the present application; Figure 7 is a structural block diagram of a binaural earphone positioning device provided in an embodiment of the present application; Figure 8 It is a structural diagram of a terminal device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0027] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0028] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0029] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0030] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0031] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0032] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways.

[0033] Headphones play an increasingly important role in modern life, such as enjoying music, watching videos or receiving voice guidance, etc. Although headphones are very important in daily life, they are easy to lose, such as in crowded indoor scenic spots, especially during sightseeing, headphones are easy to fall out of pockets or bags.

[0034] The related technology generally adopts some anti-lost devices to help users track lost items such as headphones, and locate them through Bluetooth signals. However, in a noisy indoor environment, the interference caused by the environment may be large, affecting the Bluetooth signal, resulting in the inability to effectively and accurately locate the headphones. In order to solve the above technical problems, the embodiment of the present application provides a binaural headset retrieval method. In the present application, the True Wireless Stereo (TWS) Bluetooth headset's own positioning technology is used to locate the left and right headsets through the phase between the two headsets. There is no need to add other modules for positioning, which reduces the complexity of module design. In addition, the transmission of voice data through the two headsets greatly increases the possibility of finding people or objects, and improves the user experience.

[0035] See also Figure 1 , is a schematic diagram of a binaural earphone positioning system provided in an embodiment of the present application, comprising a first terminal device, a first earphone, a second earphone, and a second terminal device; wherein the first earphone and the second earphone are connected, the first earphone is used to detect the distance between the first earphone and the second earphone, and generate a motion trajectory of the second earphone according to the distance, the second earphone is used to broadcast location information and be received by the second terminal device, and the second terminal device is used to send the location information to the first terminal device.

[0036] See also Figure 2 , is a flow chart of a method for retrieving a binaural headset provided in an embodiment of the present application. As an example but not a limitation, the method is applied to the first headset in the above binaural headset, and the method may include the following steps: S101, detecting a phase difference of a signal transmitted between the first earphone and the second earphone in the binaural earphones.

[0037] In an embodiment of the present application, the phase difference value refers to the phase difference between two signals at the same point in time. Phase is a parameter that describes the position of a periodic signal on the time axis. For two signals with the same frequency, the phase difference value can represent the relative time delay or advance between them. In Bluetooth headsets (especially true wireless stereo headsets, i.e., TWS headsets), the concept of phase difference value is often used to ensure audio synchronization between left and right earphones. Specifically, the phase difference value can be used to measure the phase difference between the signal detected by the first earphone (e.g., the left earphone is also called the first earphone) and the signal received by the second earphone (e.g., the right earphone is also called the second earphone).

[0038] In one implementation, the phase change between two devices can be measured by the Channel Sounding (CS) technology of Bluetooth Low Energy (BLE). The first earphone (for example, the first earphone of a TWS earphone) sends a known detection signal (for example, a specific modulation signal) through the BLE interface, and the second earphone (the second earphone of the TWS earphone) receives the detection signal and records the phase and amplitude information of the received signal. It is compared with the phase of the signal sent by the first earphone, the phase difference is calculated, and the phase difference value is sent to the first earphone.

[0039] In another implementation, a known signal is sent to the first earphone and the second earphone respectively, and two microphones or two-channel audio acquisition devices are used to respectively acquire the signals emitted by the two earphones. Ensure that the sampling rate of the acquisition device is high enough to accurately capture the details of the signal, and process the acquired signal to calculate the phase difference.

[0040] Specifically, the collected signal is subjected to Fourier transform (FFT) to convert the time domain signal into the frequency domain signal. In the frequency domain, the phase difference can be calculated by comparing the phase angles of the two signals at the same frequency component. Assuming that the frequency domain representations of the two signals are X(f) and Y(f), the phase difference It can be expressed as: =∠X(f)-∠Y(f) Wherein, ∠X(f) and ∠Y(f) represent the phase angles of X(f) and Y(f), respectively.

[0041] S102: Determine a first distance between the second earphone and the second earphone according to the phase difference value.

[0042] In the embodiment of the present application, after obtaining the phase difference value of the detection signal transmission between the two earphones, it is necessary to determine the distance (first distance) between the two earphones according to the frequency of the detection signal and the propagation speed of the detection signal in the air.

[0043] Specifically, the propagation time of the detection signal between the first earphone and the second earphone can be calculated by the phase difference, which can be calculated by the following formula:

[0044] in, is the phase difference of the detection signal transmitted between the first earphone and the second earphone, and f is the signal frequency of the detection signal. After obtaining the propagation time of the detection signal, it is necessary to determine the distance (first distance) between the first earphone and the second earphone according to the propagation speed of the detection signal in the air, where the propagation speed c of the detection signal in the air is approximately / second, therefore, the calculation formula for the first distance is as follows:

[0045] Wherein, d is the first distance between the first earphone and the second earphone holder.

[0046] S103: Retrieve the second headset according to the first distance.

[0047] In the embodiment of the present application, the first earphone is taken as a reference point, and the position of the second earphone can be determined according to the distance between the first earphone and the second earphone, that is, the first distance.

[0048] As an example, in an application scenario, when a tourist and his fellow tourists are playing indoors or outdoors, two earphones can be worn on tourist A and fellow tourist B respectively, wherein the earphone worn by tourist A is the first earphone, i.e., the first earphone, which is connected to the mobile phone, and the earphone worn by tourist A is the second earphone, i.e., the second earphone, and the first earphone and the second earphone are connected via a BLE connection. During the tour, when fellow tourist B is moving away from tourist A, the first earphone can detect and obtain the first distance between it and the second earphone in real time, and determine the approximate position of tourist A, i.e., the first position, based on the first distance, and prompt fellow tourist B based on the size of the first distance, etc., to prevent the two from getting lost, that is, to prevent the loss of the second earphone.

[0049] In one embodiment, see Figure 3 , is a schematic diagram of a process for determining headset status information provided in an embodiment of the present application Figure 1 ,like Figure 3 As shown, step S103 includes: S201: Determine status information of the second earphone according to the first distance, wherein the status information includes a away status and a lost status.

[0050] In an embodiment of the present application, the status information of the second earphone includes being away from the first earphone, or the second earphone being disconnected from the mobile phone and the first earphone respectively, which is a lost state. If the second earphone is in a close distance with the first earphone, it can be determined that the first earphone and the second earphone are in the same small range, possibly in the same room or on the user, etc. If the first distance is too large, it may be determined that a certain earphone is in a lost state, etc.

[0051] As an example, a relevant threshold may be set and compared with the distance between the first earphone and the second earphone, or the state of the second earphone may be determined by judging whether there is a connection between the second earphone and the first terminal device.

[0052] In one embodiment, see Figure 4 , is a schematic diagram of a process for determining headset status information provided in an embodiment of the present application Figure 2 ,like Figure 4 As shown, step S201 includes: S301: If it is detected that the first distance is greater than a first threshold and less than a second threshold, determine that the state information of the second headset is a distance state.

[0053] In the embodiment of the present application, two thresholds are set, such as the first threshold can be d1=5 meters d2=10 meters, and the second threshold can be d2=50 meters. These two thresholds can be determined according to the actual application scenario and system requirements. If the condition that the above first distance d is satisfied is detected, , then the state of the second earphone is determined to be away.

[0054] As an example, in the above application scenario, Figure 1 As shown, if the first earphone A is worn by tourist a, and the second earphone B is worn by tourist b, if the distance d between the two earphones or the two tourists is detected to be satisfied, , and if tourist a is in a fixed position, it can be determined that the fellow tourist b wearing the second earphone B is in a far away state.

[0055] Among them, after the distance between the first earphone and the second earphone is between the second threshold and the first threshold, it is also necessary to determine whether the second earphone is connected to the first earphone and the terminal device respectively. If the distance between the second earphone and the first earphone is within the two set threshold ranges, and there is a connection with the first earphone and the terminal device, it is determined that the second earphone, that is, the fellow tourist b wearing the second earphone, is in a distant state.

[0056] S302: If it is detected that the first distance is greater than a second threshold or the first distance to the second headset is not detected, determine that the status information of the second headset is in a lost state.

[0057] In an embodiment of the present application, in one implementation, as in the above application scenario, if it is detected that the distance d between the two earphones is much greater than , then the second earphone is determined to be in lost state.

[0058] In another implementation, if the distance between the first earphone and the second earphone cannot be detected, it means that the first earphone and the second earphone have lost connection. Similarly, if the second earphone loses connection with the first terminal device, it is determined that the second earphone is disconnected due to the long distance between the first earphone and the first earphone. At this time, the second earphone can be determined to be in a lost state.

[0059] In the above method, different thresholds are used to distinguish the away state and the lost state of the headset. The user can understand the current situation of the headset more accurately and take corresponding measures. By setting different thresholds, false alarms caused by distance fluctuations can be reduced, thereby improving the reliability of the system and the user's trust.

[0060] S202: Determine a first position of the second earphone according to the status information of the second earphone.

[0061] In an embodiment of the present application, when the first headset is always connected to the first terminal device, the second headset is positioned according to the status information of the second headset and the connection status of the second headset and the first terminal mobile phone.

[0062] As an example, if the second earphone is in a distant state, the position determination is relatively simple, and the first earphone can effectively detect the position or movement track of the second earphone, and display it through the first terminal device to remind the user of the status information of the second earphone. Figure 5 , is a schematic diagram of a flow chart of feedback earphone motion trajectory provided by an embodiment of the present application, such as Figure 5 As shown, the method also includes: S401: When the status information of the second earphone is a distance status, detect a second distance between the second earphone and the second earphone.

[0063] In an embodiment of the present application, in a TWS earphone system, when the status information of the second earphone is detected as being in a far away state, the movement trajectories of the first earphone and the second earphone can be calculated through continuous distance detection and related algorithms.

[0064] Specifically, a suitable detection frequency can be determined, such as detecting the distance (first distance) once per second, to ensure that the movement changes of the second earphone can be captured, and the distance measured each time is recorded to form a time series data. Each time the distance is measured, the current timestamp t is recorded for subsequent analysis, and each measured distance d and the corresponding timestamp t are stored in a data structure, such as a list or array. Select a suitable motion trajectory calculation algorithm according to actual needs. Common algorithms include Kalman filter, particle filter, etc.

[0065] S402: Determine a movement trajectory of the second earphone according to the second distance.

[0066] In the embodiment of the present application, the movement trajectory of the second earphone can be obtained by recording the position of the second earphone at different time points and connecting the positions of the second earphone at multiple different time points.

[0067] Specifically, the position data of all time points are arranged in chronological order, and an interpolation algorithm (such as linear interpolation or spline interpolation) is used to smooth the position data to generate a continuous motion trajectory, and the generated motion trajectory can be visualized for users to view.

[0068] S403, sending the motion trajectory to the first terminal device to provide an anti-lost reminder to the user.

[0069] In the embodiment of the present application, the first earphone detects the distance between the first earphone and the second earphone, and calculates the motion trajectory of the two through a related algorithm. Since the first earphone is connected to the first terminal device such as a mobile phone, the obtained motion trajectory can be synchronized to the connected first terminal device such as a mobile phone. And since the connection mode between the first earphone and the second earphone includes a communication mode, the first earphone sends a voice reminder when sending the motion trajectory to the first terminal to prompt the user to check the trajectory to prevent the earphone from being lost.

[0070] In the above method, in an embodiment of the present application, when the earphones are in a distant state, distance detection is continuously performed, so that further movement of the earphones can be discovered in time to prevent the earphones from moving further away or being lost. By recording the movement trajectory of the earphones, detailed path information can be provided, and the movement trajectory can be sent to the first terminal device. The user can receive anti-loss reminders in real time and take timely measures to retrieve the earphones.

[0071] In one embodiment, the method further comprises: When the status information of the second earphone is the away state, the communication mode between the first earphone and the second earphone is switched to the voice connection mode; wherein, in the voice connection mode, the user of the first earphone and the user of the second earphone interact through voice.

[0072] In an embodiment of the present application, the application scenario is in a crowded outdoor place. When the first earphone detects that the second earphone is lost, the second earphone sends location information to the surrounding broadcast receiving devices through the broadcast mode. The broadcast receiving device transmits the location information to the first terminal device connected to the first earphone. The first terminal device guides the user to the location of the second earphone through voice and map positioning.

[0073] The specific implementation is as follows: When the switching conditions are detected, the first earphone automatically switches to the unicast server mode (Unicast Server mode), and the second earphone automatically switches to the unicast client mode (Unicast Client mode). At this time, the BLE link mode between the master earphone and the slave earphone is immediately converted to the BLE voice mode, that is, the voice connection mode. In this mode, the users of the first earphone and the second earphone can interact in real time through voice.

[0074] In one embodiment, the application scenario is that when visiting an indoor scenic spot, the first earphone and the second earphone are respectively worn on two tourists traveling together, and the first earphone is connected to a first terminal device carried by the tourists. When it is detected that the second earphone is in a distant state, the first earphone prompts the direction and distance information of the traveling tourist to the first terminal device through the mobile phone, and in the voice connection mode, the two tourists can communicate their location information in real time so as to get closer to each other.

[0075] Taking the actual application scenario as an example, suppose that tourist a wears the first headset A, and tourist b wears the second headset B to visit the scenic spot. When it is detected that the distance between the first headset A and the second headset B is in the set distance state interval (that is, the condition that the first distance is greater than the first threshold and less than the second threshold is satisfied), the first headset A and the second headset B automatically complete the mode switching, and tourists a and tourists b can communicate by voice like using a walkie-talkie. Tourist a can ask tourist b where he is, and tourist b can also inform him of his situation in real time. Both parties can actively approach each other based on the information exchanged, reducing the risk of losing the headset.

[0076] In addition, during the voice connection mode, the first earphone will continue to monitor the distance between it and the second earphone. Once the distance changes, whether it is gradually approaching or moving further away, the first earphone will generate a new motion trajectory based on the monitored data and use the relevant algorithm, and send the trajectory to the first terminal device (such as a mobile phone) connected to the first earphone in a timely manner. After the mobile phone receives the motion trajectory information, it will be displayed in real time on the interface, and voice reminders will be given to inform the user of the motion status of the earphone, further enhancing the anti-lost effect.

[0077] In the above method, when the earphone is in a distant state, through the voice connection mode, the user can interact with the other party in real time by voice, confirm the location and status of the earphone, and reduce the risk of losing the earphone. The voice connection mode allows both parties to perform two-way confirmation to ensure that the earphone is not forgotten or lost, thereby improving the anti-loss effect.

[0078] In one embodiment, the method further comprises: When the status information of the second earphone is a lost state, the first location information sent by the first terminal device is obtained; wherein the first location information is the location information sent by the second earphone to the second terminal device via a broadcast mode, and the second terminal device sends the location information to the first terminal device via a communication network between the second terminal device and the first terminal device.

[0079] In an embodiment of the present application, when the second earphone is in a lost state, that is, the second earphone does not receive the detection signal generated by the first earphone A within a preset time, and the second earphone is disconnected from the terminal device, the second earphone will switch to the broadcast source mode and play its own location information (first location information) in real time through voice mode so that the user can retrieve it.

[0080] After the second earphone plays its own location information in real-time voice mode, the broadcast receiving device near the second earphone, such as the broadcast server of the scenic spot (second terminal device), etc., because the first terminal device and the second terminal device can be connected through a network mechanism, the second terminal device will send the received broadcast information of the second earphone to the first terminal device.

[0081] In one embodiment, the application scenario is in a crowded outdoor place. When the first earphone detects that the second earphone is lost, the second earphone sends location information to the surrounding broadcast receiving devices through the broadcast mode. The broadcast receiving device transmits the location information to the first terminal device connected to the first earphone. The first terminal device guides the user to the location of the second earphone through voice and map positioning.

[0082] The first earphone continuously monitors the signal transmission between it and the second earphone, and determines whether the second earphone is lost according to the preset rules. When the first earphone fails to receive the signal from the second earphone within a certain period of time, or detects that the distance between the two is greater than the set loss threshold (such as 50 meters), the second earphone will be determined to be lost. This detection mechanism utilizes the connection status monitoring and distance measurement functions of Bluetooth, and is achieved by continuously obtaining signal strength indication (RSSI) and distance measurement data based on phase difference.

[0083] Once the second headset is determined to be lost, it will automatically switch to broadcast mode. In broadcast mode, the second headset uses the built-in Bluetooth chip or other wireless communication module to periodically send broadcast signals containing its own location information to the surrounding space according to a specific broadcast frequency and data format. There are various ways to obtain its location information. If the headset has a built-in high-precision positioning chip (such as a chip that supports Beidou, GPS and other satellite positioning systems), it can obtain accurate longitude and latitude coordinates in real time; if not, it can also interact with Bluetooth beacons in known locations around it through Bluetooth signals, and use triangulation positioning algorithms to estimate the approximate location.

[0084] Surrounding broadcast receiving devices, such as Bluetooth gateways distributed in the venue, public facilities with receiving functions (such as street lamps, receiving devices integrated on billboards), etc., will continuously scan and receive these broadcast signals. After receiving the broadcast signal of the second headset, the broadcast receiving device will parse the location information and transmit the location information to the first terminal device connected to the first headset through a pre-established communication network (such as Wi-Fi, 4G / 5G network, etc.). These broadcast receiving devices are equivalent to data relay stations, which collect and aggregate the location information of headsets scattered everywhere to ensure that the information can reach the user accurately.

[0085] After receiving the location information of the second headset from the broadcast receiving device, the first terminal device (such as the user's mobile phone) will immediately start the corresponding guidance function. On the one hand, through the voice broadcast system of the mobile phone, the user is prompted with a clear voice about the approximate direction and distance of the second headset, such as "Your headset is 200 meters northeast of you", which is convenient for users to quickly obtain key information in a noisy environment. On the other hand, the map application on the mobile phone (such as Amap, Baidu Map, etc.) will automatically locate the user's current location and plan an optimal navigation route based on the location information of the second headset. This route will comprehensively consider factors such as population density and road traffic conditions to ensure that users can reach the location of the second headset as quickly as possible, helping users to efficiently retrieve lost headsets.

[0086] It should be noted that in the above method, the first earphone is used as a detection device to monitor the location information of the second earphone, and determine whether the second earphone is far away or lost based on the location information of the second earphone. Similarly, the second earphone can be used as a detection device to monitor the location information of the first earphone, and determine whether the first earphone is far away or lost based on the location information of the first earphone. The location information of the first earphone or the location information of the second earphone is sent to a terminal device such as a mobile phone connected to the first earphone or the second earphone, so that the terminal device reminds the user that the earphone is far away or lost, and the user can retrieve the first earphone or the second earphone based on the location information of the first earphone or the second earphone in the terminal device.

[0087] It should be noted that, since the second earphone was connected to the first terminal device before being lost, when the second earphone broadcasts its own location information, it also broadcasts the identity information of the first terminal, such as ID, etc. After receiving the broadcast message, the second terminal device will scan according to the identity information of the first terminal device, and after scanning the first terminal device, it will send the location information of the second earphone to the first terminal device. At the same time, the first terminal device synchronizes the information to the first earphone for voice reminder, so as to remind the user to retrieve the second earphone.

[0088] In the above method, through the broadcast mode, the second earphone can send its location information in real time, and the second terminal device acts as a relay to transmit the location information to the first terminal device, ensuring that the location information can be smoothly transmitted even when direct communication between the second earphone and the first terminal device is limited.

[0089] See also Figure 6 , is a general structural block diagram of binaural earphone positioning provided by an embodiment of the present application, such as Figure 6 As shown, it includes a first terminal device (mobile phone), a first earphone (first earphone A), a second earphone (second earphone B) and a second terminal device. The first earphone and the second earphone are respectively connected to the mobile phone via a BLE connection mode, and the first earphone and the second earphone are also connected via a BLE connection mode. The second terminal device is used to receive broadcast information. The steps of preventing the earphone from being lost and recovering it after being lost according to the above structural diagram include: Anti-loss method: Example application scenario: Tourist a carries a first headset A, and fellow tourist b carries a second headset B to prevent the headset from being lost.

[0090] 1. The first earphone A detects a phase change between the first earphone A and the second earphone B through CS distance detection, and determines a first distance between the first earphone A and the second earphone B according to the phase change; 2. Determine the state of the second earphone according to the first distance; If the first distance is greater than the first threshold and less than the second threshold, it is determined that the second earphone is far away and not lost; if the first distance is greater than the second threshold or the first distance between the second earphone is not detected, it is determined that the second earphone is lost.

[0091] 3. Switch the voice communication mode between the first earphone and the second earphone When it is detected that the first distance is greater than the first threshold, the first earphone is converted to a unicast server, the second earphone is switched to a unicast receiver, and a communication mode is established between the two. Tourist A and fellow tourist B can communicate by voice, so that fellow tourist B carrying the second earphone B can return.

[0092] 4. Anti-loss reminder When tourist B who is traveling with the second earphone B is returning, the first earphone monitors the distance between it and the second earphone in real time, generates a motion trajectory between the first earphone and the second earphone based on a relevant algorithm, and sends the trajectory to the first terminal device, and makes a voice reminder to remind the user to prevent the earphone from being lost.

[0093] Lost and recovered earphones: 1. Lost the headphone mode switch When it is determined that the second headset is lost, that is, the second headset does not receive the detection signal of the first headset within the preset time, and the second headset is disconnected from the first terminal device, in this case, the second headset will automatically switch to the broadcast source mode.

[0094] 2. Lost headset broadcast information The second earphone plays its own location information in real time, and the information is received by a broadcast receiving device (second terminal) near the second earphone. Since the second terminal device can be connected to the first terminal device through a network connection, the location information of the second earphone can be sent to the first terminal device.

[0095] 3. Retrieve lost earphones After the first terminal device receives the location information of the first earphone sent by the second terminal device, it sends the information to the first earphone and plays the voice, so that the user can find the lost earphone.

[0096] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0097] Corresponding to the binaural headset retrieval method described in the above embodiment, Figure 7 4 is a structural block diagram of a binaural earphone positioning device provided in an embodiment of the present application. For the sake of convenience of explanation, only the parts related to the embodiment of the present application are shown.

[0098] Reference Figure 7 , the device comprises: A detection module 71, used for detecting a phase difference value of a signal transmitted between the second earphone and the second earphone; A determination module 72, configured to determine a first distance from the second earphone according to the phase difference value; The positioning module 73 is used to position the second earphone according to the first distance.

[0099] Optionally, the positioning module 73 is further used for: determining status information of the second earphone according to the first distance; The second headset is positioned according to the status information of the second headset.

[0100] Optionally, the positioning module 73 is further used for: If it is detected that the first distance is greater than a first threshold and less than a second threshold, determining that the state information of the second headset is a distance state; If it is detected that the first distance is greater than a second threshold or the first distance to the second earphone is not detected, it is determined that the status information of the second earphone is in a lost state.

[0101] Optionally, the positioning module 73 is further used for: When the state information of the second earphone is a distance state, performing distance detection on the second earphone and obtaining movement trajectories of the first earphone and the second earphone; The motion trajectory is sent to the first terminal device to provide an anti-lost reminder to the user.

[0102] Optionally, the positioning module 73 is further used for: When the status information of the second earphone is the away state, the communication mode between the first earphone and the second earphone is switched to the voice connection mode; wherein, in the voice connection mode, the user of the first earphone and the user of the second earphone interact through voice.

[0103] Optionally, the positioning module 73 is further used for: When the status information of the second earphone is a lost state, the first location information sent by the first terminal device is obtained; wherein the first location information is the location information sent by the second earphone to the second terminal device via a broadcast mode, and the second terminal device sends the location information to the first terminal device via a communication network between the second terminal device and the first terminal device.

[0104] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0105] in addition, Figure 7 The binaural earphone positioning device shown can be a software unit, a hardware unit, or a combination of software and hardware units built into an existing terminal device, or can be integrated into the terminal device as an independent pendant, or can exist as an independent terminal device.

[0106] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0107] Figure 8 Schematic diagram of the structure of the terminal device provided in the embodiment of the present application. Figure 8 As shown, the terminal device 8 of this embodiment includes: at least one processor 80 ( Figure 8 Only one is shown in the figure) a processor, a memory 81, and a computer program 82 stored in the memory 81 and executable on the at least one processor 80, and when the processor 80 executes the computer program 82, the steps in any of the above-mentioned binaural headset retrieval method embodiments are implemented.

[0108] The terminal device may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The terminal device may include, but is not limited to, a processor and a memory. Those skilled in the art will understand that Figure 8 It is only an example of the terminal device 8 and does not constitute a limitation on the terminal device 8. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, it may also include input and output devices, network access devices, etc.

[0109] The processor 80 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0110] In some embodiments, the memory 81 may be an internal storage unit of the terminal device 8, such as a hard disk or memory of the terminal device 8. In other embodiments, the memory 81 may also be an external storage device of the terminal device 8, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device 8. Further, the memory 81 may also include both an internal storage unit and an external storage device of the terminal device 8. The memory 81 is used to store an operating system, an application program, a boot loader, data, and other programs, such as the program code of the computer program. The memory 81 may also be used to temporarily store data that has been output or is to be output.

[0111] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0112] An embodiment of the present application provides a computer program product. When the computer program product runs on a terminal device, the terminal device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0113] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of the above-mentioned various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device that can carry the computer program code to the device / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0114] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0115] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0116] In the embodiments provided in the present application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0117] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0118] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A method for retrieving binaural earphones, characterized in that: Applied to the first earphone in the binaural earphone, the method comprises: Detecting a phase difference value of signal transmission between the first earphone and the second earphone in the binaural earphone; determining a first distance between the second earphone and the second earphone according to the phase difference value; The second earphone is retrieved according to the first distance.

2. The binaural earphone retrieval method according to claim 1, characterized in that: The retrieving the second headset according to the first distance includes: Determine status information of the second headset according to the first distance; wherein the status information includes a distance status and a lost status; The first position of the second earphone is determined according to the status information of the second earphone.

3. The binaural earphone retrieval method according to claim 2, characterized in that: The determining the status information of the second earphone according to the first distance includes: If it is detected that the first distance is greater than a first threshold and less than a second threshold, determining that the state information of the second headset is a distance state; If it is detected that the first distance is greater than a second threshold, determining that the status information of the second earphone is in a lost state; If the first distance to the second earphone is not detected, it is determined that the status information of the second earphone is a lost status.

4. The binaural earphone retrieval method according to claim 3, characterized in that: The method further comprises: When the state information of the second earphone is a distant state, detecting a second distance between the second earphone and the second earphone; determining a movement trajectory of the second earphone according to the second distance; The motion trajectory is sent to the first terminal device to provide an anti-lost reminder to the user.

5. The binaural earphone retrieval method according to claim 4, characterized in that: The method further comprises: When the status information of the second earphone is the away state, the communication mode between the first earphone and the second earphone is switched to the voice connection mode; wherein, in the voice connection mode, the user of the first earphone and the user of the second earphone interact through voice.

6. The binaural earphone retrieval method according to claim 2, characterized in that: The method further comprises: When the status information of the second earphone is a lost state, the first location information sent by the first terminal device is obtained; wherein the first location information is the location information sent by the second earphone to the second terminal device via a broadcast mode, and the second terminal device sends the location information to the first terminal device via a communication network between the second terminal device and the first terminal device.

7. The binaural earphone retrieval method according to any one of claims 1 to 6, characterized in that: The application scenario is that when visiting an indoor scenic spot, the first earphone and the second earphone are respectively worn on two tourists traveling together, and the first earphone is connected to a first terminal device carried by the tourists. When it is detected that the second earphone is in a distant state, the first earphone prompts the direction and distance information of the traveling tourist to the first terminal device through the mobile phone, and in the voice connection mode, the two tourists can communicate their location information in real time so as to get closer to each other.

8. The binaural earphone retrieval method according to any one of claims 1 to 6, characterized in that: The application scenario is that in a crowded outdoor place, when the first earphone detects that the second earphone is lost, the second earphone sends location information to the surrounding broadcast receiving devices through the broadcast mode. The broadcast receiving device transmits the location information to the first terminal device connected to the first earphone. The first terminal device guides the user to the location of the second earphone through voice and map positioning.

9. A binaural earphone positioning system, characterized in that: include: A first terminal device, a first headset, a second headset, and a second terminal device; The first earphone is used to implement the binaural earphone retrieval method as described in any one of claims 1 to 6.

10. A terminal device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 8 is implemented.

11. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images