Guiding blind method, device and wearable device

Abstract

The application is suitable for the field of blind guiding technology, and provides a blind guiding method, device and wearable equipment, which comprises the following steps: determining the relative position relationship between the wearable equipment and an obstacle according to the ultrasonic signal emitted by the wearable equipment and the reflected signal received; detecting the first orientation information of the wearable equipment relative to the wearer according to the orientation sensor of the wearable equipment; and guiding the wearer according to the relative position relationship and the first orientation information. Even if the pose of the wearable equipment changes, the orientation information of the obstacle relative to the wearer can still be determined according to the first orientation information of the wearable equipment and the wearer, so that more accurate obstacle position information can be obtained, and the wearable equipment does not need to be held, so that the hands are free, and the convenience of use of the user is improved.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of blind navigation, and particularly relates to a blind guiding method and device and wearable equipment BACKGROUND

[0002] In order to improve the convenience of the blind people's travel, a blind guiding device capable of recognizing obstacles existing in a road can be designed and manufactured by utilizing the characteristic that ultrasonic waves can detect obstacles. The blind guiding device emits ultrasonic signals to the surroundings of the user's location and receives reflected ultrasonic signals. According to the time of the emitted ultrasonic signals and the received ultrasonic signals, the distance between the obstacle and the user is determined. For example, the blind guiding device can be a walking stick, and the user obtains the obstacle information in the surrounding scene through the walking stick held by the user, thereby helping the user to avoid obstacles in the walking process. However, since the pose of the walking stick can change in the use process, the obstacle feedback signal is inaccurate, and the user's hands cannot be freed, and the use is relatively inconvenient. SUMMARY

[0003] Embodiments of the present application provide a blind guiding method, device and wearable equipment to solve the problem that the obstacle signal fed back when the blind people are guided in the prior art is inaccurate and inconvenient to use.

[0004] In a first aspect, an embodiment of the present application provides a blind guiding method, comprising: a wearable device determining a relative position relationship between the wearable device and an obstacle according to an ultrasonic signal emitted by the wearable device and a reflected signal, wherein the reflected signal is a signal reflected by the obstacle; the wearable device acquiring first orientation information of the wearable device relative to a wearer collected by an orientation sensor of the wearable device; the wearable device sending the relative position relationship and the first orientation information to an electronic device connected to the wearable device; and the electronic device guiding the wearer according to the relative position relationship and the first orientation information.

[0005] The wearable device can emit an ultrasonic signal (or also referred to as an ultrasonic wave) through a sensor. If an obstacle is encountered during the straight propagation of the ultrasonic signal, the ultrasonic signal is reflected. The sensor of the wearable device can detect the reflected signal of the ultrasonic wave. According to the emission time and the reception time of the ultrasonic signal, combined with the propagation speed of the ultrasonic wave, the distance between the obstacle and the wearable device can be calculated. Combined with the receiving direction of the sensor receiving the reflected signal, the position of the obstacle relative to the wearable device can be determined. The first position information of the wearable device relative to the wearer is determined through the position sensor of the wearable device. Therefore, even if the posture of the wearable device changes, the position information of the obstacle relative to the wearer can still be determined according to the first position information of the wearable device and the wearer. Therefore, more accurate obstacle position information can be obtained, and the wearable device does not need to be held, which can free the hands and improve the convenience of use of the user.

[0006] In combination with the first aspect, in a first possible implementation manner of the first aspect, the relative position relationship includes second position information of the wearable device relative to the obstacle, and a distance between the wearable device and the obstacle; and the electronic device navigates the wearer according to the relative position relationship and the first position information, including: the electronic device determines third position information of the obstacle relative to the wearer according to the first position information and the second position information; and the electronic device navigates the wearer according to the distance and the third position information.

[0007] According to the second position information of the obstacle relative to the wearable device and the first position information of the wearable device relative to the wearer, the third position information of the obstacle relative to the wearer can be determined. Therefore, when the posture of the wearer changes, the influence of the posture change on the direction of the obstacle relative to the wearer can be determined according to the first position information, and the accuracy of the position information between the obstacle and the wearer is ensured.

[0008] In combination with the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the electronic device navigates the wearer according to the distance and the third position information, including: the electronic device real-time broadcasts the distance and the third position information through voice, or prompts the distance and the third position information through voice and vibration intensity, when the distance and / or the third position information reaches a predetermined prompt condition.

[0009] The predetermined distance prompting condition can be that the distance change meets a predetermined requirement, or the distance meets a preset distance range, or an obstacle is detected at a preset orientation, or the detected obstacle meets a preset orientation and a preset distance requirement. The electronic device can broadcast the obstacle information through voice or through voice and vibration, so that the wearer can obtain the distance and orientation information of the obstacle according to the information broadcast by the electronic device.

[0010] In a third possible implementation manner of the first aspect, before the wearable device determines the relative positional relationship between the wearable device and the obstacle according to the ultrasonic signal emitted by the wearable device and the reflection signal received by the wearable device, the method further includes: in response to the operation of starting the guide mode, the electronic device sends a guide instruction to the wearable device connected to the electronic device; and correspondingly, the wearable device determines the relative positional relationship between the wearable device and the obstacle according to the ultrasonic signal emitted by the wearable device and the reflection signal received by the wearable device, including: after receiving the guide instruction, the wearable device emits an ultrasonic signal according to a preset emission period, receives a reflection signal of the ultrasonic signal reflected by the obstacle, and determines the relative positional relationship between the wearable device and the obstacle according to the emitted ultrasonic signal and the received reflection signal.

[0011] When the electronic device responds to the operation of the guide mode, such as receiving a starting instruction of the guide mode through voice or a key operation of the wearer, the electronic device sends a guide instruction to the wearable device, so that the wearable device can perform the guide operation according to the received guide instruction sent by the electronic device, including emitting an ultrasonic signal according to a preset emission period, and obtaining a reflection signal of the ultrasonic signal reflected by the obstacle. The relative positional relationship between the wearable device and the obstacle is determined.

[0012] In a third possible implementation manner of the first aspect, before the wearable device determines the relative positional relationship between the wearable device and the obstacle according to the ultrasonic signal emitted by the wearable device and the reflection signal received by the wearable device, the method further includes: in response to the operation of starting the guide mode, the electronic device sends a guide instruction to the wearable device connected to the electronic device; and correspondingly, the wearable device determines the relative positional relationship between the wearable device and the obstacle according to the ultrasonic signal emitted by the wearable device and the reflection signal received by the wearable device, including: after receiving the guide instruction, the wearable device emits an ultrasonic signal according to a preset emission period, receives a reflection signal of the ultrasonic signal reflected by the obstacle, and determines the relative positional relationship between the wearable device and the obstacle according to the emitted ultrasonic signal and the received reflection signal.

[0013] After the wearer wears the wearable device, the wearable device can emit an ultrasonic signal (or also referred to as an ultrasonic wave). If an obstacle is encountered during the straight propagation of the ultrasonic signal, the ultrasonic signal will be reflected. The wearable device can detect the reflected signal of the ultrasonic wave. According to the emission time and the reception time of the ultrasonic signal, combined with the propagation speed of the ultrasonic wave, the distance between the obstacle and the wearable device can be calculated. Combined with the receiving direction of the sensor receiving the reflected signal, the direction of the obstacle relative to the wearable device can be determined. Through the orientation sensor of the wearable device, the first orientation information of the wearable device relative to the wearer is determined, so that even if the posture of the wearable device changes, the orientation information of the obstacle relative to the wearer can still be determined according to the first orientation information of the wearable device and the wearer, so that more accurate obstacle position information can be obtained, and the wearable device does not need to be held, so that the hands are free and the convenience of use of the user is improved.

[0014] After the wearable device obtains the first orientation information and the relative position relationship, a wireless connection can be used, for example, the wearable device can establish a connection with an electronic device through a Bluetooth communication protocol. The electronic device can be a smart phone or other device commonly used by the user. After receiving the relative position relationship and the first orientation information, the electronic device can broadcast the orientation of the obstacle and the distance between the obstacle and the wearer in real time (which can be determined according to the distance between the obstacle and the wearable device, or directly using the distance between the obstacle and the wearable device as the distance between the obstacle and the wearer). When the electronic device broadcasts the navigation, the distance and the orientation between the obstacle and the wearer can be broadcast through a voice, for example, through a voice assistant, or the broadcasting can be performed through a combination of vibration intensity and voice. For example, the orientation of the obstacle can be played through a voice, and the distance between the wearer and the obstacle can be broadcast through vibration intensity, so that the wearer can more effectively determine the distance between the obstacle and the wearer through the size of the vibration intensity.

[0015] In combination with the second aspect, in a first possible implementation manner of the first aspect, the relative position relationship includes second orientation information between the wearable device and the obstacle, and a distance between the wearable device and the obstacle; and the navigation of the wearer according to the relative position relationship and the first orientation information includes: determining third orientation information of the obstacle relative to the wearer according to the first orientation information of the wearable device relative to the wearer and the second orientation information between the wearable device and the obstacle; and navigating the wearer according to the distance and the third orientation information.

[0016] The third-party position information between the obstacle and the wearer can be directly calculated by the wearable device and directly broadcasted by the wearable device. When the wearable device broadcasts the navigation information, the navigation information can be broadcasted in a voice manner or in a voice and vibration intensity manner, thereby improving the convenience of using the wearable device.

[0017] In a second possible implementation manner of the first aspect, the navigation of the wearer according to the distance and the third-party position information comprises: broadcasting the distance and the third-party position information in real time through a voice or broadcasting the distance and the third-party position information through a voice and vibration intensity when the distance and / or the third-party position information reaches a predetermined prompt condition.

[0018] The prompt condition can include a distance condition, a position condition, and a distance and position condition. The distance condition can include a pre-set distance threshold or a distance range. When the distance between the detected obstacle and the wearer reaches the pre-set distance threshold, the obstacle information is broadcasted. Or when the distance between the detected obstacle and the wearer meets the pre-set distance range, the obstacle information is broadcasted. The position condition can include whether there is an obstacle in a predetermined position, such as a front position, including a left front position and a right front position. If there is an obstacle, the obstacle is prompted. The position condition and the distance condition can be that the distance between the obstacle in the predetermined position and the wearer reaches a pre-set distance requirement, and the obstacle information is broadcasted.

[0019] In a third possible implementation manner of the second aspect, the first possible implementation manner of the second aspect, or the second possible implementation manner of the second aspect, the relative position relationship between the wearable device and the obstacle is determined according to the ultrasonic signal emitted by the wearable device and the reflected signal received by the wearable device, and the third-party position information between the obstacle and the wearer is determined according to the relative position relationship, and the navigation of the wearer is performed according to the distance and the third-party position information, comprising: emitting the ultrasonic signal according to a pre-set emission period; receiving the reflected signal of the ultrasonic signal reflected by the obstacle, determining the distance between the obstacle and the wearable device according to the receiving time of the ultrasonic signal and the receiving time of the emission signal, and determining the first position information of the obstacle relative to the wearable device according to the ultrasonic sensor receiving the reflected signal.

[0020] In determining the relative positional relationship between the wearable device and the obstacle, the time interval between the sending time and the receiving time of the ultrasonic signal can be used to determine the propagation time of the ultrasonic signal, and the distance between the obstacle and the wearable device at that time can be calculated in combination with the propagation speed of the ultrasonic signal. The first orientation information of the obstacle relative to the wearable device is determined according to the range of the ultrasonic signal received by the ultrasonic sensor in the wearable device. The range of the ultrasonic signal received by the ultrasonic sensor can be determined according to the position of the ultrasonic sensor in the wearable device, and the detection range of the ultrasonic sensor can be divided or the range of the ultrasonic signal received by the ultrasonic sensor can be determined according to the position of the ultrasonic sensor in the wearable device.

[0021] In combination with the third possible implementation manner of the second aspect, in a fourth possible implementation manner of the second aspect, the preset transmission period includes a mute time length and an ultrasonic signal filling time length, and the detection time length of the obstacle in the detection range is greater than the ultrasonic signal filling time length and less than the mute time length. The ultrasonic signal filling time length is the transmission time length of the ultrasonic signal in the transmission period, and the mute time length is the time length in which no ultrasonic signal is transmitted in the transmission period.

[0022] In order to avoid the detection blind area, the mute time length and the ultrasonic signal filling time length in the transmission period can be determined according to the detection time length determined by the detection range, that is, the detection time length is greater than the ultrasonic signal filling time length and less than the mute time length. The detection time length refers to the time interval between the ultrasonic signal transmission time and the time at which the reflected signal obtained by reflecting the ultrasonic signal is received. The ultrasonic signal filling time length refers to the time length during which the ultrasonic signal is transmitted in the transmission period. The mute time length refers to the time length during which no ultrasonic signal is transmitted in the transmission period. In the embodiment of the present application, the ultrasonic signal is transmitted in a single transmission period, so that the transmission time of the ultrasonic signal corresponding to the received reflected signal can be determined.

[0023] In the embodiment of the present application, the detection time length can be determined according to the distance range of the obstacle to be detected. For example, the minimum detection distance is Rmin=4.25 cm, and the maximum detection distance is Rmax=5 m. According to the calculation formula of the detection distance: T=2R / c, the minimum value Tmin of the time interval between the reception of the reflected signal and the transmission of the ultrasonic signal, that is, the detection time T, is 0.25 ms, wherein R is the distance between the obstacle and the wearable device, and c is the propagation speed of the ultrasonic signal, which can be taken as 340 m / s. The maximum value Tmax of the time interval between the reception of the reflected signal and the transmission of the ultrasonic signal, that is, the detection time T, is 0.029 seconds.

[0024] In a fifth possible implementation manner of the second aspect, the first possible implementation manner of the second aspect, the second possible implementation manner of the second aspect, the third possible implementation manner of the second aspect, or the fourth possible implementation manner of the second aspect, the wearable device is a wireless earphone, and the ultrasonic signal is emitted by an ultrasonic emitter of the wireless earphone, and the reflected signal of the ultrasonic wave is received by a microphone of the wireless earphone.

[0025] The wireless earphone is used as a blind guiding device, and the microphone of the wireless earphone can be used to receive the reflected signal of the ultrasonic signal feedback. When the wireless earphone is connected to the electronic device, the collected data can be sent to the electronic device through the Bluetooth protocol, and the obstacle information is calculated and broadcast by the electronic device. The obstacle information includes the distance between the obstacle and the wearer, the third azimuth information of the obstacle and the wearer, and the like. When the wireless earphone broadcasts the obstacle information, the broadcasting can be directly performed through the loudspeaker in the wireless earphone, or the broadcasting can be performed through the vibration signal and the audio signal in the wireless earphone. When the broadcasting is performed through the wireless earphone, the position information of the obstacle can correspond to the position of the wireless earphone. For example, the obstacle located on the right side is broadcast through the vibration or audio of the wireless earphone on the right side, thereby improving the convenience of the user in obtaining the position of the obstacle.

[0026] In the sixth possible implementation manner of the second aspect, the wireless earphone includes a plurality of ultrasonic sensors, the ultrasonic sensors include the ultrasonic emitter and the microphone, and the plurality of ultrasonic sensors are used to detect the obstacle information in a 360-degree range around the wearer.

[0027] The ultrasonic sensors are arranged in the wireless earphone, including the ultrasonic emitter and the ultrasonic receiver, wherein the ultrasonic receiver can be a microphone built in the earphone. By wearing the wireless earphone, the azimuth detection of the obstacles in a 360-degree range around the wearer can be realized. For example, the obstacles in the area on the left side can be detected through the wireless earphone on the left side, and the obstacles in the area on the right side can be detected through the wireless earphone on the right side. In addition, for the azimuth reminding of the obstacles, the left wireless earphone and the right wireless earphone can be combined to distinguish and remind the obstacles.

[0028] The wireless earphone can include two wireless earphones, i.e., a first wireless earphone and a second wireless earphone. The first wireless earphone can include a first ultrasonic sensor and a second ultrasonic sensor, the second wireless earphone can include a third ultrasonic sensor and a fourth ultrasonic sensor, the coverage range of each sensor is four equally divided ranges around the wearer, and each ultrasonic sensor includes an ultrasonic emitter and a microphone used to receive the reflected signal.

[0029] By setting two ultrasonic sensors in the wireless earphone respectively, the four ultrasonic sensors are used to divide the area around the wearer. For example, each sensor can detect a 90-degree corresponding area, and the four sensors can detect a 360-degree range of areas around the wearer, so as to realize the detection of obstacles in the full range around the wearer.

[0030] With reference to the second aspect, in a seventh possible implementation manner of the first aspect, the wearable device obtaining the first orientation information of the wearable device relative to the wearer from the orientation sensor of the wearable device comprises: the wearable device obtaining posture information of the wearer collected by the orientation sensor of the wearable device, the posture information comprising a deflection angle; and the wearable device determining the first orientation information of the wearable device relative to the wearer according to the collected posture information of the wearer.

[0031] When detecting the posture information of the wearer by the orientation sensor, the motion characteristics of different posture changes can be preset. The sensor information detected by the orientation sensor is compared with the preset motion characteristics to determine whether the posture of the wearer changes. For example, the posture change of the wearer can include a head turning posture, a body leaning posture, or a turning posture, etc. According to the change of different postures, the first orientation information between the wearable device and the wearer is determined.

[0032] In the third aspect, the embodiments of the present application provide a guide blind system, which comprises a wearable device and an electronic device, wherein: the wearable device is configured to determine a relative position relationship between the wearable device and an obstacle according to a transmitted ultrasonic signal and a received reflection signal, the reflection signal being a signal reflected by the obstacle from the ultrasonic signal, determine first orientation information of the wearable device relative to a wearer according to an orientation sensor of the wearable device; and the electronic device is configured to guide the wearer according to the relative position relationship and the first orientation information.

[0033] While determining the relative position relationship of the obstacle relative to the wearable device based on the reflection signal of the transmitted ultrasonic signal detected by the wearable device, the first orientation information of the wearable device relative to the wearer is also detected by the orientation sensor. The wearable device can determine third orientation information of the obstacle relative to the wearer according to the first orientation information and the relative position relationship, and send the detected distance of the obstacle and the third orientation information to the electronic device, so that the electronic device gives a voice or vibration reminder. Alternatively, the wearable device can also send the relative position relationship and the first orientation information to the electronic device, so that the electronic device calculates the third orientation information of the obstacle relative to the wearer, and gives a voice or vibration navigation according to the distance between the obstacle and the wearer and the third orientation information of the obstacle relative to the wearer.

[0034] With reference to the third aspect, in a first possible implementation manner of the third aspect, the relative position relationship includes second orientation information between the wearable device and the obstacle, and a distance between the wearable device and the obstacle, and the electronic device is configured to navigate the wearer according to the relative position relationship and the first orientation information, including: the electronic device determines third orientation information of the obstacle relative to the wearer according to the first orientation information of the wearable device relative to the wearer and the second orientation information of the obstacle relative to the wearable device, and navigates the wearer according to the distance and the third orientation information.

[0035] The second orientation information can be determined according to an ultrasonic sensor that collects a reflection signal of an ultrasonic signal. When the electronic device receives data including the first orientation information, the second orientation information, and the distance between the obstacle and the wearable device, the electronic device can determine third orientation information of the obstacle relative to the wearer according to the first orientation information of the wearable device relative to the wearer and the second orientation information of the obstacle relative to the wearable device. According to the third orientation information and the distance, the electronic device can determine the distance and the orientation of the obstacle, and can report the obstacle in real time in the form of voice or vibration.

[0036] With reference to the first possible implementation manner of the third aspect, in a second possible implementation manner of the third aspect, the electronic device navigates the wearer according to the distance and the third orientation information, including: the electronic device reports the distance and the third orientation information in real time through voice, or reports the distance and the third orientation information through voice and vibration intensity.

[0037] When reporting the distance and the third orientation information, the reporting can be in the form of real-time reporting and / or distance threshold reporting. Real-time reporting refers to reporting the position of the obstacle according to a predetermined time interval. When reporting according to a distance threshold, the distance between the obstacle and the wearer is compared with a pre-set distance threshold, and if the distance is less than the pre-set distance threshold, the position of the obstacle is reported. The distance threshold can include one or more distance thresholds. In a possible implementation manner, the distance threshold can be used to report when the distance is far, and the position of the obstacle can be reported in real time when the distance is close.

[0038] In a third possible implementation manner of the third aspect, the third possible implementation manner of the third aspect, the second possible implementation manner of the third aspect, the third possible implementation manner of the third aspect, or the fourth possible implementation manner of the third aspect, in a fifth possible implementation manner of the third aspect, the wearable device is a wireless earphone, and the wearable device transmits the ultrasonic signal through an ultrasonic transmitter of the wireless earphone and receives the reflected ultrasonic signal through a microphone of the wireless earphone.

[0039] The ultrasonic signal is transmitted according to the preset transmission period, so that the received reflected signal can be received after the ultrasonic signal transmission in one period is completed, that is, the filling time length of the ultrasonic signal is less than the detection time length of the minimum detection distance, and the mute time length of the ultrasonic signal is greater than the detection time length of the maximum detection distance. The purpose of such setting is to ensure that the receiving time of the reflected signal does not occur in the filling area in the detection period, thereby improving the accuracy of the calculated distance between the obstacle and the wearable device. For example, the filling time length of the ultrasonic signal is less than the detection time length of the minimum detection distance, so that the receiving time of the reflected signal does not occur in the same area as the transmission time of the ultrasonic signal. The mute time length of the ultrasonic signal is greater than the detection time length of the maximum detection distance, so that the receiving time of the reflected signal of the ultrasonic signal does not occur in the same area as the transmission time of the ultrasonic signal in the next period.

[0040] In a fifth possible implementation manner of the third aspect, the third possible implementation manner of the third aspect, the second possible implementation manner of the third aspect, the third possible implementation manner of the third aspect, or the fourth possible implementation manner of the third aspect, the wearable device is a wireless earphone, and the wearable device transmits the ultrasonic signal through an ultrasonic transmitter of the wireless earphone and receives the reflected ultrasonic signal through a microphone of the wireless earphone.

[0041] The ultrasonic signal is transmitted and detected through the wireless earphone, which can utilize the microphone device in the wireless earphone and improve the utilization efficiency of the device in the wireless earphone.

[0042] In a fourth aspect, an embodiment of the present application provides a blind guiding device, which is applied to a wearable device, and includes: a relative position relationship determining unit, configured to determine a relative position relationship between the wearable device and an obstacle according to an ultrasonic signal emitted by the wearable device and a reflected signal received by the wearable device, wherein the reflected signal is a signal reflected by the obstacle; a first orientation information detecting unit, configured to acquire first orientation information of the wearable device relative to a wearer collected by an orientation sensor of the wearable device; and a navigation unit, configured to guide the wearer according to the relative position relationship determined by the relative position relationship determining unit and the first orientation information detected by the first orientation information detecting unit.

[0043] In a fifth aspect, an embodiment of the present application provides a blind guiding device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the wearable device implements the method in any one of the first aspect.

[0044] In a sixth aspect, an embodiment of the present application provides a computer readable storage medium, which stores a computer program, and when the processor executes the computer program, the wearable device implements the method in any one of the first aspect.

[0045] It can be understood that the beneficial effects of the second aspect to the sixth aspect can be referred to the related description in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0046] Figure 1 A structural schematic diagram of a wearable device provided by an embodiment of the present application;

[0047] Figure 2 A schematic diagram of a wireless earphone and an earphone box provided by an embodiment of the present application;

[0048] Figure 3 A structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0049] Figure 4 An implementation flowchart of a blind guiding method provided by an embodiment of the present application;

[0050] Figure 5 An implementation flowchart of another blind guiding method provided by an embodiment of the present application;

[0051] Figures 6a-6d A group of interface schematic diagrams of setting a wearable device to establish a connection with an electronic device provided by an embodiment of the present application;

[0052] Figure 7A region division schematic diagram of an ultrasonic sensor of a wireless earphone provided for an embodiment of the present application;

[0053] Figure 8 A schematic diagram of a transmission period of an ultrasonic signal provided for an embodiment of the present application;

[0054] Figures 9a-9b A schematic diagram of a transmission signal and a reflection signal provided for an embodiment of the present application;

[0055] Figure 10 A schematic diagram of a guide blind system provided for an embodiment of the present application. DETAILED DESCRIPTION

[0056] In the field of blind navigation, the blind guide device used can include a guide cane, guide glasses or a guide robot, etc. Since ultrasonic waves have strong directivity, energy is easy to concentrate and the propagation distance is far, the position of the obstacle can be detected more accurately, therefore, the guide device can usually use the ultrasonic signal transmitted by the ultrasonic transmitter to detect obstacles, and according to the detected obstacle position, an obstacle avoidance prompt is sent to the blind person, so that the blind person can avoid obstacles during walking in the case of poor or lack of vision, effectively assisting the blind person to walk.

[0057] For example, when a blind person uses ultrasonic-based blind avoidance glasses, the blind person emits ultrasonic signals through the ultrasonic sensors provided on the glasses, receives the reflection signals of the ultrasonic signals, and determines the distance between the obstacle and the wearer based on the reception time of the reflection signals and the transmission time of the ultrasonic signals. However, due to the stability of the guide glasses or the change of the body posture of the wearer, the detected position information of the obstacle is not accurate, which is not conducive to helping the wearer to guide more accurately.

[0058] For example, when a blind person uses a guide cane configured with an ultrasonic sensor, the blind person holds the cane, and according to the pointing position of the cane of the blind person, obtains the obstacle detection information corresponding to the pointing position.

[0059] When a blind person uses a guide cane, the blind person can mimic the mode of using a common cane to explore the road to obtain obstacle information, and can obtain more range of obstacle information than a common cane, which is conducive to improving the convenience of using the cane. However, during the use of the cane, the position of the cane held may change. When the position of the cane held changes, the position of the detected obstacle is not accurate. For example, the relative position information of the detected obstacle and the cane may deviate, which is not conducive to the blind person to accurately obtain obstacle information and is not conducive to accurately guiding.

[0060] For example, when a blind person uses a guide robot (or also called a guide trolley) to guide, the blind person wears a special marker, and the guide robot detects the reflection signal of the marker by sending ultrasonic waves to the blind person to determine the distance between the guide robot and the blind person. And through the surrounding environment information detected by the guide robot, the obstacles are broadcasted.

[0061] When using the guide robot to guide, a specific marker needs to be worn, and the guide robot needs to be used for assistance, and even the user needs to wear a wireless earphone to obtain the prompt sound of the obstacle. The system is more troublesome to use. And in the process of use, the robot needs to be synchronized with the blind person. If the synchronization is not timely, it is not conducive to providing accurate obstacle information.

[0062] In order to provide more accurate obstacle information and improve the convenience of use of the user, an embodiment of the present application provides a wearable device. The wearable device can be a wireless earphone, smart glasses and the like.

[0063] An embodiment of the present application takes the wearable device as a wireless earphone for illustration. As shown in Figure 1 The wireless earphone 100 can include at least one processor 101, at least one memory 102, a wireless communication module 103, an audio module 104, a power module 105, an input / output interface 106, an ultrasonic sensor 107, an orientation sensor 108, and a button 109, etc. The processor can include one or more interfaces for connecting with other components of the wireless earphone 100. The wireless earphone 100 can be stored in an earphone box.

[0064] The memory 102 can be used to store program codes, such as program codes for virtual connection or physical connection between the wireless earphone 100 and an electronic device, switching the physical connection between the wireless earphone 100 and the electronic device, processing audio services (such as music playing, receiving / calling, etc.) of the electronic device, and program codes for charging the wireless earphone 100, and wireless pairing connection between the wireless earphone 100 and other electronic devices. The memory 102 can also be used to store other information, such as the priority of the electronic device.

[0065] The processor 101 can be used to execute the above-mentioned application program codes, and call related modules to realize the functions of the wireless earphone 100 in the embodiments of the present application. For example, realize the functions of virtual connection or physical connection between the wireless earphone 100 and the electronic device, audio playing, receiving / calling, switching the physical connection between the wireless earphone 100 and different electronic devices according to the priority of the device, etc.

[0066] For another example, the processor 101 can also control the ultrasonic sensor to emit an ultrasonic signal according to a predetermined emission cycle, acquire a time when a reflected signal of the ultrasonic signal is detected, and determine a distance between the obstacle and the wearer according to the emission time and the reception time. According to the ultrasonic sensor that detects the reflected signal and the action information of the wearer detected by the orientation sensor, the orientation information of the obstacle relative to the wearer is determined.

[0067] The processor 101 can include one or more processing units, and different processing units can be independent devices or integrated in one or more processors 101. The processor 101 can be an integrated control chip, or can be composed of a circuit including various active and / or passive components, and the circuit is configured to perform the functions described in the embodiments of the present application that belong to the processor 101.

[0068] The wireless communication module 103 can be used to support the wireless earphone 100 to exchange data with other electronic devices or earphone boxes through wireless communication technologies such as BT (Chinese full name is Bluetooth, English full name is BlueTooth), WLAN (such as Wi-Fi), Zigbee, FM, NFC, IR, or general 2.4G / 5G wireless communication technology, etc.

[0069] In some embodiments, the wireless communication module 103 can be a Bluetooth chip. The wireless earphone 100 can pair with and establish a wireless connection with the Bluetooth chip of other electronic devices through the Bluetooth chip, so as to realize wireless communication and service processing between the wireless earphone 100 and other electronic devices through the wireless connection. The wireless connection can be a physical connection or a virtual connection. Generally, the Bluetooth chip can support basic rate (BR) / enhanced data rate (EDR) Bluetooth and BLE, for example, can receive / transmit paging information, receive / transmit BLE broadcast messages, etc.

[0070] In addition, the wireless communication module 103 can also include an antenna, and the wireless communication module 103 receives electromagnetic waves via the antenna, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 101. The wireless communication module 103 can also receive signals to be sent from the processor 101, perform frequency modulation and amplification on the signals, and convert the signals into electromagnetic wave radiation via the antenna.

[0071] The audio module 104 can be configured to manage audio data and implement input and output of audio signals of the wireless earphone 100. For example, the audio module 104 can obtain audio signals from the wireless communication module 103 or deliver audio signals to the wireless communication module 103, so as to implement functions such as making / receiving a call, playing music, starting / closing a voice assistant of an electronic device connected with the earphone, receiving / sending voice data of a user, and the like through a Bluetooth earphone. The audio module 104 can include a speaker (or a receiver) component for outputting audio signals, a microphone (or a microphone), a microphone sound receiving circuit cooperating with the microphone, and the like.

[0072] The speaker can be configured to convert an audio electrical signal into a sound signal and play the sound signal. The microphone can be configured to convert a sound signal into an audio electrical signal, or convert a reflected signal of ultrasonic waves into an ultrasonic electrical signal.

[0073] The power module 105 can be configured to provide a system power supply of the wireless earphone 100, supply power to each module of the wireless earphone 100, support the wireless earphone 100 to receive a charging input, and the like. The power module 105 can include a power management unit (PMU) and a battery. The power management unit can receive an external charging input, transform an electrical signal input by a charging circuit and provide the electrical signal to the battery for charging, transform an electrical signal provided by the battery and provide the electrical signal to the audio module 104, the wireless communication module 103, and other modules, and prevent overcharging, over-discharging, short circuit, overcurrent, and the like of the battery. In some embodiments, the power module 105 can further include a wireless charging coil for wirelessly charging the wireless earphone 100. In addition, the power management unit can be configured to monitor parameters such as a battery capacity, a battery cycle number, a battery health status (leakage, impedance), and the like.

[0074] The plurality of input / output interfaces 106 can be configured to provide a wired connection for charging or communication between the wireless earphone 100 and the earphone case. In some embodiments, the input / output interface can be a USB interface. In other embodiments, the input / output interface 106 can be an earphone electrical connector. When the wireless earphone 100 is placed in the earphone case, the wireless earphone 100 can establish an electrical connection with an electrical connector in the earphone case through the earphone electrical connector, so as to charge the battery in the wireless earphone 100. In other embodiments, after the electrical connection is established, the wireless earphone 100 can also perform data communication with the earphone case, for example, can receive a pairing instruction from the earphone case.

[0075] In addition, the wireless earphone 100 comprises an ultrasonic sensor 107 and an orientation sensor 108. The ultrasonic sensor comprises an ultrasonic transmitter and an ultrasonic receiving device. The ultrasonic transmitter is configured to emit an ultrasonic signal in a predetermined period. The ultrasonic receiving device is configured to detect a reflected signal reflected by an obstacle. The receiving time of the detected reflected signal and the emission time of the ultrasonic signal are recorded by a processor, and the recorded time data can be transmitted to an electronic device connected to the wireless earphone for data processing, or the distance and orientation information between the obstacle and the wearer can be calculated by the wireless earphone.

[0076] The orientation sensor 108 can be a gyroscope. The angular velocity of the wireless earphone around three axes (i.e., x, y, and z axes) is determined by the orientation sensor to obtain the action feature information of the wearer. By comparing the feature information, the action currently performed by the user can be determined, including, for example, a head turning action, a body turning action, or a turning or turning around action.

[0077] The wireless earphone can also comprise a distance sensor or a proximity light sensor, which can be used to determine whether the wireless earphone 100 is worn by the user. For example, the wireless earphone 100 can use the distance sensor to detect whether there is an object near the wireless earphone 100, so as to determine whether the wireless earphone 100 is worn by the user. When it is determined that the wireless earphone 100 is worn, the wireless earphone 100 can turn on the loudspeaker.

[0078] For another example, the wireless earphone can also comprise a bone conduction sensor, which is combined into a bone conduction earphone. Using the bone conduction sensor, the wireless earphone 100 can obtain the vibration signal of the human vocal part vibration bone block, analyze the voice signal, and realize the voice function, so as to receive the voice instruction of the user. The wireless earphone 100 can also perform voice authentication according to the voice signal of the user obtained by the bone conduction earphone, so as to authenticate the identity of the user in a business scenario such as a payment transaction.

[0079] For another example, the wireless earphone can also comprise a touch sensor for detecting the touch operation of the user, a fingerprint sensor for detecting the fingerprint of the user to identify the identity of the user, an ambient light sensor that can adaptively adjust some parameters (such as the volume) according to the brightness of the sensed ambient light, and other sensors.

[0080] In some embodiments, the touch sensor can detect the touch operation of the user, such as single click, double click, multiple clicks, long press, heavy pressure, and the like, and can also perform fingerprint identification of the user to authenticate the identity of the user in a business scenario such as a payment transaction.

[0081] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the wireless earphone 100. It can have more or fewer structures than those shown in the embodiments of the present application. Figure 1More or fewer elements than shown can be present. Two or more elements can be combined into a single element, or a position that is different than depicted can be employed. For example, the outer surface of the wireless earphone 100 can further include a button 109, an indicator light (which can indicate the status of the power, incoming / outgoing, pairing mode, etc.), a display screen (which can prompt the user with relevant information), a dust screen (which can be used in conjunction with the earpiece), and the like. The button 108 can be a physical button or a touch button (used in conjunction with a touch sensor), and the like, and can be used to trigger operations such as turning on / off, pausing, playing, recording, starting pairing, resetting, and the like.

[0082] Figure 1 The various elements shown can be implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing or application specific integrated circuits.

[0083] For example, when the wireless earphone is a TWS earphone, as shown in Figure 2 The wireless earphone 200 can include an earphone body 201 (also referred to as a left earplug or a first part) worn on the left ear and an earphone body 202 (also referred to as a right earplug or a second part) worn on the right ear, respectively. The earphone body can include a housing and internal components. The internal components are disposed in a cavity formed by the housing. The internal components can include devices in the above-mentioned audio module, power module, and wireless communication module, and the like.

[0084] When the wireless earphone is a TWS (True Wireless Stereo) earphone, the user can use the TWS earphone in a dual-ear mode. In the dual-ear mode, the user (or wearer) can wear two earplugs to collect obstacle information in the scene where the user is located, and according to the collected obstacle information, the wireless earphone can broadcast the obstacle information, or the wireless earphone can send the collected data to an electronic device, and the electronic device can broadcast the distance and direction information between the obstacle and the wearer in the form of voice or vibration.

[0085] In the dual-ear mode, the two earplugs are divided into a main earplug and a secondary earplug. Moreover, the main and secondary roles of the two earplugs can be switched during the use of the TWS earphone.

[0086] In some embodiments, the TWS earphone can interact with the electronic device to control information such as connection control information and service control information through the main earplug. Thus, a physical connection and a virtual connection with the electronic device can be established or disconnected according to the connection control information, and service action control (such as pausing, playing, previous song, etc.) and the like can be performed according to the service control information.

[0087] In one case, the primary earbud and the electronic device establish a wireless connection, and the primary earbud and the electronic device can communicate wirelessly, interact control information and audio data, including sending collected ultrasonic data to the electronic device, or sending processed data to the electronic device. The primary earbud and the secondary earbud also establish a wireless connection, and the primary earbud can notify the secondary earbud to synchronize the state, such as establishing / disconnecting a physical connection, a virtual connection, etc. with the electronic device. The secondary earbud can receive audio data sent by the electronic device through forwarding, listening or near field magnetic induction (NFMI) of the primary earbud, etc.

[0088] In the listening scheme, the electronic device and the primary earbud establish a Bluetooth connection, complete the sending of audio data to the primary earbud, and complete the service action triggered by the electronic device and the TWS earphone (such as playing, pausing, switching to the previous song, increasing the volume, etc.); The two earbuds establish a Bluetooth connection to complete the information synchronization between the two earbuds; the secondary earbud obtains audio data by listening to the Bluetooth link between the primary earbud and the electronic device.

[0089] In the forwarding scheme, the electronic device and the primary earbud establish a Bluetooth connection, complete the sending of audio data to the primary earbud, and complete the service action triggered by the electronic device and the TWS earphone; The two earbuds establish a Bluetooth connection to complete the information synchronization between the two earbuds, and the primary earbud forwards the audio data to the secondary earbud through the Bluetooth link between the primary earbud and the secondary earbud.

[0090] In the NFMI scheme, the electronic device and the primary earbud establish a Bluetooth connection, complete the sending of audio data to the primary earbud, and complete the service action triggered by the electronic device and the TWS earphone; The two earbuds establish an NFMI connection to complete the information synchronization between the two earbuds, and the primary earbud forwards the audio data to the secondary earbud through the NFMI link between the primary earbud and the secondary earbud.

[0091] In another case, the primary earbud and the secondary earbud can establish a dual-transmit connection with the electronic device. In the dual-transmit scheme, the electronic device establishes a Bluetooth connection with the two earbuds of the TWS earphone respectively. In some embodiments, the electronic device interacts with the two earbuds of the TWS earphone through the Bluetooth link between them respectively to interact audio data, service control information, etc., to realize audio data playing and service action control, etc. The TWS earphone can also include a primary earbud and a secondary earbud. The primary earbud interacts connection control information with the electronic device, and the primary earbud notifies the secondary earbud to synchronize the connection state.

[0092] And, since the primary and secondary roles of the two earbuds of the TWS earphone can be switched during use, the primary earbud can synchronize relevant information required for establishing or disconnecting the physical connection and virtual connection with the electronic device to the secondary ear; so that after the secondary ear is switched to the primary ear, the physical connection and virtual connection with the electronic device can be established or disconnected according to the relevant information. For example, the relevant information can include historical pairing information, historical connection information, device priority information, service priority information, etc. of the electronic device.

[0093] In some embodiments, the electronic device establishes Bluetooth connection with the two earbuds of the TWS earphone respectively in a dual-transmit scheme. The electronic device interacts with the connection control information, audio data and service control information through the Bluetooth link between the electronic device and the two earbuds of the TWS earphone respectively.

[0094] In addition, Figure 2 A schematic diagram of an earphone case 203 for accommodating the wireless earphone 200 is also shown. In some embodiments, the earphone case can have one or more magnets inside to attract the earphone body into the cavity inside the earphone case. The earphone case can include a battery and a plurality of input / output interfaces. In some embodiments, the input / output interface can be a box electrical connector. When a pair of box electrical connectors in the earphone case establishes electrical connection with two earphone electrical connectors in the earphone body respectively, the earphone case can charge the battery in the earphone body through its own battery.

[0095] In some embodiments, the earphone case can be provided with at least one touch control, which can be used to trigger the wireless earphone to perform pairing reset or charging of the wireless earphone, etc. The earphone case can also be provided with one or more power indicator lights to prompt the user about the size of the battery power in the earphone case and the size of the battery power in each earphone body in the earphone case.

[0096] In some embodiments, the earphone case can also include a processor, a memory and other components. The memory can be used to store application program codes and be controlled and executed by the processor of the earphone case to realize various functions of the earphone case. For example, the processor of the earphone case charges the wireless earphone after detecting that the wireless earphone is put into the earphone case and the cover of the earphone case is closed, etc. by executing the application program codes stored in the memory.

[0097] In addition, the earphone case can also be provided with a charging interface for charging the battery of the earphone case. The earphone case can also include a wireless charging coil for wirelessly charging the battery of the earphone case. It can be understood that the earphone case can also include other components, which are not described one by one here.

[0098] In a possible implementation, the wireless earphone can establish a connection with the electronic device, process the collected data through the electronic device, and broadcast the obstacle information according to the processed result. Figure 3 A structural diagram of an electronic device is shown as Figure 3 As shown, the electronic device 300 can include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (USB) interface 330, a charging management module 340, a power management unit 341, a battery 342, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, a headset interface 370D, a sensor module 380, a key 390, a motor 391, an indicator 392, a camera 393, a display screen 394, and a subscriber identification module (SIM) card interface 395, and the like. The sensor module 380 can include a pressure sensor 380A, a gyroscope sensor 380B, a barometric pressure sensor 380C, a magnetic sensor 380D, an acceleration sensor 380E, a distance sensor 380F, a proximity light sensor 380G, a fingerprint sensor 380H, a temperature sensor 380J, a touch sensor 380K, an ambient light sensor 380L, a bone conduction sensor 380M, and the like.

[0099] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 300. In other embodiments of the present application, the electronic device 300 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0100] The processor 310 can include one or more processing units, for example: the processor 310 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), and the like. Different processing units can be independent devices, or can be integrated into one or more processors.

[0101] The controller can be the nerve center and command center of the electronic device 300. The controller can generate operation control signals according to instruction operation codes and timing signals to complete the control of instruction fetching and instruction execution.

[0102] The processor 310 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. The memory can store instructions or data that the processor 310 has just used or recycled. If the processor 310 needs to use the instructions or data again, it can be directly called from the memory. This avoids repeated access and reduces the waiting time of the processor 310, thereby improving the efficiency of the system.

[0103] In some embodiments, the processor 310 can include one or more interfaces. The interface can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0104] The I2S interface can be used for audio communication. In some embodiments, the processor 310 can contain multiple sets of I2S buses. The processor 310 can be coupled with the audio module 370 through the I2S bus to achieve communication between the processor 310 and the audio module 370. In some embodiments, the audio module 370 can deliver audio signals to the wireless communication module 360 through the I2S interface to achieve the function of answering a phone through a Bluetooth headset.

[0105] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 370 can be coupled with the wireless communication module 360 through a PCM bus interface. In some embodiments, the audio module 370 can also transmit audio signals to the wireless communication module 360 through the PCM interface, enabling the function of answering a phone call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0106] The UART interface is a universal serial bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 310 and the wireless communication module 360. For example, the processor 310 communicates with the Bluetooth module in the wireless communication module 360 through the UART interface, enabling Bluetooth function. In some embodiments, the audio module 370 can transmit audio signals to the wireless communication module 360 through the UART interface, enabling the function of playing music through a Bluetooth headset.

[0107] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 300. In other embodiments of the present application, the electronic device 300 can also use different interface connection methods or combinations of multiple interface connection methods in the above embodiments.

[0108] The charging management module 340 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 340 can receive charging input from a wired charger through the USB interface 330. In some wireless charging embodiments, the charging management module 340 can receive wireless charging input through the wireless charging coil of the electronic device 300. The charging management module 340 charges the battery 342 while also providing power to the electronic device through the power management unit 341.

[0109] The power management unit 341 is used to connect the battery 342, the charging management module 340 and the processor 310. The power management unit 341 receives input from the battery 342 and / or the charging management module 340 to provide power to the processor 310, the internal memory 321, the external memory, the display screen 394, the camera 393 and the wireless communication module 360, etc. The power management unit 341 can also be used to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In other embodiments, the power management unit 341 can also be arranged in the processor 310. In other embodiments, the power management unit 341 and the charging management module 340 can also be arranged in the same device.

[0110] The wireless communication function of the electronic device 300 can be implemented through the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, the modem processor, and the baseband processor, etc.

[0111] The antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 300 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0112] The mobile communication module 350 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied to the electronic device 300. The mobile communication module 350 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 350 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 350 can also amplify the signals modulated by the modem processor, and convert the signals into electromagnetic waves radiated by the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 350 can be arranged in the processor 310. In some embodiments, at least part of the functional modules of the mobile communication module 350 and at least part of the modules of the processor 310 can be arranged in the same device.

[0113] The modem processor can include a modulator and a demodulator. The modulator is used to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 370A, the microphone 370B, etc.), or displays an image or a video through the display screen 394. In some embodiments, the modem processor can be an independent device. In some other embodiments, the modem processor can be independent of the processor 310, and arranged in the same device as the mobile communication module 350 or other functional modules.

[0114] The wireless communication module 360 can provide a solution for wireless communication including WLAN (e.g., Wi-Fi), BT, global navigation satellite system (GNSS), FM, NFC, IR, or general 2.4G / 5G wireless communication technology, etc. applied to the electronic device 300. The wireless communication module 360 can be one or more devices that integrate at least one communication processing module. The wireless communication module 360 receives electromagnetic waves via the antenna 2, frequency-modulates and filters the electromagnetic wave signals, and transmits the processed signals to the processor 310. The wireless communication module 360 can also receive signals to be transmitted from the processor 310, frequency-modulate them, amplify them, and radiate them as electromagnetic waves via the antenna 2.

[0115] In some embodiments, the wireless communication module 360 can be a Bluetooth chip. The electronic device 300 can pair with and establish a wireless connection with a Bluetooth chip of another electronic device such as a wireless earphone, and implement wireless communication and service processing between the electronic device 300 and the other electronic device through the wireless connection. The wireless connection can be a physical connection or a virtual connection. The Bluetooth chip can generally support BR / EDR Bluetooth and BLE.

[0116] In some embodiments, the antenna 1 and the mobile communication module 350 of the electronic device 300 are coupled, and the antenna 2 and the wireless communication module 360 are coupled, so that the electronic device 300 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidu navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0117] The electronic device 300 implements a display function through a GPU, a display screen 394, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 310 can include one or more GPUs, which execute program instructions to generate or change display information.

[0118] The display screen 394 is configured to display images, videos, and the like. The display screen 394 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 300 can include one or N display screens 394, where N is a positive integer greater than 1.

[0119] The electronic device 300 can implement a photographing function through an ISP, the camera 393, a video codec, a GPU, the display screen 394, and an application processor.

[0120] The ISP is configured to process data fed back by the camera 393. For example, when taking a photo, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be disposed in the camera 393.

[0121] The camera 393 is configured to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into a standard RGB, YUV, or the like format image signal.

[0122] In some embodiments, the electronic device 300 can include one or N cameras 393, where N is a positive integer greater than 1.

[0123] The digital signal processor is used to process digital signals, in addition to being able to process digital image signals, it can also process other digital signals. For example, when the electronic device 300 is in frequency point selection, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0124] The video codec is used to compress or decompress digital video. The electronic device 300 can support one or more video codecs. In this way, the electronic device 300 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0125] The NPU is a neural-network (NN) computing processor, which can quickly process input information by drawing on the structure of a biological neural network, such as drawing on the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, the electronic device 300 can realize intelligent cognition and other applications, such as: image recognition, face recognition, voice recognition, text understanding, etc.

[0126] The external memory interface 320 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the electronic device 300. The external storage card communicates with the processor 310 through the external memory interface 320 to realize data storage functions. For example, music, video, and other files are saved in the external storage card.

[0127] The internal memory 321 can be used to store computer executable program codes, which include instructions. The processor 310 executes various function applications and data processing of the electronic device 300 by running the instructions stored in the internal memory 321. The internal memory 321 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 300 (such as audio data, a phone book, etc.), etc.

[0128] In addition, the internal memory 321 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0129] The processor 310 can be configured to execute the program codes described above, and call the related modules to implement the functions of the electronic device in the embodiments of the present application. For example, pairing with the wireless earphone; when there is audio service, sending connection request information to the wireless earphone according to the priority of the audio service; establishing / disconnecting the physical connection or virtual connection between the wireless earphone, and the like.

[0130] The electronic device 300 can implement the audio function through the audio module 370, the speaker 370A, the receiver 370B, the microphone 370C, the earphone interface 370D, and the application processor, and the like. For example, music playing, recording, and the like.

[0131] The audio module 370 is configured to convert the digital audio information into an analog audio signal output, and is also configured to convert the analog audio input into a digital audio signal. The audio module 370 can also be configured to encode and decode the audio signal. In some embodiments, the audio module 370 can be arranged in the processor 310, or some of the functional modules of the audio module 370 can be arranged in the processor 310.

[0132] The speaker 370A, also known as a "loudspeaker", is configured to convert an audio electrical signal into an acoustic signal. The electronic device 300 can listen to music or listen to a hands-free call through the speaker 370A.

[0133] The receiver 370B, also known as a "earpiece", is configured to convert an audio electrical signal into an acoustic signal. When the electronic device 300 answers a call or a voice message, the receiver 370B can be held close to the ear to listen to the voice.

[0134] The microphone 370C, also known as a "microphone", "sound collector", is configured to convert an acoustic signal into an electrical signal. When making a call or sending a voice message, the user can speak into the microphone 370C close to the mouth to input the acoustic signal into the microphone 370C. The electronic device 300 can be provided with at least one microphone 370C.

[0135] In other embodiments, the electronic device 300 can be provided with two microphones 370C, in addition to collecting acoustic signals or ultrasonic signals, noise reduction functions can also be implemented.

[0136] In other embodiments, the electronic device 300 can also be provided with three, four or more microphones 370C, to implement the functions of collecting acoustic signals or ultrasonic signals, noise reduction, and also to identify the source of the sound, to implement the directional recording function, and the like.

[0137] The earphone interface 370D is used to connect a wired earphone. The earphone interface 370D can be a USB interface 330, or a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0138] The pressure sensor 380A is used to sense a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 380A can be disposed on the display screen 394. The pressure sensor 380A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. The capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 380A, the capacitance between the electrodes changes. The electronic device 300 determines the intensity of the force according to the change in capacitance. When a touch operation is applied to the display screen 394, the electronic device 300 detects the intensity of the touch operation according to the pressure sensor 380A. The electronic device 300 can also calculate the position of the touch according to the detection signal of the pressure sensor 380A.

[0139] In some embodiments, a touch operation applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view a short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

[0140] The gyroscope sensor 380B can be used to determine the motion attitude of the electronic device 300. In some embodiments, the angular velocity of the electronic device 300 around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 380B. The gyroscope sensor 380B can be used for anti-shake photography. For example, when the shutter is pressed, the gyroscope sensor 380B detects the angle of shaking of the electronic device 300, and calculates the distance that the lens module needs to compensate according to the angle, so that the lens counteracts the shaking of the electronic device 300 by reverse movement, thereby achieving anti-shake. The gyroscope sensor 380B can also be used for navigation and motion sensing game scenarios.

[0141] The barometric pressure sensor 380C is used to measure air pressure. In some embodiments, the electronic device 300 calculates the altitude, assists positioning and navigation by using the air pressure value measured by the barometric pressure sensor 380C.

[0142] The magnetic sensor 380D includes a Hall sensor. The electronic device 300 can use the magnetic sensor 380D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 300 is a flip phone, the electronic device 300 can detect the opening and closing of the flip cover using the magnetic sensor 380D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0143] The accelerometer 380E can detect the magnitude of acceleration of an electronic device 300 in various directions (typically three axes). When the electronic device 300 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of the electronic device, and can be applied to applications such as screen orientation switching and pedometers.

[0144] A distance sensor 380F is used to measure distance. Electronic device 300 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 300 can utilize the distance sensor 380F to measure distance for rapid focusing.

[0145] The proximity sensor 380G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 300 emits infrared light outward through the LED. The electronic device 300 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that an object is near the electronic device 300. When insufficient reflected light is detected, the electronic device 300 can determine that no object is near the electronic device 300. The electronic device 300 can use the proximity sensor 380G to detect when a user holds the electronic device 300 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 380G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.

[0146] The ambient light sensor 380L is used to sense the brightness of ambient light. The electronic device 300 can adaptively adjust the brightness of its display screen 394 based on the sensed ambient light level. The ambient light sensor 380L can also be used to automatically adjust the white balance when taking photos. The ambient light sensor 380L can also work in conjunction with the proximity sensor 380G to detect whether the electronic device 300 is in a pocket, preventing accidental touches.

[0147] The fingerprint sensor 380H is used to collect fingerprints. The electronic device 300 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0148] Temperature sensor 380J is used to detect temperature. In some embodiments, electronic device 300 uses the temperature detected by temperature sensor 380J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 380J exceeds a threshold, electronic device 300 performs thermal protection by reducing the performance of a processor located near temperature sensor 380J to reduce power consumption. In other embodiments, when the temperature is below another threshold, electronic device 300 heats battery 342 to prevent abnormal shutdown of electronic device 300 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, electronic device 300 boosts the output voltage of battery 342 to prevent abnormal shutdown due to low temperature.

[0149] Touch sensor 380K, also known as a "touch panel," can be located on display screen 394. The touch sensor 380K and display screen 394 together form a touchscreen, also known as a "touch screen." Touch sensor 380K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 394. In other embodiments, touch sensor 380K may also be located on the surface of electronic device 300, in a different position than display screen 394.

[0150] The bone conduction sensor 380M can acquire vibration signals. In some embodiments, the bone conduction sensor 380M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 380M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 380M can also be incorporated into headphones to form bone conduction headphones. The audio module 370 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 380M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 380M to realize heart rate detection functionality.

[0151] Buttons 390 include a power button, volume buttons, etc. Buttons 390 can be mechanical buttons or touch-sensitive buttons. Electronic device 300 can receive button input and generate key signal inputs related to user settings and function control of electronic device 300.

[0152] Motor 391 can generate vibration alerts. Motor 391 can be used for incoming call vibration alerts and touch vibration feedback. For example, it can emit vibrations of varying intensities when applied to obstacles at different distances. Different vibration feedback effects can be corresponding to touch operations in different applications (such as taking photos, playing audio, etc.). Motor 391 can also provide different vibration feedback effects for touch operations applied to different areas of the display screen 394. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0153] Indicator 392 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0154] The SIM card interface 395 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 395 to make contact with and separate from the electronic device 300. The electronic device 300 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 395 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 395 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 395 is also compatible with different types of SIM cards. The SIM card interface 395 is also compatible with external memory cards. The electronic device 300 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 300 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 300 and cannot be separated from the electronic device 300.

[0155] The terminology used in the embodiments of this application is explained below.

[0156] 1. Reflected Signal. A reflected signal, also known as reflected ultrasound or feedback signal, refers to the ultrasound signal emitted by a wearable device to detect obstacles. This signal travels in a straight line and is reflected back upon encountering an obstacle. When a wearable device is equipped with multiple sets of ultrasonic sensors for detecting obstacles in different locations, the receiving direction of the ultrasonic receiver can be set so that the reflected signals received by the ultrasonic receiver are emitted by the same ultrasonic transmitter within the same set. This facilitates determining the location of the obstacle based on the ultrasonic sensors.

[0157] 2. Relative Positional Relationship. The relative positional relationship is used to describe the distance and orientation information between two objects. When describing a relative positional relationship, it includes the two objects whose relationship needs to be determined. For example, in the embodiments of this application, the relative positional relationship includes a wearable device and an obstacle, which can be described by the distance between the wearable device and the obstacle, and the orientation of the obstacle relative to the wearable device.

[0158] 3. Wearing Location. Wearable devices are worn on different parts of the wearer's body. For example, when the wearable device is a Bluetooth headset, it is worn over the wearer's ears. When the wearable device is smart glasses, it is worn over the wearer's eyes.

[0159] 4. Transmission Cycle. The transmission cycle refers to the period of the ultrasonic signal emitted by the wearable device when detecting obstacle information. Within one transmission cycle, it includes the ultrasonic signal filling time corresponding to the ultrasonic transmission period, and the silence time when ultrasonic transmission stops.

[0160] 5. Ultrasonic signal fill time. Ultrasonic signal fill time refers to the duration of continuous ultrasound transmission within one ultrasound transmission cycle. Normally, only one ultrasound signal is transmitted within one ultrasound transmission cycle. Therefore, ultrasonic signal fill time typically refers to the duration of a single ultrasound transmission within one ultrasound transmission cycle.

[0161] 6. Silence Duration. Silence duration refers to the time during which no ultrasonic signal is emitted within one ultrasonic transmission cycle. The minimum silence duration can be determined based on the farthest distance of the detected obstacle. That is, the minimum silence duration should be greater than the detection time corresponding to the farthest obstacle.

[0162] 7. Detection Duration. Detection duration refers to the time between emitting the ultrasonic signal and receiving the reflected signal, when the distance between the obstacle and the wearer is determined by the emitted ultrasonic signal and the received reflected signal. In other words, it is the duration of the ultrasonic wave from emission to acquisition. To avoid detection blind spots, the ultrasonic signal fill time is usually shorter than the detection duration, and the detection duration is shorter than the silence time.

[0163] The following is combined Figure 4 The implementation process of the guide method for the blind provided in the embodiments of this application will be described in detail.

[0164] In the embodiments of this application, Figure 4 This is a schematic diagram illustrating the implementation process of another guidance method for the blind, which includes:

[0165] S401, the wearable device determines the relative positional relationship between the wearable device and the obstacle based on the ultrasonic signal it emits and the reflected signal it receives, wherein the reflected signal is the signal of the ultrasonic signal reflected back by the obstacle.

[0166] The ultrasonic signals emitted by the wearable device can be a response to a guide command issued by an electronic device. Alternatively, the wearable device can determine this based on wearer status information detected by a position sensor. For example, the wearer status information may include walking status information; when the wearer is walking, the device begins emitting ultrasonic signals to detect obstacles.

[0167] When a wearable device establishes a connection with an electronic device, the connection can be established according to the steps outlined in the communication protocol. For example, if the wearable device is a Bluetooth headset, the connection establishment method corresponding to the Bluetooth protocol type in the Bluetooth communication protocol can be used to determine the steps for establishing a connection between the wearable device and the electronic device.

[0168] In possible implementations, considering the limitations of user operation, the connection between the electronic device and the wearable device can be established automatically by receiving the user's voice commands. For example, the wearer can invoke a voice assistant to listen to their voice commands. When the wearer issues the voice command "Start guiding," the system automatically searches for connected or connectable wearable devices and can send guiding commands to them.

[0169] S402, the wearable device acquires the first orientation information of the wearable device relative to the wearer collected by the orientation sensor of the wearable device.

[0170] The wearable device can be a Bluetooth headset, wired headset, or smart glasses, among other smart devices. An orientation sensor is installed in the wearable device to detect changes in its orientation. Feature data corresponding to different posture changes can be pre-set. The collected sensor data is compared with the pre-set feature data, and the wearer's current posture change information is determined based on the matching degree. The initial orientation information between the wearable device and the wearer is determined based on the posture change information.

[0171] For example, when the wearer is determined to be in a turning posture or turning motion, the wearable device and the wearer can have the same orientation information, and their primary orientation information can be zero degrees apart. When the wearer is performing actions such as turning their head or turning their body, the primary orientation information can be determined based on the degree of head turning or turning.

[0172] S403, the wearable device sends the relative position relationship and the first orientation information to an electronic device connected to the wearable device.

[0173] The wearable device sends the detected data to the electronic device, which then calculates the distance between the obstacle and the wearer, as well as the wearer's third-party position information relative to the obstacle, based on the detected data. Figure 4 This has been explained in detail elsewhere, so I will not repeat it here.

[0174] S404, the electronic device navigates the wearer based on the relative positional relationship and the first orientation information.

[0175] When electronic devices navigate to the wearer, they can do so via voice. For example, the device can calculate the distance and orientation of obstacles relative to the wearer. This information can then be broadcast aloud by a voice assistant.

[0176] In one implementation, the electronic device can broadcast the location information of obstacles and, through vibration, broadcast the distance between the obstacle and the wearer. For example, a correlation between vibration intensity and distance can be established, and the distance between the obstacle and the wearer can be broadcast based on the magnitude of the vibration intensity.

[0177] Among possible implementations, the wearable device can guide the wearer independently, or navigation can be achieved through a combination of electronic devices and the wearable device. The following section will discuss these possibilities. Figure 5 The guide method for the visually impaired, as shown, applied to wearable devices, will be explained in detail.

[0178] S501, determine the relative positional relationship between the wearable device and the obstacle based on the ultrasonic signals emitted by the wearable device and the reflected signals received.

[0179] The wearable devices described in this application may include smart wearable devices such as wireless headphones, wired headphones, or smart glasses.

[0180] Among the possible implementation methods, taking wireless earphones for guidance as an example, there are two ways to achieve guidance: one is to achieve guidance by using wireless earphones alone, and the other is to use wireless earphones and electronic devices together to form a guidance system, and achieve guidance through the guidance system.

[0181] In this system, when wearable devices and electronic devices work together to form a guidance system for the visually impaired, the wireless headset can establish a communication connection with the electronic device in advance. Through the established communication connection, the wearable device uploads the collected data to the electronic device, and the electronic device can process the collected data.

[0182] The electronic device can be a smart device, including devices such as smartphones and tablets. In a simplified implementation, the electronic device may include a processor, memory, a communication interface, and a broadcaster, which can be a voice broadcaster, or a voice broadcaster and a vibration broadcaster. A communication connection is established with the wearable device through the communication interface. The communication interface can be a wireless communication interface or a wired communication interface. Wireless communication can include WLAN, Bluetooth, infrared, Zigbee, and other communication methods.

[0183] When the electronic device is a smartphone, the process of establishing a communication connection between the wireless earphone and the electronic device can be as follows: Figures 6a-6d As shown, it includes:

[0184] like Figure 6a As shown, the desktop of an electronic device includes a settings button. Upon receiving a click, swipe, or tap command from the user, the electronic device can trigger the display of the settings interface. Of course, Figure 6a This illustrates a common method for triggering a settings interface, but it's not limited to this. Other triggering methods set by the electronic device can also be included, such as shortcuts via buttons, shortcuts via specific touch curves, or accessing the settings interface via voice commands from users through voice assistants or other applications. Considering the difficulty users of guide devices face in touching objects, voice commands can be received to directly connect to wearable devices, i.e., wireless headphones.

[0185] After receiving the trigger command input by the user, the electronic device displays... Figure 6b The settings interface shown. The settings interface includes several settings items. For example, Figure 6b The settings interface shown includes entries for wireless and network settings, device connectivity, desktop and wallpaper, display, sound, notification center, and applications. The wireless and network settings entry triggers the interface for setting up mobile networks, WLAN networks, and managing dual SIM cards. The device connectivity entry triggers the interface for setting up Bluetooth, NFC, or screen mirroring. The desktop and wallpaper entry triggers the interface for setting up the lock screen and theme. The display entry triggers the interface for setting the display brightness, font size, and eye protection features. The sound entry triggers the interface for setting volume, ringtone selection, and sound mode selection. Sound modes can include vibration, silent, and ringtone modes. The notification center entry allows for unified management and settings of application notifications, including management of desktop icon badges and lock screen notifications. The application entry allows for setting application uninstallation and permissions, and can also include management of application launch, default application management, and application cloning. It can receive user-input trigger commands for the device connectivity entry and enter...Figure 6c The device connection settings interface shown.

[0186] like Figure 6c As shown, the device connection settings interface includes settings for Bluetooth connection, NFC near-field communication connection, mobile phone screen mirroring, and a switch for "Bluetooth headset navigation mode for the blind." Figures 6a-6d In the settings interface shown, when the electronic device receives the command to activate the "Bluetooth Headset Navigation Mode for the Blind," it can automatically establish a communication connection with the pre-paired wireless headset. Alternatively, after establishing the communication connection, it can move the selection button in the selection switch to the "on" position, or highlight the button from its previous position to enter... Figure 6d The displayed interface indicates that the user has established a connection with the wearable device and has entered guide mode.

[0187] In one implementation, the Bluetooth connection settings interface can also receive the user's selection command for the wireless headphones to be connected, establishing a connection between the electronic device and the wireless headphones, thereby enabling the electronic device to receive location information, distance, etc. uploaded by the wireless headphones.

[0188] In a guide system for the visually impaired, where wireless earphones and electronic devices work together, once a communication connection is established between the wireless earphones and the electronic devices, the wireless earphones can activate obstacle detection mode. The wireless earphones can emit ultrasonic signals to detect reflected signals from obstacles, thus detecting the relative position of the obstacle to the wearer, including information such as the distance and orientation of the obstacle relative to the wearer.

[0189] In the standalone guidance mode of wireless earphones, the processor in the earphones can directly process the collected data to determine the location and distance of obstacles relative to the wearer (or user). The wireless earphones announce the detected location and distance through their built-in speakers, or announce the distance of the detected obstacles through vibration.

[0190] In the standalone guide mode of the wireless headset, obstacle detection can be enabled or disabled via a mode switch set on the headset. This mode switch can be a proximity sensor, infrared sensor, orientation sensor, or physical switch, etc.

[0191] The proximity sensor or infrared sensor can detect whether the wireless earphone is currently being worn. If the earphone is detected to be worn, obstacle detection will begin. If the earphone is detected to be unworn, such as when it is charging or when it is rotated in its storage case, obstacle detection will stop.

[0192] The orientation sensor can detect whether the wearer is walking. It collects motion data, including horizontal and vertical acceleration. This motion data is compared with walking and sitting characteristics to determine if the wearer is currently walking. When walking is confirmed, obstacle detection is activated; when the wearer is sitting, obstacle detection is deactivated.

[0193] Of course, one possible implementation is to configure the wireless device to detect obstacles even when the user is seated. This allows the wearer to promptly identify obstacles around them in scenarios where the position of obstacles changes.

[0194] In order to detect obstacles in a 360-degree radius around the wearer, one implementation method is as follows: Figure 7 As shown, the wireless earphones include a left wireless earphone and a right wireless earphone. Each of the left and right wireless earphones is equipped with two sets of ultrasonic sensors, which divide the wearer's surroundings into four detection zones when the earphones are worn. Each detection zone corresponds to a 90-degree detection area, forming a 360-degree detection area around the wearer.

[0195] like Figure 7 As shown, the ultrasonic sensor divides the detection area into four regions: left front region E1, left rear region E2, right front region E3, and right rear region E4. Each region's ultrasonic sensor includes an ultrasonic receiving device for receiving reflected ultrasonic signals from obstacles within the defined region. The ultrasonic receiving device can be a microphone. However, this is not a limitation; other methods of dividing the detection region can also be used, such as dividing the detection region into 6 or 8 areas. When detecting obstacle information within the divided regions, the following implementation methods can be included:

[0196] 1. The transmission range of the ultrasonic transmitter is the same as the reception range of the ultrasonic receiver. That is, the ultrasonic transmitter emits ultrasonic signals within a 90-degree range, and the ultrasonic receiver receives ultrasonic signals emitted by ultrasonic transmitters in the same area. The ultrasonic signals emitted by each ultrasonic transmitter can be synchronous or asynchronous. When the ultrasonic signals emitted by the ultrasonic transmitter are asynchronous, the calculation of the distance between the obstacle and the wireless earpiece can be performed by combining the timing of the ultrasonic signals emitted by the ultrasonic transmitters in that area.

[0197] 2. The transmission range of the ultrasonic transmitter and the range of the ultrasonic receiver may not perfectly match. That is, the angular range of the ultrasonic transmitter's transmission may differ from the range of the ultrasonic receiver. Ultrasonic transmitters in each area transmit synchronously. When the ultrasonic receiver receives the reflected ultrasonic signal, it determines the location of the obstacle based on the area corresponding to the ultrasonic receiver. Based on the synchronous transmission time of the ultrasonic signal and the reception time of the reflected ultrasonic signal, the distance between the obstacle and the wearer is determined.

[0198] When the ultrasonic transmitter in an ultrasonic sensor emits ultrasonic signals, it can emit ultrasonic signals according to a preset emission cycle. For example... Figure 8 The diagram shown is a schematic representation of the transmission period of an ultrasonic signal according to an embodiment of this application. Figure 8 As shown, the transmission period of the ultrasonic signal includes the silence duration T. 静音 and ultrasound signal filling time T 填充 .

[0199] Wherein, the ultrasonic signal filling time T 填充 This refers to the period during which an ultrasonic signal is emitted within its emission cycle. Within one ultrasonic signal emission cycle, the emitted ultrasonic signal is typically a continuous ultrasonic signal.

[0200] In possible implementations, the ultrasonic signal can be a sinusoidal signal with a frequency greater than 20 kHz. The frequency of the emitted ultrasonic signal can be a sine wave of 30-50 kHz, for example, 40 kHz. The ultrasonic signal filling time can be 10 sinusoidal signals. When the sinusoidal wave frequency is 40 kHz, the ultrasonic signal filling time T in the ultrasonic emission cycle... 填充 =10*(1 / 40000)s=0.025ms.

[0201] In possible implementations, the obstacle detection time—that is, the time from the start of ultrasonic signal transmission to the receipt of the reflected ultrasonic signal—is determined by the distance between the obstacle and the wearer (or user). Furthermore, to avoid detection time blind spots, the ultrasonic signal fill time T within the ultrasonic signal transmission cycle... 填充 The detection duration is less than T, and the detection duration T is less than the silence duration T. 静音 Therefore, the ultrasonic signal filling time T can be determined based on the detection distance range of the obstacle. 填充 The maximum value and the minimum duration of silence.

[0202] For example, the set range for detecting obstacles is Rmin-Rmax, where Rmin is the minimum detection distance and Rmax is the maximum detection distance. This is based on the constraint T to avoid detection blind spots.填充 <T<T 静音 The ultrasound signal filling time T can be calculated. 填充 The maximum value is less than 2*Rmin / c, where c is the propagation speed of the ultrasonic signal, which can be taken as 340m / s. The minimum silence duration of the ultrasonic signal is greater than 2*Rmax / c.

[0203] The relative positional relationships in the embodiments of this application include relative orientational relationships and relative distance relationships. The relative positional relationship between the wearable device and the obstacle can also be understood as the relative positional relationship between the wearer or user of the wearable device and the obstacle, that is, the distance between the obstacle and the wearer, and the direction in which the obstacle is located relative to the wearer.

[0204] When determining the distance in the relative positional relationship between a wearable device and an obstacle, the time period during which the ultrasonic transmitter emits ultrasonic signals can be recorded, for example... Figure 9a The application records the time period corresponding to the transmitted signal and the time period for receiving the received reflected signal. This application limits the ultrasonic signal filling time T. 填充 The detection duration is less than T, and the detection duration T is less than the silence duration T. 静音 Therefore, the forms in which the received reflected signals exist include, for example, Figure 9a , 9b The calculation process for both scenarios is described below:

[0205] for Figure 9a In the scenario depicted, the distance between the obstacle and the wearer is relatively short, and the reception time of the reflected signal partially overlaps with the emission time of the ultrasonic signal. Assuming that the position of the obstacle relative to the wearer does not change within the detection period of the ultrasonic signal, or that the change in the position of the obstacle relative to the wearer is less than a preset value, the detection duration T of the detected obstacle can be determined based on the emission time of the end time point B of the ultrasonic signal filling duration and the time point D in the reflected signal corresponding to the ultrasonic signal emitted at time point B. The distance between the obstacle and the wearer can then be calculated based on this detection duration.

[0206] for Figure 9b In the scenario shown, the distance between the obstacle and the wearer is moderate, and the time period for receiving the reflected signal falls within the range of the silent duration. This can be determined based on the emitted ultrasonic signal, i.e. Figure 9b The detection duration T of the detected obstacle is determined by the starting time point A of the fill time of the transmitted signal and the starting time point C of the received reflected signal. Alternatively, the detection duration T of the detected obstacle can also be determined by the ending time point B of the ultrasonic signal fill time and the ending time point E of the received reflected signal. The distance between the obstacle and the wearer can then be calculated based on this detection duration T.

[0207] When determining the relative position between an obstacle and the wearer, the area to which the obstacle belongs can be determined based on the area where the received reflected signal is located. For example, based on... Figure 7 The system is divided into four detection zones. When the ultrasonic receiver in the left front detection zone detects a reflected signal, it determines that the obstacle is in front of the wearer's left side. When the ultrasonic receiver in the right front detection zone detects a reflected signal, it determines that the obstacle is in front of the wearer's right side.

[0208] In possible implementations, the detection area can include four or more, or four or fewer. For example, three detection areas can be set: one for the front, one for the left, and one for the right, to detect obstacles in front of, to the left of, and to the right of the wearer. Alternatively, six or eight detection areas can be set to more precisely divide the wearer's surroundings, thereby improving the accuracy of determining the location of obstacles around the wearer. When dividing the wearer's surroundings, depending on the wearable device, such as the wearing position of wireless headphones, the left and right sides can be divided into the same number of detection areas.

[0209] S502, detects the first orientation information of the wearable device relative to the wearer based on the orientation sensor of the wearable device.

[0210] In this embodiment of the application, when the wearable device is a wireless earphone, the first position information of the wearable device relative to the wearer can be determined based on the wearer's action information.

[0211] The detected motion information of the wearer can include head turning, body turning, body turning and head turning, and turning direction.

[0212] Specifically, turning the head refers to a change in the orientation of the wearer's head, while the orientation of the wearer's body and feet remains unchanged, but the angle of the wearer's head relative to the wearer's body changes. Here, the orientation of the wearer's head, body, or feet refers to the direction the wearer's head, body, and feet are facing, respectively. In normal forward walking, the wearer's head, body, and feet are all facing forward.

[0213] A sideways movement can refer to a change in the wearer's body position. In this case, the wearer's head can turn at the same angle as the body, and the wearer's feet do not change position.

[0214] In some implementations, the wearer's body-turning and head-turning movements occur simultaneously. For example, when the wearer turns their body, they simultaneously turn their head. Furthermore, the angle of the head-turning movement is greater than the angle of the body-turning movement.

[0215] When the wearer turns their head, turns their body, or both simultaneously, since the feet remain facing forward, to facilitate the wearer's acquisition of information about obstacles ahead, the orientation sensor can detect the wearable device's position relative to the wearer during the head-turning or body-turning movements. This orientation information can refer to the position of the wearable device relative to the wearer's feet.

[0216] When detecting the wearer's movement information, the sensing characteristics detected by the orientation sensor can be compared with pre-set feature data. For example, the feature data may include the magnitude of changes in angular velocity and the wearer's vertical acceleration characteristics. Since the feet do not change during head turning or body turning movements, the vertical acceleration characteristics can be used to distinguish whether it is a turning movement.

[0217] In possible implementations, a turning motion can be determined when acceleration features in the vertical direction and angular velocity features are detected, matching the characteristics of a turning motion. Under normal circumstances, if the wearer does not perform a head-turning or body-turning motion when turning, the device's orientation information is the same as the wearer's.

[0218] If the detected vertical acceleration and angular velocity characteristics match the preset head-turning or body-turning motion characteristics, it can be determined that the wearer has performed a head-turning or body-turning motion. Furthermore, based on the turning angle of the head-turning or body-turning motion, the first positional information of the wearable device relative to the wearer can be determined. For example, if the turning angle of the head-turning or body-turning motion is X degrees to the right, then the first positional information of the wearable device relative to the wearer is X degrees to the right.

[0219] S503, Navigate the wearer based on the relative positional relationship and the first orientation information.

[0220] In this embodiment of the application, when navigating the wearer based on relative positional relationships and first orientation information, the following implementation methods may be included:

[0221] Method 1: The wearable device calculates the location and distance of obstacles relative to the wearer based on the first location information and relative positional relationship. Based on the calculated location and distance of the obstacles relative to the wearer, it then broadcasts an alert regarding the obstacles.

[0222] For example, when the wearable device is a wireless headset, the wearer can determine the location and distance of the obstacle relative to the wearer by broadcasting the corresponding voice information about the obstacle.

[0223] When broadcasting via voice, you can use precise distance broadcasting, distance range reminder broadcasting, or a combination of precise distance broadcasting and distance range reminder broadcasting.

[0224] The precise distance reporting feature can announce the distance between the obstacle and the wearer at predetermined time intervals. This time interval can be adjusted based on the distance; the closer the obstacle is to the wearer, the shorter the time interval can be.

[0225] When broadcasting alerts based on a distance range, the required distance range can be preset. When the distance between the obstacle and the wearer switches to the preset range, an alert is generated. The closer the obstacle is to the wearer, the smaller the preset distance range can be, resulting in more frequent broadcasts and allowing the wearer to better understand changes in distance between nearby obstacles and themselves.

[0226] When precise distance reporting is combined with distance range alerts, a distance range alert can be triggered when the distance between the obstacle and the wearer exceeds a predetermined distance threshold, while precise distance reporting is used when the distance is less than the threshold. Furthermore, the interval between precise distance alerts can be shorter as the distance decreases.

[0227] In addition to voice announcements, distance can also be announced via vibration. The intensity of the vibration can be used to determine the distance between the obstacle and the wearer. Because vibration announcements have a longer response time than voice announcements, they can respond to obstacle information much faster.

[0228] When using vibration to broadcast warnings, it can be combined with voice broadcasting to announce the location information of obstacles. This allows the wearer to quickly sense the distance to obstacles and also determine their location. In addition to using voice to announce the obstacle's location relative to the wearer, to facilitate quick location determination, sounds such as "beep" and "beep-beep" can be used to represent different locations. For example, a single short, sharp "beep" can represent the first location, two short, sharp "beep-beep" sounds can represent the second location, and so on.

[0229] In one possible implementation, two or more vibration devices can be placed in the wearable device. Different vibration devices can be associated with different locations. Based on the obstacle's location relative to the wearer, the corresponding vibration devices are controlled to vibrate, thus enabling the wearer to obtain the obstacle's location information more quickly.

[0230] Method Two: The wearable device sends its initial location information and relative position to an electronic device with which it has established a communication connection. The electronic device then calculates the obstacle's location and distance relative to the wearer. Based on the calculated location and distance of the obstacle relative to the wearer, the electronic device broadcasts an alert regarding the obstacle.

[0231] For example, electronic devices can directly use voice assistants to broadcast obstacle information, allowing the wearer to determine the obstacle's location and distance relative to them. Alternatively, the electronic device can send the calculated location and distance information to a wearable device capable of broadcasting sound, such as headphones.

[0232] When electronic devices broadcast messages via voice, they can use precise distance broadcasting, distance range reminder broadcasting, or a combination of precise distance broadcasting and distance range reminder broadcasting.

[0233] The precise distance reporting feature can announce the distance between the obstacle and the wearer at predetermined time intervals. This time interval can be adjusted based on the distance; the closer the obstacle is to the wearer, the shorter the time interval can be.

[0234] When electronic devices broadcast alerts based on a distance range, the required distance range can be preset. When the distance between the obstacle and the wearer switches to the preset range, an alert is generated. The closer the obstacle is to the wearer, the smaller the preset distance range can be, resulting in more frequent broadcasts and allowing the wearer to better understand changes in distance between nearby obstacles and themselves.

[0235] When precise distance reporting is combined with distance range alerts, a distance range alert can be triggered when the distance between the obstacle and the wearer exceeds a predetermined distance threshold, while precise distance reporting is used when the distance is less than the threshold. Furthermore, the interval between precise distance alerts can be shorter as the distance decreases.

[0236] In addition to voice announcements, electronic devices can also use vibration announcements to report distance. The intensity of the vibration can be used to determine the distance between the obstacle and the wearer. Because vibration announcements have a longer response time than voice announcements, they can respond to obstacle information much faster.

[0237] When electronic devices broadcast vibrations, they can combine this with voice announcements to indicate the location of obstacles. This allows the wearer to quickly perceive the distance to an obstacle and determine its location. Besides using voice to announce the obstacle's location relative to the wearer, to facilitate quick location determination, different sounds like "beep" or "beep-beep" can be used to represent different locations. For example, a single, short "beep" can represent the first location, two short "beep-beep" sounds can represent the second location, and so on.

[0238] Of course, the wearable device can also send the time of the collected reflected signal, the time of the emitted ultrasonic signal, and the ultrasonic receiving device that collected the reflected signal to the electronic device, which then calculates the distance and orientation information of the obstacle relative to the wearer.

[0239] In this embodiment, when determining the orientation information between the obstacle and the wearer, i.e., the third orientation information, it can be based on the second orientation information between the obstacle and the wearable device, and the first orientation information between the wearable device and the wearer. The third orientation information between the obstacle and the wearable device can be summed with the first orientation information to determine the third orientation information between the obstacle and the wearer.

[0240] For example, if the angle of the obstacle relative to the wearable device is clockwise X1 degrees, and the angle of the wearable device relative to the wearer is clockwise X2 degrees, then the orientation information of the obstacle relative to the wearer is X1 + X2. If the first orientation information and the second orientation information are different, one of the directions can be determined as the positive direction, and the angle value of the negative direction can be taken as negative. The orientation information of the obstacle relative to the wearer can be obtained by summing these values.

[0241] Figure 10 This is a schematic diagram illustrating the implementation of a guide system for the visually impaired, as provided in an embodiment of this application. Figure 10 As shown, the guide system for the visually impaired includes wearable devices and electronic devices, wherein:

[0242] Wearable devices can be wireless headphones, wired headphones, smart glasses, etc. Electronic devices can be smartphones, tablets, and other smart devices. The communication connection established between the wearable device and the electronic device can include Wi-Fi, Bluetooth, infrared, or Zigbee connections.

[0243] Wearable devices can be used to collect sensor data, including the emission time of ultrasonic signals, the reception time of reflected ultrasonic signals, and data from the ultrasonic receiving device. The wearable device can preprocess the collected data; for example, based on the emission and reception times of the ultrasonic signals, the distance between the obstacle and the wearable device can be determined, and based on the reception range set by the wearable device's ultrasonic receiving device, a second location information of the obstacle relative to the wearable device can be determined. The preprocessed data is then sent to an electronic device.

[0244] Wearable devices are equipped with orientation sensors that can detect the device's initial orientation relative to the wearer. The orientation sensor can be used to determine the wearer's action type, and the device's initial orientation relative to the wearer can be determined based on the action type. Alternatively, the wearable device can send the collected data to an electronic device, which can then calculate the device's initial orientation relative to the wearer.

[0245] Electronic devices can determine the orientation of an obstacle relative to the wearer based on the first orientation information of the wearable device relative to the wearer collected by the orientation sensor device, and the second orientation information of the obstacle relative to the wearable device determined by the ultrasonic receiving device.

[0246] The electronic device broadcasts warnings about obstacles based on the calculated location and distance of the obstacles relative to the wearer.

[0247] For example, electronic devices can directly use voice assistants to broadcast obstacle information, allowing the wearer to determine the obstacle's location and distance relative to them. Alternatively, the electronic device can send the calculated location and distance information to a wearable device capable of broadcasting sound, such as headphones.

[0248] When electronic devices broadcast messages via voice, they can use precise distance broadcasting, distance range reminder broadcasting, or a combination of precise distance broadcasting and distance range reminder broadcasting.

[0249] The precise distance reporting feature can announce the distance between the obstacle and the wearer at predetermined time intervals. This time interval can be adjusted based on the distance; the closer the obstacle is to the wearer, the shorter the time interval can be.

[0250] When electronic devices broadcast alerts based on a distance range, the required distance range can be preset. When the distance between the obstacle and the wearer switches to the preset range, an alert is generated. The closer the obstacle is to the wearer, the smaller the preset distance range can be, resulting in more frequent broadcasts and allowing the wearer to better understand changes in distance between nearby obstacles and themselves.

[0251] When precise distance reporting is combined with distance range alerts, a distance range alert can be triggered when the distance between the obstacle and the wearer exceeds a predetermined distance threshold, while precise distance reporting is used when the distance is less than the threshold. Furthermore, the interval between precise distance alerts can be shorter as the distance decreases.

[0252] In addition to voice announcements, electronic devices can also use vibration announcements to report distance. The intensity of the vibration can be used to determine the distance between the obstacle and the wearer. Because vibration announcements have a longer response time than voice announcements, they can respond to obstacle information much faster.

[0253] When electronic devices broadcast vibrations, they can combine this with voice announcements to indicate the location of obstacles. This allows the wearer to quickly perceive the distance to an obstacle and determine its location. Besides using voice to announce the obstacle's location relative to the wearer, to facilitate quick location determination, different sounds like "beep" or "beep-beep" can be used to represent different locations. For example, a single, short "beep" can represent the first location, two short "beep-beep" sounds can represent the second location, and so on.

[0254] To avoid detection time blind spots when wearable devices emit ultrasonic signals, the ultrasonic signal fill time T in the ultrasonic signal emission cycle can be set. 填充 The detection duration is less than T, and the detection duration T is less than the silence duration T. 静音 Therefore, the ultrasonic signal filling time T can be determined based on the detection distance range of the obstacle. 填充 The maximum value and the minimum duration of silence.

[0255] For example, the set range for detecting obstacles is Rmin-Rmax, where Rmin is the minimum detection distance and Rmax is the maximum detection distance. This is based on the constraint T to avoid detection blind spots. 填充 <T<T 静音 The ultrasound signal filling time T can be calculated. 填充The maximum value is less than 2*Rmin / c, where c is the propagation speed of the ultrasonic signal, which can be taken as 340m / s. The minimum silence duration of the ultrasonic signal is greater than 2*Rmax / c.

[0256] The guide system for the blind, consisting of wearable devices and electronic devices, shown in the embodiments of this application, is similar to... Figure 4 The implementation scenarios for wearable devices connecting to electronic devices in the guide methods shown are basically the same, so they will not be elaborated on here.

[0257] It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.

[0258] The guide device provided in this embodiment is used to execute the above-described guide method, thus achieving the same effect as the aforementioned implementation. When using integrated units, the guide device may include a processing module and a storage module. The processing module can be used to process data, for example, to determine the relative positional relationship between the wearable device and an obstacle based on ultrasonic signals emitted and reflected signals received by the wearable device; to detect first orientation information of the wearable device relative to the wearer based on the wearable device's orientation sensor; and to navigate the wearer based on the relative positional relationship and the first orientation information. The storage module can be used to support the guide device in executing stored program code and data.

[0259] The processing module can be a processor or a controller. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination of functions that implement computing capabilities, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, or other devices that interact with other electronic devices.

[0260] This embodiment also provides a computer-readable storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the secure data access method described in the above embodiment.

[0261] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to achieve the secure data access method described in the above embodiment.

[0262] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the secure data access methods described in the above method embodiments.

[0263] In this embodiment, the electronic device, computer storage medium, computer program product or chip are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding method provided above, and will not be repeated here.

[0264] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0265] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0266] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0267] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0268] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0269] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method of guiding the blind, characterized by, The method comprises the following steps: The wearable device determines the relative position relationship between the wearable device and the obstacle according to the ultrasonic signal emitted by the wearable device and the reflection signal received by the wearable device, wherein the reflection signal is the signal reflected by the obstacle; The wearable device obtains the first orientation information of the wearable device relative to the wearer collected by the orientation sensor of the wearable device, and the first orientation information is used to represent the deflection of the wearable device relative to the wearer's body; The wearable device sends the relative position relationship and the first orientation information to an electronic device connected to the wearable device; The electronic device navigates the wearer according to the relative position relationship and the first orientation information; and the wearable device is a wireless earphone or smart glasses.

2. The method of claim 1, wherein, The relative position relationship comprises the second orientation information of the wearable device relative to the obstacle and the distance between the wearable device and the obstacle; The electronic device navigates the wearer according to the relative position relationship and the first orientation information, which comprises: The electronic device determines the third orientation information of the obstacle relative to the wearer according to the first orientation information and the second orientation information; The electronic device navigates the wearer according to the distance and the third orientation information.

3. The method of claim 2, wherein, The electronic device navigates the wearer according to the distance and the third orientation information, which comprises: The electronic device real-time broadcasts the distance and the third orientation information through voice or prompts the distance and the third orientation information through voice and vibration intensity when the distance and / or the third orientation information reaches a predetermined prompt condition.

4. The method of claim 1 to 3, wherein, Before the wearable device determines the relative position relationship between the wearable device and the obstacle according to the ultrasonic signal emitted by the wearable device and the reflection signal received by the wearable device, the method further comprises: The electronic device sends a guide blind instruction to the wearable device connected to the electronic device in response to an operation of starting a guide blind mode; Correspondingly, the wearable device determines the relative position relationship between the wearable device and the obstacle according to the ultrasonic signal emitted by the wearable device and the reflection signal received by the wearable device, which comprises: The wearable device emits the ultrasonic signal according to a preset emission period and receives the reflection signal of the ultrasonic signal reflected by the obstacle after receiving the guide blind instruction, and determines the relative position relationship between the wearable device and the obstacle according to the emitted ultrasonic signal and the received reflection signal.

5. A method of guiding the blind, characterized by, The guide blind method is applied to a wearable device, and the wearable device is a wireless earphone or smart glasses, and the guide blind method comprises: The wearable device determines the relative position relationship between the wearable device and the obstacle according to the ultrasonic signal emitted by the wearable device and the reflection signal received by the wearable device, wherein the reflection signal is the signal reflected by the obstacle; The wearable device obtains the first orientation information of the wearable device relative to the wearer collected by the orientation sensor of the wearable device, and the first orientation information is used to represent the deflection of the wearable device relative to the wearer's body; According to the relative position relationship and the first orientation information, the wearer is navigated.

6. The method of claim 5, wherein, The relative position relationship includes second orientation information of the wearable device relative to the obstacle and a distance between the wearable device and the obstacle; The navigation of the wearer according to the relative position relationship and the first orientation information includes: According to the first orientation information and the second orientation information, third orientation information of the obstacle relative to the wearer is determined; The wearer is navigated according to the distance and the third orientation information.

7. The method of claim 6, wherein, The navigation of the wearer according to the distance and the third orientation information includes: When the distance and / or the third orientation information reaches a predetermined prompt condition, the distance and the third orientation information are broadcast in real time through voice or prompted through voice and vibration intensity.

8. The method of guiding a blind person according to any one of claims 5-7, characterized in that, The relative position relationship between the wearable device and the obstacle is determined according to the ultrasonic signal emitted by the wearable device and the reflection signal received, and includes: The ultrasonic signal is emitted according to a preset emission period; The reflection signal of the ultrasonic signal reflected by the obstacle is received, the distance between the obstacle and the wearable device is determined according to the emission time of the ultrasonic signal and the receiving time of the reflection signal, and the second orientation information of the obstacle relative to the wearable device is determined according to the ultrasonic sensor of the sensing device receiving the reflection signal.

9. The method of claim 8, wherein, The preset emission period includes a mute duration and an ultrasonic signal filling duration, and the detection duration of the obstacle in the detection range is greater than the ultrasonic signal filling duration and less than the mute duration, the ultrasonic signal filling duration is the emission duration of the ultrasonic signal in the emission period, the ultrasonic signal is the emission duration of the ultrasonic signal in the emission period, and the mute duration is the duration of the emission period without emitting the ultrasonic signal.

10. The method of guiding a blind person according to any one of claims 5-9, characterized in that, The wearable device is a wireless earphone, and the ultrasonic signal is emitted by the ultrasonic wave emitter of the wireless earphone, and the reflection signal is received by the microphone of the wireless earphone.

11. The method of claim 10, wherein, The wireless earphone includes a plurality of ultrasonic sensors, the ultrasonic sensor includes the ultrasonic wave emitter and the microphone, and the plurality of ultrasonic sensors are used to detect obstacle information within a 360° range around the wearer.

12. The method of claim 5, wherein, The wearable device acquires first orientation information of the wearable device relative to the wearer collected by an orientation sensor of the wearable device, and includes: The wearable device acquires posture information of the wearer collected by an orientation sensor of the wearable device, and the posture information includes a deflection angle; The wearable device determines the first orientation information of the wearable device relative to the wearer according to the collected posture information of the wearer.

13. A guide dog device characterized by comprising: The device is applied to a wearable device, the wearable device is a wireless earphone or smart glasses, and the device includes: A relative position relationship determination unit is configured to determine a relative position relationship between the wearable device and an obstacle according to an ultrasonic signal emitted by the wearable device and a reflection signal received. a first orientation information detecting unit, configured to acquire first orientation information of the wearable device relative to a wearer, which is collected by an orientation sensor of the wearable device, the first orientation information being used to indicate a deflection condition of the wearable device relative to the wearer's body; a navigation unit, configured to navigate the wearer according to the relative position relationship determined by the relative position relationship determining unit and the first orientation information detected by the first orientation information detecting unit.

14. A wearable device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program, so that the wearable device implements the method in any one of claims 5 to 12.

15. A computer-readable storage medium, the computer-readable storage medium storing a computer program, characterized in that, The computer program is executed by the processor, so that the wearable device implements the method in any one of claims 5 to 12.

Images