Correcting audio signal based on orientation of spectacle assembly

Abstract

The disclosure relates to correcting an audio signal based on an orientation of a spectacle assembly. An eyewear assembly may include a frame configured to rest on a face of a wearer; a plurality of extraaural speakers; and a plurality of sensors. Processing circuitry may execute instructions stored in memory to: process output data of the plurality of sensors to determine locations of a plurality of anatomical features of the wearer; detecting an orientation of the eyewear assembly relative to the wearer of the eyewear assembly based on the position of the plurality of anatomical features of the wearer; and determining a correction of an audio signal to drive an extraaural speaker of the plurality of extraaural speakers based on the orientation. Other aspects are also described and claimed to be protected.

Description

[0001] Related patent applications

[0002] This patent application claims the benefit of priority to U.S. Provisional Application No. 63 / 578,590, filed on August 24, 2023, which is incorporated herein by reference in its entirety. Technical Field

[0003] The present disclosure relates generally to audio signals driven to an external ear speaker, and more particularly to correcting the audio signals driven to the external ear speaker of an eyeglass assembly based on the orientation of the eyeglass assembly. Other aspects are also described. Background Art

[0004] The off-ear speakers can enable sound to be projected in the environment near the user's ears without covering or otherwise blocking the ears. For example, the off-ear speakers can be attached to a headgear designed to be worn on the user's head. The off-ear speakers can then project sound in a direction outside the user's ears without physically covering the ears. This can enable the sound to be combined with other sounds in the environment, such as the user's own voice. This can also enable the wearer of the headgear to avoid wearing hardware in or on their ears. Summary of the invention

[0005] Specific implementations of the present disclosure include configuring sensors coupled to an eyeglass assembly to detect the orientation of the eyeglass assembly relative to an anatomical feature of a wearer (e.g., a user) of the eyeglass assembly. Outputs from the sensors may be used to adjust an audio signal driven to an external ear speaker coupled to the eyeglass assembly based on the detected orientation. In some implementations, the eyeglass assembly may include: a frame configured to rest on the face of the wearer; a plurality of temples or bands extending from the frame and configured to rest on the ears of the wearer; a plurality of external ear speakers coupled to the frame or to the plurality of temples or bands; and a plurality of sensors coupled to the frame or the plurality of temples or bands. One or more processors or processing circuits may execute instructions stored in a memory to: process output data of the plurality of sensors to determine the position of a plurality of anatomical features of the wearer; detect the orientation of the eyeglass assembly relative to the wearer of the eyeglass assembly based on the position of the plurality of anatomical features of the wearer; and determine a correction to the audio signal to drive an external ear speaker in the plurality of external ear speakers based on the orientation. Other aspects are described and claimed.

[0006] The above summary does not include an exhaustive list of all aspects of the present disclosure. It is contemplated that the present disclosure includes all systems and methods that can be practiced by all suitable combinations of the various aspects summarized above and disclosed in the detailed description below and specifically pointed out in the claims section. Such combinations may have specific advantages not specifically set forth in the above summary of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Various aspects of the present disclosure are described by way of example and are not limited to the illustrations of the various drawings, in which similar reference numerals indicate similar elements. It should be noted that reference to "one" or "an" aspect in the present disclosure is not necessarily the same aspect, and it means at least one. In addition, for the sake of brevity and to reduce the total number of drawings, a given drawing may be used to illustrate features of more than one aspect of the present disclosure, and for a given aspect, not all elements in the drawing may be required.

[0008] Figure 1 is an example of a front view of an eyeglass assembly worn by a user.

[0009] Figure 2 is an example of a side view of an eyeglass assembly worn by a user.

[0010] Figure 3 is a block diagram of an example of a system for correcting an audio signal based on the orientation of an eyeglass assembly.

[0011] Figure 4 is a flow chart of an example of a process for correcting an audio signal based on the orientation of an eyeglass assembly.

[0012] Figure 5 is a flow chart of an example of a process for correcting an audio signal by comparing a distance or angle to a threshold. DETAILED DESCRIPTION

[0013] Out-of-ear speakers attached to a headband worn by a user may sometimes shift out of position. For example, when the wearer (user) of the headband moves excessively and / or sweats, the headband may slide on the wearer's head. This may cause the out-of-ear speakers attached to the headband to also move out of position, resulting in a subsequent imbalance in the sound projected from the out-of-ear speakers. For example, when the headband shifts, one speaker may move farther away from the user's ear, while another speaker moves closer to the user's ear, resulting in an undesirable change in the sound experienced by the wearer. In some cases, even if the headband does not slide, the user may still experience an imbalance in the audio from the out-of-ear speakers. For example, the user may have asymmetrical anatomical features, such as one ear offset higher than the other, or an uneven head or nose, resulting in misalignment of the out-of-ear speakers.

[0014] Implementations of the present disclosure address issues such as these problems by configuring sensors coupled to an eyeglass assembly to detect the orientation of the eyeglass assembly relative to the anatomical features of the wearer. For example, the eyeglass assembly may be smart glasses or goggles, such as glasses with circuitry. The outputs from the sensors may be used to adjust an audio signal driven to an extra-ear speaker coupled to the eyeglass assembly based on the detected orientation. In some implementations, the eyeglass assembly may include: a frame configured to rest on the wearer's face; a plurality of temples or straps extending from the frame and configured to rest on the wearer's ears; a plurality of extra-ear speakers coupled to the frame or to the plurality of temples or straps; and a plurality of sensors coupled to the frame or to the plurality of temples or straps. One or more processors or processing circuits can execute instructions stored in the memory to: process the output data of the plurality of sensors to determine the positions of the plurality of anatomical features of the wearer; detect the orientation of the eyeglass assembly relative to the wearer of the eyeglass assembly based on the positions of the plurality of anatomical features of the wearer; and determine corrections to the audio signals to drive the external ear speakers of the plurality of external ear speakers based on the orientation. Thus, the user is able to hear the sound in a balanced manner regardless of whether the external ear speakers are moved out of position due to excessive movement and / or sweating, and / or regardless of whether the user has asymmetric anatomical features that cause the external ear speakers to be misaligned.

[0015] In some specific implementations, the eyeglass assembly system may utilize sensors to track the position of the user's anatomical features and compensate for movement, tilt and / or blockage when worn by the user. These sensors may include, for example, ultrasonic sensors, optical sensors, cameras, laser rangefinders (e.g., light detection and ranging (LIDAR) systems), electromechanical sensors, capacitive touch sensors, and / or strain gauge sensors. These sensors may enable the system to detect anatomical features of the user, such as eyes, pupils, ears, earlobes, ear canals, noses, or mouths. In some specific implementations, the system may utilize machine learning to predict anatomical features with a confidence percentage. The system may utilize sensors to determine the distance to the center of mass of the anatomical feature and / or the angle relative to the center of mass of the anatomical feature. If the system confirms that the anatomical feature balance is within a threshold, the system does not need to apply correction to the audio signal (audio output) driven to the external ear speaker (e.g., the audio signal can be driven normally without additional processing). However, if the system determines that the anatomical feature is unbalanced (e.g., the difference between the distance and / or angle exceeds a threshold), the system may apply signal processing to correct the one or more audio signals of one or more external ear speakers driven to the external ear speakers to achieve balance. In some implementations, applying the correction may include applying level compensation, equalization adjustment, and / or HRTF correction. In some implementations, the system may utilize a sensor to detect an object that causes blockage of the external ear speaker. For example, the sensor may detect hair and / or clothing between the user's ear and the external ear speaker. The system may then determine a correction to the audio signal driven to the external ear speaker based on the object causing the blockage (e.g., to compensate for the hair and / or clothing in the audio signal).

[0016] In some specific implementations, the system may use sensors to determine the amount of asymmetry and then correct the amount of asymmetry in the audio output (e.g., audio signal). For example, a user with asymmetric features may hear unbalanced audio. In order to enable the user to receive the same experience as others, the system may use sensors to track the position of the user's anatomical features and compensate for tilt. The sensor may include, for example, an ultrasonic sensor, an optical sensor, a camera, a laser rangefinder, an electromechanical sensor, a capacitive touch sensor, and / or a strain gauge sensor. The system may use sensors to generate signals, which may include, for example, feature detection (e.g., earlobes, eyes, hair, etc.), each with a confidence percentage, a distance to the center of mass of the feature, and / or an angle relative to the center of mass of the feature. If the system determines that the amount of asymmetry is minimal or below a threshold (e.g., there is a certain degree of symmetry, corresponding to balance), the system will not apply the correction to the audio output. However, if the system determines that the amount of asymmetry is above a threshold (e.g., there is a certain degree of asymmetry, corresponding to imbalance), the system will apply the correction to the audio output via signal processing. The correction may include, for example, level compensation, equalization, and / or HRTF correction. In some implementations, the amount of asymmetry and / or correction can be determined based on the amount of hair affecting the user of the system.

[0017] Various aspects of the present disclosure will now be explained with reference to the accompanying drawings. Whenever the shapes, relative positions, and other aspects of the components described are not clearly defined, the scope of the present invention is not limited to the components shown, which are only used for illustrative purposes. In addition, although many details are set forth, it should be understood that some aspects of the present disclosure can be implemented without these details. In other cases, well-known circuits, structures, and technologies are not shown in detail to avoid obscuring the understanding of the description.

[0018] Figure 1 is an example of a front view of the eyeglass assembly 100 worn by a user, and Figure 2 is an example of a side view of an eyeglass assembly 100 worn by a user. The eyeglass assembly 100 can be part of a system that enables correction of audio signals based on the orientation of the eyeglass assembly 100 relative to the anatomical features of the wearer. The eyeglass assembly 100 may include a frame 102 configured to rest on the wearer's face, and a plurality of temples or straps extending from the frame 102 (the plurality of temples or straps may be configured to rest on the wearer's ears, such as right arm 104 and left arm 106, or on the sides of the wearer's head). For example, the eyeglass assembly 100 may be smart glasses or goggles, such as glasses with circuitry, which may optionally include a lens or shield 108 in front of the wearer's eyes.

[0019] The eyeglass assembly 100 may also include a plurality of external ear speakers coupled to the frame 102 or coupled to a plurality of temples or bands, such as a right external ear speaker 110 coupled to the right arm 104 (e.g., near the right ear of the wearer) and a left external ear speaker 112 coupled to the left arm 106 (e.g., near the left ear of the wearer). The external ear speakers can enable sound to be projected in the environment near the wearer's ear without covering or otherwise blocking the ear. This can enable the sound to be combined with other sounds in the environment (including the wearer's own voice). This can also enable the wearer to avoid wearing hardware (e.g., earplugs) in or on their ears. In some specific implementations, a plurality of external ear speakers may be integrated in the frame 102 or in a plurality of temples or bands at the time of manufacture (e.g., a plurality of external ear speakers may be configured to cooperate with mechanical features in the frame 102 and / or a plurality of temples or bands to keep them in a fixed position).

[0020] The eyeglass assembly 100 may also include a plurality of sensors, such as sensors m1 to m4, coupled to the frame 102 or to a plurality of temples or straps. For example, sensor m1 may be coupled to the right arm 104; sensor m2 may be coupled to the left arm 106; sensor m3 may be coupled to the right side of the frame 102; and sensor m4 may be coupled to the left side of the frame 102. Sensors m1 to m4 may include a combination of ultrasonic sensors, optical sensors, cameras, laser rangefinders (e.g., LIDAR systems), electromechanical sensors, capacitive touch sensors, and / or strain gauge sensors. In some implementations, a plurality of sensors may be integrated into the frame 102 or into a plurality of temples or straps at the time of manufacture (e.g., a plurality of sensors may be configured to cooperate with mechanical features in the frame 102 and / or the plurality of temples or straps to hold them in a fixed position).

[0021] The eyeglass assembly 100 may be part of a system that enables correction of one or more audio signals driven to a plurality of external ear speakers (e.g., right external ear speaker 110 and / or left external ear speaker 112) based on the orientation of the eyeglass assembly 100 relative to the wearer's anatomical features. The system may utilize sensors m1 to m4 to track the position of the wearer's anatomical features and compensate for movement, tilt, and / or blockage when the user wears the eyeglass assembly 100. For example, the wearer's anatomical features may include a right earlobe f1, a left earlobe f2, a right eye f3, a left eye f4, a right ear canal f5, a left ear canal f6, a nose f7, and a mouth f8. The system may utilize one or more processors or processing circuits to execute instructions stored in a memory to correct the audio signal based on the orientation of the eyeglass assembly 100 relative to one or more of the anatomical features f1 to f8.

[0022] In some implementations, the eyeglass assembly 100 may include the one or more processors and memory, such as a system on a chip (SoC) 114 coupled to the frame 102 or to a plurality of temples or bands or other processing circuits. In some implementations, the eyeglass assembly 100 may include a wireless communication system 116 coupled to the frame 102 or to a plurality of temples or bands. In some implementations, the eyeglass assembly 100 may utilize the wireless communication system 116 to communicate with a companion device having one or more processors and memory, such as a smartphone or tablet computer that the wearer can access to control audio playback through the right ear external speaker 110 and the left ear external speaker 112 (e.g., via a media application executed in the companion device).

[0023] The system may utilize one or more processors and memories to process output data of multiple sensors m1 to m4 to determine the location of multiple anatomical features of the wearer (e.g., one or more anatomical features of anatomical features f1 to f8). For example, sensors m1 to m4 may include one or more sensors for detecting anatomical features and distances to those anatomical features. Sensor m1 may detect the right earlobe f1 at a distance d1; sensor m2 may detect the left earlobe f2 at a distance d2; sensor m3 may detect the right eye f3 at a distance d3; and sensor m4 may detect the left eye f4 at a distance d4. In some cases, the distance from the sensor to the center of mass of the anatomical feature may be determined. In another example, sensors m1 to m4 may include one or more sensors for detecting anatomical features and angles between those anatomical features. For example, sensor m3 may detect the right eye f3 and a reference point, such as a nose f7, with an angle θ3 between them; and sensor m4 may detect the left eye f4 and the same reference point, such as a nose f7, with an angle θ4 between them.

[0024] The system may then detect the orientation of the eyeglass assembly 100 relative to the wearer of the eyeglass assembly 100 based on the positions of the multiple anatomical features of the wearer. In some implementations, the system may use the symmetry of the anatomical features as a baseline. For example, detecting the orientation may include calculating a first difference between a distance d1 to the right earlobe f1 and a distance d2 to the left earlobe f2, and comparing the first difference to a first threshold (e.g., an earlobe threshold); and / or calculating a second difference between a distance d3 to the right eye f3 and a distance d4 to the left eye f4, and comparing the second difference to a second threshold (e.g., an eye threshold). In another example, detecting the orientation may include calculating a difference between an angle, such as an angle θ3 (e.g., an angle between the right eye f3 and the nose f7) and an angle θ4 (e.g., an angle between the left eye f4 and the nose f7), and comparing the difference to an angle threshold. In some implementations, the system may use a combination of distances and angles to determine the orientation. For example, distance d1 being equal to distance d2, distance d3 being equal to distance d4, and / or angle θ3 being equal to angle θ4 may indicate a balanced orientation (e.g., the system does not need to correct the audio signal driven to the plurality of external-ear speakers). However, distance d1 being greater than or less than distance d2, distance d3 being greater than or less than distance d4, and / or angle θ3 being greater than or less than angle θ4 may indicate an unbalanced orientation (e.g., the system may then determine a correction to the audio signal used to drive one or more of the plurality of external-ear speakers).

[0025] In some cases, detecting the orientation may include determining that one external-ear speaker is farther from the wearer's ear than another external-ear speaker is from the wearer's other ear. Figure 2 , detecting the orientation may include determining that the left external ear speaker 112 has moved further away from the left ear lobe f2 (and the right external ear speaker 110 has moved closer to the right ear lobe f1). The detection may be based on the distance d2 being greater than the distance d1 by more than a threshold. In some cases, this may be caused by excessive movement and / or sweating of the wearer causing the eyeglass assembly 100 to shift. In other cases, this may be the result of the wearer having asymmetric anatomical features, such as one ear offset higher than the other, or an uneven head or nose, resulting in an offset position of the external ear speaker.

[0026] The system may then determine, based on the orientation, corrections to one or more audio signals used to drive an external-ear speaker among a plurality of external-ear speakers. In some implementations, the correction may include: level compensation or equalization adjustments applied to the audio signal. For example, based on determining that the left external-ear speaker 112 has moved farther away from the left earlobe f2 (and the right external-ear speaker 110 has moved closer to the right earlobe f1), the system may increase the gain of the audio signal to the left external-ear speaker 112 (e.g., level compensation applied to the left external-ear speaker 112). In some implementations, the correction may include changes to information characterizing an HRTF associated with the wearer. For example, information characterizing the HRTF may be stored by a companion device that communicates with the eyeglass assembly 100. Figure 2 In the example of , the change can enable the HRTF to compensate for the change in position of the left external ear speaker 112 (e.g., farther from the left earlobe f2). The system can then apply corrections to improve the audio perceived by the wearer. Thus, regardless of whether one or more external ear speakers are moved out of position and / or regardless of whether the wearer has asymmetric anatomical features that cause the external ear speakers to be misaligned, the wearer can hear the sound in a balanced manner.

[0027] In some implementations, the system may utilize sensors m1 to m4 to detect objects that cause obstruction to the external ear speaker. For example, these sensors may detect hair or clothing between the ear and the external ear speaker (e.g., between the left ear canal f6 and the left external ear speaker 112). The system may then determine a correction to the audio signal driven to the external ear speaker (e.g., the left external ear speaker 112) based on the hair or clothing that causes the obstruction. This may enable compensation of the audio signal for hair or clothing.

[0028] In some implementations, the system may utilize machine learning to include predicting anatomical features with a confidence percentage. To make the prediction, the system may utilize a machine learning model that is trained to detect anatomical features, such as anatomical features f1 to f8. For example, the machine learning model may be trained using a training data set that includes data samples that characterize the anatomical features. The training may be periodic, such as by updating the machine learning model on a discrete time basis (e.g., weekly or monthly basis), or in other ways. The training data set may be derived from multiple users or may be specific to a particular user (e.g., Figure 1 and Figure 2 The machine learning model may, for example, be or include one or more of a neural network (e.g., a convolutional neural network, a recursive neural network, a deep neural network, or other neural network), a decision tree, a vector machine, a Bayesian network, a cluster-based system, a genetic algorithm, a deep learning system separate from a neural network, or other machine learning models.

[0029] Figure 3 1 is a block diagram of an example of a system 300 for correcting an audio signal based on an orientation of an eyeglass assembly (e.g., eyeglass assembly 100). System 300 may be implemented by one or more processors or processing circuits of an eyeglass assembly (e.g., SoC 114), one or more processors or processing circuits of a companion device that communicates with the eyeglass assembly (e.g., via wireless communication system 116), or a combination thereof.

[0030] The system 300 may receive audio content, such as streaming music, audio from a phone call, or audio that provides noise cancellation. The system may apply a baseline digital signal processing (DSP) algorithm to the audio content to generate a baseline audio signal that is configured to drive the external ear speakers (e.g., the right external ear speaker 110 and the left external ear speaker 112) of the eyeglass assembly.

[0031] In order to correct the audio signal based on the orientation, the system 300 may utilize sensors (e.g., sensors m1 to m4) to determine the positions of multiple anatomical features of the wearer of the eyeglass assembly. In some specific implementations, the system 300 may also receive information characterizing the HRTF associated with the wearer. For example, the HRTF may enable a priori determination of the user's anatomical features (e.g., the positions of the right earlobe f1, the left earlobe f2, the right eye f3, the left eye f4, the right ear canal f5, the left ear canal f6, the nose f7, and / or the mouth f8). The system 300 may then utilize an orientation estimator to detect the orientation (e.g., tilt and / or orientation estimation) of the eyeglass assembly relative to the wearer of the eyeglass assembly. The orientation may include quantitative estimates of movement, tilt, and / or blocking of the eyeglass assembly 100 and multiple external ear speakers (e.g., right ear external speaker 110 and / or left ear external speaker 112). The orientation may be based on the positions of multiple anatomical features of the wearer from the sensor and / or information characterizing the HRTF. The system 300 may then utilize the correction DSP algorithm to apply a correction to the baseline audio signal from the baseline digital DSP algorithm based on the orientation from the orientation estimator. In some implementations, the correction may include: a level compensation or equalization adjustment applied to the baseline audio signal. In some implementations, the correction may include a change to the information characterizing the HRTF. The system 300 may then output the audio signal generated by the correction DSP algorithm to drive the external ear speaker of the eyeglass assembly. Thus, the audio signal may achieve balanced audio for the user.

[0032] Figure 4 is a flow chart of an example of a process 400 for correcting an audio signal based on an orientation of an eyeglass assembly. The process 400 may be performed using a computing device such as a computer system. Figures 1 to 3The process 400 may be performed, for example, by executing a machine-readable program or other computer-executable instructions (such as a routine, instruction, program, or other code). The operations of the process 400 or another technique, method, process, or algorithm described in conjunction with the specific implementations disclosed herein may be implemented directly in hardware, firmware, software executed by hardware, circuits, or a combination thereof.

[0033] For simplicity of explanation, process 400 is depicted and described herein as a series of operations. However, operations according to the present disclosure may be performed in various orders and / or simultaneously. Additionally, other operations not presented and described herein may be used. In addition, not all illustrated operations are required to implement the technology according to the disclosed subject matter.

[0034] At operation 402, the system may process output data of a plurality of sensors to determine the locations of a plurality of anatomical features of the wearer. For example, the system 300 may process output data of sensors m1 to m4 to determine the locations of one or more anatomical features f1 to f8 of the wearer of the eyeglass assembly 100. The sensors may include, for example, one or more ultrasonic sensors, optical sensors, cameras, laser rangefinders, electromechanical sensors, capacitive touch sensors, and / or strain gauge sensors. The anatomical features may include, for example, one or more of an eye, a pupil, an ear, an earlobe, an ear canal, a nose, or a mouth.

[0035] At operation 404, the system may detect the orientation of the eyeglass assembly relative to the wearer of the eyeglass assembly based on the positions of the plurality of anatomical features of the wearer. For example, the system 300 may utilize sensors m1 to m4 to detect the orientation of the eyeglass assembly 100 relative to the wearer of the eyeglass assembly based on the positions of the plurality of anatomical features f1 to f8 of the wearer. In another example, the system 300 may utilize sensors m1 to m2 to detect that the left-outer-ear speaker 112 has moved farther from the left earlobe f2, and the right-outer-ear speaker 110 has moved closer to the right earlobe f1 (e.g., distance d2 is greater than distance d1).

[0036] At operation 406, the system may also detect obstruction between the external ear speaker and the wearer's ear. For example, the system 300 may detect obstruction caused by hair or clothing between the external ear speaker and the wearer's ear (e.g., the left external ear speaker 112 and the wearer's left ear).

[0037] At operation 408, the system may determine a correction to the audio signal to drive an external-ear speaker of the plurality of external-ear speakers based on the orientation and / or the blockage. For example, the system 300 may determine a correction to the audio signal to drive the external-left-ear speaker 112 based on the orientation and / or the blockage (e.g., to compensate for the increased distance of d2 and / or the presence of hair or clothing that interferes with the sound entering the ear). In some implementations, applying the correction may include applying level compensation, equalization adjustment, and / or HRTF correction.

[0038] Figure 5 4 is a flow chart of an example of a process 500 for correcting an audio signal by comparing a distance or angle to a threshold. For example, one or more operations of process 500 may be utilized in process 400 (such as operation 404). Process 500 may be performed using a computing device (such as a computer). Figures 1 to 3 The process 500 may be performed, for example, by executing a machine-readable program or other computer-executable instructions (such as a routine, instruction, program, or other code). The operations of the process 500 or another technique, method, process, or algorithm described in conjunction with the specific implementations disclosed herein may be implemented directly in hardware, firmware, software executed by hardware, circuits, or a combination thereof.

[0039] For simplicity of explanation, process 500 is depicted and described as a series of operations herein. However, operations according to the present disclosure may be performed in various orders and / or simultaneously. Additionally, other operations not presented and described herein may be used. In addition, not all illustrated operations are required to implement the technology according to the disclosed subject matter.

[0040] At operation 502, the system may determine a first distance (or angle) to a first anatomical feature of a plurality of anatomical features using one or more sensors of an eyeglass assembly (e.g., eyeglass assembly 100) having a plurality of external ear speakers (e.g., right external ear speaker 110 and / or left external ear speaker 112). For example, the system 300 may determine a distance d1 to the right earlobe f1 using sensor m1; determine a distance d3 to the right eye f3 using sensor m3; and / or determine an angle θ3 between the right eye f3 and the nose f7 using sensor m3.

[0041] At operation 504, the system may determine a second distance (or angle) to a second anatomical feature of the plurality of anatomical features using one or more sensors of the eyeglass assembly. For example, the system 300 may determine a distance d2 to the left earlobe f2 using sensor m2; a distance d4 to the left eye f4 using sensor m4; and / or an angle θ4 between the left eye f4 and the nose f7 using sensor m4.

[0042] At operation 506, the system may calculate a difference between the first distance (or angle) and the second distance (or angle), and compare the difference with a threshold value. For example, the system 300 may calculate a difference between distance d1 and distance d2, a difference between distance d3 and distance d4, and / or a difference between angle θ3 and angle θ4, and compare one or more of these differences with a corresponding threshold value.

[0043] If the calculated difference is within the threshold ("yes"), the system does not need to correct the audio signal driven to multiple external ear speakers. For example, the system may determine that the positioning of the eyeglass assembly is symmetrical and / or the multiple external ear speakers are balanced. The system may return to operation 502 to continue monitoring the orientation of the eyeglass assembly. However, if the difference exceeds the threshold ("no"), at operation 508, the system may determine the correction of the audio signal to drive the external ear speaker among the multiple external ear speakers. For example, the system 300 may determine the correction of the audio signal used to drive the left external ear speaker 112 based on the orientation to compensate for the difference between the distance d1 and the distance d2, the distance d3 and the distance d4, and / or the angle θ3 and the angle θ4 that are not within the threshold. In some specific implementations, applying the correction may include: applying level compensation, equalization adjustment, and / or HRTF correction. The system may then return to operation 502 to continue monitoring the orientation of the eyeglass assembly, such as to apply the next correction.

[0044] Some implementations may include a system comprising: an eyeglass assembly including a frame configured to rest on a wearer's face; a plurality of external ear speakers; and a plurality of sensors; and one or more processors or processing circuits configured to execute instructions stored in a memory to: process output data of the plurality of sensors to determine the positions of a plurality of anatomical features of the wearer; detect the orientation of the eyeglass assembly relative to the wearer of the eyeglass assembly based on the positions of the plurality of anatomical features of the wearer; and determine a correction to an audio signal to drive an external ear speaker in the plurality of external ear speakers based on the orientation. In some implementations, detecting the orientation includes: determining that the external ear speaker is farther from the ear of the wearer than a second external ear speaker in the plurality of external ear speakers is from another ear of the wearer. In some implementations, detecting the orientation includes: calculating a difference between a first distance to a first anatomical feature in the plurality of anatomical features and a second distance to a second anatomical feature in the plurality of anatomical features. In some implementations, the correction includes at least one of level compensation or equalization adjustment applied to the audio signal. In some implementations, the processor or processing circuit is further configured to execute instructions stored in the memory to receive information characterizing the HRTF associated with the wearer via a wireless communication system. In some implementations, the correction includes a change to the information characterizing the HRTF associated with the wearer. In some implementations, the processor or processing circuit is further configured to execute instructions stored in the memory to detect an obstruction between the external ear speaker and the wearer's ear; and determine a second correction to the audio signal based on the obstruction. In some implementations, the plurality of anatomical features include eyes and ears.

[0045] Some implementations may include a method comprising: determining the positions of multiple anatomical features of a wearer of the eyeglass assembly based on output data of multiple sensors of an eyeglass assembly, wherein the eyeglass assembly includes a frame configured to rest on the face of the wearer and multiple external ear speakers; detecting the orientation of the eyeglass assembly relative to the wearer of the eyeglass assembly based on the positions of the multiple anatomical features of the wearer; and determining a correction to an audio signal to drive an external ear speaker of the multiple external ear speakers based on the orientation. In some implementations, detecting the orientation includes: determining that the external ear speaker is closer to the ear of the wearer than the second external ear speaker of the multiple external ear speakers is to another ear of the wearer. In some implementations, detecting the orientation includes: comparing a difference between a first distance to a first anatomical feature of the multiple anatomical features and a second distance to a second anatomical feature of the multiple anatomical features with a threshold. In some implementations, the method may also include: applying the correction by at least one of level compensating or equalizing the audio signal. In some implementations, the method may also include: receiving information characterizing an HRTF associated with the wearer via a near field communication system. In some implementations, the method may further include: detecting hair between the external ear speaker and the wearer's ear; and determining a second correction to the audio signal based on the hair. In some implementations, the plurality of anatomical features include a pupil and an earlobe.

[0046] Some implementations may include a non-transitory computer-readable medium storing instructions operable to cause one or more processors or processing circuits to perform operations including: determining the positions of multiple anatomical features of a wearer of the eyeglass assembly based on output data of multiple sensors of the eyeglass assembly, wherein the eyeglass assembly includes a frame configured to rest on the face of the wearer and multiple external-ear speakers; detecting the orientation of the eyeglass assembly relative to the wearer of the eyeglass assembly based on the positions of the multiple anatomical features of the wearer; and determining a correction to an audio signal to drive an external-ear speaker of the multiple external-ear speakers based on the orientation. In some implementations, detecting the orientation includes determining that the external-ear speaker is farther from the ear of the wearer than a second external-ear speaker of the multiple external-ear speakers is from another ear of the wearer. In some implementations, detecting the orientation includes calculating a difference between a first angle relative to a first anatomical feature of the multiple anatomical features and a second angle relative to a second anatomical feature of the multiple anatomical features. In some implementations, the correction includes changing information characterizing an HRTF associated with the wearer. In some implementations, the operation may also include: detecting clothing between the off-ear speaker and the wearer's ear; and determining a second correction to the audio signal based on the clothing.

[0047] It is understood that the use of personally identifiable information should be subject to privacy policies and practices that are generally recognized to meet or exceed industry or government requirements for maintaining user privacy. Specifically, personally identifiable information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use, and the nature of the authorized use should be clearly stated to users.

[0048] As used herein, the term "circuit" refers to an arrangement of electronic components (e.g., transistors, resistors, capacitors, and / or inductors) constructed to implement one or more functions. For example, a circuit may include one or more transistors interconnected to form logic gates that collectively implement a logic function.

[0049] In utilizing various aspects of the embodiments, it will be apparent to those skilled in the art that combinations or variations of the above embodiments are possible for correcting the audio signal driven to the external ear speaker of the eyeglass assembly based on the orientation of the eyeglass assembly. Although the embodiments are described in language specific to structural features and / or methodological acts, it should be understood that the appended claims are not necessarily limited to the specific features or acts described. The specific features and acts disclosed should instead be understood as embodiments of the claims for purposes of illustration.

Claims

1. A system comprising: A glasses assembly, the glasses assembly comprising: a frame configured to rest on a wearer's face; Multiple external ear speakers; and Multiple sensors; and one or more processing circuits configured to execute instructions stored in the memory to: processing output data from the plurality of sensors to determine locations of a plurality of anatomical features of the wearer; detecting an orientation of the eyeglass assembly relative to the wearer of the eyeglass assembly based on the positions of the plurality of anatomical features of the wearer; and A correction to an audio signal to drive an extra-ear speaker of the plurality of extra-ear speakers is determined based on the orientation.

2. The system of claim 1 , wherein detecting the orientation comprises: It is determined that the distance of the external ear speaker from the wearer's ear is farther than the distance of a second external ear speaker among the plurality of external ear speakers from the other ear of the wearer.

3. The system of claim 1 , wherein detecting the orientation comprises: A difference between a first distance to a first anatomical feature of the plurality of anatomical features and a second distance to a second anatomical feature of the plurality of anatomical features is calculated.

4. The system of claim 1, wherein the correction comprises at least one of level compensation or equalization adjustment applied to the audio signal.

5. The system of claim 1 , wherein the one or more processing circuits are further configured to execute instructions stored in the memory to: Information representative of a head related transfer function (HRTF) associated with the wearer is received via a wireless communication system.

6. The system of claim 1, wherein the correction comprises a change to information representing a HRTF associated with the wearer.

7. The system of claim 1 , wherein the one or more processing circuits are further configured to execute instructions stored in the memory to: detecting an obstruction between the off-ear speaker and the wearer's ear; and A second correction to the audio signal is determined based on the blockage.

8. The system of claim 1, wherein the plurality of anatomical features include eyes and ears.

9. A method comprising: determining locations of a plurality of anatomical features of a wearer of an eyeglass assembly based on output data of a plurality of sensors of the eyeglass assembly, wherein the eyeglass assembly includes a frame configured to rest on a face of the wearer and a plurality of off-ear speakers; detecting an orientation of the eyeglass assembly relative to the wearer of the eyeglass assembly based on the positions of the plurality of anatomical features of the wearer; as well as A correction to an audio signal to drive an extra-ear speaker of the plurality of extra-ear speakers is determined based on the orientation.

10. The method of claim 9, wherein detecting the orientation comprises: It is determined that the distance of the external ear speaker from the wearer's ear is closer than the distance of a second external ear speaker among the plurality of external ear speakers from the other ear of the wearer.

11. The method of claim 9, wherein detecting the orientation comprises: A difference between a first distance to a first anatomical feature of the plurality of anatomical features and a second distance to a second anatomical feature of the plurality of anatomical features is compared to a threshold value.

12. The method according to claim 9, further comprising: The correction is applied by at least one of level compensating or equalizing the audio signal.

13. The method according to claim 9, further comprising: Information representative of a head related transfer function (HRTF) associated with the wearer is received via a near field communication system.

14. The method according to claim 9, further comprising: detecting hair between the external ear speaker and the wearer's ear; as well as A second correction to the audio signal is determined based on the hair.

15. The method of claim 9, wherein the plurality of anatomical features include a pupil and an earlobe.

16. A non-transitory computer-readable medium storing instructions operable to cause one or more processing circuits to perform operations comprising: determining locations of a plurality of anatomical features of a wearer of an eyeglass assembly based on output data of a plurality of sensors of the eyeglass assembly, wherein the eyeglass assembly includes a frame configured to rest on a face of the wearer and a plurality of off-ear speakers; detecting an orientation of the eyeglass assembly relative to a wearer of the eyeglass assembly based on the positions of the plurality of anatomical features of the wearer; as well as A correction to an audio signal to drive an extra-ear speaker of the plurality of extra-ear speakers is determined based on the orientation.

17. The non-transitory computer readable medium storing instructions of claim 16, wherein detecting the orientation comprises: It is determined that the distance of the external ear speaker from the wearer's ear is farther than the distance of a second external ear speaker among the plurality of external ear speakers from the other ear of the wearer.

18. The non-transitory computer readable medium storing instructions of claim 16, wherein detecting the orientation comprises: A difference is calculated between a first angle relative to a first anatomical feature of the plurality of anatomical features and a second angle relative to a second anatomical feature of the plurality of anatomical features.

19. The non-transitory computer-readable medium storing instructions of claim 16, wherein the correction comprises changing information representing a head-related transfer function (HRTF) associated with the wearer.

20. The non-transitory computer readable medium storing instructions of claim 16, wherein the operations further comprise: detecting clothing between the external ear speaker and the wearer's ear; as well as A second correction to the audio signal is determined based on the article of clothing.

Images