Media control based on directivity measurements

Abstract

A device includes one or more processors configured to receive data representative of an electromagnetic signal transmitted by a second device, and estimate a field of view of a user based on the data representative of the electromagnetic signal. The one or more processors are further configured to initiate output of the media content by the output device based on determining that the output device is within the field of view.

Description

[0001] I. Cross-references to related applications

[0002] This application claims the priority of jointly owned Greek patent application No. 20230100340, filed on April 24, 2023, the contents of which are expressly incorporated herein by reference in their entirety. Technical Field

[0003] This disclosure generally relates to controlling media based on directional measurements.

[0004] III. Related Technical Descriptions

[0005] Some wireless devices (e.g., earbuds, headsets, etc.) can pair with and sometimes connect to multiple devices simultaneously to transmit or receive media content. Simultaneous pairing and / or connection to multiple devices simplifies switching between media sources and / or output devices. However, automatic switching between devices can sometimes lead to an unsatisfactory user experience. For example, when a user's earbuds come into range of a media device (e.g., a TV or computer), the earbuds may automatically play audio from that media device. One way to avoid such problems is to require the user to manually switch between media sources and / or output devices, which can also be unsatisfactory as it imposes an additional burden on the user. Summary of the Invention

[0006] According to one embodiment of this disclosure, an apparatus includes one or more processors configured to receive data representing electromagnetic signals emitted by a second device, and to estimate a user's field of view based on the data representing these electromagnetic signals. The one or more processors are further configured to initiate the output of media content by an output device based on determining that the output device is within the field of view.

[0007] According to another embodiment of this disclosure, a method includes receiving data representing electromagnetic signals emitted by a second device at one or more processors of a device. The method further includes having the one or more processors estimate a user's field of view based on the data representing the electromagnetic signals. The method also includes having the one or more processors initiate the output of media content by the output device based on determining that the output device is within the field of view.

[0008] According to another embodiment of this disclosure, a non-transitory computer-readable medium storage instruction is provided. This instruction is executable by one or more processors to cause the one or more processors to receive data representing electromagnetic signals emitted by a second device, and to estimate a user's field of view based on the data representing the electromagnetic signals. The instruction is also executable to cause the one or more processors to initiate the output of media content by the output device based on determining that the output device is within the field of view.

[0009] According to another embodiment of this disclosure, an apparatus includes components for receiving data representing electromagnetic signals emitted by a second device. The apparatus also includes components for estimating a user's field of view based on the data representing the electromagnetic signals. Furthermore, the apparatus includes components for initiating the output of media content by the output device based on determining that the output device is within the field of view.

[0010] Other aspects, advantages, and features of this disclosure will become apparent upon examination of the entire application, which includes the description of the drawings, detailed description, and claims.

[0011] V. Illustrations

[0012] Figure 1A This is a block diagram of a specific aspect of a system operable to control media output based on directional measurements, according to some examples of this disclosure.

[0013] Figure 1B This disclosure provides examples of operable methods for controlling media output based on directionality measurements. Figure 1A A block diagram of a specific aspect of the wearable device system.

[0014] Figure 2 Examples of integrated circuits operable to control media output based on directional measurements are illustrated according to some examples of this disclosure.

[0015] Figure 3 This is an illustration of a head-mounted device operable to control media output based on directional measurements, according to some examples of this disclosure.

[0016] Figure 4 This is an illustration of a head-mounted device (such as a virtual reality, mixed reality, or augmented reality head-mounted device) operable to control media output based on directional measurements, according to some examples of this disclosure.

[0017] Figure 5 This is an illustration of augmented reality glasses operable to control media output based on directional measurements, according to some examples of this disclosure.

[0018] Figure 6This is an illustration of a wearable device operable to control media output based on directional measurements, according to some examples of this disclosure.

[0019] Figure 7 This is a diagram illustrating an earbud operable to control media output based on directional measurements, according to some examples of this disclosure.

[0020] Figure 8 Based on some examples of this disclosure, it is possible to... Figure 1A and Figure 1B A diagram illustrating a specific implementation of a method for controlling media output based on directional measurements performed by a wearable device.

[0021] Figure 9 Based on some examples of this disclosure, it is possible to... Figure 1A and Figure 1B An illustration of another specific implementation of a method for controlling media output based on directional measurements performed by a wearable device.

[0022] Figure 10 This is a block diagram of a particular exemplary example of a device operable to control media output based on directional measurements, according to some examples of this disclosure.

[0023] VI. Detailed Implementation

[0024] Methods and systems for controlling media data based on directional measurements are disclosed. As an example, the disclosed methods and systems enable a user to switch between a media source device, a media output device, or both, based on the user's field of view. In some implementations, media control is performed hands-free.

[0025] In certain aspects, wearable devices (such as earbuds, headsets, glasses, etc.) are configured to estimate a user's field of view and control media output based on that field of view. Wearable devices are configured to perform directional measurements used to estimate the user's field of view based on electromagnetic signals transmitted by one or more other devices. Using electromagnetic signals transmitted by other devices, rather than, for example, transmitting electromagnetic signals from the wearable device and determining directional measurements based on the signal return, saves power on the wearable device's onboard circuitry. Lower power usage enables the use of lighter batteries on the wearable device's onboard circuitry, longer usage time, or both.

[0026] Specific aspects of this disclosure are described below with reference to the accompanying drawings. In this description, common features are designated by common reference numerals. As used herein, various terms are used only for the purpose of describing particular embodiments and are not intended to limit the scope of the embodiments. For example, the singular forms “a,” “an,” and “the” are intended to also include the plural forms unless the context clearly indicates otherwise. Furthermore, some features described herein are singular in some embodiments and plural in others. For example, Figure 1B It describes a system that includes one or more processors ( Figure 1B The term "processor 190" refers to the wearable device 102, indicating that in some embodiments, the wearable device 102 includes a single processor 190, and in other embodiments, the wearable device 102 includes multiple processors 190. For ease of reference herein, such features are generally introduced as "one or more" features and are subsequently referred to in the singular or optional plural form (as indicated by "(multiple)"), unless the aspect described relates to multiples of features.

[0027] In some figures, multiple instances of a particular type of feature are used. Although these features are physically and / or logically different, the same reference numerals are used for each feature, and these different instances are distinguished by adding letters to the reference numerals. Reference numerals are used without distinguishing letters when a feature is referenced herein as a group or a type of feature (e.g., when a specific feature among these features is not referenced). However, reference numerals are used with distinguishing letters when a specific feature among multiple features of the same type is mentioned herein. For example, see reference... Figure 1B The figure illustrates multiple antennas, which are associated with reference numerals 112A and 112B. When referring to a particular antenna among these antennas (such as antenna 112A), the distinguishing letter "A" is used. However, when referring to any one of these antennas or to these antennas as a group, reference numeral 112 is used without the distinguishing letter.

[0028] As used herein, the term "comprise" is used interchangeably with "include". Additionally, the term "wherein" is used interchangeably with "where". As used herein, "exemplary" indicates an example, specific implementation, and / or aspect, and should not be construed as restrictive or indicating a preference or preferred implementation. As used herein, ordinal terms used to modify elements (such as structures, components, operations, etc.) (e.g., "first", "second", "third", etc.) do not themselves indicate any priority or order of that element relative to another element, but merely distinguish that element from another element with the same name (but using ordinal terms). As used herein, the term "set" refers to one or more specific elements among specific elements, while the term "multiple" refers to multiple (e.g., two or more) specific elements.

[0029] As used herein, “coupling” can include “communicationally coupled,” “electrically coupled,” or “physically coupled,” and may also (or alternatively) include any combination thereof. Two devices (or components) may be directly or indirectly coupled (e.g., communicationally coupled, electrically coupled, or physically coupled) via one or more other devices, components, wires, buses, networks (e.g., wired networks, wireless networks, or combinations thereof). As an illustrative, non-limiting example, two electrically coupled devices (or components) may be included in the same device or in different devices and may be connected via electronics, one or more connectors, or inductive coupling. In some specific implementations, two communicationally coupled (e.g., electrically connected) devices (or components) may transmit and receive signals (e.g., digital or analog signals) directly or indirectly via one or more wires, buses, networks, etc. As used herein, “direct coupling” can include two devices coupled (e.g., communicationally coupled, electrically coupled, or physically coupled) without intermediate components.

[0030] In this disclosure, terms such as “determine,” “calculate,” “estimate,” “shift,” and “adjust” can be used to describe how one or more operations are performed. It should be noted that such terms should not be construed as restrictive, and similar operations can be performed using other techniques. Additionally, as mentioned herein, “generate,” “calculate,” “estimate,” “use,” “select,” “access,” and “determine” are used interchangeably. For example, “generating,” “calculating,” “estimate,” or “determining” a parameter (or signal) can refer to actively generating, estimating, calculating, or determining the parameter (or signal), or it can refer to using, selecting, or accessing a parameter (or signal) that has already been generated (e.g., by another component or device).

[0031] Figure 1AThis is a block diagram of a specific aspect of a system 100 operable to control media output based on directional measurements, according to some examples of this disclosure. Figure 1A In the system 100, wearable device 102 is included. Figure 1B (More detailed examples are shown below) and one or more media devices 130. In Figure 1A In the illustrated example, media device 130 includes media device 130A (e.g., a mobile communication device), media device 130B (e.g., a television), and media device 130C (e.g., a speaker).

[0032] Each media device in media device 130 is operable to act as a media source device, a media output device, or both. A media source device is a device operable to provide media content to another device for output. A media source device can generate media content, retrieve media content from local memory, or act as an intermediate device to retrieve media content from a remote location and provide media content to a media output device. A media output device is a device operable to generate user-perceptible output (e.g., sound, images, video, etc.) based on media content. In some cases, a media source device can also be a media output device. For example, Figure 1A The media device 130A is exemplified as a mobile communication device (e.g., a smartphone). Mobile communication devices like media device 130A are typically configured to transmit media content to other devices (e.g., via...). Connection, via The connection, via mobile data connection (e.g., a connection conforming to cellular voice and data network protocols from the 3rd Generation Partnership Project (3GPP) standards organization, such as 3G, 4G, or 5G connections), enables the mobile communication device to operate as a media source device. It is a registered trademark of the Bluetooth Special Interest Group (SIG). (This is a registered trademark of the Wi-Fi Alliance). Additionally, such mobile communication devices typically include a display screen and speakers that can be used to output media content received from another device, thereby enabling the mobile communication device to operate as a media output device. Media content may include, for example, audio content, video content, game content, extended reality content (such as virtual reality content, augmented reality content, or mixed reality content) or combinations thereof (such as audio content and associated video content). In some specific implementations, media content may include multiple independent content streams. For example, media content may include a first text stream of news content and a second video stream of entertainment content. The mobile communication device can be used to output one or more of the multiple content streams.

[0033] Figure 1A and Figure 1BThe wearable device 102 is operable to control media content based on directional measurements. The directional measurements are used to estimate the field of view 124 of the user 120 wearing the wearable device 102, and media output is controlled based on the estimation of the field of view 124. As an example, the wearable device 102 can transmit media content from a media source device to a media output device determined to be within the user 120's field of view 124. In some aspects of this example, the wearable device 102 can be a media source device. Alternatively, in some other aspects of this example, the wearable device 102 can receive media content from a media source device and can switch the output of the media content to the media output device based on determining that the media output device is within the user 120's field of view 124 (and optionally based on other criteria, such as gaze duration, posture, etc.).

[0034] exist Figure 1B In the illustrated example, wearable device 102 includes one or more processors 190, one or more sensors 108, memory 106, one or more interface devices 110, and multiple antennas 112. Additionally, in Figure 1B In this configuration, antenna 112 is coupled to one or more modems 160 via one or more transceivers 162. The modems 160 and transceivers 162 enable processor 190 to communicate with... Figure 1A The system 100 communicates with other devices and optionally with other devices to transmit or receive commands 150, transmit or receive data (e.g., notification packets 116), transmit or receive media content, etc.

[0035] Antenna 112 is configured to receive electromagnetic signals 114 emitted by one or more devices or other devices in device 130. Antenna 112 is arranged to provide spatial diversity, allowing beamforming techniques to be used to compare electromagnetic signals 114A received by the first antenna 112A with electromagnetic signals 114B received by the second antenna 112B to determine the direction from wearable device 102 to device 130 transmitting electromagnetic signals 114. For example, the spatial diversity of antenna 112 enables the comparison of the phase of the waveform of electromagnetic signals 114 to determine the angle of arrival of electromagnetic signals 114. Although antenna 112 is in Figure 1B While illustrated as a physically discrete structure, in some specific embodiments, antenna 112 includes or corresponds to elements of an antenna array. Therefore, as used herein, the term "antenna" includes any structure that converts (or vice versa) electromagnetic waves propagating in free space to electrical signals propagating via a conductor. For example, an antenna can be, but is not limited to, a monopole antenna, a dipole antenna, a patch antenna, a helical antenna, a horn antenna, or another type of antenna. As another example, an antenna can be an element of an antenna array comprising two or more such antennas.

[0036] In a particular implementation, transceiver 162 is configured to provide processor 190 with data representing electromagnetic signal 114. In this context, the data representing electromagnetic signal 114 differs from the data content of electromagnetic signal 114 (if any). For example, the data representing electromagnetic signal 114 describes the waveform and timing of electromagnetic signal 114 itself. For illustration, the data representing electromagnetic signal 114 may include phase information, amplitude information, frequency information, etc. The data representing electromagnetic signal 114 may include analog or digital information. As further explained below, processor 190 uses the data representing electromagnetic signal 114 to estimate the field of view 124 of user 120.

[0037] exist Figure 1B In one example, processor 190 includes a field of view (FOV) estimator 140, a motion detector 142, a media controller 144, a spatial media processor 146, or a combination thereof. FOV estimator 140 is configured to estimate the field of view 124 of user 120. In some embodiments, processor 190 may determine the gaze direction 128 of user 120 based on the expected orientation of wearable device 102 relative to user 120. In some such embodiments, wearable device 102 is configured to be worn by user 120 in a manner that positions wearable device 102 in a specific orientation relative to user 120's field of view 124 and / or gaze direction 128. In such embodiments, the gaze direction 128, field of view 124, or both of user 120 are estimated in part based on the specific orientation of wearable device 102. For illustration, a particular orientation may cause the gaze direction 128 to be perpendicular to a plane including portions of the wearable device 102 configured to be worn on opposite sides of a user's head (e.g., on different earcups of a headband or in different earplugs). The FOV estimator 140 estimates the field of view 124 as including angularly offset regions to both sides of the gaze direction 128.

[0038] Processor 190 is operable to determine the angle of arrival (Angle of Arrival) of electromagnetic signal 114 based on a comparison of waveforms received at space diversity antenna 112 disposed on wearable device 102. FOV estimator 140 uses the estimated Angle of Arrival to orient the gaze direction 128 relative to the device transmitting electromagnetic signal 114, enabling FOV estimator 140 to relative to... Figure 1A One or more of the other devices 130 orient the user’s field of view 124.

[0039] Media controller 144 is configured to control the output of media content based at least in part on determining that a specific device in device 130 is within field of view 124. For example, in response to detecting that a media output device in device 130 is within the user's field of view 124, media controller 144 may cause media content to be transferred to the media output device for playback. As another example, in response to detecting that a media source device in device 130 is within the user's field of view 124, media controller 144 may cause media content to be transferred from the media source device to the media output device for playback.

[0040] In each of the examples above, wearable device 102 may act as a media source device, a media output device, or neither. For illustration, when wearable device 102 is outputting media content to user 120 (e.g., acting as a media output device), user 120 may look at one of the devices 130 to select a different media output device. As another illustrative example, when wearable device 102 is transmitting media content to another device (e.g., acting as a media source device), user 120 may look at one of the devices 130 to select a different media output device for the media content transmitted from wearable device 102. As yet another illustrative example, when user 120 is consuming media from one of the devices 130 (e.g., that device is acting as a media output device), user 120 may look at another device in device 130 to select a different media output device from which the media content is consumed, in which case wearable device 102 neither acts as a media source device nor a media output device.

[0041] Media controller 144 is configured to enable wearable device 102 to control media output from one or more devices 130 (and optionally wearable device 102) based on the user 120's field of view 124. In some implementations, media controller 144 is configured to initiate the output of media content by one or more devices 130, stop or pause the output of media content by one or more devices 130, cause one or more devices 130 to change the output media, or a combination thereof. In this context, "initiating the output of media content" by an output device (e.g., wearable device 102 and / or one or more devices 130) includes any action performed by wearable device 102 that results in the output of media content by the output device. For example, media controller 144 may initiate the output of media content by device 130C by sending one or more commands 150 to device 130C to enable device 130C to access and play media content. As another example, media controller 144 can initiate the output of media content by device 130C by sending one or more commands 150 to device 130A to cause device 130A to send media content to device 130C. As another example, media controller 144 can initiate the output of media content by device 130C by sending media content from wearable device 102 to device 130C. As another example, media controller 144 can initiate the output of media content by device 130C by sending one or more commands 150 to device 130A to cause device 130A to command another device (e.g., device 130B) to send media content to device 130C. As a result of the commands 150 sent by media controller 144, the volume or spatial output of the media content can be modified. For example, initiating the output of media content may result in the volume of the output media content increasing or decreasing. As another example, initiating the output of media content can cause the first media content (e.g., media content output by a first device such as device 130C) to be moved to the background relative to the second media content (e.g., media content output by a second device such as device 130B).

[0042] As another example, when media content is projected, it can be omnidirectional or in a direction corresponding to the relative orientation of the user's head-mounted device and the media output device. In an exemplary example, moving the first media content to the background may include reducing the first volume of the first media content by a second volume relative to the second media content. Additionally or alternatively, moving the first media content to the background may include projecting the first media content in a direction that is shifted from the orientation of the user's head-mounted device compared to the orientation of the second media content (e.g., omnidirectional or to one side).

[0043] For example, command 150 may instruct the selection of a media source device providing the media stream, the selection of a media output device playing the media stream, or both. For illustration, output of media content may be initiated at a specific media output device in device 130 based on determining that a particular media output device is within the user 120's field of view 124. In some implementations, media controller 144 controls the media content based on changes in the field of view 124. For example, when user 120 looks from device 130B to device 130C (perhaps for a specified time period or with a specified posture), media controller 144 may switch the output of media content from device 130B to device 130C.

[0044] In some implementations, wearable device 102 is selected as the media output device if no device in device 130 is in the user 120's field of view 124. For example, if device 130A is streaming media content (e.g., acting as a media source device) to device 130C for output (e.g., device 130C is acting as a media output device), and the user 120 turns around and leaves the room with wearable device 102 and device 130A, wearable device 102 is selected as the media output device. In some implementations, if wearable device 102 is outputting media content when one of the devices in device 130 is selected as the media output device (e.g., based on the user 120's field of view 124), in addition to initiating the output of media content at the selected media output device in device 130, media controller 144 may also pause or stop the output of media content by wearable device 102 (e.g., the wearable device's or one or more speakers coupled to the wearable device). In such an implementation, the media content output at the selected media output device may include the media content being output by the wearable device 102. For example, if user 120 is listening to a podcast on wearable device 102 when she (based on user 120's field of view 124) selects device 130C as the media output device, the podcast output may stop or pause at wearable device 102 and resume at device 130C.

[0045] In some implementations, if the first device in device 130 is outputting media content when the second device in device 130 is selected as the media output device (e.g., based on the field of view 124 of user 120), then in addition to initiating the output of media content at the second device, the media controller 144 may also pause or stop the output of media content at the first device. In some implementations, the media controller 144 may adjust the gain of the media content output by the first device to place the media content output by the first device in the background relative to the media content at the second device.

[0046] The media content output by the first device and the second device can be the same or different.

[0047] In a particular implementation, motion detector 142 detects changes in the field of view by comparing the field of view 124 estimated by FOV estimator 140 with a previous estimate of the field of view. Motion detector 142 may also determine a user's posture based on changes in the field of view and / or sensor data from sensor 108. For example, motion detector 142 may detect postures indicated by head movement, such as head rotation and / or translation. Examples of such postures may include, but are not limited to, nodding, shaking, or tilting of the head. When a posture is detected, motion detector 142 may determine a control action mapped to the posture based on configuration settings 148 in memory 106. In such an implementation, a command 150 transmitted by media controller 144 is selected to cause the control action to be performed by one or more devices in device 130.

[0048] In some implementations, sensor 108 includes motion sensors configured to generate sensor data indicating head movement. For example, sensor 108 may include a gyroscope or inertial measurement unit that generates sensor data indicating movement. Additionally or alternatively, the sensor data can be used to detect when the user's head movement stops. For example, a dwell timer may start when head movement stops. For illustration, the dwell timer is used to determine whether the user's gaze has remained (e.g., substantially still) for at least a threshold duration. In this example, media controller 144 initiates media control operation after the dwell timer indicates that the user's gaze has remained substantially still for the threshold duration.

[0049] In some implementations, sensor 108 includes a gesture sensor, such as a camera or proximity sensor, configured to detect gestures performed by user 120. Gestures may include head movements, eye movements, facial movements, hand movements, limb movements, or other body movements. In such implementations, user 120 may combine gaze direction with gestures to control the output of media content. For example, user 120 may turn to look at device 130C and perform a gesture to cause media controller 144 to initiate the output of media content at device 130C. As another example, user 120 may turn to look at device 130C for a threshold duration, after which media controller 144 may prompt user 120 to confirm that device 130C has been selected as the media output device. In this example, user 120 may use a gesture to confirm that device 130C has been selected as the media output device.

[0050] In some implementations, wearable device 102 transmits command 150 to control the output of media content by device 130. For example, command 150 may cause a specific media source device in device 130 to transmit media content to wearable device 102 or to a media output device in device 130. As another example, command 150 may cause a specific media output device in device 130 to output specific media content. In some implementations, when the media output device is changed, command 150 is transmitted to both the media source device and the selected media output device. For example, in such an implementation, command 150 may cause the media source device and the media output device to establish a data connection through which media content is sent from the media source device to the media output device.

[0051] In some implementations, one or more commands in command 150 may be transmitted based on sensor data from sensor 108, input received via interface device 110, or both, in addition to the estimated field of view 124 of user 120. For example, as explained above, sensor 108 may include a posture sensor that detects the posture of user 120, such as a posture confirming a selection. In this example, one or more commands in command 150 may be transmitted based on the detected posture and the field of view 124 of user 120. As another example, interface device 110 may include one or more input devices configured to receive input from user 120. Examples of such input devices include, but are not limited to, a microphone for receiving voice input; a touchpad for receiving touch input; a switch, knob, or button; or combinations thereof. In this example, user 120 may provide input via one of the interface devices in interface device 110 to confirm or reject a selection, initiate detection of a selection, etc. In such implementations, a specific command in command 150 may be transmitted based on user 120's confirmation of a selection.

[0052] In some implementations, processor 190 is configured to output a prompt to user 120 via one or more interface devices of interface device 110 before transmitting a specific command 150. The prompt can be used to confirm a media source selection, a media output device selection, or another media control selection. For example, when media controller 144 determines a selection of a media source device or a media output device based on field of view 124 or gesture indication from user 120, processor 104 can output a prompt to user 120 via interface device 110 to confirm the selection. As an example, interface device 110 may include a display device, and the prompt may be displayed on the display device. As another example, interface device 110 may include at least one haptic device 152, and the prompt may be provided via haptic output from haptic device 152. For illustration, when the field of view 124 lingers on the specific device 130 for a first threshold duration (e.g., 5 seconds), the haptic device 152 may vibrate to indicate to the user 120 that if the user 120 continues to look at the specific device 130 for a second threshold duration (e.g., another 5 seconds), the wearable device 102 will transmit a command 150 to switch the media output to the specific device 130 or to start a media stream from the specific device 130. In some specific implementations, the haptic device 152 may also be used, or alternatively, to provide a cue to the user 120 to inform the user 120 that the specific device 130 is available for use. For illustration, the haptic device 152 on the right side of the wearable device 102 may vibrate to inform the user 120. Figure 1A The 130A device is available on the user's right.

[0053] In some implementations, wearable device 102 may allow prompts to be presented by devices other than wearable device 102 (such as one of the devices in device 130). For example, in Figure 1A In this example, device 130A includes a mobile communication device, which includes a display. Wearable device 102 can transmit command 150 to device 130A to cause device 130A to display a prompt. When the prompt is output via the display, the prompt may include additional information, such as a description of the selected device, a description of the media content to be output, etc. As another example, in... Figure 1A When the selected device is a media output device, the wearable device 102 can send a command 150 to the media output device to cause the media output device to output a prompt. For example, if the media output device includes a display, the prompt can be output via the display. As another example, if the media output device includes a speaker, the prompt can be output as a tone or voice from the speaker.

[0054] In a particular implementation, configuration settings 148 include user-adjustable settings, default settings, or both. Configuration settings 148 include, for example, information describing devices 130 that can be controlled by media controller 144. For instance, the information describing devices 130 may indicate the location of each device within a specific space, enabling processor 190 to determine whether a particular device 130 is within the estimated field of view 124 of user 120. The location of devices 130 may be user-specified or determined based on a calibration process. As another example, the information describing devices 130 may indicate whether each device in devices 130 can operate as a media source device, as a media output device, or both.

[0055] In some implementations, configuration setting 148 may also or alternatively include user-specific control options. For example, configuration setting 148 may include a user-adjustable FOV sensitivity option that indicates how wide or narrow the field of view 124 used to control media output should be set. In this example, the offset angle of the field of view 124 from the gaze direction 128 is determined based on a value associated with the FOV sensitivity option. As another example, configuration setting 148 may include a user-adjustable setting for gaze dwell time. Such gaze dwell time setting may specify one or more thresholds for how long the device 130 should remain within the user 120's field of view 124 before various actions are taken. For illustration, a first threshold may indicate how long the device 130 should remain in the field of view 124 before the wearable device 102 prompts the user 120 to confirm the selection of the device 130. In this illustrative example, a second threshold may indicate how long the device 130 should remain in the field of view 124 after the user 120 is prompted to confirm the selection of the device 130 to indicate the user's confirmation of the selection.

[0056] In some implementations, configuration setting 148 may also include other settings. For example, configuration setting 148 may include information mapping a specific gesture to a specific control action. For illustration, a forward swipe on the touchpad of interface device 110 may indicate selection of a specific device 130 as a media output device, and a backward swipe on the touchpad of interface device 110 may indicate selection of a specific device 130 as a media source device. As another example, configuration setting 148 may include information indicating whether to prompt the user to confirm the selection, and if so, indicating how to prompt (e.g., via audio output at wearable device 102, via haptic output at wearable device 102, or via audio output associated with the selection at device 130).

[0057] Figure 1BThe spatial media processor 146 is optional and, if present, is configured to process media content spatially based at least in part on the estimated orientation of device 130 relative to user 120. For example, spatial media processor 146 may receive first media data representing first media content from a first source device (e.g., device 130B) and second media data representing second media content from a second source device (e.g., device 130A). In this example, spatial media processor 146 is configured to: estimate a first orientation of device 130B relative to user 120 based on the angle of arrival of electromagnetic signal 114 emitted by device 130B; estimate a second orientation of device 130A relative to user 120 based on the angle of arrival of electromagnetic signal 114 emitted by device 130A; perform spatial audio processing at least in part based on the first and second orientations to generate output data including at least a portion of the first media data and at least a portion of the second media data; and provide the output data to an output device (e.g., wearable device 102, or one of devices 130).

[0058] As an example of spatial processing, the spatial media processor 146 can generate output data such that the first media content is spatially ducked relative to the second media content in the direction of the first source device relative to the user 120 within the audio scene. As another example of spatial processing, the spatial media processor 146 can generate output data based on the device type of the first and / or second device and configuration settings 148. For illustration, the spatial media processor 146 can be configured to determine the device type of at least one of the first or second source devices and determine the configuration settings 148 associated with that device type, wherein spatial audio processing is based on configuration settings 148. As another example of spatial processing, the sensor 108 can be configured to generate motion data associated with the movement of the user 120, and the spatial media processor 146 can update the parameters of the spatial audio processing based on this movement.

[0059] In certain aspects, electromagnetic signal 114 includes an electromagnetic waveform that can be detected by wearable device 102 to determine directional information. For example, electromagnetic signal 114 may include a signal encoded with media content to be controlled. As another example, electromagnetic signal 114 may include notification packets 116 (such as...) (BLE (Balanced Low Power) notification packets). One technical advantage of using electromagnetic signals 114, including notification packets 116, to determine directional information is that directional information can be determined without establishing connections between devices (e.g., between wearable device 102 and device 130 that sends electromagnetic signals 114). In many implementations, wearable device 102 is battery powered and therefore has limited available onboard power. In such implementations, power savings provide greater availability of wearable device 102 and a better user experience overall. Establishing a connection between wearable device 102 and another device in device 130 requires multiple data exchanges (e.g., handshake exchanges). Therefore, avoiding the need to establish connections with each device in device 130 saves power and results in a better user experience.

[0060] Figure 1A The device 130A that transmits electromagnetic signal 114 is illustrated as an example only. In other examples, different devices in device 130 transmit electromagnetic signal 114, which wearable device 102 can use to control media output. For example, while device 130A is illustrated as a mobile device (e.g., a mobile communication device), in some specific implementations, a stationary device (such as a base station, beacon device, or another device, 130B, 130C) transmits electromagnetic signal 114. The advantage of using electromagnetic signal 114 from a stationary device to determine field of view 124 is that the positioning of device 130 relative to the stationary device can be pre-mapped and stored in configuration settings 148, making it easier to determine which devices 130 are in field of view 124. For illustration, configuration settings 148 may store data mapping the positions of sets of devices 130 in two or more different locations (e.g., two or more different rooms). In this exemplary example, each room may be associated with a stationary device that transmits electromagnetic signal 114, which can be distinguished from electromagnetic signals transmitted by stationary devices in other rooms (such as BLE notification packets including device identifiers). In this exemplary example, notification packets 116 received by wearable device 102 at a specific time include sufficient information for the wearable device to determine which room it is in and (based on the angle of arrival of electromagnetic signal 114) which device(s) 130(if any) is in the user 120's field of view 124.

[0061] In some specific implementations, Figure 1AMore than one device in device 130 transmits electromagnetic signals 114. In such an implementation, electromagnetic signals 114 from two or more devices in device 130 can be used to estimate the field of view 124 of user 120. For example, when electromagnetic signals 114 from two devices in device 130 are used to determine directional information, the directional information associated with the two devices 130 can be used to more accurately determine the position and orientation of user 120.

[0062] In some implementations, each device 130, which can be controlled by wearable device 102, sends a corresponding electromagnetic signal 114. In such implementations, the positions of the various devices 130 do not need to be known in advance (e.g., mapped in configuration settings 148). For example, when the angle of arrival of a particular electromagnetic signal comes from a position within a specified angular offset from the gaze direction 128, processor 190 can determine that the device 130 sending the particular electromagnetic signal is within the user 120's field of view 124.

[0063] As explained above, in some implementations, electromagnetic signal 114 includes announcement packets 116, such as BLE announcement packets. In other implementations, electromagnetic signal 114 conforms to one or more other communication protocols. For example, electromagnetic signal 114 may conform to an ultra-wideband (UWB) communication protocol. Communication protocols, New Radio (NR) Side Link (SL) communication protocols, etc. In some specific implementations, more than one communication protocol may be used. For example, the initial estimate of the field of view 124 may be based on the first electromagnetic signal 114 transmitted according to the first communication protocol, and the initial estimate of the field of view 124 may be updated or refined based on the second electromagnetic signal 114 transmitted according to the second communication protocol.

[0064] Although Figure 1A A system 100 comprising three devices 130 is illustrated, but in other specific embodiments, system 100 may include more, fewer, or different devices 130. Furthermore, although... Figure 1BA wearable device 102 including two antennas 112 is illustrated, but in other embodiments, the wearable device 102 includes more than two antennas 112 or fewer than two antennas 112 (e.g., a single antenna). For illustration, when the wearable device 102 is bilaterally symmetrical (e.g., including two earmuffs, two earplugs, displays for both eyes, etc.), the wearable device 102 may include two or more antennas 112 on each side of the user's head to improve the spatial diversity of the antennas 112. When using more than two antennas 112, the FOV estimator 140 may also be able to estimate the range of one or more devices in the device 130. In such embodiments, the media controller 144 may limit the selection of device 130 based on the estimated distance between device 130 and wearable device 102. For example, the media controller 144 may select only one device in the device 130 that is within the field of view 124 and within a distance threshold (as a media output device or media source device).

[0065] In addition, although Figure 1B Examples include an FOV estimator 140, a motion detector 142, a media controller 144, and a spatial media processor 146, executed by a processor 190 of wearable device 102. However, in other embodiments, one or more of the FOV estimator 140, motion detector 142, media controller 144, or spatial media processor 146 may be executed by one or more processors of one of the devices in device 130. For example, in some embodiments, the FOV estimator 140 and the media controller 144 may reside at different devices. For illustration, the FOV estimator 140 may reside at wearable device 102, and the media controller 144 may reside at device 130A. In this example, wearable device 102 may transmit information indicating an FOV 124 to device 130A, and device 130A may use the information received from wearable device 102 to control the output of media content.

[0066] In some implementations, the FOV estimator 140 may reside at one of the devices in device 130 (such as device 130C). In such implementations, the media controller 144 may also reside at one of the devices in device 130 or at wearable device 102. For example, wearable device 102 may transmit signal 114, and device 130C may detect signal 114 and determine FOV 124 based on signal 114. In this example, device 130C may use FOV 124 to control the output of media content. Alternatively, device 130C may transmit information indicating FOV 124 to wearable device 102 or another device in device 130, and whichever device includes media controller 144 (e.g., device 130A, device 130B, or wearable device 102) may use the information received from device 130C to control the output of media content.

[0067] In a specific embodiment where the wearable device 102 transmits signal 114, signal 114 may include round-trip time (RTT), received signal strength indication (RSSI), or other measurements indicating the relative positioning of antenna 112 of the wearable device 102, or be used to measure such measurements. Therefore, signal 114 may be used by one of the devices 130 to estimate the field of view (FOV) 124 of user 120. In some such embodiments, wearable device 102 may also determine information regarding the relative positioning of antenna 112 based on signal 114. For example, when signal 114 includes a near-ultra-low energy field (NULEF) signal, signal 114 may be able to penetrate the body tissue of user 120 and be used to measure, for example, the spacing between antennas 112.

[0068] At least in some specific implementations, Figure 1A and Figure 1B One technical advantage of the wearable device 102 is that the user 120 can control the media output hands-free. Another technical advantage is that media control via the wearable device 102 is performed in a way that conserves the power of the wearable device 102's onboard battery. For example, estimating the user 120's field of view 124 based on electromagnetic signals 114 transmitted by one or more other devices (e.g., device 130) can be termed passive sensing, which contrasts with active sensing in which a device transmits a signal and determines its position or orientation based on the return of that signal. Therefore, passive sensing devices use less power because the power associated with signal transmission is saved.

[0069] Figure 2 Examples of specific implementations 200 according to some examples of this disclosure, wherein the integrated circuit 202 is operable to control media output based on directionality measurements, are illustrated. Specifically, in Figure 2In this embodiment, the processor 190 of the wearable device 102 is disposed in the integrated circuit 202. The integrated circuit 202 also includes an input interface 204, such as one or more bus interfaces, to allow input data 210 (such as representing...) Figure 1A and Figure 1B The electromagnetic signal 114 (data) can be received for processing. Integrated circuit 202 also includes an output interface 206, such as a bus interface, to enable the transmission of output data 212 (such as...). Figure 1B (One or more commands from command 150). Figure 2 In this embodiment, the processor 190 of integrated circuit 202 includes one or more media control components 240, such as an FOV estimator 140, a motion detector 142, and a media controller 144. Optionally, in some implementations, the media control component 240 may include other components such as a space media processor 146. Technical advantages of the media control component 240 including the space media processor 146 may include the ability to perform space media processing. Technical advantages of the media control component 240 excluding the space media processor 146 may include a smaller integrated circuit 202, lower power consumption, faster processing, etc. Integrated circuit 202 enables media control based on orientation measurements in various types of wearable devices. For example, integrated circuit 202 may be integrated into wearable devices such as... Figure 3 The described head-mounted device, such as Figure 4 The virtual reality, mixed reality, or augmented reality headsets described, such as Figure 5 The augmented reality headset depicted, such as Figure 6 The described hearing aid devices, such as Figure 7 The earbuds or another wearable device depicted.

[0070] Figure 3 A specific embodiment 300 of the wearable device 102, including a head-mounted device 302, is depicted. The head-mounted device 302 includes one or more microphones 306 and one or more speakers 304. Figure 3In the illustrated example, one of the microphones 306 is primarily positioned to detect speech from a person wearing the head-mounted device 302. The head-mounted device 302 may also or alternatively include one or more microphones 306 positioned to detect ambient sounds, such as speech or other sounds from another person. Components of the processor 190 (including the media control component 240) are integrated into the head-mounted device 302. The head-mounted device 302 also includes an antenna 112. In a particular example of operation, the media control component 240 may estimate the field of view of a user wearing the head-mounted device 302 based on electromagnetic signals received at the antenna 112. The media control component 240 may control media content on the speaker 304 and / or other devices (e.g., ...) based on the user's estimated field of view. Figure 1A The output at one or more of the devices in device 130.

[0071] Figure 4 A specific implementation 400 is depicted in which wearable device 102 includes a portable electronic device corresponding to virtual reality, mixed reality, or augmented reality head-mounted device 402. Head-mounted device 402 includes microphone 306 and speaker 304. Additionally, components of processor 190 (including media control component 240) are integrated into head-mounted device 402. Head-mounted device 402 also includes antennas 112 arranged to provide spatial diversity. In a particular example of operation, media control component 240 may estimate the field of view of a user wearing head-mounted device 402 based on electromagnetic signals received at antenna 112. Media control component 240 may control media content on speaker 304 and / or other devices (e.g., based on the user's estimated field of view) Figure 1A The output at one or more of the devices in device 130.

[0072] Figure 5 A specific implementation 500 is depicted in which wearable device 102 includes a portable electronic device corresponding to augmented reality or mixed reality glasses 502. Glasses 502 includes a holographic projection unit 504 configured to project visual data onto the surface of a lens 506, or to reflect the visual data from the surface of the lens 506 onto the wearer's retina. Glasses 502 also includes a microphone 306, a speaker 304, an antenna 112, and a processor 190 including a media control component 240. In a particular example of operation, the media control component 240 may estimate the field of view of a user wearing glasses 502 based on electromagnetic signals received at antenna 112. The media control component 240 may control media content on speaker 304 and / or other devices (e.g., [missing information]) based on the user's estimated field of view. Figure 1A The output at one or more of the devices in device 130.

[0073] In some implementations, the holographic projection unit 504 is configured to display information related to media control via the media control component 240. For example, the holographic projection unit 504 may display prompts to enable the user to confirm the selection of a specific media source device or media output device.

[0074] Figure 6 A specific embodiment 600 of the wearable device 102, including a hearing aid device 602, is depicted. The hearing aid device 602 includes a microphone 306, a speaker 304, an antenna 112, and a processor 190, which includes a media control component 240. Figure 6 In the illustrated example, hearing aid device 602 includes a portion 604 configured to be worn behind a user's ear, a portion 608 configured to extend above the ear, and a portion 606 worn in or near the user's ear canal. In other examples, hearing aid device 602 has different configurations or form factors. For illustration, hearing aid device 602 may be an in-ear device that does not include the portion 604 configured to be worn behind the ear and the portion 608 configured to extend above the ear.

[0075] In a specific example of operation, the media control component 240 may estimate the field of view of the user of the wearable hearing aid device 602 based on the electromagnetic signals received at antenna 112. The media control component 240 may then control media content on speaker 304 and / or other devices (e.g., based on the user's estimated field of view). Figure 1A The output at one or more of the devices in device 130.

[0076] Figure 7 A specific embodiment 700 is depicted in which the wearable device 102 includes a portable electronic device corresponding to one or more earplugs 706 (e.g., a first earplug 702, a second earplug 704, or both). Although the earplugs 706 are described, it should be understood that this technology can be applied to other in-ear, over-ear, or head-mounted devices.

[0077] exist Figure 7 In the illustrated example, the first earbud 702 includes: a first microphone 306A, such as a high signal-to-noise ratio microphone positioned to capture the speech of the wearer of the first earbud 702; one or more other microphones configured to detect ambient sound and spatially distributed to support beamforming, illustrated as microphone 712A; an "internal" microphone 714A located near the wearer's ear canal (e.g., to assist active noise cancellation); and a self-speech microphone 716A, such as a bone conduction microphone configured to convert sound vibrations from the wearer's ear bones or skull into audio signals. The first earbud 702 also includes one or more speakers 304A and one or more antennas 112.

[0078] The second earbud 704 may be configured in a substantially similar manner to the first earbud 702. For example, the second earbud 704 may include: a microphone 306B positioned to capture the voice of the wearer of the second earbud 704; one or more other microphones 712B configured to detect ambient sound and spatially distributed to support beamforming; an "internal" microphone 714B; and a self-speech microphone 716B. The second earbud 704 also includes one or more speakers 304B and one or more antennas 112. The first earbud 702, the second earbud 704, or both include a processor 190 and a media control assembly 240.

[0079] In some embodiments, earbuds 702 and 704 are configured to automatically switch between various operating modes, such as a pass-through mode in which ambient sound is processed for output via speaker 304, and a playback mode in which non-ambient sound (e.g., streaming audio corresponding to telephone conversations, media playback, video games, etc.) is played back via speaker 304. In other embodiments, earbuds 702 and 704 may support fewer modes, or may support one or more other modes in place of the described modes, or may support one or more other modes in addition to the described modes.

[0080] In some specific implementations, one or both earbuds 706 are operable to control media content based on the field of view of a user wearing the earbuds 706. In a particular example of operation, the media control component 240 of one or both earbuds 706 may estimate the field of view of the user wearing the earbuds 706 based on electromagnetic signals received at antenna 112. The media control component 240 may control media content in speaker 304 and / or other devices (e.g., based on the user's estimated field of view) Figure 1A The output at one or more of the devices in device 130.

[0081] Figure 8 Based on some examples of this disclosure, it is possible to... Figure 1A and Figure 1B A diagram illustrating a specific implementation of a method for performing media control based on directional information, executed by wearable device 102. In a particular aspect, one or more operations of method 800 are controlled by a reference... Figures 1A to 7 At least one of the wearable device 102, processor 190, or media control component 240, or a combination thereof, described in various ways, shall be executed.

[0082] Method 800 includes: at block 802, (e.g., at one or more processors of the device) receiving data representing an electromagnetic signal emitted by the second device. For example, Figure 1A and Figure 1BThe antenna 112 of the wearable device 102 can receive electromagnetic signals 114 transmitted by one or more devices in the device 130. In this example, a transceiver 162, a modem 160, or a combination thereof can generate data representing the electromagnetic signal 114, such as data representing the phase or other characteristics of the waveform of the electromagnetic signal 114. In this example, the processor 190 receives data representing the electromagnetic signal 114 transmitted by one or more devices in the device 130.

[0083] Method 800 includes, at block 804, estimating the user's field of view based on data representing an electromagnetic signal. For example, the FOV estimator 140 of processor 190 may estimate the user 120's field of view 124 based on the angle of arrival of the electromagnetic signal 114, the expected orientation of the wearable device 102 on the user's head, and optionally based on configuration settings of the location of the mapping device 130, as referenced. Figure 1A and Figure 1B As described.

[0084] Method 800 includes, at block 806, initiating the output of media content by the output device based on determining that the output device is within the field of view. For example, the media controller 144 of wearable device 102 may determine that a specific device in device 130 is within the field of view 124 of user 120 and that the specific device is operable as a media output device. In this example, the media controller 144 may cause one or more commands in command 150 to be sent to the media output device, the media source device, or both to cause the output of media content at the media output device.

[0085] Figure 8 Method 800 can be implemented by a field-programmable gate array (FPGA) device, an application-specific integrated circuit (ASIC), a processing unit (such as a central processing unit (CPU)), a digital signal processor (DSP), a controller, another hardware device, a firmware device, or any combination thereof. As an example, Figure 8 Method 800 can be executed by instructions (such as references) Figure 10 (As described) Execution by one or more processors.

[0086] Figure 9 Based on some examples of this disclosure, it is possible to... Figure 1A and Figure 1B This is an illustration of another specific implementation of a method for performing media control based on directional information, executed by wearable device 102. In a particular aspect, one or more operations of method 900 are controlled by a reference... Figures 1A to 7 At least one of the wearable device 102, processor 190, or media control component 240, or a combination thereof, described in various ways, shall be executed.

[0087] Method 900 includes: at block 902, (e.g., at one or more processors of the device) receiving data representing an electromagnetic signal emitted by the second device. For example, Figure 1A and Figure 1B The antenna 112 of the wearable device 102 can receive electromagnetic signals 114 transmitted by one or more devices in the device 130. In this example, a transceiver 162, a modem 160, or a combination thereof can generate data representing the electromagnetic signal 114, such as data representing the phase or other characteristics of the waveform of the electromagnetic signal 114. In this example, the data representing the electromagnetic signal 114 is provided to the processor 190.

[0088] Method 900 includes, at block 904, determining the angle of arrival of an electromagnetic signal based on a comparison of waveforms received at one or more antennas. For example, the angle of arrival of the electromagnetic signal may be determined by comparing the phases of waveforms received at two or more antennas, and in some instances, by determining the range to the device transmitting the electromagnetic signal, as referenced. Figure 1A and Figure 1B As described. As another example, a single antenna array comprising multiple antenna elements can be used to determine the angle of arrival.

[0089] Method 900 includes: at box 906, detecting movement of the user's head. For example, this can be based on movement from one or more motion sensors (such as...) Figure 1B The wearable device 102 uses sensor data from one or more sensors (108) to detect the movement of the user's head.

[0090] Method 900 includes, at block 908, estimating the user's field of view based on the angle of arrival of an electromagnetic signal in response to detected movement. For example, the FOV estimator 140 of processor 190 may estimate the user 120's field of view 124 based on the angle of arrival of electromagnetic signal 114, the expected orientation of wearable device 102 on the user's head, and optionally based on the configuration settings of the location of mapping device 130.

[0091] Method 900 includes: at block 910, causing a prompt to be output to the user based on determining that the output device is within the field of view. For example, it may be activated Figure 1B The wearable device 102 uses a tactile device 152 to generate cues. In other examples, the wearable device 102 may make the cues available at another device (such as on...). Figure 1A The output is from one of the devices in device 130.

[0092] Method 900 includes, at block 912, receiving confirmation of a user selection based on user input, including gesture or voice. For example, interface device 110 may include one or more microphones to detect voice confirming the user selection. As another example, interface device 110 or sensor 108 may include a gesture sensor to detect gesture confirming the user selection.

[0093] Method 900 includes, at block 914, initiating the output of media content by an output device. For example, a media controller 144 of wearable device 102 may determine that a particular device in device 130 is in the user 120's field of view 124 and that particular device is operable as a media output device. In this example, method 900 includes, at block 916, commanding a media source to transmit a media stream to the output device. For illustration, media controller 144 may cause transceiver 162 to transmit one or more commands of command 150 to a media source (e.g., a device in device 130). Additionally or alternatively, media controller 144 may cause transceiver 162 to transmit one or more commands of command 150 to a media output device.

[0094] Figure 9 Method 900 can be implemented by an FPGA device, an ASIC, a processing unit (such as a CPU), a DSP, a controller, another hardware device, a firmware device, or any combination thereof. As an example, Figure 9 Method 900 can be executed by one or more processors (such as reference processors) that execute instructions. Figure 10 (As described) Execution.

[0095] refer to Figure 10 This describes a block diagram of a specific, exemplary embodiment of the device, and designates it generally as 1000. In various embodiments, device 1000 may have the same... Figure 10 The illustrated component may have more or fewer components. In an illustrative embodiment, device 1000 may correspond to wearable device 102. In an illustrative embodiment, device 1000 may perform reference... Figures 1A to 9 One or more operations as described.

[0096] In a particular implementation, device 1000 includes a processor 1006 (e.g., a CPU). Device 1000 may include one or more additional processors 1010 (e.g., one or more DSPs). In a particular aspect, Figure 1BThe processor 190 corresponds to processor 1006, processor 1010, or a combination thereof. Processor 1010 may include a speech and music decoder-decoder (codec) 1008, which includes a speech decoder (“vocoder”) encoder 1036 and a vocoder decoder 1038. Processor 1010 and / or speech and music codec 1008 also include a field-of-view estimator 140 and a media controller 144. Optionally, in some embodiments, processor 1010 and / or speech and music codec 1008 may also include a motion detector 142, a spatial media processor 146, or both.

[0097] exist Figure 10 In this device 1000, memory 1086 and codec 1034 are included. Memory 1086 includes (e.g., store) instructions 1056 that can be executed by one or more additional processors 1010 (or processor 1006) to implement references. Figure 1B The functionality described in wearable device 102. Figure 10 In this device 1000, modem 160 is also included, coupled to antenna 112 via transceiver 162. Modem 160, transceiver 162, and antenna 112 enable device 1000 to exchange data with one or more other devices wirelessly. For example, device 1000 can use antenna 112 to detect electromagnetic signal 114. Furthermore, device 1000 can use modem 160, transceiver 162, and antenna 112 to send instructions (e.g., command 150) to other devices. Antenna 112 is arranged to provide spatial diversity to enable determination of the angle of arrival of electromagnetic signal 114.

[0098] Device 1000 may include a display 1028 coupled to a display controller 1026. A speaker 304 and a microphone 306 may be coupled to a codec 1034. Figure 10 In this embodiment, codec 1034 includes a digital-to-analog converter (DAC) 1002 and an analog-to-digital converter (ADC) 1004. In a particular embodiment, codec 1034 receives analog signals from microphone 306, converts these analog signals into digital signals using ADC 1004, and provides these digital signals to voice and music codec 1008. Voice and music codec 1008 can process digital signals. In a particular embodiment, voice and music codec 1008 can provide digital signals representing, for example, media content to codec 1034. Codec 1034 can use ADC 1002 to convert digital signals into analog signals and can provide analog signals to speaker 304.

[0099] In a particular embodiment, device 1000 may be included in a system-in-package (SiP) or system-on-a-chip (SoC) device 1022. In a particular embodiment, memory 1086, processor 1006, processor 1010, display controller 1026, codec 1034, modem 160, and transceiver 162 are included in the SiP or SoC device 1022. In a particular embodiment, input device 1030 and power supply 1044 are coupled to the SiP or SoC device 1022. Furthermore, in a particular embodiment, such as... Figure 10 As illustrated, the display 1028, input device 1030, speaker 304, microphone 306, antenna 112, and power supply 1044 are external to the system-in-package or system-on-chip device 1022. In a particular implementation, each of the display 1028, input device 1030, speaker 304, microphone 306, antenna 112, and power supply 1044 may be coupled to a component of the system-in-package or system-on-chip device 1022, such as an interface or controller.

[0100] Device 1000 may include wearable devices such as wearable mobile communication devices, wearable personal digital assistants, wearable display devices, wearable gaming systems, wearable music players, wearable wireless devices, wearable cameras, wearable navigation devices, head-mounted devices, augmented reality head-mounted devices, mixed reality head-mounted devices, virtual reality head-mounted devices, voice-activated devices, portable electronic devices, wearable computing devices, wearable communication devices, virtual reality (VR) devices, one or more earbuds, hearing aid devices, or any combination thereof.

[0101] In conjunction with the specific embodiments described, an apparatus includes components for receiving data representing an electromagnetic signal emitted by a second device. For example, the components for receiving data representing the electromagnetic signal may correspond to wearable device 102, modem 160, transceiver 162, processor 190, field estimator 140, integrated circuit 202, input interface 204, media control component 240, processor 1006, processor 1010, one or more other circuits or components configured to receive data representing the electromagnetic signal, or any combination thereof.

[0102] The device also includes components for estimating the user's field of view based on the data representing these electromagnetic signals. For example, the components for estimating the user's field of view based on the data representing electromagnetic signals may correspond to wearable device 102, processor 190, field of view estimator 140, integrated circuit 202, media control component 240, processor 1006, processor 1010, one or more other circuits or components configured to estimate the user's field of view based on the data representing electromagnetic signals, or any combination thereof.

[0103] The device also includes components for initiating the output of media content by the output device based on determining that the output device is within the field of view. For example, the components for initiating the output of media content by the output device based on determining that the output device is within the field of view may correspond to wearable device 102, processor 190, media controller 144, integrated circuit 202, media control component 240, processor 1006, processor 1010, one or more other circuits or components, or any combination thereof, configured to initiate the output of media content by the output device based on determining that the output device is within the field of view.

[0104] In some implementations, a non-transitory computer-readable medium (e.g., a computer-readable storage device, such as memory 1086) includes instructions (e.g., instruction 1056) that, when executed by one or more processors (e.g., one or more processors 1010 or processor 1006), cause one or more processors to: receive data representing an electromagnetic signal (e.g., electromagnetic signal 114) emitted by a second device (e.g., device 130); estimate the field of view (e.g., field of view 124) of a user (e.g., user 120) based on the data representing the electromagnetic signal; and initiate the output of media content by the output device based on determining that the output device (e.g., device 130) is within the field of view.

[0105] Specific aspects of this disclosure are described below in a collection of related embodiments:

[0106] According to Embodiment 1, an apparatus includes: one or more processors configured to: receive data representing an electromagnetic signal emitted by a second device; estimate a user's field of view based on the data representing the electromagnetic signal; and initiate the output of media content by the output device based on determining that the output device is within the field of view.

[0107] Example 2 includes the device according to Example 1, wherein the electromagnetic signal corresponds to one or more notification groups.

[0108] Example 3 includes the device according to Example 1 or Example 2, wherein one or more processors are integrated into the wearable device.

[0109] Example 4 includes the device according to Example 3, wherein the wearable device is configured to be worn by the user in a manner that positions the wearable device in a particular orientation relative to the user's field of view, and wherein the user's field of view is estimated in part based on the particular orientation of the wearable device.

[0110] Example 5 includes a device according to any one of Examples 1 to 3, wherein one or more processors are integrated into one or more earbuds associated with the user.

[0111] Example 6 includes a device according to any one of Examples 1 to 3, wherein one or more processors are integrated into the output device.

[0112] Example 7 includes the device according to any one of Examples 1 to 6, and further includes one or more antennas coupled to the one or more processors, wherein the one or more processors are configured to determine the angle of arrival of the electromagnetic signal based on a comparison of waveforms received at the one or more antennas, and wherein the user's field of view is estimated based on the angle of arrival.

[0113] Example 8 includes a device according to any one of Examples 1 to 7, wherein one or more processors are configured to command a media source to transmit a media stream to the output device to initiate the output of the media content.

[0114] Example 9 includes the device according to any one of Examples 1 to 8, and further includes one or more sensors coupled to the one or more processors and configured to generate data indicating movement of the user's head, wherein the user's field of view is estimated in response to the detection of the movement.

[0115] Example 10 includes a device according to any one of Examples 1 to 9, wherein one or more processors are further configured to prompt the user to confirm the media source selection before initiating the output of the media content.

[0116] Example 11 includes the device according to Example 10, wherein the prompt is output at a media source device.

[0117] Example 12 includes the device according to Example 10, wherein the prompt is output at the output device.

[0118] Example 13 includes the device according to Example 10, and further includes one or more interface devices coupled to the one or more processors, wherein the prompt is output via the one or more interface devices.

[0119] Example 14 includes the device according to Example 13, wherein the one or more interface devices include at least one tactile device, and the cues include tactile output.

[0120] Example 15 includes a device according to any one of Examples 10 to 14, wherein one or more processors are further configured to receive confirmation of the media source selection based on user input, including gestures or voice.

[0121] Example 16 includes a device according to any one of Examples 1 to 15, wherein one or more processors are further configured to prompt the user to confirm the selection of the output device before initiating the output of the media content.

[0122] Example 17 includes the device according to Example 16, wherein the prompt is output at the second device.

[0123] Example 18 includes the device according to Example 16, wherein the prompt is output at the output device.

[0124] Example 19 includes the device according to Example 16, and further includes one or more interface devices coupled to the one or more processors, wherein the prompt is output via the one or more interface devices.

[0125] Example 20 includes the device according to Example 19, wherein the one or more interface devices include at least one tactile device, and the cues include tactile output.

[0126] Example 21 includes a device according to any one of Examples 16 to 20, wherein one or more processors are further configured to receive acknowledgments of the output device based on user input, including gestures or voice.

[0127] Example 22 includes a device according to any one of Examples 1 to 21, wherein one or more processors are configured to cause a second device to pause or stop the output of the media content based on determining that the output device is initiating the output of the media content.

[0128] Example 23 includes a device according to any one of Examples 1 to 21, wherein one or more processors are configured to cause a second device to pause or stop outputting other media content based on determining that the output device is initiating the output of the media content.

[0129] Example 24 includes the device according to any one of Examples 1 to 21, and further includes one or more speakers coupled to the one or more processors, wherein the one or more processors are configured to pause or stop the output of the media content or other media content by the one or more speakers based on determining that the output device is initiating the output of the media content.

[0130] Example 25 includes a device according to any one of Examples 1 to 21, wherein one or more processors are configured to reduce the volume of the media content or other media content output by another device based on determining that the output device is initiating the output of the media content.

[0131] According to embodiment 26, a method includes: receiving data representing an electromagnetic signal emitted by a second device at one or more processors of a device; estimating a user's field of view by the one or more processors based on the data representing the electromagnetic signal; and initiating the output of media content by the one or more processors based on determining that an output device is within the field of view.

[0132] Example 27 includes the method according to Example 26, wherein the electromagnetic signal corresponds to one or more notification groups.

[0133] Example 28 includes the method according to Example 26 or Example 27, the method further comprising determining the angle of arrival of the electromagnetic signal based on a comparison of waveforms received at one or more antennas, wherein the user's field of view is estimated based on the angle of arrival.

[0134] Example 29 includes the method according to any one of Examples 26 to 28, wherein initiating the output of the media content includes commanding a media source to transmit a media stream to the output device.

[0135] Example 30 includes the method according to any one of Examples 26 to 29, and further includes detecting movement of the user's head, wherein the user's field of view is estimated in response to the detection of the movement.

[0136] Example 31 includes the method according to any one of Examples 26 to 30, and further includes prompting the user to confirm the media source selection before initiating the output of the media content.

[0137] Example 32 includes the method according to Example 31, wherein outputting the prompt to the user includes sending a command to the media source device to cause the media source device to output the prompt.

[0138] Example 33 includes the method according to Example 31 or Example 32, and further includes receiving confirmation of the media source selection based on user input including gesture or voice after the prompt output, wherein the output is initiated in response to receiving the confirmation.

[0139] Example 34 includes the method according to any one of Examples 31 to 33, wherein the cues include tactile output.

[0140] Example 35 includes the method according to any one of Examples 26 to 34, and further includes prompting the user to confirm the selection of the output device before initiating the output of the media content.

[0141] Example 36 includes the method according to Example 35, wherein outputting the prompt to the user includes sending a command to a media output device to cause the media output device to output the prompt.

[0142] Example 37 includes the method according to Example 35 or Example 36, and further includes receiving confirmation of selection of the output device based on user input including gesture or voice after the prompt output is made, wherein the output is initiated in response to receiving the confirmation.

[0143] Example 38 includes the method according to any one of Examples 35 to 37, wherein the cues include tactile output.

[0144] Example 39 includes an apparatus comprising: a memory configured to store instructions; and a processor configured to execute the instructions to perform a method according to any one of Examples 26 to 38.

[0145] Example 40 includes a non-transitory computer-readable medium that stores instructions that, when executed by a processor, cause the processor to perform the method according to any one of Examples 26 to 38.

[0146] Example 41 includes an apparatus comprising components for performing the method according to any one of Examples 26 to 38.

[0147] According to embodiment 42, a non-transitory computer-readable medium storage instruction is provided, the instruction being executable by one or more processors to cause the one or more processors to: receive data representing an electromagnetic signal emitted by a second device; estimate a user's field of view based on the data representing the electromagnetic signal; and initiate the output of media content by the output device based on determining that the output device is within the field of view.

[0148] Example 43 includes a non-transitory computer-readable medium according to Example 42, wherein the electromagnetic signal corresponds to one or more notification packets.

[0149] Example 44 includes a non-transitory computer-readable medium according to Example 42 or Example 43, wherein estimating the user's field of view includes determining the angle of arrival of the electromagnetic signal based on a comparison of waveforms received at one or more antennas.

[0150] Example 45 includes a non-transitory computer-readable medium according to any one of Examples 42 to 44, wherein initiating the output of the media content includes commanding a media source to transmit a media stream to the output device.

[0151] Example 46 includes a non-transitory computer-readable medium according to any one of Examples 42 to 45, wherein the instructions are further executable to cause the one or more processors to detect movement of the user's head based on sensor data, wherein the user's field of view is estimated in response to the detection of the movement.

[0152] Example 47 includes a non-transitory computer-readable medium according to any one of Examples 42 to 46, wherein the instructions are further executable to cause the one or more processors to output a prompt to the user to confirm the media source selection before initiating the output of the media content.

[0153] Example 48 includes a non-transitory computer-readable medium according to Example 47, wherein outputting the prompt to the user includes sending a command to a media source device to cause the media source device to output the prompt.

[0154] Example 49 includes a non-transitory computer-readable medium according to Example 47 or Example 48, wherein the instructions are further executable to cause the one or more processors to receive confirmation of the media source selection based on user input, including gesture or voice, after the prompt output, wherein the output is initiated in response to receiving the confirmation.

[0155] Example 50 includes a non-transitory computer-readable medium according to any one of Examples 47 to 49, wherein the cues include tactile output.

[0156] Example 51 includes a non-transitory computer-readable medium according to any one of Examples 42 to 50, wherein the instructions are further executable to cause the one or more processors to output a prompt to the user to confirm the selection of the output device before initiating the output of the media content.

[0157] Example 52 includes a non-transitory computer-readable medium according to Example 51, wherein outputting the prompt to the user includes sending a command to a media output device to cause the media output device to output the prompt.

[0158] Example 53 includes a non-transitory computer-readable medium according to Example 51 or 52, wherein the instructions are further executable to cause the one or more processors to receive confirmation of selection of the output device based on user input, including gesture or voice, after the prompt output, wherein the output is initiated in response to receiving the confirmation.

[0159] Example 54 includes a non-transitory computer-readable medium according to any one of Examples 51 to 53, wherein the prompt includes tactile output.

[0160] According to embodiment 55, an apparatus includes: components for receiving data representing an electromagnetic signal emitted by a second device; components for estimating a user's field of view based on the data representing the electromagnetic signal; and components for initiating the output of media content by the output device based on determining that the output device is within the field of view.

[0161] Example 56 includes the apparatus according to Example 55, wherein the electromagnetic signal corresponds to one or more notification groups.

[0162] Example 57 includes the apparatus according to Example 55 or Example 56, the apparatus further including components for determining the angle of arrival of the electromagnetic signal based on a comparison of waveforms received at one or more antennas, and wherein the user's field of view is estimated based on the angle of arrival.

[0163] Example 58 includes an apparatus according to any one of Examples 55 to 57, wherein initiating the output of the media content includes commanding a media source to transmit a media stream to the output device.

[0164] Example 59 includes the apparatus according to any one of Examples 55 to 58, and further includes components for detecting movement of the user's head, wherein the user's field of view is estimated in response to the detection of the movement.

[0165] Example 60 includes the apparatus according to any one of Examples 55 to 59, and further includes a component for prompting the user to confirm the media source selection before initiating the output of the media content.

[0166] Example 61 includes the apparatus according to Example 60, wherein outputting the prompt to the user includes sending a command to a media source device to cause the media source device to output the prompt.

[0167] Example 62 includes the apparatus according to Example 60 or Example 61, and further includes components for receiving confirmation of the media source selection after the prompt output is made, the confirmation being received based on user input including gesture or voice, wherein the output is initiated in response to receiving the confirmation.

[0168] Example 63 includes the device according to any one of Examples 60 to 62, wherein the cues include tactile output.

[0169] Example 64 includes the apparatus according to any one of Examples 55 to 63, and further includes components for prompting the user to confirm the selection of the output device before initiating the output of the media content.

[0170] Example 65 includes the apparatus according to Example 64, wherein outputting the prompt to the user includes sending a command to a media output device to cause the media output device to output the prompt.

[0171] Example 66 includes the apparatus according to Example 64 or Example 65, and further includes components for receiving confirmation of selection of the output device after the prompt output is made, the confirmation being received based on user input including gesture or voice, wherein the output is initiated in response to receiving the confirmation.

[0172] Example 67 includes the device according to any one of Examples 64 to 66, wherein the cues include tactile output.

[0173] Those skilled in the art will also understand that the various exemplary logic blocks, configurations, modules, circuits, and algorithm steps described in connection with the specific embodiments disclosed herein can be implemented as electronic hardware, computer software executed by a processor, or a combination of both. The various exemplary components, blocks, configurations, modules, circuits, and steps have been generally described above in terms of their functionality. Whether such functionality is implemented as hardware or processor-executable instructions depends on the specific application and the design constraints imposed on the overall system. Those skilled in the art may implement the described functionality in different ways for each specific application, and such implementation decisions shall not be construed as departing from the scope of this disclosure.

[0174] The steps of the methods or algorithms described in conjunction with the specific embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of both. The software module may reside in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, removable disks, compressed optical disc read-only memory (CD-ROM), or any other form of non-transitory storage medium known in the art. An exemplary storage medium is coupled to a processor such that the processor can read information from and write information to the storage medium. Alternatively, the storage medium may be integral with the processor. The processor and storage medium may reside in an application-specific integrated circuit (ASIC). The ASIC may reside in a computing device or a user terminal. Alternatively, the processor and storage medium may reside as discrete components in a computing device or a user terminal.

[0175] The prior description of the disclosed aspects is provided to enable those skilled in the art to make or use the disclosed aspects. Various modifications to these aspects will be apparent to those skilled in the art, and the principles defined herein can be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but should be granted the broadest scope that may be consistent with the principles and novel features as defined by the following claims.

Claims

1. An apparatus, the apparatus comprising: One or more processors, said one or more processors being configured to: Receive data representing electromagnetic signals transmitted by the second device; The user's field of view is estimated based on the data representing the electromagnetic signal; as well as The output of media content is initiated by the output device based on the determination that the output device is within the field of view.

2. The device of claim 1, wherein the electromagnetic signal corresponds to one or more notification groups.

3. The device of claim 1, wherein the one or more processors are integrated into the wearable device.

4. The device of claim 3, wherein the wearable device is configured to be worn by the user in a manner that positions the wearable device in a particular orientation relative to the user's field of view, and wherein the user's field of view is estimated in part based on the particular orientation of the wearable device.

5. The device of claim 1, wherein the one or more processors are integrated into one or more earpieces associated with the user.

6. The device of claim 1, wherein one or more processors are integrated into the output device.

7. The device of claim 1, further comprising one or more antennas coupled to the one or more processors, wherein the one or more processors are configured to determine the angle of arrival of the electromagnetic signal based on a comparison of waveforms received at the one or more antennas, and wherein the user's field of view is estimated based on the angle of arrival.

8. The device of claim 1, wherein the one or more processors are configured to command a media source to transmit a media stream to the output device to initiate the output of the media content.

9. The device of claim 1, further comprising one or more sensors coupled to the one or more processors and configured to generate data indicative of movement of the user's head, wherein the user's field of view is estimated in response to the detection of the movement.

10. The device of claim 1, wherein the one or more processors are further configured to prompt the user to confirm the media source selection before initiating the output of the media content.

11. The device of claim 10, wherein the one or more processors are further configured to receive confirmation of the media source selection based on user input, including gestures or voice.

12. The device of claim 10, further comprising one or more interface devices coupled to the one or more processors, wherein the prompt is output via the one or more interface devices.

13. The device of claim 12, wherein the one or more interface devices include at least one tactile device, and the cues include tactile output.

14. The device of claim 1, wherein the one or more processors are further configured to prompt the user to confirm the selection of the output device before initiating the output of the media content.

15. The device of claim 14, wherein the one or more processors are further configured to receive acknowledgments of the output device based on user input, including gestures or voice.

16. The device of claim 14, further comprising one or more interface devices coupled to the one or more processors, wherein the prompt is output via the one or more interface devices.

17. The device of claim 16, wherein the one or more interface devices include at least one tactile device, and the cues include tactile output.

18. The device of claim 1, wherein the one or more processors are configured to cause the second device to pause or stop the output of the media content based on determining that the output device is initiating the output of the media content.

19. The device of claim 1, wherein the one or more processors are configured to cause the second device to pause or stop outputting other media content based on determining that the output device is initiating the output of the media content.

20. The device of claim 1, further comprising one or more speakers coupled to the one or more processors, wherein the one or more processors are configured to pause or stop the output of the media content or other media content by the one or more speakers based on determining that the output device is initiating the output of the media content.

21. The device of claim 1, wherein the one or more processors are configured to reduce the volume of the media content or other media content output by another device based on determining that the output device is initiating the output of the media content.

22. A method, the method comprising: Receive data representing electromagnetic signals emitted by the second device at one or more processors of the device; The one or more processors estimate the user's field of view based on the data representing the electromagnetic signal; as well as Based on the determination that the output device is within the field of view, the one or more processors initiate the output of media content by the output device.

23. The method of claim 22, wherein the electromagnetic signal corresponds to one or more notification groups.

24. The method of claim 22, further comprising detecting movement of the user's head, wherein the user's field of view is estimated in response to detecting the movement.

25. The method of claim 22, further comprising prompting the user to confirm the selection before initiating the output of the media content.

26. A non-transitory computer-readable medium storing instructions, the instructions being executable by one or more processors to cause the one or more processors to: Receive data representing electromagnetic signals transmitted by the second device; The user's field of view is estimated based on the data representing the electromagnetic signal; as well as The output of media content is initiated by the output device based on the determination that the output device is within the field of view.

27. The non-transitory computer-readable medium of claim 26, wherein initiating the output of the media content comprises commanding a media source to transmit a media stream to the output device.

28. The non-transitory computer-readable medium of claim 26, wherein the instructions are further executable to cause the one or more processors to output a prompt to the user to confirm the selection before initiating the output of the media content.

29. An apparatus comprising: A component for receiving data representing electromagnetic signals emitted by a second device; A component for estimating the user's field of view based on the data representing the electromagnetic signal; and A component for initiating the output of media content by the output device based on determining that the output device is within the field of view.

30. The apparatus of claim 29, further comprising means for determining the angle of arrival of the electromagnetic signal based on a comparison of waveforms received at one or more antennas, wherein the user's field of view is estimated based on the angle of arrival.

Images