Input device for head-mounted devices

Abstract

The invention relates to an input device for a head-mountable device. An earplug includes a housing, a haptic driver carried by the housing, a haptic surface defined by the housing, and an input surface defined by the housing. The haptic surface is coupled to the haptic driver, the haptic driver configured to generate a haptic output through the haptic surface in response to a haptic signal from the head-mountable device. The input surface is capable of receiving an input to transmit an input signal to the head-mountable device.

Description

Technical Field

[0001] The present disclosure relates generally to electronic devices and more particularly to communication between an input device and a head-mountable device. Background Art

[0002] Recent advances in portable computing have enabled head-mounted devices (HMDs) to provide users with augmented reality (AR) and virtual reality (VR) experiences. Such HMDs may include various components, such as displays, view frames, lenses, optics, batteries, motors, speakers, sensors, cameras, and other components. These components may work together to provide an immersive user experience.

[0003] Users typically interact with and input text or commands to head-mountable devices by using gestures and / or speaking audible commands or phrases. These available text input methods can be cumbersome, replacing keyboards. Other methods of data input rely on the use of keyboards or other external electronic devices. However, even keyboards are bulky and difficult for users to carry around. Therefore, there is a need for a device that allows users to conveniently and accurately interact with head-mountable devices, particularly for text input. Summary of the Invention

[0004] In at least one example of the present disclosure, an earbud includes a housing, a haptic driver carried by the housing, a haptic surface defined by the housing, and an input surface defined by the housing. The haptic surface is coupled to the haptic driver, the haptic driver configured to generate haptic output via the haptic surface in response to receiving a haptic signal from a head-mountable device. The input surface can receive the haptic input and transmit the input signal to the head-mountable device.

[0005] In one example of an earbud, the tactile surface comprises a portion of the input surface.

[0006] In one example of an earbud, the haptic driver is configured to generate shear haptic output at the haptic surface.

[0007] In one example, the earbud also includes an audio driver.

[0008] In one example of an earbud, an audio driver includes a first haptic driver configured to generate a first haptic response in a first direction and a second haptic driver configured to generate a second haptic response in a second direction different from the first direction.

[0009] In one example, the earbud further includes a processor and a memory device storing instructions that, when executed by the processor, cause the processor to convert the tactile input into a graphical representation signal used by the head-mountable device to display the graphical representation.

[0010] In one example, the earbud further includes a stylus sensor comprising at least one of an ultrasonic sensor, an optical flow sensor, or a capacitive sensor.

[0011] In at least one example of the present disclosure, a touch input system includes a first earbud including a first sensor and a second earbud including a second sensor. When the first and second earbuds are placed on a support surface, the first and second earbuds define a touch space adjacent to the support surface, where touch input can be detected via the first and second sensors.

[0012] In one example of a touch input system, the support surface comprises an object surface.

[0013] In one example of a touch input system, the supporting surface includes a display of a client device.

[0014] In one example, a touch input system includes a housing configured to receive a first earbud and a second earbud, the housing further defining a touch space on a display of a client device.

[0015] In one example, the touch input system further includes a housing configured to receive the first earbud and the second earbud. The housing includes a third sensor.

[0016] In one example of a touch input system, a housing includes a sensor configured to detect vibrations from a touch input at a touch space.

[0017] In one example of a touch input system, a first earbud, a second earbud, and a housing are configured to determine a location of a touch input within a touch space.

[0018] In one example of a touch input system, each of the first earbud and the second earbud includes a reference portion.

[0019] In one example of a touch input system, a first earbud may be attachably coupled to a second earbud to define a combined input surface.

[0020] In at least one example of the present disclosure, a wireless headset includes a housing and an optical flow sensor carried by the housing. The optical flow sensor is configured to transmit sensor data to a display device to generate an image based on the sensor data.

[0021] In one example, the wireless headset further includes a writing surface disposed on the housing adjacent to the optical flow sensor.

[0022] In one example, the wireless headset further includes a speaker. The optical flow sensor is disposed at a distal end of the wireless headset opposite to the speaker.

[0023] In one example of a wireless headset, the display device is a display of a head-mountable device. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The present disclosure will be readily understood through the following detailed description in conjunction with the accompanying drawings, in which like reference numerals represent like structural elements and in which:

[0025] Figure 1 A system including an input device and a head-mountable device according to one or more examples is illustrated;

[0026] Figure 2 illustrates a case for housing an earbud according to one or more examples;

[0027] Figure 3 An earplug according to one or more examples is illustrated;

[0028] Figure 4 Illustrate the fingers of a user's hand and Figure 3 earbud interaction;

[0029] Figure 5 illustrates an earbud including an optical flow sensor according to one or more examples;

[0030] Figure 6 illustrates a touch input system including a housing on a support surface according to one or more examples;

[0031] Figure 7 illustrates a touch input system including a first earbud and a second earbud on a support surface according to one or more examples;

[0032] Figure 8 A touch input system according to one or more examples is illustrated, wherein a first earbud is configured to be coupled to a second earbud; and

[0033] Figure 9 A high-level block diagram of an example computer system that can be used to implement examples of the present disclosure is shown. DETAILED DESCRIPTION

[0034] Reference will now be made in detail to the representative examples illustrated in the accompanying drawings. It should be understood that the following description is not intended to limit the examples to one preferred example. On the contrary, the following description is intended to cover alternatives, modifications, and equivalents that may be included within the spirit and scope of the described examples as defined by the appended claims.

[0035] The following disclosure relates to wearable devices. In particular, the following disclosure relates to wireless earbuds that can provide tactile input and output for wireless communication with a head-mounted device. In at least one example, the earbud may include a housing or other portion that may be at least partially disposed in, on, or otherwise contact the user's ear (or in an area surrounding the user's ear for bone conduction). The earbud may include one or more electronic components disposed on or within the housing to operate the earbud. These components may include any components used by the earbud to generate audio (or in the case of bone conduction, sound waves, or vibrations). For example, the electronic components may include one or more speakers, audio drivers, transducers, microphones, processors, power supplies (e.g., batteries), circuit components (including wires, circuit boards), or any other electronic components in the earbud for generating and outputting audio.

[0036] In at least one example, a head-mountable device may include a viewing frame and a fixed arm (or strap / band) extending from the viewing frame. Examples of head-mountable electronic devices may include virtual reality or augmented reality devices having optical components. In the case of an augmented reality device, optical glasses or frames may be worn on the user's head such that an optical window, which may include a transparent window, lens, or display, may be positioned in front of the user's eyes. In another example, a virtual reality device may be worn on the user's head such that a display screen is positioned in front of the user's eyes. The viewing frame may include a housing (e.g., a display housing or display frame) or other structural components that support optical components (e.g., a lens or display window) or various electronic components.

[0037] Additionally, the head-mounted electronic device may include one or more electronic components for operating the head-mounted electronic device. These components may include any components used by the head-mounted electronic device to generate a virtual or augmented reality experience. For example, the electronic components of the head-mounted device may include one or more projectors, waveguides, speakers, processors, batteries, circuit components including wires and circuit boards, or any other electronic components used in the head-mounted device to deliver augmented or virtual reality visual, sound, and other outputs. The various electronic components may be disposed within an electronic component housing. In some examples, the various electronic components may be disposed within or attached to one or more of a display frame, an electronic component housing, or a fixed arm.

[0038] Users can interact with conventional head-mounted devices by speaking audibly, using gestures, or using external keyboards or controls. Speaking or using gestures can be disruptive to people nearby. Transporting keyboards and controls can also be cumbersome, bulky, and inconvenient. Additionally, many people use wireless earbuds. However, wireless earbuds have so far included limited input capabilities.

[0039] The following disclosure relates to earbuds that can receive tactile input and generate tactile output for wireless communication with a head-mountable device. Various types of tactile input and output can be implemented. In some examples, the earbud can provide shear tactile output and / or receive rotational or vibration tactile input. For example, the earbud can include a housing, a tactile driver carried by the housing, a tactile surface defined by the housing, and an input surface defined by the housing. The tactile surface can be vibratingly coupled to the tactile driver, which is configured to generate tactile output through the tactile surface in response to tactile signals from the head-mountable device. The input surface can receive the tactile input to transmit the input signal to the head-mountable device.

[0040] The earbuds of the present disclosure can also be implemented to define a touch space. The touch space can be real (i.e., having physical boundaries and limits). In other examples, the touch space can be virtual. For illustration, the virtual touch space can include a virtual keyboard viewed through a head-mounted device. The virtual touch space (as seen through the head-mounted device) can be defined on a supporting surface, such as an object surface (e.g., a table), a display of a client device (e.g., a monitor, a tablet computer), etc. The case of the present disclosure can also be implemented in combination with one or more earbuds to define a touch space and detect actuation using the touch space.

[0041] Other types of input methods are also contemplated herein. For example, an earbud can be used as a stylus that, when interacting with a surface, generates an image for display at a head-mountable device. As another example, a combination of earbuds (e.g., interlocking, mating, engaging) can be utilized as a controller for providing input to a head-mountable device.

[0042] The following will refer to Figures 1 to 9 to discuss these and other examples. However, those skilled in the art will readily appreciate that the detailed description of these figures given herein is for illustrative purposes only and should not be construed as limiting. In addition, as used herein, a system, method, article, component, feature, or sub-feature comprising at least one of a first option, a second option, or a third option should be understood to refer to a system, method, article, component, feature, or sub-feature that can include one of each listed option (e.g., only one first option, only one second option, only one third option), multiple of a single listed option (e.g., two or more first options), two options simultaneously (e.g., one first option and one second option), or a combination thereof (e.g., two first options and one second option).

[0043] Figure 1A system 100 including an input device 102 and a head-mountable device 104 according to one or more examples of the present disclosure is illustrated. The head-mountable device 104 can be worn on a user's head 105. The input device 102 can be communicatively coupled to the head-mountable device 104. In other words, signals and other communications can be sent wirelessly between the input device 102 and the head-mountable device 104.

[0044] As used herein, the term input device refers to an electronic device that can transmit and / or receive signals (whether via a wired or wireless connection) from a head-mounted device. In a specific example, the input device includes earplugs. Earplugs (or headphones) may include one or more devices that can generate audio (or a vibration signal that can be perceived as audio). For example, earplugs or headphones may include various types of audio devices, including over-ear headphones, on-ear headphones, in-ear headphones or monitors, wireless headphones, wired headphones, noise-canceling headphones, bone conduction headphones, closed-back headphones, open-back headphones, semi-open-back headphones, waterproof headphones, DJ (disc jockey) headphones, etc. Earplugs may also include other audio devices, audio accessories, or audio amplification devices, such as hearing aids. The input device 102 may also be another type of electronic device or wearable device. In some other examples, the input device 102 may be a smart watch, a cellular phone or tablet device, a laptop computer, or other electronic device that communicates with the head-mounted device 104, rather than earplugs.

[0045] Although the present systems and methods are described in the context of a head-mountable device 104, the systems and methods can be used with any wearable device, wearable electronic device, or any device or system that can be physically attached to a user's body, but are particularly relevant to electronic devices worn on a user's head. The systems and methods can also be used with any electronic device having one or more sensors that can be communicatively coupled.

[0046] The head-mountable device 104 may include a display or other optical components (e.g., one or more optical lenses or display screens in front of the user's eyes). In other words, the head-mountable device 104 may be a display device and may include a display. The display may include a screen for presenting augmented reality visualization, virtual reality visualization, or other suitable visualization. The display may be part of an optical module that may include sensors, cameras, light-emitting diodes, an optical housing, cover glass, sensitive optical elements, etc. The head-mountable device 104 may include a display frame disposed around the display. The display may be disposed on or within the display frame. The display frame may be a display housing that houses the display and other optical components such that the display is positioned within the display frame. For example, the display may be positioned within the display housing facing the user's face to display graphical information to the user.

[0047] The head-mountable device may include straps or arms 106. The arms 106 may secure the head-mountable device 104 to the user's head. The arms 106 are connected to the display frame and extend distally toward the back of the head. The arms 106 may secure the display in a certain position relative to the user's head (e.g., so that the display remains in front of the user's eyes). For example, the arms 106 extend over the user's ears. In some examples, the arms 106 rest on the user's ears to secure the head-mountable device 104 via friction between each of the arms 106 and the user's head. For example, the arms 106 may apply opposing pressure to the sides of the user's head to secure the head-mountable device 104 to the user's head.

[0048] The head-mountable device 104 may include a facial interface, such as a light seal or other foam that extends around the perimeter and inner surface of the display frame. As used herein, the term "facial interface" refers to a portion of the head-mountable device 104 that directly contacts and engages the user's face. For example, the facial interface may be connected to the display frame (display housing). Specifically, the facial interface includes a portion of the head-mountable device 104 that conforms to (e.g., presses against) an area of the user's face. For example, the facial interface may include a flexible (or semi-flexible) facial track that spans the forehead region, surrounds the eyes, contacts the zygomatic and maxillary regions of the face, and bridges the nose. As used herein, the term "forehead region" refers to the area of a person's face between the eyes and the scalp. The term "zygomatic region" refers to the area of a person's face that corresponds to the person's zygomatic bone structure. The term "maxillary region" refers to the area of a person's face that corresponds to the person's maxillary structure.

[0049] The facial interface may include various components of a structure, mesh, covering, fabric, or frame that forms a display frame and the user's skin. In certain embodiments, the facial interface may include a seal (e.g., a light seal, an environmental seal, a dust seal, an air seal, etc.). It should be understood that in addition to a complete seal, the term "seal" may also include partial seals or inhibitors (e.g., when a head-mounted device is worn, a partial facial interface blocks some ambient light, and a complete facial interface blocks all ambient light). The facial interface can be pressed against the user's face to provide comfort and block ambient light from the surrounding environment or the external environment. As used herein, an "inner surface" refers to a surface of the head-mounted device 104 that is oriented to face (or contact) a person's face or skin. In contrast, as used herein, an "external surface" refers to an outer surface of the head-mounted device 104 that faces outward toward the surrounding environment.

[0050] The head-mountable device 104 may include an electronics box (electronic assembly). The electronics box may be disposed on one of the arms 106. In other examples, the electronics box may be disposed on a strap, a display frame, or elsewhere on the head-mountable device 104. The electronics box may include various electronic components, such as sensors, controllers, microcontrollers, processors, memory, batteries, power ports, and the like. At least some of the various electronic components may be communicatively coupled to the input device 102 (e.g., for generating an image for display corresponding to an input signal from the input device 102).

[0051] In some examples, there may be multiple input devices 102, such as a pair of earbuds. In other words, there may be a first earbud and a second earbud. The first earbud may be placed in one ear of the user, while the second earbud may be placed in the other ear of the user. The first earbud may include a first sensor, and the second earbud may include a second sensor. As described below, the earbuds may include various additional sensors and output devices, such as audio drivers and haptic drivers. The earbuds may be received by a case. The case may charge and store the earbuds. The case may additionally include sensors and may be communicatively coupled to the head-mountable device 104.

[0052] Figure 1 Any of the features, components, and / or parts shown (including their arrangements and configurations) may be included alone or in any combination in any other examples of devices, features, components, and parts shown in other figures described herein. Similarly, any of the features, components, and / or parts shown or described with reference to other figures (including their arrangements and configurations) may be included alone or in any combination in any other examples of devices, features, components, and parts shown in other figures described herein. Figure 1 Examples of devices, features, components and parts are shown below. Figure 2 Describes additional details of the shell.

[0053] Figure 2 The shell 200 according to one or more examples of the present disclosure is illustrated. In a specific implementation, the shell 200 is the shell described above. Figure 1 Examples of input devices 102 discussed above. A case may include a shield, case, cover, housing, pouch, charging pack, etc. for storing, charging, and / or protecting one or more electronic devices or input devices. In a specific example, the case 200 may house earbuds (examples of which are discussed above and further discussed below). Figure 3 For example, the housing 200 may receive an earbud 300 (or a pair of earbuds 300).

[0054] As shown, the housing 200 may include a button 208. The button 208 may be used for various types of input to the head-mountable device. In some examples, the button 208 may be used to confirm or make an input selection. For example, a user may make a visual selection on the head-mountable device by directing their gaze toward the desired selection. The user may then press the button 208 to confirm their visual selection.

[0055] In some examples, the case 200 may include a sensor 210. The sensor 210 may include a camera, a vibration sensor, a microphone, a touch sensor (e.g., a capacitive sensor, an inductive sensor, a resistive sensor, etc.). In some examples, the case 200 may include an inertial measurement unit (IMU) 212. In some examples, the case 200 may include additional sensors 214, including a camera, a shock sensor, a microphone, etc. The sensor 210, the IMU 212, and / or the additional sensors 214 may detect input from a user, as will be described with reference to FIG. Figure 6 Further described.

[0056] In some examples, the case 200 may also include a surface (e.g., outer surface 254) that may include a touch surface for receiving input from a user. In one example, the user may interact with the touch surface with their hand by writing, sliding, tapping, etc. on the outer surface 254 of the case.

[0057] Figure 2 Any of the features, components, and / or parts shown (including their arrangements and configurations) may be included alone or in any combination in any other examples of devices, features, components, and parts shown in other figures described herein. Similarly, any of the features, components, and / or parts shown or described with reference to other figures (including their arrangements and configurations) may be included alone or in any combination in any other examples of devices, features, components, and parts shown in other figures described herein. Figure 2 Examples of devices, features, components and parts are shown below. Figure 3 Additional details of the earplugs are described.

[0058] Figure 3An earbud 300 according to one or more examples of the present disclosure is shown. As shown, the earbud 300 may include various elements that can detect tactile input and / or generate tactile output for communicating with a head-mounted device. In a specific example, the earbud 300 may include a sensor 316, an IMU 318, and / or additional sensors 320. Each of the sensors 316, IMU 318, and / or additional sensors may be similar to the sensors 210, IMU 212, and additional sensors 214 of the case 200. For example, the sensor 316 may include a camera, a vibration sensor, a microphone, a touch sensor (e.g., a capacitive sensor, an inductive sensor, a resistive sensor, etc.). The additional sensor 320 may include a camera, a vibration sensor, a microphone, etc. The sensor 316, the IMU 318, and / or the additional sensors 320 may further receive input from the user.

[0059] The head-mountable device can receive input from the earbud 300 (and from the shell 200). Additionally or alternatively, the head-mountable device can generate output based on input from the earbud 300 and / or the shell 200. For illustration, the earbud 300 can be used to receive input or commands from the user, which the earbud 300 can relay to the head-mountable device. In addition, the earbud 300 can be used to receive tactile information and audio from the user and output tactile information and audio to the user. To this end, the earbud 300 may include a tactile driver 324 carried by the housing 322. The housing 322 may include a cover that houses various electronic components of the earbud 300, such as a speaker, a battery, an antenna, a driver (including the tactile driver 324), etc. The tactile driver 324 may include one or more linear and / or rotary actuators that can generate vibrations in the shear direction 307 or the axial direction 309, respectively.

[0060] The earbud 300 may include a tactile surface 326 defined by the housing 322. As used herein, a tactile surface refers to a section of the housing 322 of the earbud 300 that can present a tactile output. For example, when a user contacts and overlaps the tactile surface 326 with their finger, the user may perceive the tactile output as a vibration, a rumbling sound, a sense of surface movement (e.g., simulating mechanical displacement or a button press), etc. In other words, the tactile surface 326 may be vibrationally coupled to the haptic driver 324 such that vibrations or other energy waves may travel from the haptic driver 324 to the tactile surface 326. The haptic driver 324 may generate the tactile output via the tactile surface 326 in response to a tactile signal (e.g., a digital message, computer-executable instructions, data packets, etc. that, when processed, causes the tactile driver to generate a tactile output). In these or other examples, the head-mountable device may generate the tactile signal. Alternatively, the processor of the earbud 300 may generate the tactile signal.

[0061] In at least one example, the earbud 300 can include an audio driver 328. The audio driver 328 can generate audible sounds that can be output by a speaker 329 of the earbud 300. In some examples, the audio driver 328 can include a first tactile driver to generate a first tactile response in a first direction, and a second tactile driver to generate a second tactile response in a second direction different from the first direction. In other words, the audio driver 328 can generate an audio signal that is tactilely received by the user. Additionally or alternatively, the audio driver 328 can receive a tactile signal from the user as an input audio signal. As described below, the first direction can include a shear direction (or longitudinal direction 307), and the second direction can include a rotational direction (or axial direction 309).

[0062] To input or output tactile signals, the earbud 300 may include an input surface 330 defined by the housing 322. The input surface 330 may receive tactile input to transmit input signals from a user's interaction with the earbud 300 to the head-mountable device. The input surface 330 may be an outer surface of the earbud 300, and when a user places their finger on this outer surface, the user can provide tactile input to the earbud 300 and thereby communicate with the head-mountable device. The input surface 330 may at least partially coincide with a portion of the tactile surface 326. In this manner, a user can input information into the earbud 300 and receive output information (e.g., tactile feedback) from the earbud 300 at a localized area of the earbud 300. In these or other examples, the input surface 330 may correspond to the neck region 356 of the earbud 300, where a user can grasp or hold a portion of the earbud 300 that extends outwardly relative to the body region 358. Additionally or alternatively, the input surface 330 may correspond to a body area 358 of the earbud 300 , wherein the body area 358 is positioned adjacent to the speaker 329 .

[0063] In at least one example, the earbud 300 can be a first earbud that can be used in conjunction with a second earbud (not shown). Each of the first earbud and the second earbud can include a reference portion 332. As used herein, a reference portion can include a marking or other physical feature that can be used as a reference point, spatial locator, etc. when placed in the field of view of a camera or other sensor. The reference portion can include a color (such as white or other bright color that can be easily detected in a dark environment; or black or other dark color that can be easily detected in a bright environment). As further described below, the reference portion marking of the earbud 300 can be used by the earbud 300 to help positionally correlate the movement of the earbud 300 with accurate input to the head-mountable device.

[0064] Figure 3Any of the features, components, and / or parts shown (including their arrangements and configurations) may be included alone or in any combination in any other examples of devices, features, components, and parts shown in other figures described herein. Similarly, any of the features, components, and / or parts shown or described with reference to other figures (including their arrangements and configurations) may be included alone or in any combination in any other examples of devices, features, components, and parts shown in other figures described herein. Figure 3 Examples of devices, features, components and parts are shown below. Figure 4 Describes additional details of user interaction with the earbuds.

[0065] Figure 4 4. The user's hand finger 401 is illustrated with a finger 401 of the user's hand according to one or more examples of the present disclosure. Figure 3 As discussed above, the tactile surface 326 can be a touch interface through which tactile input can be received by the earbud 300 and / or tactile output can be provided to the user's finger 401. In some examples, the tactile surface 326 corresponds to a portion of the outer surface of the earbud 300 that can directly contact the user's finger 401. In other examples, the tactile surface 326 is internal to the earbud 300 (e.g., below the surface of the outer surface of the earbud 300). For example, the tactile surface 326 can include an internal plate or other vibrating component that can mechanically generate a tactile response that the user can experience as tactile feedback. The tactile response can be a shear tactile output (e.g., in a longitudinal direction 307 along the earbud 300 or an axis of the earbud 300), a rotational tactile output (e.g., in an axial direction 309 about the earbud 300 or about the axis of the earbud 300), or a combination of shear and rotational tactile output. In more detail, the shear tactile output according to some examples may include a series of vibrations that progress incrementally, extend further along, or translate in direction 307. Similarly, the rotational tactile output according to some examples may include a series of vibrations that progress incrementally, extend further along, or translate in direction 309.

[0066] In some examples, the haptic response can be generated by the audio driver 328. The audio driver 328 can include a first haptic driver to generate a first haptic response in a first direction, and a second haptic driver to generate a second haptic response in a second direction different from the first direction. Additionally or alternatively, the audio driver 328 can include a first haptic driver to receive the first haptic response in the first direction, and a second haptic driver to receive the second haptic response in the second direction different from the first direction.

[0067] In at least one example, the haptic driver 324 can generate a shear tactile output at the tactile surface 326. The shear tactile output can be generated by the haptic driver 324 and / or the audio driver 328. The user can hold or touch the earbud 300 at the tactile surface 326 and can feel the shear tactile output or tactile response. The shear tactile output can convey information from the head-mountable device to the user via the earbud. For example, the shear tactile output can indicate the status of the head-mountable device (powered on, low battery, volume level, etc.).

[0068] In some examples, the input surface 330 can receive rotational tactile input. Rotational tactile input can be input to the earbud 300 in response to rotational movement (e.g., twisting, sliding, or turning) of one or more of the user's fingers against the surface of the neck region 356 of the earbud 300 along the axial direction 309. The rotational tactile input can be received by one or more of the sensors 316, the IMU 318, or the other sensors 320. The user can hold or touch the earbud 300 at the input surface 330 and can move or rotate their finger relative to the input surface 330 to transmit information to the head-mountable device. For example, the user powers the head-mountable device on / off, adjusts the volume, adjusts the brightness of the head-mountable device's display, etc.

[0069] Figure 4 Any of the features, components, and / or parts shown (including their arrangements and configurations) may be included, alone or in any combination, in any other examples of devices, features, components, and parts shown in other figures described herein. Likewise, any of the features, components, and / or parts shown or described with reference to other figures (including their arrangements and configurations) may be included, alone or in any combination, in any other examples of devices, features, components, and parts shown in other figures described herein. Figure 4 Examples of devices, features, components and parts are shown below. Figure 5 Describes additional details of user interaction with the earbuds.

[0070] Figure 5 An earbud 500 including an optical flow sensor 534 according to one or more examples of the present disclosure is illustrated. Although not all components are shown or labeled, the earbud 500 can be substantially similar to and include Figure 3 300. For example, earbud 500 may include housing 322 or a casing, and optical flow sensor 534 may be carried by the casing.

[0071] Additionally, the earbud 500 may include a speaker 329. The optical flow sensor 534 may be located at a distal end of the earbud 500 (e.g., a wireless headset) opposite the speaker 329. Specifically, the speaker 329 may be located near the proximal end of the earbud 500, which may be inserted into the user's ear. The optical flow sensor 534 may be located at the opposite end of the earbud 500 (e.g., farthest from the user's ear).

[0072] Optical flow sensor 534 may be a stylus sensor including an ultrasonic sensor, an optical flow sensor, or a capacitive sensor. In some examples, optical flow sensor 534 or a stylus sensor may include an ultrasonic sensor, a capacitive sensor, a resistive sensor, an inductive sensor, an accelerometer, a gyroscope, or other types of sensors.

[0073] The optical flow sensor 534 can transmit sensor data to a display device to generate an image based on the sensor data. The display device may include a head-mountable device, a cellular device, a laptop computer, etc. The sensor data may include any data collected by the optical flow sensor 534. In some examples, a user can use the earbud 500 as a stylus to write or draw text to be presented on the display device. In some examples, the optical flow sensor 534 can detect the light level of the surrounding environment. Additionally or alternatively, the optical flow sensor 534 can detect changes in the detected surface topography (e.g., the detected surface topography of an object's surface) to accurately correlate with the movement or displacement of the earbud 500 as a stylus. Therefore, when the earbud 500 is manipulated (e.g., to write text, draw, make a selection within a touch space, etc.), the optical flow sensor 534 can transmit the sensor data to the processor of the earbud 500, which in turn relays the sensor data to the head-mountable device (or other client device) for generating a visual output of the earbud stylus movement.

[0074] The earbud 500 may include a writing surface 536 disposed on the housing or casing 322 adjacent to the optical flow sensor 534. The writing surface 536 may be a lens or other protective cover that is transparent to optical and / or infrared wavelengths. In other examples, the writing surface 536 is optically opaque and, therefore, limits the field of view of the optical flow sensor 534. When a user virtually writes with the earbud 500, the writing surface 536 may contact various surfaces. For example, the writing surface 536 may contact and slide along a table surface, a piece of paper, a device display surface, and the like.

[0075] Figure 5Any of the features, components, and / or parts shown (including their arrangements and configurations) may be included alone or in any combination in any other examples of devices, features, components, and parts shown in other figures described herein. Similarly, any of the features, components, and / or parts shown or described with reference to other figures (including their arrangements and configurations) may be included alone or in any combination in any other examples of devices, features, components, and parts shown in other figures described herein. Figure 5 Examples of devices, features, components and parts are shown below. Figure 6 Describes the details of the touch input system.

[0076] Figure 6 A touch input system 600 according to one or more examples of the present disclosure is illustrated. As shown, the touch input system 600 may include a housing 200 disposed on a support surface 638. The support surface 638 may include various surfaces on which the housing 200 may be positioned, stored, or set. In some examples, the support surface 638 may include a desktop, the floor, a work surface, a device display surface (e.g., a monitor, screen, etc.), or any other suitable surface that can physically support the housing 200. The support surface 638 may be the surface of an object on which the housing 200 may be placed.

[0077] The case 200 may define a touch space 640 on or near the support surface 638. The touch space 640 may be defined as an area in which a user can interact with the case 200. In one example, the touch space 640 may be an area centered on the case 200. In one example, the touch space 640 may be defined by an area within a threshold distance from the case 200. The touch space 640 may be predetermined by the user. For example, the user may increase or decrease the threshold distance as desired.

[0078] In at least one example, sensor 210, IMU 212, or other sensor 214 can detect vibrations from a user providing touch input (e.g., a tap, a swipe, a knock, etc.) to support surface 638 within touch space 640. It should also be understood that sensor 210, IMU 212, or other sensor 214 can detect a pattern or series of touch inputs that represent a particular type of input or correspond to a given meaning (e.g., two taps for "yes," a single tap for "no"). In at least one example, sensor 210 or other sensor 214 can detect movement of a user's hand or finger within touch space 640. Case 200 can generate sensor data for the head mountable device based on the user's movements within touch space 640. Case 200 can reject other interactions with support surface 638 outside of touch space 640. For example, case 200 can reject ambient vibrations, taps or typing from nearby people other than the user, and the like.

[0079] In at least one example, the surface of case 200 defines an additional touch space that can receive touch input and vibration input. In addition to receiving vibrations and taps within touch space 640, the surface of case 200 can also receive touch input (e.g., via a sensor such as a capacitive sensor, a resistive sensor, an inductive sensor, etc.). In some examples, this can allow a user to utilize more than one type of input method (e.g., in combination or simultaneously).

[0080] Figure 6 Any of the features, components, and / or parts shown (including their arrangements and configurations) may be included, alone or in any combination, in any other examples of devices, features, components, and parts shown in other figures described herein. Likewise, any of the features, components, and / or parts shown or described with reference to other figures (including their arrangements and configurations) may be included, alone or in any combination, in any other examples of devices, features, components, and parts shown in other figures described herein. Figure 6 Examples of devices, features, components and parts are shown below. Figure 7 Describes details of additional touch input systems.

[0081] Figure 7 A touch input system 700 according to one or more examples of the present disclosure is illustrated. As shown, the touch input system 700 may include a first earbud 300a and a second earbud 300b disposed on a support surface 638. The touch input system 700 may include the first earbud 300a, which includes a first sensor, such as any one of the sensor 316, the IMU 318, or the additional sensor 320. The touch input system 700 may also include the second earbud 300b, which includes a second sensor, such as any one of the sensor 316, the IMU 318, or the additional sensor 320.

[0082] When the first and second earbuds are arranged on the support surface 638, the first and second earbuds 300a, 300b may define a touch space 740 on the support surface at which touch input may be detected via the first and second sensors.

[0083] In at least one example, the touch input system 700 can include a case 200. The case 200 can receive, store, charge, and / or perform other functions related to the first earbud 300a and the second earbud 300b. The case 200 can also include a third sensor, such as any one of the sensor 316, the IMU 318, or the additional sensor 320. The case 200 can also define a touch space 740. For example, the case 200 can extend or expand the touch space 740. In certain examples, the case 200 can more accurately define the boundaries and limits (whether real or virtual) of the touch space 240 by providing additional reference points, boundary points, and / or the like.

[0084] Touch input may include vibration, tap, or movement by a user at the support surface 638 within the touch space 740. The first earbud 300a, the second earbud 300b, and the case 200 may determine the location of the touch input within the touch space 740. The first touch input may correspond to a first location 742 on the support surface 638 within the touch space 740, while the second touch input may correspond to a second location 744 on the support surface 638 within the touch space 740 that is different from the first location 742. Based on the first location 742 of the first touch input, the touch input system 700 transmits a first command or input to the head mountable device. Based on the second location 744 of the first touch input, the touch input system 700 transmits a second command or input to the head mountable device. Taps or vibrations may occur outside of the touch space 740, such as at a third location 746. The touch input system 700 may reject such taps.

[0085] In some examples, support surface 638 may include a display 748 of the client device. In these or other examples, display 748 includes a graphical representation (e.g., an image of a keyboard, a screen with icons, images, digital content, an application or game, etc.). In a specific example, display 748 may be a virtual display projected onto support surface 638 from the user's perspective as seen through a head-mountable device (e.g., in a mixed reality experience). In such an example, the device may display a background screen, a home screen, a blank screen, etc. that is visually helpful (and not distracting or confusing) for providing touch input to virtual display 748. Alternatively, no head-mountable device or virtual display is involved. Instead, display 748 may be an actual display of a keyboard, icon arrangement, controller configuration, etc., presented by the client device. Thus, even non-touchscreen devices (which are not designed to receive touch input at a display) can be converted to receive touch input via touch input system 700. That is, via touch input system 700, touch input can accurately correlate with the visual imagery or graphical content depicted on the client device's display.

[0086] exist Figure 7 In the depicted example, display 748 includes a keyboard. Touch input system 700 can input text into the head mountable device based on determining touch input at first location 742, touch input at second location 744, and additional touch input at other locations. Although depicted as a keyboard, in other examples, display 748 can include a software application screen, a game, etc.

[0087] Figure 7Any of the features, components, and / or parts shown (including their arrangements and configurations) may be included, alone or in any combination, in any other examples of devices, features, components, and parts shown in other figures described herein. Likewise, any of the features, components, and / or parts shown or described with reference to other figures (including their arrangements and configurations) may be included, alone or in any combination, in any other examples of devices, features, components, and parts shown in other figures described herein. Figure 7 Examples of devices, features, components and parts are shown below. Figure 8 Describes details of additional touch input systems.

[0088] Figure 8 A touch input system 800 according to one or more examples of the present disclosure is illustrated. As shown, the touch input system 800 may include a first earbud 300a and a second earbud 300b that are joined together to form a combined interface, controller, etc. In some examples, the first earbud 300a and the second earbud 300b are at least partially stacked on top of each other. In other examples, the first earbud 300a and the second earbud 300b are positioned laterally adjacent to each other. In these or other examples, the touch input system 800 can provide an increased surface area to provide a wider variety of touch inputs or for use in a variety of different applications. In one example, the touch input system 800 can be configured as a stylus (similarly with reference to FIG. 1 ). Figure 5 Description). In one example, touch input system 800 can define a surface that can receive touch input from a user.

[0089] In one example, the first earbud 300a and the second earbud 300b can be coupled such that the distal end 850a of the first earbud 300a is proximal to the proximal end 852b of the second earbud 300b, and the proximal end 852a of the first earbud 300a is proximal to the distal end 850b of the second earbud 300b. The coupling mechanism may include a magnetic coupling or a mechanical coupling (such as via a snap-fit connection, a groove, and a guide rail). In some examples, the first earbud 300a can be moved laterally relative to the second earbud 300b along direction 803 to adjust the surface area. As used herein, the proximal end refers to the end of the earbud that is placed in the user's ear, while the distal end refers to the opposite end of the earbud and is farthest from the user's ear.

[0090] In some examples of the touch input system 800, one or both of the first earbud 300a and the second earbud 300b can be further coupled to other auxiliary devices, such as a case 200 or a docking station, etc., for example, the docking station can allow for increasing the input surface of the first earbud 300a and the second earbud 300b.

[0091] Figure 8Any of the features, components, and / or parts shown (including their arrangements and configurations) may be included alone or in any combination in any other examples of devices, features, components, and parts shown in other figures described herein. Similarly, any of the features, components, and / or parts shown or described with reference to other figures (including their arrangements and configurations) may be included alone or in any combination in Figure 8 The following references to the devices, features, components and parts shown are examples of Figure 9 Describes details of a computer system for implementing tactile input and output.

[0092] Figure 9 A high-level block diagram of a computer system 900 that can be used to implement examples of the present disclosure is shown. In various examples, the computer system 900 may include Figure 9 Various sets and subsets of components are shown. Thus, Figure 9 The various components shown may be included in various combinations and subsets based on the operations and functions performed by the computer system 900 in different examples. In at least one example, the computer system 900 may be a combination of the above Figures 1 to 8 A portion of the described head mountable device 104, case 200, or earbud 102, 300, or 500. It should be noted that when describing or reciting herein, the use of articles such as "a" or "an" are not to be construed as limited to only one, but are intended to mean one or more, unless specifically stated otherwise herein.

[0093] Computer system 900 may include a central processing unit (CPU) or processor 902 connected via bus 904 for electrical communication with a memory device 906, a power supply 908, an electronic storage device 910, a network interface 912, an input device adapter 916, an output device adapter 920, and a display. For example, one or more of these components may be connected to each other via a substrate (e.g., a printed circuit board (PCB) or other substrate) supporting bus 904 and other electrical connectors that provide electrical communication between the components. Bus 904 may include a communication mechanism for transferring information between the various parts of computer system 900.

[0094] The processor 902 may be a microprocessor or similar device that can receive and execute an instruction set 924 stored by a memory device 906. The memory device 906 may be referred to as a main memory, such as a random access memory (RAM) or another dynamic electronic storage device for storing information and instructions to be executed by the processor 902. The memory device 906 may also be used to store temporary variables or other intermediate information during the execution of instructions executed by the processor 902. The processor 902 may include one or more processors or controllers, such as, for example, a CPU typically used for the processor 902 or the head-mountable device 104, the case 200, or the earbuds 102, 300, or 500, and a touch controller or similar sensor or input / output (I / O) interface for controlling and receiving signals from the display or speaker 932 and any other sensors being used. The power supply 908 may include a power source capable of providing power to the processor 902 and other components connected to the bus 904, such as a connection to a utility grid or a battery system.

[0095] The storage device 910 may include a read-only memory (ROM) or another type of static storage device coupled to the bus 904 for storing static or long-term (i.e., non-dynamic) information and instructions for the processor 902. For example, the storage device 910 may include a magnetic or optical disk (e.g., a hard disk drive (HDD)), solid-state memory (e.g., a solid-state drive (SSD)), or the like.

[0096] Instructions 924 may include information for executing processes and methods using components of computer system 900, such as processor 902. Such processes and methods may include, for example, methods for generating predictive dictation as described in conjunction with other examples elsewhere herein. In at least one example, memory device 906 may store instructions that, when executed by processor 902, cause processor 902 to convert tactile input into a graphical representation signal (e.g., computer-executable instructions, data packets, etc.) used by a head-mountable device to display a graphical representation. In at least one example, the graphical representation may include text input.

[0097] The network interface 912 may include an adapter for connecting the system 900 to external devices via a wired or wireless connection. For example, the network interface 912 may provide a connection to a computer network 926, such as a cellular network, the Internet, a local area network (LAN), a separate device capable of wirelessly communicating with the network interface 912, other external devices, or network locations, and combinations thereof. In one example, the network interface 912 is a wireless networking adapter that can connect to another device having interface capabilities using the same protocol via WI-FI(R), Bluetooth(R), Bluetooth Low Energy (BLE), Bluetooth mesh, or a related wireless communication protocol. In some examples, a network device or collection of network devices in the network 926 may be considered part of the computer system 900. In some cases, a network device may be considered connected to the computer system 900, but not part of it.

[0098] The input device adapter 916 can provide connectivity to various input devices such as, for example, the camera 810, the sensor 928, and other external electronic device components such as a touch input device, a keyboard or other peripheral input device, related devices, and combinations thereof to the computer system 900. One or more sensors (which may include any of the sensors of the input devices described herein) can be used to detect physical phenomena (e.g., light, sound waves, electric fields, forces, vibrations, etc.) near the computing system 900 and convert these phenomena into electrical signals. In some examples, the input device adapter 916 can be connected to a stylus or other input tool via a wired connection or a wireless connection (e.g., via the network interface 912) to receive input.

[0099] The output device adapter 920 can provide the computer system 900 with the ability to output information to the user, such as by providing visual output using one or more displays, providing audible output using one or more speakers 932, audio drivers 930, audio output devices, or by providing tactile feedback sensed by touch via one or more haptic drivers 934. Other output devices can also be used. The processor 902 can control the output device adapter 920 to provide information to the user via an output device connected to the adapter 920.

[0100] To the extent applicable to the present technology, the collection and use of data obtained from various sources can be used to improve the delivery of inspirational content or any other content that may be of interest to the user. The present disclosure contemplates that in some instances, such collected data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, ID, home address, data or records related to the user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identifying or personal information.

[0101] This disclosure recognizes that the use of such personal information data within the present technology can be used to benefit users. For example, this personal information data can be used to deliver targeted content of particular interest to the user. Thus, the use of such personal information data enables users to exercise planned control over the content delivered. Furthermore, this disclosure contemplates other uses of personal information data that can benefit users. For example, health and fitness data can be used to provide insights into a user's overall health or as positive feedback to individuals using technology to pursue health goals.

[0102] This disclosure contemplates that entities responsible for the collection, analysis, disclosure, transmission, storage, or other use of such personal information data will adhere to robust privacy policies and / or privacy practices. Specifically, such entities should implement and adhere to privacy policies and practices that are recognized as meeting or exceeding industry or government requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and updated as changes occur in the collection and / or use of data. Personal information from users should be collected for legitimate and reasonable entity purposes and should not be shared or sold outside of those legitimate purposes. Furthermore, such collection / sharing should be conducted after receiving the user's informed consent. Furthermore, such entities should consider taking any necessary steps to protect and safeguard access to such personal information data and ensure that other entities with access to the personal information data comply with the other entities' privacy policies and procedures. Furthermore, such entities may subject themselves to third-party assessments to demonstrate compliance with widely accepted privacy policies and practices. Furthermore, policies and practices should be tailored to the specific type of personal information data collected and / or accessed, as well as to applicable laws and standards, including jurisdictional considerations. For example, in the United States, the collection or access of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); whereas health data in other countries may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.

[0103] Regardless of the foregoing, the present disclosure also contemplates examples where a user selectively blocks the use or access of personal information data. That is, the present disclosure contemplates providing hardware elements and / or software elements to prevent or block access to such personal information data. For example, with respect to an advertising delivery service, the technology of the present invention may allow a user to choose to "opt in" or "opt out" to participate in the collection of personal information data at any time during or after registration for the service. In another example, a user may choose not to provide emotion-related data to a targeted content delivery service. In another example, a user may choose to limit the length of time that emotion-related data is retained, or to prohibit the development of underlying emotional conditions altogether. In addition to providing "opt-in" and "opt-out" options, the present disclosure also contemplates providing notifications related to access or use of personal information. For example, a user may be notified that their personal information data will be accessed when downloading an application, and then be reminded again just before the personal information data is accessed by the application.

[0104] Furthermore, it is the intention of the present disclosure that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once the data is no longer needed, the risk can be minimized by limiting the collection of data and deleting the data. In addition, and when applicable, including in certain health-related applications, data de-identification can be used to protect the privacy of users. De-identification can be facilitated by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than the address level), controlling how the data is stored (e.g., aggregating data across users), and / or other methods, where appropriate.

[0105] Thus, while this disclosure broadly covers the use of personal information data to implement one or more of the various disclosed examples, this disclosure also contemplates that various examples may be implemented without access to such personal information data. That is, various examples of the present technology will not fail to function due to the lack of all or part of such personal information data. For example, content may be selected and delivered to a user by inferring preferences based on non-personal information data or an absolute minimum amount of personal information, such as content requested by a device associated with the user, other non-personal information available to a content delivery service, or publicly available information.

[0106] For illustrative purposes, the foregoing description uses specific nomenclature to provide a thorough understanding of the examples. However, it will be apparent to those skilled in the art that these examples can be practiced without these specific details. Therefore, the foregoing description of the specific examples described herein is presented for purposes of illustration and description. These details are not intended to be exhaustive or to limit the examples to the precise forms disclosed. It will be apparent to those skilled in the art that many modifications and variations are possible in light of the above teachings.

Claims

1. An earplug comprising: shell; a haptic driver, the haptic driver being carried by the housing; a haptic surface defined by the housing and coupled to the haptic driver, the haptic driver configured to generate haptic output through the haptic surface in response to receiving a haptic signal from a head-mountable device; as well as An input surface is defined by the housing, the input surface being capable of receiving an input to transmit an input signal to the head mountable device.

2. The earplug of claim 1 , wherein the tactile surface comprises a portion of the input surface.

3. The earplug of claim 1 , wherein the haptic driver is configured to generate a shear tactile output at the tactile surface.

4. The earbud of claim 1 , further comprising an audio driver.

5. The earbud of claim 4, wherein the audio driver comprises a first haptic driver configured to generate a first haptic response in a first direction and a second haptic driver configured to generate a second haptic response in a second direction different from the first direction.

6. The earplug according to claim 1, further comprising: processor; as well as A memory device storing instructions that, when executed by the processor, cause the processor to convert the input into a graphical representation signal used by the head mountable device to display a graphical representation.

7. The earplug of claim 1 , further comprising a stylus sensor comprising at least one of an ultrasonic sensor, an optical flow sensor, or a capacitive sensor.

8. A touch input system comprising: a first earbud, the first earbud comprising a first sensor; as well as a second earbud comprising a second sensor; When the first earbud and the second earbud are placed on a support surface, the first earbud and the second earbud define a touch space adjacent to the support surface, where touch input can be detected via the first sensor and the second sensor.

9. The touch input system of claim 8, wherein the support surface comprises a surface of an object.

10. The touch input system of claim 8, wherein the support surface comprises a display of a client device.

11. The touch input system of claim 10, further comprising a housing configured to receive the first earbud and the second earbud; Wherein the shell further defines the touch space on the display of the client device.

12. The touch input system of claim 8, further comprising a housing configured to receive the first earbud and the second earbud, the housing comprising a third sensor. 13 . The touch input system of claim 12 , wherein the housing comprises a sensor configured to detect vibrations from the touch input at the touch space.

14. The touch input system of claim 11, wherein the first earbud, the second earbud, and the housing are configured to determine a location of a touch input within the touch space.

15. The touch input system of claim 8, wherein each of the first earbud and the second earbud comprises a reference portion.

16. The touch input system of claim 8, wherein the first earbud is attachable to the second earbud to define a combined input surface.

17. A wireless headset comprising: case; as well as an optical flow sensor, the optical flow sensor being carried by the housing; The optical flow sensor is configured to transmit sensor data to a display device to generate an image based on the sensor data.

18. The wireless headset of claim 17, further comprising a writing surface disposed on the housing adjacent to the optical flow sensor.

19. The wireless headset according to claim 17, further comprising a speaker; The optical flow sensor is arranged at a distal end of the wireless headset opposite to the speaker.

20. The wireless headset of claim 17, wherein the display device comprises a display of a head-mountable device.

Images