Systems, methods, and apparatus including optical occlusion detection

Abstract

The disclosure relates to systems, methods, and devices including optical occlusion detection. The present examples relate to systems and methods for detecting localized optical occlusion on a device. Examples also relate to a device that may detect local optical occlusion. For example, a device may include a first light emitter and a first light detector, and the device may determine that the first light emitter of the device is optically occluded by an object external to a housing of the device based on a first light amount of one or more light amounts detected via the first light detector.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 586,906, filed on September 29, 2023, and U.S. Patent Application No. 18 / 818,475, filed on August 28, 2024, the contents of both applications are incorporated herein by reference in their entirety for all purposes. Technical Field

[0003] The present disclosure relates generally to input devices, systems, and methods, and more particularly to input devices, systems, and methods that include optical sensors. Background Art

[0004] Many types of input devices are currently available for performing operations in a computing system, such as buttons or keys, mice, trackballs, joysticks, touch panels, touch screens, etc. Some computing systems use handheld input devices such as a stylus or game controller. Summary of the invention

[0005] Spatial tracking of an input device (e.g., a handheld input device such as a remote game controller, a stylus, or another type of input device) and spatial tracking of user interactions with the handheld input device are optionally used for input (e.g., input to another computing system). However, spatial tracking techniques can be resource intensive. For example, one spatial tracking technique for a handheld input device (referred to herein as outside-in optical tracking) uses a cluster of light emitters (e.g., light emitting diodes (LEDs)) in a driven handheld input device. A computer system can capture an image (e.g., via one or more cameras) and use the captured light information (e.g., using the geometry of the cluster of handheld input and / or the emitter wavelengths of the cluster of light emitters of the handheld input device) to determine the spatial position (e.g., up to six degrees of freedom pose) of the handheld input device. This approach to spatial tracking can be resource intensive and / or waste power, particularly when a cluster of light emitters is driven independent of whether one or more of the light emitters of the cluster of light emitters are optically obscured and / or outside the field of view of one or more cameras of the computer system.

[0006] In practice, one or more light emitters in a cluster of light emitters may be partially optically obscured in practice, for example due to a hand gesture (e.g., one or more fingers and / or palm of a user covering a portion of a handheld input device that includes one or more emitters), a table, clothing, or bag, or another type of object covering the one or more light emitters. Despite being optically obscured and therefore unable to contribute to optical tracking, the one or more light emitters being driven optionally still consume power (e.g., when the cluster of light emitters is driven independent of whether one or more light emitters in the cluster of light emitters are optically obscured from visibility by one or more cameras of the computing device).

[0007] As described herein, improved systems and methods for optical tracking detect optical occlusion at a handheld input device and / or act upon the detection of optical occlusion. For example, the systems and methods described herein can improve synchronization of electronic devices communicating with a handheld input device, reduce power consumption at the handheld input device (e.g., reduce drive current requirements and heat generation). Specifically, power consumption can be reduced by selectively driving one or more light emitters in a cluster of light emitters of a handheld input device based on an understanding of whether one or more light emitters are optically occluded.

[0008] The present examples relate to systems and methods for detecting partial optical occlusion on a handheld input device and / or for intelligently driving one or more light emitters in a cluster of light emitters of a handheld input device. In some examples, a method includes: driving one or more light emitters; detecting an amount of light via one or more light detectors; and determining that a first light emitter of the one or more light emitters is optically obscured by an object outside the housing of the handheld electronic device based on the amount of light detected via the first light detector. In some examples, when the first light emitter is determined to be optically obscured, the method includes abandoning driving the light emitter at that location for outside-to-in tracking (or reducing the frequency or power of the driving), while continuing to drive other light emitters that are not determined to be optically obscured, thereby saving power for the handheld input device. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 A computing system in communication with an input device including a partial optical occlusion detection circuit is illustrated according to some examples of the present disclosure.

[0010] Figure 2 A block diagram of a system including a computing system and an input device including a partial optical occlusion detection circuit is illustrated according to some examples of the present disclosure.

[0011] Figure 3AAn optical module on an input device according to some examples of the present disclosure is illustrated, the optical module including a light emitter and a light detector that can be utilized by a partial optical occlusion detection circuit.

[0012] Figure 3B Illustrated are example graphs of the amount of light detected at a light detector of an input device in response to light emitted by a light emitter of the input device as a function of the distance of an object external to a housing of the input device according to some examples of the present disclosure.

[0013] FIG. 4A to FIG. 4B An input device including partial optical occlusion detection circuitry held by a user in a first hand posture and a second hand posture is illustrated.

[0014] FIG. 5A to FIG. 5B Light emitters of an input device for tracking the input device according to examples of the present disclosure are illustrated, including light emitters that are optically obscured or not optically obscured due to external objects.

[0015] Figure 6 A block diagram of an input device including one or more light emitters and one or more optical detectors according to some examples of the present disclosure is illustrated.

[0016] Figure 7 A flowchart of a method for detecting partial optical occlusion of an input device according to some examples of the present disclosure is illustrated. DETAILED DESCRIPTION

[0017] In the following description of the examples, reference is made to the accompanying drawings which form a part of the following description and in which are shown by way of illustration specific examples that can be practiced. It should be understood that other examples can be used and structural changes can be made without departing from the scope of the disclosed examples.

[0018] Spatial tracking of an input device (e.g., a handheld input device such as a remote game controller, a stylus, or another type of input device) and spatial tracking of user interactions with the handheld input device are optionally used for input (e.g., input to another computing system). However, spatial tracking techniques can be resource intensive. For example, one spatial tracking technique for a handheld input device (referred to herein as outside-in optical tracking) uses a cluster of light emitters (e.g., light emitting diodes (LEDs)) in a driven handheld input device. A computer system can capture an image (e.g., via one or more cameras) and use the captured light information (e.g., using the geometry of the cluster of handheld input and / or the emitter wavelengths of the cluster of light emitters of the handheld input device) to determine the spatial position (e.g., up to six degrees of freedom pose) of the handheld input device. This approach to spatial tracking can be resource intensive and / or waste power, particularly when a cluster of light emitters is driven independent of whether one or more of the light emitters of the cluster of light emitters are optically obscured and / or outside the field of view of one or more cameras of the computer system.

[0019] In practice, one or more light emitters in a cluster of light emitters may be partially optically obscured in practice, for example due to a hand gesture (e.g., one or more fingers and / or palm of a user covering a portion of a handheld input device that includes one or more emitters), a table, clothing, or bag, or another type of object covering the one or more light emitters. Despite being optically obscured and therefore unable to contribute to optical tracking, the one or more light emitters being driven optionally still consume power (e.g., when the cluster of light emitters is driven independent of whether one or more light emitters in the cluster of light emitters are optically obscured from visibility by one or more cameras of the computing device).

[0020] As described herein, improved systems and methods for optical tracking detect optical occlusion at a handheld input device and / or act upon the detection of optical occlusion. For example, the systems and methods described herein can improve synchronization of electronic devices communicating with a handheld input device, reduce power consumption at the handheld input device (e.g., reduce drive current requirements and heat generation). Specifically, power consumption can be reduced by selectively driving one or more light emitters in a cluster of light emitters of a handheld input device based on an understanding of whether one or more light emitters are optically occluded.

[0021] The present examples relate to systems and methods for detecting partial optical occlusion on a handheld input device and / or for intelligently driving one or more light emitters in a cluster of light emitters of a handheld input device. In some examples, a method includes: driving one or more light emitters; detecting an amount of light via one or more light detectors; and determining that a first light emitter of the one or more light emitters is optically obscured by an object outside the housing of the handheld electronic device based on the amount of light detected via the first light detector. In some examples, when the first light emitter is determined to be optically obscured, the method includes abandoning driving the light emitter at that location for outside-to-in tracking (or reducing the frequency or power of the driving), while continuing to drive other light emitters that are not determined to be optically obscured, thereby saving power for the handheld input device.

[0022] Figure 1 An example computing system 148 is illustrated in communication with an input device 100 including partial optical occlusion detection circuitry according to some examples of the present disclosure.

[0023] Example computing system 148 optionally represents a computer (e.g., a personal computer), a tablet computer, a game console (e.g., a video game console), smart glasses (e.g., smart glasses), a headset such as an extended reality (XR) headset, a mobile phone, a digital media player, a wearable device, a mobile or non-mobile computing device including a display, and / or another type of computing system. In some examples, example computing system 148 is an XR system including a head-mounted display for immersing a user of example computing system 148 into an augmented and / or virtual reality environment (e.g., a three-dimensional environment).

[0024] The input device 100 optionally represents a handheld input device (e.g., a game controller, a digital stylus, a digital pen, a digital stick, a digital ring, or another type of handheld input device). In some examples, the input device 100 is configured to provide input to the example computing system 148 during the XR experience. The input device 100 optionally includes spatial tracking technology and / or is included in a spatial tracking system. For example, the computing system 148 optionally tracks the position and / or orientation of the input device 100, optionally relative to a three-dimensional environment and / or relative to the position of the computing system 148 in the three-dimensional environment (e.g., using an outside-in tracking system).

[0025] In some examples, computing system 148 and input device 100 communicate with each other. For example, computing system 148 optionally detects input from input device 100 and / or input device 100 optionally detects input from computing system 148. In some examples, input device 100 communicates with example computing system 148 via a wired connection. In some examples, input device 100 communicates with example computing system 148 via a wireless connection. Although Figure 1 The example computing system 148 shown in FIG. 1 includes a touch screen 130, but in some examples, the example computing system 148 may additionally or alternatively have a non-touch-sensitive display. Furthermore, in some examples, the example computing system 148 may accept input from the input device 100 via the touch screen 130. In some examples, the computing system 148 does not accept input from the input device 100 via the touch screen.

[0026] The input device 100 includes light emitters 104a-104h (e.g., a cluster of light emitters). In some examples, the geometry and / or wavelength of one or more or all of the light emitters 104a-104h are known or made known to the example computing system 148. In some examples, the example computing system 148 can track the input device 100 spatially (e.g., relative to the physical environment and / or relative to the example computing system 148) using detection of light emitted by these one or more light emitters by a camera of the example computing system 148 (e.g., outside-in optical tracking).

[0027] In some examples, the light emitters 104a-104h can be driven (e.g., independently, sequentially, and / or simultaneously) in a first mode and / or a second mode. In a first mode of operation of a corresponding light emitter, the corresponding light emitter is driven by the example computing system 148 for detection (e.g., outside-in optical tracking). In a second mode of operation of the corresponding light emitter, the corresponding light emitter is driven (e.g., independently, sequentially, and / or simultaneously) to detect whether the corresponding light emitter is optically obscured on the input device by an object external to the housing of the input device 100.

[0028] In some examples, the input device 100 alternates between the first operating mode and the second operating mode of the light emitters 104a-104h. For example, the input device optionally operates the light emitters 104a-104h in the second mode to determine which light emitters are optically blocked. Then, based on the determination, the input device 100 optionally triggers the first operating mode of the light emitters that are not determined to be optically blocked, and optionally turns off the light emitters that are determined to be optically blocked, while operating the light emitters that are not determined to be optically blocked in the first operating mode. Therefore, the input device 100 optionally alternates between the first mode and the second mode. In some examples, the input device 100 drives the light emitters 104a-104h in the second mode at different frequencies. For example, the input device 100 optionally drives the light emitters in the second mode for every 3rd, 5th, 8th cycle or another frequency of the light emitters driven.

[0029] In some examples, the input device 100 operates the corresponding light emitter in the first mode or in the second mode. Based on determining that the corresponding light emitter is not optically obscured when the corresponding light emitter is in the first mode, the corresponding light emitter continues to operate in the first mode, and based on determining that the first corresponding light emitter is not optically obscured when the corresponding light emitter is in the second mode, the first corresponding light emitter continues to operate in the second mode.

[0030] In some examples, the corresponding light emitter is driven in the second mode, and in response to determining that the corresponding light emitter is not optically obscured on the input device by an object external to the housing of the input device, the corresponding light emitter is driven in the first mode. In some examples, the corresponding light emitter is driven in the second mode, and in response to determining that the corresponding light emitter is optically obscured on the input device by an object external to the housing of the input device, the corresponding light emitter continues to be driven in the second mode, optionally with one or more drive characteristics different from the first mode, or stops being driven (e.g., at least temporarily). In some examples, local optical occlusion detection circuitry on the input device is used to determine whether to drive the corresponding light emitter in the first mode or in the second mode.

[0031] exist Figure 1 , light emitters 104a - 104h are distributed in input device 100 in a first distribution arrangement. Figure 1 The arrangement and number of light emitters in are representative (eg, non-limiting), and different arrangements are considered to be within the scope of the present disclosure. Figure 1, light emitters 104a-104h are optionally within the input device 100 (e.g., within or internal to the housing 102 of the input device 100), but other arrangements are possible, such as arrangements in which one or more light emitters are on a surface of the input device 100 (e.g., coupled to a surface of the input device 100 or external to the housing of the input device 100) or not obscured by the housing of the input device 100.

[0032] Figure 2 An example computing system 200 (which is optionally a Figure 1 The example computing system 148 of FIG. 1 and the example input device 230 (which is optionally Figure 1 00 ), where the example input device 230 includes a partial optical occlusion detection circuit.

[0033] In some examples, computer system 200 may include power source 208 (e.g., an energy storage device such as a battery), host processor 204, program storage 210 and / or memory 206, wireless communication circuitry 202, and one or more sensing devices 216. Host processor 204 may control some or all of the operations of computing system 200. Host processor 204 may communicate, directly or indirectly, with some or all of the other components of computer system 200. For example, a system bus or other communication mechanism may provide communication between power source 208, host processor 204, display 212, program storage 210, memory 206, wireless communication circuitry 202, and sensing devices 216.

[0034] The host processor 204 may be implemented as any electronic device capable of processing, receiving, or sending data or instructions, whether such data or instructions are in the form of software or firmware or encoded in other ways. For example, the host processor 204 may include a microprocessor, a central processing unit (CPU), an application specific integrated circuit (ASIC), a digital signal processor (DSP), a controller, or a combination of such devices. As used herein, the term "processor" or "processing circuit" is intended to cover a single processor or processing unit, multiple processors, multiple processing units, or other appropriately configured one or more computing elements. In some cases, the host processor 204 may provide reference to FIGS. 3 to 4. Figure 7 Part or all of the processing system or processor described in any of the above.

[0035] In some examples, the host processor 204 may perform an action in response to detecting input at or from the input device 230. In some examples, the display 212 may be configured to display content generated using the input device 230 (e.g., based on selections made at the input device and / or based on the position or pointing of the input device 230). For example, the host processor 204 may be connected to the program storage device 210 (and / or the memory 206) and the display controller / driver to generate images on the display 212. The display 212 optionally includes a liquid crystal display (LCD) display, a light emitting diode (LED) display (including organic LED (OLED), active matrix organic LED (AMOLED), passive matrix organic LED (PMOLED) display), a projector, a holographic projector, a retinal projector, or other suitable display. In some examples, the display driver may provide a voltage to each pixel transistor on a select (e.g., gate) line and may provide data signals to these same transistors along data lines to control the pixels of the display 212 to display images.

[0036] The host processor 204 may enable a display image on the display 212 (such as a display image of a user interface (UI)) or a display image of content generated using the input device 230, and may use a touch processor and / or a touch controller to detect a touch on or near the display 212 (such as a touch input to a displayed UI when the computing system 200 includes a touch screen). The host processor 204 may also perform additional functions that may not be related to display or touch processing.

[0037] It should be noted that one or more of the functions described in the present disclosure may be performed by firmware stored in the memory 206 and / or stored in the program storage device 210 and executed by the host processor 204 or other processing circuits of the computing system 200. The firmware may also be stored and / or transmitted in any non-transitory computer-readable storage medium for use or in conjunction with an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can obtain instructions from the instruction execution system, device or apparatus and execute the instructions). In the context of this document, a "non-transitory computer-readable storage medium" may be any medium (excluding signals) that can contain or store a program for use or in conjunction with an instruction execution system, device or apparatus. In some examples, the program storage device 210 and / or the memory 206 may be a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium (or multiple non-transitory computer-readable storage media) may have instructions stored therein, which, when executed by the host processor 204 or other processing circuits, may cause a device including the computing system 200 to perform one or more functions and methods of one or more examples of the present disclosure. The computer-readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared or semiconductor system, apparatus or device, a portable computer disk (magnetic), a random access memory (RAM) (magnetic), a read-only memory (ROM) (magnetic), an erasable programmable read-only memory (EPROM) (magnetic), a portable optical disk (such as a CD, CD-R, CD-RW, DVD, DVD-R or DVD-RW), or a flash memory (such as a compact flash card, a secure digital card, a universal serial bus (USB) memory device, a memory stick, etc.).

[0038] The firmware may also be transmitted in any transmission medium for use by or in conjunction with an instruction execution system, device, or apparatus (such as a computer-based system, a system including a processor, or other system that can obtain instructions from an instruction execution system, device, or apparatus and execute the instructions). In the context of this document, a "transmission medium" may be any medium that can convey, propagate, or transport the program for use by or in conjunction with an instruction execution system, device, or apparatus. The transmission medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, or infrared wired or wireless transmission media.

[0039] The power supply 208 may be implemented with any device capable of providing energy to the computing system 200. For example, the power supply 208 may include one or more batteries (e.g., rechargeable batteries). Additionally or alternatively, the power supply 208 may include a power connector or power cord that connects the computing system 200 to another power source, such as a wall outlet.

[0040] Memory 206 can store electronic data that can be used by computing system 200. For example, memory 206 can store electronic data or content, such as, for example, audio and video files, documents and applications, device settings and user preferences, timing signals, control signals, and data structures or databases. Memory 206 can include any type of memory. For example, memory 206 can include random access memory, read-only memory, flash memory, removable memory, other types of storage elements, or combinations of such memory types.

[0041] Sensing device 216 may include sensor circuitry configured to sense one or more types of parameters, such as, but not limited to: vibration; light; touch; force; heat; movement; relative motion; a user's biometric data (e.g., biometric parameters); air quality; proximity; location; connectivity; etc. In some examples, sensing device 216 may include an image sensor (such as an outward-facing camera 218), a radio frequency sensor (and / or transmitter) 220, an infrared sensor (and / or transmitter) 222, a magnetic sensor (and / or generator) 224 (e.g., a magnetometer), an ultrasonic sensor (and / or transmitter) 226, and / or an inertial measurement unit 228. It should be understood that Figure 2 Some example sensors of sensing device 216 are illustrated, but the sensors are not limited thereto. In some examples, sensing device 216 may also include other sensors, including force sensors, thermal sensors, position sensors, light or optical sensors, accelerometers, pressure transducers, gyroscopes, acoustic sensors, health monitoring sensors, and / or air quality sensors, among other possibilities. Additionally, one or more sensors of sensing device 216 may utilize any suitable sensing technology, including but not limited to interferometry, magnetic, capacitive, ultrasonic, resistive, optical, acoustic, piezoelectric, or thermal technology.

[0042] Wireless communication circuitry 202 may send or receive data from another electronic device, such as from input device 230. Although wireless communication circuitry 202 is shown and described, it should be understood that other wired communication interfaces may be used. In some examples, the wireless and / or wired communication interfaces may include, but are not limited to, cellular, Bluetooth, and / or Wi-Fi communication interfaces. Although not shown, computing system 200 may also include other input / output mechanisms including one or more touch-sensing input surfaces, a crown, one or more physical buttons, one or more microphones or speakers, one or more ports (such as a microphone port), and / or a keyboard.

[0043] Figure 2The input device 230 may include a housing 290. The housing 290 is optionally transparent or at least partially transparent to one or more light emitter wavelengths (e.g., optionally a range of wavelengths). In some examples, the housing 290 includes a cylindrical body or another body shape optionally having a tip portion. In some examples, the tip portion can be part of a unitary housing, and in some examples, the tip portion can be removable from the body. In some examples, the housing 290 of the input device 230 may include a cylindrical body or another body shape optionally without a tip portion (e.g., opposite ends of the input device housing have a similar appearance or size). The housing 290 may include an ergonomic recess (or multiple ergonomic recesses), optionally as a guide for placing one of the user's fingers (e.g., a thumb or index finger). The input device 230 can be held by the user in different ways (e.g., a range of hand gestures), as described with reference to FIG. FIG. 4A to FIG. 4B The ergonomic press may optionally help the user achieve a variety of gestures and / or enable the user to provide additional input (eg, to locate a touch-sensitive area with a particular finger).

[0044] The circuitry of the input device 230 may be disposed in the housing. For example, the circuitry may include a power source 238 (e.g., a battery), a processing circuit (e.g., a processor 234), a memory 236, a wireless communication circuit 232, and various sensors. It should be noted that one or more of the functions described in the present disclosure may be performed by firmware stored in the memory 236 and executed by the processor 234 or other processing circuitry of the input device 230. The sensors of the input device 230 may include an optical sensor 240 and other possible sensors. In some examples, the optical sensor 240 is distributed in the input device 230. In some examples, the input device 230 may include an outward-facing camera 250, a beacon transmitter 246 (e.g., using any electromagnetic signal), an ultrasonic sensor (and / or transmitter) 258, a force sensor 244 (e.g., a strain gauge, a capacitive gap force sensor, a piezoelectric sensor 242), an inertial measurement unit (IMU) 260 (and / or other motion or orientation devices such as accelerometers or gyroscopes), capacitive electrodes or other capacitive sensors 248, radio frequency sensors (and / or transmitters) 252, infrared sensors (and / or transmitters) 254, magnetic sensors (and / or generators) 256, and other suitable sensors. The processor 234 may communicate directly or indirectly with some or all of the other components of the input device 230. For example, a system bus or other communication mechanism may provide communication between the various components of the input device 230. The processor 234 and / or the memory 236 may be the same or similar to the processor 204 and / or the memory 206, respectively.

[0045] As described herein, in some examples, the motion, position, and / or orientation of input device 230 can be tracked, optionally to generate input for computing system 200. In some examples, optical sensor 240 can be used to track the motion, position, and / or orientation of input device 230, optionally in addition to sensors of computing system 200. For example, input device 230 can include a single optical sensor 240 or multiple optical sensors 240 that can be used for spatial tracking of input device 230 (e.g., optical tracking from outside to inside). In addition, single or multiple optical sensors 240 can be used to estimate the hand pose of the user of input device 230. Optical sensor 240 can be configured to both send and receive light (e.g., emit and receive infrared light), which can provide data about the motion, position, and / or orientation of the input device (and optionally specific portions of the input device) relative to computing system 200, and also provide data about whether one or more light emitters of input device 230 are optically blocked by objects external to housing 290.

[0046] In some examples, tracking the motion, position, and / or orientation of input device 230 using optical sensor 240 can be enhanced by additional sensors. For example, various sensors of sensing device 216 and / or input device 230 can track information about input device 230 (e.g., the position, motion, orientation, force, etc. of the input device), and the information can be communicated from the one or more sensing devices 216 to host processor 204. In some examples, information from input device 230 (e.g., received via wireless communication circuits 202, 232) and one or more sensing devices 216 can be stored in memory 206. This information may be processed by host processor 204 to present and / or display content from input device 230 on display 212 (e.g., present writing or drawing on the display in response to selection and / or movement of input device 230 in free space (e.g., generating content in response to detecting that input device 230 is pointing in one or more directions relative to computing system 200 and / or relative to a user interface displayed by computing system 200, without the input device contacting a surface). In some examples, this information about input device 230 may be collected by, transmitted to, processed by, and / or stored on the input device. For example, one or more sensing modules within input device 230 may be used to generate information about input device 230. The state may provide additional information about the force, orientation, motion, and / or position of the input device. According to an example of the present disclosure, the combined information from the optical sensor 240 and one or more sensing modalities may then be transmitted to, processed by, and / or stored on a computing device to provide input to the computing system 200 and / or render and / or display content on the display 212. In some examples, the computing system 200 may render content in a three-dimensional environment based on the position and / or motion of the input device. For example, the computing system 200 may be a head-mounted XR headset that can render and overlay content on a real-world environment or a representation of a real-world environment captured by an outward-facing camera 218.

[0047] In some examples, each optical sensor 240 includes an application specific integrated circuit (ASIC) 261, a light emitter 262 (e.g., light emitters 104a-104h), and / or one or more light detectors 264. In some examples, the input device 230 includes a single ASIC for partial optical occlusion detection circuitry. For example, ASIC 261 is optionally configured to include partial optical occlusion detection circuitry for multiple light emitter / light detector pairs for detecting light emitters 262 (e.g., Figure 1In some examples, the input device includes multiple ASICs for local optical occlusion detection circuitry. For example, each ASIC is optionally assigned to a subset of the multiple light emitter / light detector pairs (e.g., on the ASIC for each individual light emitter / light detector pair).

[0048] Housing 290 is optionally at least partially transparent to the wavelength of the light emitter. For example, light emitter 262 optionally emits light incident on housing 290, and some of the light is received into light detector 264 (e.g., via reflection). Some of the light is transmitted at and / or through housing 290 and then reflected back into light detector 264. When not blocked by an object outside the housing, some of the light is transmitted through housing 290 and is not reflected back into light detector 264. Light detector 264 is optionally configured to detect ambient light (optionally in addition to light from light emitter 262) at the same time or at different times. In some examples, when ambient visible light and invisible light occur simultaneously or partially overlap, light detector 264 can detect ambient visible light and detect invisible light for occlusion detection related to tracking. In some examples, light emitter 262 emits visible light for tracking. In some examples, when light emitter 262 emits visible light for tracking, the duty cycle is below a threshold duty cycle for visibility of visible light to the naked human eye. In some examples, light emitter 262 may include a light emitting diode (LED) or a vertical cavity surface emitting laser (VCSEL). In some examples, light detector 264 may include an image sensor. In addition, optical sensor 240 optionally includes a lens or a lens array.

[0049] It is obvious that Figure 2 The architecture shown is only one exemplary architecture of computing system 200, input device 230, and optical sensor 240, and the system may have more or fewer components or a different configuration of components than shown. Figure 2 The various components shown in the drawings may be implemented in hardware, software, firmware, or any combination thereof, including one or more signal processing and / or application specific integrated circuits.

[0050] Figure 3A An optical module 302 of an input device 100 according to some examples of the present disclosure is illustrated, the optical module including a light emitter 104b and a light detector 306 (hereinafter also referred to as PD 306 ) that can be utilized by a partial optical occlusion detection circuit.

[0051] exist Figure 3A In FIG. 3 , the optical module 302 includes a light emitter 104 b (eg, an infrared emitting LED) and a photodiode (PD) 306. Figure 3A3, the light emitter 104b and the PD 306 are both below the housing 290 of the input device 100 and are optionally at a given lateral distance from each other. It should be noted that the light emitter 104b and the PD 306 can be internal components (e.g., inside or below the housing 290 in the orientation shown in FIG. 3), external components on the surface of the housing 290, or embedded in the housing 290. In some examples, the light emitter 104b and the PD 306 are arranged differently in the optical module 302. In some examples, the light emitter 104b and the PD 306 are not in the same optical module, but in different optical modules. In some examples, the light emitter 104b and / or the PD 306 include a lens / lens array and / or other features. In some examples, the PD 306 includes a complementary metal oxide semiconductor (CMOS) image sensor or a single photon avalanche detector (SPAD) array. The PD 306 is optionally configured to detect light emitted by the light emitter 104b. For example, PD 306 is optionally configured to detect the wavelength of light emitted by light emitter 104b, which wavelength is optionally infrared. Optionally, PD 306 optionally detects ambient light in addition to light from light emitter 104b.

[0052] exist Figure 3A In response to driving the light emitter 104b, light is emitted from the light emitter 104b. Some of the light emitted from the light emitter 104b is reflected into the PD 306. Figure 3A , optical path 310 represents a baseline signal detected at PD 306 that is not due to light reflection from objects external to housing 290 of the input device, but is optionally due to crosstalk (e.g., light that is optionally reflected into PD 306 due to internal characteristics rather than due to reflection from external objects). Optical path 314 corresponds to light emitted from optical emitter 104b that exits housing 290 of input device 100. Optical path 312 corresponds to light emitted from optical emitter 104b that is reflected back to PD 306 due to an object external to housing 290 (e.g., due to being incident on a surface of an object external to housing 290 and within a threshold distance (e.g., 1 mm, 2 mm, 4 mm, 5 mm, 1 cm, 1.5 cm, 2 cm, 3 cm, or another distance from the housing of the input device) that reflects light back to housing 290. It should be noted that PD 306 optionally receives ambient light 316 (eg, light originating from outside of input device 100 , optionally assuming sufficient transparency of housing 290 to be sensitive to ambient light).

[0053] In some examples, the optical module 302 includes one or more additional or alternative light emitters that are not driven by the example computing system 148 for detection; these additional or alternative light emitters are optionally driven to emit light of a specific wavelength that is sensitive to a specific type of object (e.g., skin) that reflects the specific wavelength, such as a light-based proximity sensor described in U.S. Pat. No. 11,109,136, which is incorporated herein by reference. In addition, other light emitters and / or light sensors can be used for proximity sensing or ranging to sense or range external objects or for laser pointer / flashlight functionality (or another type of light emitter / sensor functionality) without being configured for spatial tracking.

[0054] It should be noted that in some examples, each of the light emitters 104a-104h is paired with a corresponding single light detector. In some examples, one or more light emitters 104a-104h are associated with more than one light detector. Similarly, in Figure 3A The relative distance between the light emitter 104b and the PD 306 and the relative placement of the light emitter 104b and the PD 306 are representative (e.g., non-limiting), and other distances and / or relative placements are also considered to be within the scope of the present disclosure. In some examples, the light emitters and light detectors of the input device for local optical occlusion detection are equal in number. In some examples, the light emitters and light detectors of the input device for local optical occlusion detection are not equal in number. For example, a light emitter is optionally paired with one or more light detectors. For another example, a light detector is optionally paired with one or more light emitters.

[0055] Figure 3B An example graph 320 is illustrated of the amount of light detected at PD 306 in response to light emission from light emitter 104b as a function of the distance of an object outside the housing of the input device (and optionally intersecting the light path corresponding to light emitted from light emitter 104b) in accordance with some examples of the present disclosure.

[0056] exist Figure 3B , line 322 corresponds to the amount of light detected at PD 306 that is due to crosstalk (e.g., crosstalk that is reflected by or in the housing and does not leave the housing to the external environment), such as described above. Figure 3A310, and line 324 corresponds to a threshold amount of light detected at PD 306, above which a partial optical occlusion detection circuit on the input device 100 determines that the light emitter 104b is optically occluded by an object external to the housing of the input device 100. In some examples, line 324 is modulated based on an ambient light level. For example, based on determining that the ambient light level is a first amount (e.g., in response to detecting that the ambient light level is the first amount), the threshold for triggering partial optical occlusion detection is the first amount, and based on determining that the ambient light level is a second amount greater than the first amount, the threshold for triggering partial optical occlusion detection is the second amount greater than the first amount.

[0057] As shown in the example graph 320, as the distance of the object (e.g., a finger, a table, and / or another object reflective to the emitter wavelength) from the housing of the input device 100 decreases, the amount of light entering the PD 306 exceeds a threshold amount of light. Based on determining that the amount of light entering the PD 306 exceeds the threshold, the input device 100 (e.g., an optical occlusion detection circuit on the input device) optionally determines that the light emitter 104b is partially optically occluded by an object external to the housing of the input device. Line 326 optionally defines a threshold distance of an external object at which the light emitter is determined to be optically occluded by the external object. It should be noted that in the example shown, the input device detects partial optical occlusion when the object is not in contact with the housing of the input device (e.g., the object is 1 mm, 2 mm, 4 mm, 5 mm, 1 cm, 1.5 cm, 2 cm, 3 cm, or another threshold distance from the housing of the input device). In this way, in addition to external objects in contact with the input device, the input device can also detect partial optical occlusion at the input device due to objects that are not necessarily in contact with the input device.

[0058] In some examples, the input device initiates partial optical occlusion detection circuitry when the input device is activated (e.g., not when the input device is off, unpaired with the computer system, or deactivated) and / or held (e.g., held or stationary by a user) for a threshold time period (e.g., 0.2s, 0.5s, 1s, 3s, 5s, 12s, or another threshold time period). In some examples, the input device initiates partial optical occlusion detection in response to input from the computing system 200 (e.g., communicated via wired or wireless communication therebetween). For example, the computing system 200 optionally includes one or more cameras that detect that the input device is being held by a user, and the computing system 200 then sends a request to the input device to initiate partial optical occlusion detection and / or generate light clusters for spatial tracking.

[0059] exist Figure 4A, the input device 100 has optionally initiated a local optical occlusion detection circuit, optionally in response to input from the computing system 200 indicating that the input device is held in the user's hand 402. In response to the initiation, the input device 100 optionally operates the optical module in a second mode (e.g., a sniffing mode) to detect whether any of the light emitters 104a-104h is optically occluded on the handheld input device. For example, the input device 100 optionally drives the light emitters 104a-104h simultaneously or sequentially at a lower power for the second mode than the power used for spatial tracking (e.g., optical tracking from outside to inside) in the first mode. The respective PDs of the input device 100 optionally capture light from the respective light emitters, and the input device 100 optionally transmits the captured light data corresponding to the respective PDs of the input device 100 to the optical occlusion sensing circuit. When the input device 100 determines that there is a partial optical occlusion based on the captured light data corresponding to the corresponding PD of the input device 100, the input device 100 optionally abandons driving (e.g., abandons driving for optical tracking from outside to inside) the light emitter corresponding to the corresponding PD or maintains the operation of the light emitter in a low power mode, thereby saving power on the input device 100. For example, in Figure 4A , the hand 402 of the user holding the input device 100 optically blocks light from a light emitter at a particular position relative to the input device 100 (e.g., at a position where the hand 402 covers the input device 100). The input device 100 optionally determines that there is a local optical occlusion on the input device 100, and optionally abandons driving (e.g., abandons driving for optical tracking from outside to inside) the blocked light emitter determined to be locally optically blocked based on data from the corresponding PD, such as Figure 5A , and optionally driving light emitters 104a, 104b, 104d, 104h, and 104e in an optical tracking mode because these light emitters are not optically obscured. Figure 5A In the embodiment, light emitters 104c, 104f and 104g are illuminated by external objects (e.g. Figure 4A In the same hand posture Figure 5A Fingers of hand 402 in the figure) are optically obscured and, optionally, driven at a different duty cycle or intensity than the unobstructed light emitters 104a, 104b, 104d, 104h and 104e.

[0060] In addition, the input device optionally uses occlusion information to estimate hand gestures. For example, the input device optionally operates light emitters 104a-104h in a second mode to determine which light emitters are optically occluded at the input device, and then aggregates occlusion information corresponding to the occluded light emitters to determine how the user is holding the input device.

[0061] Figure 4B and Figure 5B Another example of intelligent cluster driving for tracking input device 100 is illustrated. Figure 4B In the embodiment of the present invention, the input device 100 has optionally activated a local optical occlusion detection circuit, optionally in response to input from the computing system 200 indicating that the input device is held in the hand of the user. In response to the activation, the input device optionally operates the optical module in a second mode (e.g., a sniffing mode) to detect whether any of the light emitters 104a-104h is optically occluded on the handheld input device. For example, the input device optionally drives the light emitters 104a-104h simultaneously or sequentially at a lower power for the second mode than for spatial tracking (e.g., optical tracking from outside to inside). The corresponding PD of the input device 100 optionally captures light from the light emitters, and the input device 100 optionally transmits the captured light data corresponding to the corresponding PD of the input device 100 to the optical occlusion sensing circuit. When the input device determines that there is a partial optical occlusion based on the captured light data corresponding to the corresponding PD of the input device 100, the input device 100 optionally abandons driving (e.g., abandons driving for optical tracking from outside to inside) the light emitter corresponding to the corresponding PD or maintains the operation of the light emitter in a low power mode, thereby saving power on the input device 100. For example, in Figure 4B , a user's hand 402 holding the input device occludes light from some light emitters at a particular location relative to the input device 100 (e.g., at a location where the hand 402 covers the input device 100). The input device 100 optionally determines that there is a local optical occlusion on the input device 100, and optionally abandons driving (e.g., abandons driving for outside-in optical tracking) light emitters determined to be locally optically occluded based on data from the corresponding PD, such as Figure 5B , and optionally driving light emitters 104b-104f and 104h in an optical tracking mode because these light emitters are not optically obscured. Figure 5B In the embodiment, light emitters 104a and 104g are illuminated by external objects (e.g. Figure 4B In the same hand posture Figure 5B Fingers of hand 402 in the image are optically obscured and, optionally, driven at a different duty cycle or intensity than the unobstructed light emitters 104b-104f and 104h.

[0062] In addition, the input device optionally uses occlusion information to estimate hand gestures. For example, the input device optionally operates light emitters 104a-104h in a second mode to determine which light emitters are optically occluded at the input device, and then aggregates occlusion information corresponding to the occluded light emitters to determine how the user is holding the input device.

[0063] In some examples, the light emitters may dynamically enter or exit the outside-in tracking mode based on the hand posture, regardless of whether the light emitters are partially optically occluded. For example, when the input device 100 is being held in a first hand posture, one or more light emitters are optionally facing away from and invisible to the camera of the computing system 200, which involves outside-in optical tracking of the input device, and operating these light emitters that are not visible to the camera in the spatial tracking mode may waste power. Therefore, in some examples, when the input device 100 is not visible to the computer system (even if the light emitters of the input device do not have partial occlusion from objects within the detection distance of the light emitters), the input device optionally abandons driving the light emitters in the outside-in tracking operation mode. When one or more light emitters are not facing away from and / or visible to the camera of the computing system 200, the light emitters may be driven. In some examples, even when the light emitters are facing away from the camera of the computing system 200, the light emitters are optionally not driven, regardless of whether they are optically occluded by external objects within a threshold distance of the input device 100.

[0064] Sometimes, the user changes the hand posture when operating the input device. When the user changes the hand posture, different light emitters may become optically blocked, while other light emitters may become un-optically blocked. For example, when the hand 402 is in Figure 5A In the posture shown, light emitter 104a is not optically obscured and is therefore optionally driven for spatial tracking of the input device (e.g., outside-in optical tracking), and when hand 402 is in Figure 5B In the gesture shown, light emitter 104a is optically obscured and, therefore, optionally is not driven for spatial tracking of the input device, but is in a second mode that is different from the spatial tracking mode and optionally lower in power consumption than the spatial tracking mode of light emitter 104a. Therefore, input device 100 optionally dynamically updates the operating mode of the corresponding light emitter based on whether the corresponding light emitter is determined to be optically obscured by an external object.

[0065] Figure 6 A block diagram 600 of an optical occlusion detection system 601 according to some examples of the present disclosure is illustrated. The optical occlusion detection system 601 includes a device for optionally driving one or more light emitters 604 (eg, Figure 1The optical occlusion detection system 601 includes a driver circuit 602 for driving the optical emitters 104a-104h) in a second operating mode to drive the optical emitters at a first duty cycle and intensity. The second duty cycle and intensity are optionally lower than the second duty cycle and intensity corresponding to the first operating mode, in which the optical emitters are driven for spatial tracking of the input device 100 (e.g., optical tracking from outside to inside). In response to light emissions from one or more optical emitters, some light from the one or more optical emitters passes through the housing of the input device, exits the housing of the input device 100 and is reflected back into the housing of the input device via a reflective object such as a finger or another type of object, and then exits the housing of the input device into the PD 606. It should be noted that the PD 606 optionally detects light from multiple light emitters and is optionally used to determine whether one or more of the multiple light emitters are partially optically occluded by one or more objects outside the housing of the input device. At box 608, the optical occlusion detection system 601 also includes a local optical occlusion detection circuit that receives the captured light data from the corresponding PD and compares the light data with a local optical occlusion detection circuit such as a local optical occlusion detection circuit. Figure 3B In response to determining that the light data exceeds the threshold, the system optionally determines that the light emitter is optically obscured by an object external to the housing of the input device, and optionally abandons driving at a first duty cycle and intensity that is higher than a second duty cycle and intensity. In response to determining that the light data does not exceed the threshold (such as Figure 3B occlusion threshold), the system optionally determines that the light emitter is not optically obscured by an object outside the housing, and optionally initiates a process of driving the light emitter that is not optically obscured at a duty cycle or intensity that is higher than a second duty cycle or intensity.

[0066] Figure 7 A flow chart of a method 700 for detecting partial optical occlusion of an input device according to some examples of the present disclosure is illustrated. In some examples, the method 700 is performed at a handheld electronic device including one or more light emitters and one or more light detectors.

[0067] Method 700 includes driving (702) one or more light emitters, such as Figure 3A The method 700 includes detecting, via one or more light detectors (such as Figure 3A The method 700 includes determining (706) based on the amount of light detected via the first light detector that a first light emitter of the one or more light emitters is optically blocked by an object external to the housing of the handheld electronic device, such as a reference Figure 4A and Figure 5A As described.

[0068] In some examples, a local optical occlusion detection circuit determines a local optical occlusion at a light emitter of an input device without driving the light emitter on the input device. In some examples, a light detector detects an ambient light level, and the captured light data is transmitted to the local optical occlusion detection circuit. In some examples, the local optical occlusion detection circuit compares the amount of ambient light detected via the light detector, and based on a determination that the light detector indicates a low ambient light level compared to the amount of ambient light detected via one or more other light detectors, the input device determines that a light emitter that is close (e.g., in the same optical module as the light detector or within a threshold distance (e.g., 1 mm, 2 mm, 3 mm, 4 mm, 5 mm, 6 mm, 7 mm, 1 cm, or another threshold distance) of the light detector) is locally optically occluded. In some examples, the local optical occlusion detection circuit can dynamically change the amount of power utilized by a light emitter operating in an outside-to-in tracking mode based on the ambient light level. For example, based on a determination that the amount of ambient light detected by the light detector is a first amount, input device 100 optionally drives the light emitter at a first duty cycle and / or intensity for spatial tracking, and based on a determination that the amount of ambient light detected by the light detector is a second amount greater than the first amount, input device 100 optionally drives the light emitter at a second duty cycle and / or intensity greater than the first duty cycle and / or intensity for spatial tracking. Thus, the input device can optionally optimize the light emitter for operation in the outside-in tracking mode.

[0069] Therefore, according to the above, some examples of the present disclosure relate to a method. The method is optionally performed at a handheld electronic device including one or more light emitters and one or more light detectors. The method includes: driving one or more light emitters; detecting one or more light quantities via one or more light detectors; and determining that a first light emitter of one or more light emitters is optically blocked by an object outside the housing of the handheld electronic device based on a first light quantity of one or more light quantities detected via a first light detector in one or more light detectors. Additionally or alternatively, in some examples, the method includes: driving one or more light emitters; detecting one or more light quantities via one or more light detectors; and determining whether a first light emitter of one or more light emitters is optically blocked by an object outside the housing of the handheld electronic device based on a first light quantity of one or more light quantities detected via a first light detector in one or more light detectors; including determining that the first light emitter is optically blocked by an object outside the housing of the handheld electronic device based on a determination that the first light quantity detected via the first light detector is higher than a threshold light quantity, and determining that the first light emitter is not optically blocked by an object outside the housing of the handheld electronic device based on a determination that the first light quantity detected via the first light detector is lower than a threshold light quantity. Additionally or alternatively, in some examples, determining that the first light emitter is optically obscured by an object outside the housing of the handheld electronic device based on a first amount of light detected via the first light detector includes determining that the first light emitter is optically obscured by an object outside the housing of the handheld electronic device based on a determination that the amount of light detected via the first light detector is higher than a threshold amount of light. Additionally or alternatively, the threshold amount of light is based at least on an amount of ambient light optionally detected by one or more light detectors (e.g., before the one or more light detectors detect light from the one or more light emitters). Additionally or alternatively, in some examples, the method includes abandoning driving the first light emitter for spatial tracking of the handheld electronic device and / or a second light emitter different from the first light emitter for spatial tracking of the handheld electronic device in response to determining that the first light emitter is optically obscured by an object outside the housing of the handheld electronic device. Additionally or alternatively, in some examples, driving one or more light emitters includes driving the one or more light emitters at a first intensity or a first duty cycle, and the method includes performing an operation with respect to a first light emitter determined to be optically obscured by an object external to a housing of the handheld electronic device, including driving the first light emitter at a second intensity or a second duty cycle that is different from the first intensity or the first duty cycle (e.g., greater than the first intensity or the first duty cycle). Additionally or alternatively, in some examples, the one or more light emitters are driven at a first intensity, and the first intensity of the one or more light emitters is based on an ambient light level detected by one or more light detectors.Additionally or alternatively, in some examples, driving one or more light emitters includes driving one or more light emitters simultaneously. Additionally or alternatively, in some examples, the method includes estimating the posture of the hand in contact with the handheld electronic device based at least on one or more determined optically obscured light emitters (including a first light emitter determined to be optically obscured). Additionally or alternatively, in some examples, the method includes estimating the posture of the hand in contact with the handheld electronic device based at least on one or more light emitters that are not optically obscured (e.g., light emitters determined to be not optically obscured). Additionally or alternatively, in some examples, one or more light emitters are driven at a first duty cycle or a first intensity, and the method includes determining that the first light emitter is not optically obscured by an object outside the housing of the handheld electronic device or another object different from the object based on a second amount of light detected via a first light detector, and in response to determining that the first light emitter is not optically obscured, driving the first light emitter at a second duty cycle or a second intensity greater than the first duty cycle or the first intensity. Some examples of the present disclosure relate to a non-transitory computer-readable storage medium storing instructions configured to be executed by one or more processors of the system to cause the processor to perform any of the above methods.

[0070] Some examples of the present disclosure relate to a handheld electronic device. The handheld electronic device may include one or more light emitters, one or more light detectors, and a processing circuit, the processing circuit being configured to: drive the one or more light emitters; detect one or more light quantities via one or more light detectors; and determine that the first light emitter of the one or more light emitters is optically blocked by an object outside the housing of the handheld electronic device based on the first light quantity of the one or more light quantities detected by the first light detector of the one or more light detectors. Additionally or alternatively, in some examples, the handheld electronic device includes a housing. One or more light emitters are in or within the housing, and the housing is at least partially transparent to one or more light wavelengths of the one or more light emitters. Additionally or alternatively, in some examples, the one or more light emitters and the one or more light detectors are equal in number. Additionally or alternatively, in some examples, the one or more light emitters and the one or more light detectors are not equal in number (for example, the one or more light emitters are greater in number or less in number than the one or more light detectors). Additionally or alternatively, in some examples, the one or more light emitters and the one or more light detectors are in different optical modules and connected to the driving circuit and the sensing circuit by a flexible circuit. Additionally or alternatively, in some examples, one or more light emitters and one or more light detectors are in a single optical module along with drive circuitry and sensing circuitry. Additionally or alternatively, in some examples, the handheld electronic device includes one or more additional light emitters that are different from the one or more light emitters, and one or more additional light detectors that are different from the one or more light detectors. Additionally or alternatively, in some examples, one or more additional light emitters and one or more additional light detectors are configured to perform drive functions and / or sensing functions that are different from the one or more light emitters and one or more light detectors. For example, one or more light emitters and one or more light detectors are optionally used for spatial tracking, while one or more additional light emitters and one or more additional light detectors are optionally configured for proximity sensing or ranging, without including a mode in which they are configured for spatial tracking of the handheld electronic device and / or are not tuned for detecting close-range optical occlusion of a light emitter (e.g., an LED).

[0071] Some examples of the present disclosure relate to a system, the system including a handheld electronic device, the handheld electronic device including one or more light emitters, one or more light detectors, and a processing circuit, the processing circuit being configured to: drive the one or more light emitters; detect one or more light quantities via the one or more light detectors; and determine, based on a first light quantity of the one or more light quantities detected via a first light detector in the one or more light detectors, that a first light emitter of the one or more light emitters is optically blocked by an object outside the housing of the handheld electronic device. The system optionally also includes a second electronic device in communication with the handheld electronic device, the second electronic device including a sensor, the sensor including one or more sensors configured to detect a spatial position of the handheld electronic device relative to the second electronic device. Additionally or alternatively, in some examples, the second electronic device is configured to send an input to the handheld electronic device in response to the second electronic device detecting that the handheld electronic device is in contact with a user's hand. Additionally or alternatively, in some examples, the processing circuit is configured to abandon driving the first light emitter for spatial tracking of the handheld electronic device and / or a second light emitter different from the first light emitter for spatial tracking of the handheld electronic device in response to determining that the first light emitter is optically blocked by an object outside the housing of the handheld electronic device. Additionally or alternatively, in some examples, driving one or more light emitters includes driving one or more light emitters at a first intensity or a first duty cycle, and the processing circuit is configured to perform operations with respect to a first light emitter determined to be optically obscured by an object external to a housing of the handheld electronic device, including driving the first light emitter at a second intensity or a second duty cycle different from the first intensity or first duty cycle.

[0072] Although the examples of the present disclosure have been fully described with reference to the accompanying drawings, it should be noted that various changes and modifications will become apparent to those skilled in the art. It should be understood that such changes and modifications are understood to be included within the scope of the examples of the present disclosure defined by the appended claims.

Claims

1. A method, comprising: At a handheld electronic device comprising one or more light emitters and one or more light detectors: driving the one or more light emitters; detecting one or more light quantities via the one or more light detectors; as well as Based on a first light quantity of the one or more light quantities detected via a first light detector of the one or more light detectors, it is determined that a first light emitter of the one or more light emitters is optically obscured by an object external to a housing of the handheld electronic device.

2. The method of claim 1 , wherein determining that the first light emitter is optically obscured by the object external to the housing of the handheld electronic device based on the first amount of light detected via the first light detector comprises: Based on a determination that the first amount of light detected via the first light detector is above a threshold amount of light, it is determined that the first light emitter is optically obscured by the object external to the housing of the handheld electronic device.

3. The method according to claim 1, comprising: When it is determined that the first light emitter is optically blocked by the object outside the housing of the handheld electronic device, driving the first light emitter for spatial tracking of the handheld electronic device and / or using a second light emitter different from the first light emitter for spatial tracking of the handheld electronic device is abandoned.

4. The method of claim 3, wherein driving the one or more light emitters comprises driving the one or more light emitters at a first intensity or a first duty cycle, and wherein the method comprises: Performing operations with respect to the first light emitter determined to be optically obscured by the object external to the housing of the handheld electronic device includes driving the first light emitter at a second intensity or a second duty cycle different from the first intensity or the first duty cycle. 5 . The method of claim 1 , wherein the one or more light emitters are driven at a first intensity, and wherein the first intensity of the one or more light emitters is based on an ambient light level detected by the one or more light detectors. The method of claim 1 , wherein driving the one or more light emitters comprises driving the one or more light emitters simultaneously.

7. A method according to claim 1, comprising estimating a posture of a hand in contact with the handheld electronic device based at least on one or more determined optically obscured light emitters, wherein the one or more determined optically obscured light emitters include the first light emitter determined to be optically obscured.

8. The method of claim 1 , wherein the one or more light emitters are driven at a first duty cycle or a first intensity, and wherein the method comprises: determining, based on a second amount of light detected via the first light detector, that the first light emitter is not optically obscured by the object, or another object different from the object, external to the housing of the handheld electronic device; as well as In response to determining that the first light emitter is not optically obscured, the first light emitter is driven at a second duty cycle or a second intensity that is greater than the first duty cycle or the first intensity.

9. A handheld electronic device, comprising: one or more light emitters; one or more light detectors; as well as A processing circuit, the processing circuit being configured to: driving the one or more light emitters; detecting one or more light quantities via the one or more light detectors; as well as Based on a first light quantity of the one or more light quantities detected via a first light detector of the one or more light detectors, it is determined that a first light emitter of the one or more light emitters is optically obscured by an object external to a housing of the handheld electronic device.

10. The handheld electronic device according to claim 9, comprising: A housing, wherein the one or more light emitters are in or within the housing, and wherein the housing is at least partially transparent to one or more wavelengths of light of the one or more light emitters.

11. The handheld electronic device of claim 9, wherein the one or more light emitters and the one or more light detectors are equal in number.

12. The handheld electronic device of claim 9, wherein the one or more light emitters and the one or more light detectors are unequal in number.

13. The handheld electronic device of claim 9, wherein the one or more light emitters and the one or more light detectors are in different optical modules and connected to the driving circuit and the sensing circuit via a flexible circuit.

14. The handheld electronic device of claim 9, wherein the one or more light emitters and the one or more light detectors are in a single optical module along with drive circuitry and sensing circuitry.

15. The handheld electronic device according to claim 9, comprising: one or more additional light emitters different from the one or more light emitters; as well as one or more additional light detectors different from the one or more light detectors; Wherein the one or more additional light emitters and the one or more additional light detectors are configured to perform a driving function and / or a sensing function different from that of the one or more light emitters and the one or more light detectors.

16. A system, comprising: A handheld electronic device, comprising: one or more light emitters, one or more light detectors, and A processing circuit, the processing circuit being configured to: driving the one or more light emitters; detecting one or more light quantities via the one or more light detectors; and determining, based on a first light quantity of the one or more light quantities detected via a first light detector of the one or more light detectors, that a first light emitter of the one or more light emitters is optically obscured by an object external to a housing of the handheld electronic device; and a second electronic device in communication with the handheld electronic device, the second electronic device comprising a sensor, the sensor comprising one or more sensors configured to detect a spatial position of the handheld electronic device relative to the second electronic device, The handheld electronic device is configured to drive the one or more light emitters in response to input from the second electronic device.

17. The system of claim 16, wherein the second electronic device is configured to send the input to the handheld electronic device in response to the second electronic device detecting that the handheld electronic device is in contact with a hand of a user.

18. The system of claim 16, wherein the processing circuit is configured to: In response to determining that the first light emitter is optically obscured by the object external to the housing of the handheld electronic device: Driving the first light emitter for spatial tracking of the handheld electronic device is abandoned and / or a second light emitter different from the first light emitter is used for spatial tracking of the handheld electronic device.

19. The system of claim 16, wherein driving the one or more light emitters comprises driving the one or more light emitters at a first intensity or a first duty cycle, and wherein the processing circuit is configured to: Performing operations with respect to the first light emitter determined to be optically obscured by the object external to the housing of the handheld electronic device includes driving the first light emitter at a second intensity or a second duty cycle different from the first intensity or the first duty cycle.

20. The system of claim 16, wherein the one or more light emitters are driven at a first intensity, and wherein the first intensity of the one or more light emitters is based on an ambient light level detected by the one or more light detectors.

21. A handheld electronic device, comprising: one or more light emitters; one or more light detectors; as well as Processing circuitry, wherein the handheld electronic device is configured to perform the method according to any one of claims 1 to 8.

22. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by one or more processors, cause a handheld electronic device to perform the method according to any one of claims 1 to 8.

Images