System and method for monitoring with handheld controller

Abstract

A method of exercise tolerant optical heart rate monitoring may include calibrating an array of heart rate sensors of a handheld device by (i) evaluating an output of each sensor in the array of sensors while the handheld device is held by a user, (ii) selecting a subset of sensors in the array of sensors based on the evaluation of the output of each sensor, and (iii) calibrating the heart rate sensor array of the handheld device based on the selected subset of sensors. And (iii) monitoring the heart rate of the user using the subset of sensors. Various other methods, systems, and computer readable media are also disclosed.

Description

Cross-reference to related applications

[0001] This application claims priority to U.S. Application No. 63 / 520,389, filed August 18, 2023, the disclosure of which is incorporated herein by reference in its entirety. Attached Figure Description

[0002] The accompanying drawings illustrate several exemplary embodiments and are part of this specification. These drawings, together with the following description, demonstrate and explain various principles of this disclosure.

[0003] Figure 1 This is a diagram of an example system architecture for exercise tolerance heart rate monitoring, characterized by the physical connection between a sensor array and a controller.

[0004] Figure 2 This is a diagram illustrating an example configuration of a sensor array.

[0005] Figure 3 This is a flowchart of an example method for monitoring exercise tolerance heart rate.

[0006] Figure 4 This is a diagram of an example controller with an integrated sensor array facing the palm.

[0007] Figure 5 This is an illustration of an example hand that is grasped and has an integrated sensor array facing the palm of the hand.

[0008] Figure 6 This is an illustration of an example controller that includes a sensor array integrated into the controller's battery cover.

[0009] Figure 7 This is an illustration of an example controller that includes a gripping cap with an integrated sensor array.

[0010] Figure 8 This is an illustration of an example hand, including an array of sensors for heart rate monitoring.

[0011] Figure 9 This is a diagram showing example output readings of each of the multiple sensors in a sensor array.

[0012] Figure 10 This is an illustration of an example hand containing a sensor array during moderate-intensity boxing, highlighting the sensor in the upper left corner of the hand.

[0013] Figure 11 This is an illustration of an example sensor output reading in the upper left corner of the palm during moderate-intensity boxing.

[0014] Figure 12This is an illustration of an example palm containing a sensor array during moderate-intensity boxing, highlighting the sensors on the bottom of the palm.

[0015] Figure 13 This is an illustration of example sensor output readings from the bottom of the palm during moderate-intensity boxing.

[0016] Figure 14 This is an illustration of an example palm containing a sensor array during moderate-intensity boxing, highlighting the sensor in the upper right corner of the palm.

[0017] Figure 15 This is an illustration of the sample sensor output in the upper right corner of the palm during moderate-intensity boxing.

[0018] Figure 16A and Figure 16B A handheld controller with monitoring capabilities such as fitness data monitoring is shown according to an additional embodiment of the present disclosure.

[0019] Figure 17 This is an exploded perspective view of a portion of a handheld controller according to at least one embodiment of the present disclosure.

[0020] Figure 18 A system for monitoring (e.g., for monitoring fitness data and / or health data) using a handheld controller is shown according to at least one embodiment of the present disclosure.

[0021] Figure 19 Illustrations of example virtual reality headsets used in conjunction with various embodiments of this disclosure.

[0022] Throughout the accompanying drawings, the same reference numerals and descriptions indicate similar but not necessarily identical elements. While the exemplary embodiments described herein are readily adaptable to various modifications and alternatives, several specific embodiments are illustrated in the drawings by way of example, and these specific embodiments will be described in detail herein. However, the exemplary embodiments described herein are not intended to limit one to the particular forms disclosed. Rather, this disclosure covers all modifications, equivalents, and alternatives falling within the scope of the appended claims. Detailed Implementation

[0023] Many users currently track their personal health and fitness goals by monitoring their heart rate daily. Currently, using a smartwatch with an integrated heart rate monitor is very convenient for tracking a user's heart rate. However, the lower perfusion in the wrist when wearing a smartwatch doesn't always contribute to obtaining the most accurate heart rate readings. Therefore, leveraging the fact that the palm has higher perfusion than the wrist, using a virtual reality / artificial reality (VR / AR) controller held in the palm of the hand for heart rate monitoring could be advantageous.

[0024] This disclosure generally relates to a method for motion tolerance optical heart rate monitoring in a VR / AR controller. A major challenge in integrating heart rate monitoring into a VR / AR controller is the user's constantly changing grip, different geometry of the user's hand and palm, and constant motion during controller use. To address these challenges, the system described herein can use a photoplethysmography (PPG) sensor array to probe a large area of ​​the palm to dynamically select the optimal sensing location. For example, the system described herein can recalibrate the sensor array to find different sensing locations in response to detected movement or pressure from the controller.

[0025] Based on the general principles described herein, multiple features from any of the various embodiments described herein can be used in combination with each other. These and other embodiments, features, and advantages will be more fully understood when reading the following detailed description in conjunction with the accompanying drawings and claims.

[0026] refer to Figures 1 to 15 The integrated PPG sensor array in a VR / AR controller for exercise tolerance heart rate monitoring will be described in detail below. Figure 1 The corresponding discussion illustrates an example system architecture characterized by communication between sensors and controllers. Figure 2 The corresponding discussion illustrates an example embodiment of the sensor array. (And...) Figure 3 The corresponding discussion provides a detailed description of methods for monitoring exercise tolerance heart rate in VR / AR controllers. (And...) Figures 4 to 8 The corresponding discussion highlights various example configurations of palm-facing sensors integrated into the controller. Figures 9 to 15 The corresponding discussion details the sensor's output readings during moderate-intensity exercise. The discussion corresponding to Figure 16 illustrates a VR / AR headset that can be used in conjunction with embodiments of this disclosure.

[0027] Figure 1This is a diagram of an example system architecture for exercise tolerance heart rate monitoring, characterized by a physical connection between a sensor array and a controller. Bluetooth device 102 provides a harbor for communication between the sensor array 106 and the controller 112. The term "controller" can refer to a controller that helps a user perform certain actions in a virtual world. Examples of Bluetooth devices may include, but are not limited to, sensors, remote controls, fitness trackers, etc. Bluetooth device 102 may include a microprocessor 104, sensor array 106, and accelerometer 108. According to some embodiments, the physical connection between Bluetooth device 102 and controller 112 may represent the integration of Bluetooth device 102 within controller 112. In one embodiment, such as... Figure 1 The physical connection shown can represent the integration of Bluetooth device 102 within head-mounted device 110.

[0028] Figure 2 This is an illustration of an example configuration of a sensor array in a controller. For example, the system described in this article can be configured as follows: Figure 2 The three different embodiments of sensor 204 shown are used to represent arrays of sensor 202. The term "sensor" broadly refers to a device that detects and measures heart rate or pulse rate for heart rate monitoring. Examples of sensors used for heart rate monitoring may include, but are not limited to, electrical sensors known as electrocardiography (ECG) or optical sensors known as photoplethysmography (PPG). In one embodiment, a PPG sensor may include a light-emitting diode (LED) to measure volume changes in blood circulation within the skin. Sensor 204 may represent three different embodiments of the array constituting sensor 202. For example, sensor 204 may include a 1×5 array, a 2×5 array, a 4×4 array, etc.

[0029] Figure 3 This is a flowchart of an example method 302 for monitoring exercise tolerance heart rate. In some embodiments, the steps shown herein can execute any suitable computer-executable code and / or computing system. In one example, Figure 3 Each of the multiple steps shown can represent an algorithm whose structure includes and / or is represented by multiple sub-steps, examples of which will be provided in more detail below.

[0030] Method 302 includes several steps involved in the exercise tolerance heart rate monitoring process. For example... Figure 3As shown, one or more of the systems described herein can determine the optimal sensing location for heart rate monitoring. For example, one or more of the systems described herein can select the optimal sensor from a sensor array. As mentioned above, the sensor array can be part of a controller or head-mounted device for heart rate monitoring.

[0031] In step 304, the system described herein can activate all sensor locations used for light-emitting diode-photodiode (LED-PD) detection and motion detection. For example, the sensor array can be activated to determine the optimal sensing location by calibrating the PPG sensor, thereby detecting the user's heart rate at a location where the best signal can be provided. In some embodiments, the PPG sensor in the PPG sensor array can be activated in response to the detection of external motion from the controller.

[0032] Furthermore, when the user holds the controller, the signal quality of the output of each sensor can be evaluated. In step 306, the system described herein can, based on the strength of the signal quality, shut down selected channels of sensors that may not be in suitable sensing locations. The system described herein can, based on an evaluation of the signal output of the remaining sensors in the array, select the channel of the sensor in the most suitable location. In step 308, the channel of the selected sensor can be turned on for heart rate monitoring. In some embodiments, an algorithm calibrated for a specific movement (based on pattern, program, etc.) is enabled for heart rate monitoring.

[0033] In step 310, the sensor array may be recalibrated due to various factors that may occur during heart rate monitoring. For example, a change in motion above a predetermined threshold during heart rate monitoring may prompt the sensor to recalibrate in response to detected movement. In one embodiment, the sensor may be recalibrated to determine a new sensing location with better signal quality, away from the detected movement. In other embodiments, in step 310, the sensor array may be recalibrated in response to determining that a predetermined amount of time has elapsed since the sensor's previous calibration. In some embodiments, in step 310, the cardiac sensor array may be recalibrated in response to poor signal quality during heart rate monitoring.

[0034] Figure 4 This is an illustration of an example controller with an integrated heart rate sensor that can face the palm. In some embodiments, controller 402 may include a heart rate sensor that is already located at sensor location 404. The sensor at sensor location 404 may be integrated into the palm of the controller for convenient detection of the user's grip, thereby enabling heart rate monitoring. Figure 5This is an illustration of an example hand that a user grips, with sensors integrated into the controller facing the palm. The controller 504 may inherently include a heart rate sensor, with the sensor facing the palm of the hand 502. The hand 502 may position itself to grip the controller 504, with a sensor array integrated within the controller 504 spanning the hand 502.

[0035] Figure 6 This is an illustration of an example controller that integrates a heart rate sensor in a palm-facing battery cover. For example, controller 602 may include a battery cover 604 with a palm-facing heart rate sensor integrated. Figure 7 This is an illustration of an example controller with a heart rate sensor integrated into a grip cover. In some embodiments, controller 702 may include grip cover 704 having a heart rate sensor 702 integrated therein. In other embodiments, grip cover 704 may include a sensor 706 in an area of ​​controller 702 that can be gripped by a hand for greater detectability.

[0036] Figure 8 This is an illustration of an example user's palm, including a sensor array for heart rate monitoring. Sensor 804 can span the user's palm 802 to evaluate which sensor can provide the best signal. In some embodiments, during the calibration of sensor 804, the user can perform a movement instructed to determine the optimal sensing position. As previously... Figure 3 As shown, when evaluating the sensor's output readings, the sensor channel with the best signal quality is opened for heart rate monitoring. In some embodiments, the sensor 802 can be adapted to different hand geometries across the user to ensure the most accurate heart rate monitoring, regardless of the length, width, or size of the hand.

[0037] Figure 9 This is an illustration of an example output reading from a heart rate sensor. Output reading 902 may include readings from each of a plurality of sensors in an array that detects the user's grip. In some embodiments, output reading 902 may be evaluated to determine which sensor has the strongest signal quality for heart rate monitoring. For example, sensor 2 may have the strongest signal among the output readings 902, making it a candidate for heart rate monitoring at that location on the user's palm.

[0038] Figure 10 This is an illustration of an example hand of a user including a heart rate sensor array during moderate-intensity boxing, highlighting the sensor in the upper left corner of the hand. The hand 1002 may include the heart rate sensor array, where each sensor is evaluated to determine the optimal sensing location for heart rate monitoring during boxing. Figure 11This is an illustration of the output reading 1102 of the sensor located in the upper left corner of the palm. The output reading 1102 details the strength of the PPG signal and the user's pulse rate. In some embodiments, the sensor can compare its output reading with other sensors to determine optimal signal quality.

[0039] Figure 12 This is an illustration of an example hand of a user including a heart rate sensor array during moderate-intensity boxing, highlighting the sensors on the bottom of the palm. The palm 1202 may include the heart rate sensor array, where each sensor is evaluated to determine the optimal sensing location for heart rate monitoring during boxing. Figure 13 This is an illustration of the output reading 1302 of a sensor located on the sole of the hand. The output reading 1302 can detail the strength of the PPG signal and the user's pulse rate. In some embodiments, the sensor on the sole of the hand can compare its output reading with other sensors to determine optimal signal quality.

[0040] Figure 14 This is an illustration of an example hand of a user including a heart rate sensor array during moderate-intensity boxing, highlighting the sensor in the upper right corner of the hand. The hand 1402 may include the heart rate sensor array, where each sensor is evaluated to determine the optimal sensing location for heart rate monitoring during boxing. Figure 15 This is an illustration of the output reading 1502 of the sensor located in the upper right corner of the palm. Output reading 1502 can detail the strength of the PPG signal and the user's pulse rate. In some embodiments, the sensor in the upper right corner of the palm can compare its output reading with other sensors to determine optimal signal quality.

[0041] Handheld controllers can be configured to have monitoring capabilities, such as for fitness tracking and health tracking. In some examples, a handheld controller may include a battery unit comprising a battery, one or more sensor elements (e.g., a heart rate monitor, motion sensor, sweat sensor, etc.), circuitry, and a battery cover with windows for the sensor elements to optically approach the user's hand. In some examples, the battery cover and battery unit may be provided separately, for example, as an accessory and / or parts replacement for an existing controller. Such controllers can be used in applications such as artificial reality applications focused on fitness (e.g., exercise, dancing, boxing, workouts, etc.) and health (e.g., meditation, mindfulness, yoga, etc.). Including an integrated heart rate monitor (or another sensor) in an artificial reality controller can provide a consistent user experience for multiple users and / or multiple activities for a single user, compared to relying on a smartwatch or a standalone fitness tracker. Since the palm typically exhibits higher perfusion and lower melanin content than the wrist, the performance of the monitor can also be improved compared to wrist-worn devices.

[0042] The smart battery cover can be used to upgrade existing controllers with new features. Furthermore, the battery cover can include an integrated fitness tracker that broadcasts health and fitness metrics, such as heart rate, to another device or system via a wireless communication protocol (e.g., Bluetooth). For example, health and fitness measurements can be transmitted to a user's smartphone, personal computer, tablet, and / or cloud-based database using wireless communication elements.

[0043] The battery cover may include an integrated battery that powers the fitness tracker and controller. The battery cover may be configured to communicate with the controller and / or an associated artificial reality head-mounted device. In some examples, the battery cover may include a proximity sensor that can be used as a power-saving mechanism for monitoring the sensors and controller (e.g., starting or stopping operation based on the output of the proximity sensor).

[0044] Figure 16A and Figure 16B A handheld controller 1600 having monitoring capabilities such as fitness data monitoring (e.g., for artificial reality systems) according to an additional embodiment of the present disclosure is shown. Figure 16A It is a 3D view of a handheld controller in its assembled state, and Figure 16B This is an exploded 3D view of the handheld controller.

[0045] The handheld controller 1600 may include a controller body and a battery cover. The controller body may include a battery compartment for housing a battery (e.g., a rechargeable battery). When using the handheld controller 1600, a strap may be coupled to the battery cover for wrapping around the user's hand. The motherboard may include circuitry for operating sensors, such as photoplethysmography (PPG) sensors for heart rate monitoring, sweat sensors, inertial measurement units (IMUs), and / or other monitoring sensors (e.g., for fitness monitoring and / or health monitoring). The motherboard may also include circuitry for charging and recharging the battery. The motherboard may include a printed circuit board for mounting a microcontroller (MCU); wireless communication elements (e.g., for Bluetooth communication, Bluetooth Low Energy (BLE)); memory; a proximity sensor; a power input; and other elements for operating the handheld controller 1600, the battery, one or more sensors, etc.

[0046] The battery cover may include an optical window for the PPG sensor. For example, the optical window may include an aperture through the battery cover. The aperture may be a physical aperture, or it may be a portion of the battery cover that is transparent to the light (e.g., infrared light) used by the PPG sensor. Furthermore, the aperture may be covered by a transparent material (e.g., transparent plastic or glass) that is transparent to visible and / or infrared light.

[0047] The motherboard, rechargeable battery, and strap can be mounted onto the battery cover, allowing the motherboard, rechargeable battery, strap, and battery cover to form a unit that can be detached from the rest of the handheld controller 1600.

[0048] In some examples, the battery cover may also include a door that covers the opening. This door can be in a closed position (e.g., Figure 16A and Figure 16B (As shown) Move between the open position and the power input position, which exposes the power input on the motherboard for charging the rechargeable battery.

[0049] Figure 17 This is an exploded perspective view of a portion of a handheld controller 1700 according to at least one embodiment of the present disclosure. The handheld controller 1700 may include a controller body comprising a battery compartment for housing a battery (e.g., a rechargeable battery). Sensors (e.g., PPG sensors) and associated circuitry may be coupled to the battery. Figure 17 As shown, the PPG sensor, circuitry, and battery can be included in a single removable unit. In an additional example, the battery may be a separate unit from the PPG sensor and associated circuitry. The battery cover may include an aperture (e.g., a window) for the PPG sensor, allowing the PPG sensor to be optically close to the user's hand when using the handheld controller 1700. In other words, the PPG sensor may be positioned below the battery cover to sense input (e.g., data representing heart rate) through the aperture.

[0050] In an additional embodiment, one or more of the PPG sensor, circuitry, and / or associated windows for the PPG sensor may be included in the controller body, rather than in the battery cover.

[0051] Figure 18 A system 1800 is shown that uses a handheld controller for monitoring (e.g., for monitoring fitness data and / or health data) according to at least one embodiment of the present disclosure.

[0052] Artificial reality systems can include various types of visual feedback mechanisms. For example, display devices in augmented reality and / or virtual reality systems can include one or more liquid crystal displays (LCDs), one or more light-emitting diode (LED) displays, one or more microLED displays, one or more organic LED (OLED) displays, one or more digital light projector (DLP) microdisplays, one or more liquid crystal on silicon (LCoS) microdisplays, and / or any other suitable type of display. These artificial reality systems can include a single display for each eye, or a display for each eye, which provides additional flexibility for zoom adjustment or correction of the user's refractive errors. Some artificial reality systems may also include optical subsystems with one or more lenses (e.g., concave or convex lenses, Fresnel lenses, adjustable liquid lenses, etc.) through which the user views the display. These optical subsystems can be used for a variety of purposes, including collimating light (e.g., making an object appear at a distance greater than its physical distance), magnifying light (e.g., making an object appear larger than its actual size), and / or transmitting light (e.g., delivering light to a viewer's eye). These optical subsystems can be used in non-pupil-forming architectures (e.g., a single-lens configuration that directly collimates light but produces so-called pincushion distortion) and / or pupil-forming architectures (e.g., a multi-lens configuration that produces so-called barrel distortion to eliminate pincushion distortion).

[0053] In addition to, or instead of, using a display screen, some of the various artificial reality systems described herein may include one or more projection systems. For example, display devices in augmented reality and / or virtual reality systems may include micro-LED projectors (e.g., using waveguides) that project light onto the display device, which may be, for example, a transparent composite lens that allows ambient light to pass through. The display device may refract the projected light into the user's pupil, allowing the user to simultaneously view both the artificial reality content and the real world. This can be achieved using any of a variety of optical components, including waveguide components (e.g., holographic waveguide elements, planar waveguide elements, diffractive waveguide elements, polarizing waveguide elements, and / or reflective waveguide elements), light manipulation surfaces and elements (e.g., diffractive elements and gratings, reflective elements and gratings, and refractive elements and gratings), coupling elements, etc. Artificial reality systems may also be configured with any other suitable type or form of image projection system, such as a retinal projector for a virtual retinal display.

[0054] As mentioned, some artificial reality systems can essentially replace one or more sensory perceptions of the user's real-world experience with virtual experiences, rather than blending artificial reality with actual reality. An example of this type of system is a head-mounted display system, such as... Figure 19 A virtual reality system 1902 that covers most or all of the user's field of view. The virtual reality system 1902 may include a front rigid body 1908 and a strap 1904 shaped to fit around the user's head. The virtual reality system 1902 may also include output audio transducers 1906(A) and 1906(B). Furthermore, although not shown in Figure 16, the front rigid body 1908 may include one or more electronic components, including one or more electronic displays, one or more inertial measurement units (IMUs), one or more tracking transmitters or detectors, and / or any other suitable devices or systems for creating an artificial reality experience.

[0055] The artificial reality systems described herein may also include various types of computer vision components and subsystems. For example, augmented reality and / or virtual reality systems may include one or more optical sensors, such as two-dimensional (2D) or 3D cameras, structured light emitters and detectors, time-of-flight depth sensors, single-beam or scanning laser rangefinders, 3D LiDAR sensors, and / or any other suitable type or form of optical sensor. Artificial reality systems can process data from one or more of these sensors to identify the user's location, map the real world, provide the user with content about the real-world environment, and / or perform various other functions.

[0056] The artificial reality system described herein may also include one or more input audio transducers and / or one or more output audio transducers. Output audio transducers may include voice coil loudspeakers, ribbon loudspeakers, electrostatic loudspeakers, piezoelectric loudspeakers, bone conduction transducers, cartilage conduction transducers, tragus vibration transducers, and / or any other suitable type or form of audio transducer. Similarly, input audio transducers may include condenser microphones, dynamic microphones, ribbon microphones, and / or any other type or form of input transducer. In some embodiments, a single transducer may be used for both audio input and audio output.

[0057] In some embodiments, the artificial reality system described herein may also include a tactile (i.e., haptic) feedback system that can be integrated into headwear, gloves, clothing, handheld controllers, environmental devices (e.g., chairs, floor mats, etc.), and / or any other type of device or system. The haptic feedback system can provide various types of skin feedback, including vibration, thrust, tension, texture, and / or temperature. The haptic feedback system can also provide various types of kinematic feedback, such as motion and compliance. Haptic feedback can be implemented using motors, piezoelectric actuators, fluid systems, and / or various other types of feedback mechanisms. The haptic feedback system can be implemented independently of other artificial reality devices, within other artificial reality devices, and / or in conjunction with other artificial reality devices.

[0058] By providing tactile, auditory, and / or visual content, artificial reality (AVR) systems can create complete virtual experiences or enhance a user's real-world experiences in a variety of contexts and environments. For example, AVR systems can assist or extend a user's perception, memory, or cognition within a specific environment. Some systems can enhance a user's interaction with others in the real world or enable more immersive interaction with others in the virtual world. AVR systems can also be used for educational purposes (e.g., for teaching or training in schools, hospitals, government agencies, military facilities, businesses, etc.), entertainment purposes (e.g., for playing video games, listening to music, watching video content, etc.), and / or for accessibility purposes (e.g., as hearing aids, visual aids, etc.). The embodiments disclosed herein can realize or enhance a user's AVR experience in one or more of these contexts and environments, and / or in other contexts and environments.

[0059] By integrating a PPG sensor array into a VR controller, the PPG sensor array can be used for heart rate monitoring. The PPG sensor array can dynamically select the optimal sensing location by taking into account factors such as motion and pressure that can impair signal quality. Since a single sensor might fail to capture changes in hand geometry and grip movements when using a VR controller, the sensor array allows for better signal quality compared to a single sensor. An algorithm can be designed to select the best sensor in the array for optimal signal quality given the current factors. For example, in the initial stage, the user can be instructed to perform certain movements. In this stage, all channels can be enabled to determine the optimal sensing location. In various embodiments, multiple sensors in the PPG sensor array can be used for heart rate monitoring. Furthermore, the PPG sensor array can detect a large area on the palm, providing more accurate heart rate tracking than a traditional smartwatch worn on the wrist. Therefore, a PPG sensor array integrated into a VR controller can provide a more consistent user experience.

[0060] As described above, the computing devices and systems described and / or illustrated herein broadly refer to any type or form of computing device or system capable of executing computer-readable instructions (e.g., those contained within the modules described herein). In the most basic configuration of one or more computing devices, each of the one or more computing devices may include at least one storage device and at least one physical processor.

[0061] In some examples, the term "memory" or "storage device" generally refers to any type or form of volatile or non-volatile storage device or medium capable of storing data and / or computer-readable instructions. In one example, a storage device may store, load, and / or maintain one or more modules described herein. Examples of storage devices include, but are not limited to: Random Access Memory (RAM), Read Only Memory (ROM), flash memory, Hard Disk Drive (HDD), Solid-State Drive (SSD), Optical Disc Drive, Cache Memory, variations or combinations of one or more of the above, or any other suitable storage memory.

[0062] In some examples, the term "physical processor" broadly refers to a processing unit of any type or form of hardware implementation capable of interpreting and / or executing computer-readable instructions. In one example, a physical processor may access and / or modify one or more modules stored in the aforementioned storage device. Examples of physical processors include, but are not limited to: microprocessors, microcontrollers, central processing units (CPUs), field-programmable gate arrays (FPGAs) implementing soft-core processors, application-specific integrated circuits (ASICs), portions of one or more of the above, variations or combinations of one or more of the above, or any other suitable physical processor.

[0063] Although the modules described and / or illustrated herein are shown as individual elements, these modules may represent portions of a single module or application. Additionally, in some embodiments, one or more of these modules may represent one or more software applications or programs that, when executed by a computing device, enable the computing device to perform one or more tasks. For example, one or more of the modules described and / or illustrated herein may represent modules that are stored on one or more of the computing devices or systems described and / or illustrated herein and are configured to run on one or more of the computing devices or systems described and / or illustrated herein. One or more of these modules may also represent all or part of one or more dedicated computers configured to perform one or more tasks.

[0064] Furthermore, one or more of the modules described herein can convert data, physical devices, and / or representations of physical devices from one form to another. For example, one or more of the modules stated herein can receive [data] to be converted, convert the [data], output the conversion result to [perform a function], use the conversion result to [perform an action], and store the conversion result to [perform a function]. Additionally or alternatively, one or more of the modules stated herein can convert the processor, volatile memory, non-volatile memory, and / or any other part of a physical computing device from one form to another by executing on the computing device, storing data on the computing device, and / or otherwise interacting with the computing device.

[0065] In some embodiments, the term "computer-readable medium" broadly refers to any form of device, carrier, or medium capable of storing or carrying computer-readable instructions. Examples of computer-readable media include, but are not limited to, transport media (e.g., carrier waves), non-transitory media such as magnetic storage media (e.g., hard disk drives, magnetic tape drives, and floppy disks), optical storage media (e.g., optical discs (Compact Disk, CD, Digital Video Disk, DVD, and Blu-ray disc)), electronic storage media (e.g., solid-state drives and flash memory media), and other distributed systems.

[0066] The process parameters and order of steps described and / or illustrated herein are given by way of example only and may be changed as desired. For example, although the steps shown and / or described herein may be shown or discussed in a particular order, these steps do not necessarily need to be performed in the shown or discussed order. The various example methods described and / or illustrated herein may also omit one or more of the multiple steps described or illustrated herein, or may include additional steps in addition to those disclosed.

[0067] The foregoing description has been provided to enable others skilled in the art to optimally utilize various aspects of the exemplary embodiments disclosed herein. This exemplary description is not intended to be exhaustive or limited to any precise form disclosed. Many modifications, combinations, and variations are possible without departing from the spirit and scope of this disclosure. The embodiments disclosed herein should be considered illustrative rather than restrictive in all respects. Reference should be made to the appended claims and their equivalents in determining the scope of this disclosure.

[0068] Unless otherwise stated, the terms “connected to” and “coupled to” (and their derivatives) as used in the specification and / or claims shall be interpreted as allowing direct and indirect (i.e., via other elements or components) connections. Additionally, the terms “a” or “an” as used in this specification and claims shall be interpreted as meaning “at least one of…”. Finally, for ease of use, the terms “comprising” and “having” (and their derivatives) as used in this specification and claims may be used interchangeably with the word “including” and have the same meaning as the word “comprising”.

Claims

1. A method comprising: Calibrate the heart rate sensor array of your handheld device using the following steps: When the handheld device is held by a user, the output of each sensor in the sensor array is evaluated, wherein the output of each sensor is detected through an input aperture; Based on the evaluation of the output of each sensor, a subset of sensors in the sensor array is selected for detecting the user's heart rate; and The user's heart rate is monitored using the subset of sensors.

2. The method according to claim 1, wherein, The assessment is based on the strength of the signal quality.

3. The method according to claim 1, further comprising: In response to detecting a decrease in signal quality from at least one sensor in the sensor subset, the heart rate sensor array is calibrated.

4. The method according to claim 1, further comprising: Movement of the handheld device is detected, wherein calibration of the heart rate sensor array is performed in response to the detection of the movement.

5. The method according to claim 1, further comprising: It is determined that a predetermined amount of time has elapsed since the previous calibration of the heart rate sensor array, wherein the calibration of the heart rate sensor array is performed in response to determining that the predetermined amount of time has elapsed.

6. A handheld controller, comprising: A battery compartment configured to hold a battery to power the handheld controller; A battery cover configured to cover the battery compartment, the battery cover including apertures; as well as A sensor, positioned below the battery cover, is used to sense input through the aperture.

7. The handheld controller according to claim 6, wherein, The sensor includes a sweat sensor configured to sense sweat from the hands of a user holding the handheld controller.

8. The handheld controller according to claim 6, wherein, The sensor includes a heart rate sensor configured to sense the user's heart rate from the hand of the user holding the handheld controller.

9. The handheld controller according to claim 6 further includes a rechargeable battery, wherein, The battery compartment is configured to house the rechargeable battery.

10. The handheld controller according to claim 9, wherein, The rechargeable battery is coupled to the battery cover.

11. The handheld controller of claim 9, further comprising a printed circuit board coupled to the battery cover, wherein, The rechargeable battery is configured to power the printed circuit board and the handheld controller.

12. The handheld controller according to claim 9, wherein, The battery cover also includes a door that covers the opening, the door being movable between a closed position and an open position, wherein a power input for charging the rechargeable battery is positioned behind at least one of the doors so that it is exposed through the opening when the door is in the open position.

13. The handheld controller of claim 6 further includes a printed circuit board coupled to the battery cover, wherein, The sensor is mounted on the printed circuit board.

14. The handheld controller of claim 13 further includes a wireless communication element mounted on the printed circuit board.

15. The handheld controller of claim 6, further comprising a strap coupled to the battery cover and configured to wrap around the user's hand when the handheld controller is held.

16. A battery module for a handheld controller, the battery module comprising: A battery cover, the shape and size of which are configured to cover the battery compartment of the handheld controller, the battery cover including an aperture through which the battery cover passes; A sensor, coupled to the battery cover and positioned to sense at least one input through the aperture; as well as A rechargeable battery coupled to the battery cover, the rechargeable battery being configured to power at least the sensor.

17. The battery module of claim 16, further comprising a strap coupled to the battery cover and configured to wrap around a user's hand.

18. The battery module according to claim 16, further comprising a power input terminal for charging the rechargeable battery.

19. The battery module according to claim 18, wherein, The battery cover also includes a door that covers the opening, wherein the power input terminal is located behind the door and can be accessed through the opening when the door is in the open position.

20. The battery module of claim 16, further comprising a printed circuit board, wherein, The sensor is mounted on the printed circuit board.

Images