Controller having sensor rich control device

Abstract

A controller having a sensor rich control for enhanced controller functionality.SOLUTION: The example control may include a pressure sensor configured to detect an amount of force of a press on the cover of the control based at least in part on a proximity of the metal layer to the pressure sensor. The control may further include a touch sensor for detecting that an object has contacted the cover of the control. Additional embodiments disclose, among other things, integrated trackpads and D-pads, as well as backlighting features that indicate the functional status of the controller.SELECTED DRAWING: Figure 3A

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This specification relates to "CONTROLLER WITH This application claims priority to co-pending and commonly assigned U.S. Provisional Patent Application No. 62 / 977,030 entitled "CONTROLLER WITH SENSOR-RICH CONTROLS," filed February 11, 2021. This PCT application claims priority to U.S. patent application Ser. No. 17 / 174,167, entitled "METHOD CONTROLS," the entire contents of each of which are incorporated herein by reference. [Background technology]

[0002] Handheld controllers are used in an array of architectures, for example, to provide input to local or remote computing devices. For example, handheld controllers are utilized in the gaming industry to allow players to interact with personal computing devices running gaming applications, game consoles, game servers, the handheld controller itself, etc. While current handheld controllers offer a variety of functions, further technological improvements can enhance the user experience that these controllers provide. [Brief explanation of the drawings]

[0003] The detailed description is set forth with reference to the accompanying drawings. In each drawing, the leftmost digit(s) of a reference number identifies the drawing in which the reference number first appears. The same or similar reference numbers in different drawings indicate similar or identical items.

[0004] [Figure 1]1 illustrates a front perspective view of an exemplary handheld controller partially including one or more front controls. Each front control may include one or more sensors, such as a touch sensor for detecting at least the presence of a finger and / or a pressure sensor for detecting the amount of force associated with a finger pressing down on the control.

[0005] [Figure 2] 2 illustrates a top view of the handheld controller of FIG. 1 partially including one or more top control devices.

[0006] [Figure 3A] 1 illustrates a perspective exploded view of an exemplary control device in the form of a track pad that includes, in part, a touch sensor for sensing touch input and a pressure sensor for sensing the amount of force associated with a press. In some instances, the amount of force can be sensed as a change in capacitance between the pressure sensor and a metal layer of the control device.

[0007] [Figure 3B] 3B illustrates a cross-sectional assembly view of the exemplary control device of FIG. 3A.

[0008] [Figure 3C] 3B illustrates an assembled perspective view of the example control device of FIG. 3A from the underside of the control device.

[0009] [Figure 3D] 3B illustrates a perspective view of a pressure sensor included in the example control device of FIG. 3A.

[0010] [Figure 4] 2 illustrates a rear view of the handheld controller of FIG. 1 partially including one or more rear control devices.

[0011] [Figure 5]1 illustrates a front perspective view of an exemplary handheld controller partially including one or more front controls. Each front control may include one or more sensors, such as a touch sensor for detecting at least the presence of a finger and / or a pressure sensor for detecting the amount of force associated with a finger pressing down on the control.

[0012] [Figure 6] 6 illustrates a top view of the handheld controller of FIG. 5 partially including one or more top control devices.

[0013] [Figure 7] 6 illustrates a rear view of the handheld controller of FIG. 5 partially including one or more rear control devices.

[0014] [Figure 8A] 1 illustrates a perspective view of an exemplary front control device partially including a touch sensor for detecting a press on the control device and one or more protrusions for engaging one or more actuatable switches of a handheld controller. The pressure sensor may also detect the amount of force associated with the press on the control device.

[0015] [Figure 8B] 8B illustrates a top view of the front control of FIG. 8A partially including one or more protrusions for engaging one or more actuatable switches of the handheld controller for detecting a press on the control. The pressure sensor may also detect the amount of force associated with the press on the control.

[0016] [Figure 8C] 8B illustrates a side view of the front control device of FIG. 8A showing one or more protrusions for engaging one or more actuatable switches disposed within the controller body of the handheld controller under an exemplary collapsible configuration. The pressure sensor may also detect the amount of force associated with a press on the control device.

[0017] [Figure 9A]1 illustrates a top view of an exemplary front control device partially including a touch sensor for detecting a press on the control device and a directional pad (D-pad) for engaging one or more actuatable switches of a handheld controller. A pressure sensor may also detect the amount of force associated with the press on the control device.

[0018] [Figure 9B] 9B illustrates an exploded perspective view of the front control device of FIG. 9A, showing the control device including a receptacle for receiving a D-pad.

[0019] [Figure 9C] 9B illustrates a side view of the front control of FIG. 9A showing one or more protrusions for engaging one or more actuatable switches disposed within the controller body of the handheld controller under an exemplary collapsible configuration. The pressure sensor may also detect the amount of force associated with a press on the control.

[0020] [Figure 10A] 1 illustrates a top view of an exemplary front control device partially including a touch sensor and one or more actuatable switches of a handheld controller for detecting a press of the control device. One or more light emitting elements may indicate the location of one or more switches underneath the control device.

[0021] [Figure 10B] 1 illustrates a top view of an exemplary front control device partially including a touch sensor for detecting presses on the control device and a directional pad (D-pad) for engaging one or more actuatable switches of a handheld controller. One or more light-emitting elements may indicate the location of the D-pad below the control device.

[0022] [Figure 11A] 9B illustrates a top view of the front control device of FIG. 9A. One or more light-emitting elements may indicate a first control device mode in which the touch sensors are enabled. In some instances, in the first mode, the D-pad of the control device may be disabled.

[0023] [Figure 11B] 9B illustrates a top view of the front control device of FIG. 9A. One or more light emitting elements indicate a second control device mode in which the D-pad is enabled. In some cases, in the second mode, the touch sensors of the control device may be disabled.

[0024] [Figure 12] 1 illustrates a top view of an exemplary front control device partially including a touch sensor for detecting presses on the control device and a directional pad (D-pad) for engaging one or more actuatable switches of a handheld controller. The control device includes a first touch sensor and a second touch sensor disposed on the D-pad for detecting touches on the control device.

[0025] [Figure 13A] 1 illustrates a front perspective view of an exemplary control device partially including a touch sensor and a support member. A strain gauge may be coupled to a portion of the support member to determine the amount of deflection of the support member.

[0026] [Figure 13B] 13B illustrates a rear perspective view of the control device of FIG. 13A showing the support member of the control device.

[0027] [Figure 13C] 13B illustrates a rear view of the control device of FIG. 13A showing strain gauges on the control device for detecting the amount of deflection.

[0028] [Figure 14] 1 illustrates a front perspective view of an example control device partially including one or more electrodes for sensing the movement of one or more fingers of a user operating the control device. In some cases, the one or more electrodes may sense the initial movement of a thumb on the control device before the potentiometer detects movement of the control device.

[0029] [Figure 15A]1 illustrates a perspective view of an example control device that includes, in part, a touch sensor for sensing touch input and a pressure sensor for sensing the amount of force associated with a press. In some instances, the amount of force can be sensed as a change in capacitance between the pressure sensor and the touch sensor.

[0030] [Figure 15B] 15B illustrates an exploded view of the example control device of FIG. 15A.

[0031] [Figure 15C] 15B illustrates a side view of the example control device of FIG. 15A.

[0032] [Figure 16A] 1 illustrates a perspective view of an example control device partially including a capacitance sensor for determining the amount of deflection relative to a stationary layer, such as a portion of a handheld controller surrounding the control device, wherein the amount of force associated with pressing the control device can be determined by a change in capacitance sensed between the capacitance sensor and the stationary layer.

[0033] [Figure 16B] 16B illustrates a top view of the control device of FIG. 16A.

[0034] [Figure 16C] 16B illustrates a side view of the controller of FIG. 16A showing the deflection of the controller relative to the fixed layer to determine the amount of force associated with pressing the controller.

[0035] [Figure 17] 1 illustrates exemplary functional components of an exemplary handheld controller. DETAILED DESCRIPTION OF THE INVENTION

[0036] As described above, handheld controllers are used in a variety of environments and include a variety of functions, however, some conventional handheld controllers include static configurations with respect to user-operable controls and / or controls with limited functionality.

[0037] Described herein are handheld controllers having various controls for, among other things, engaging in video game play through the execution of video game applications and / or controlling other types of applications and / or programs. In some cases, the handheld controller may include controls for controlling games or applications executing on the handheld controller itself (e.g., a handheld gaming system substantially built into the controller). In some cases, the handheld controller may include controls for controlling a remote device (e.g., a television, an audio system, a personal computing device, a game console, etc.). The handheld controller may include one or more controls, including one or more front controls on the front of the handheld controller's housing. These front controls may include one or more joysticks, directional pads (D-pads), trackpads, trackballs, buttons, or other controls controllable, for example, by the thumbs of a user manipulating the handheld controller. Additionally or alternatively, the handheld controller may include one or more top controls present on the top surface of the handheld controller's housing. These top surface controls may be referred to as "triggers," "bumpers," etc., and may be controllable by one or more fingers of a user, such as a middle finger, index finger, etc. In some cases, the handheld controller includes one or more top surface controls operable by one or more fingers of a user's left hand and / or one or more fingers of a user's right hand. In addition, the handheld controller may include one or more rear control devices. In some cases, the rear control devices may include one or more controls operable by a user's left hand and / or a user's right hand.

[0038] In some cases, a handheld controller may include one or more integrated controls with multiple functions. For example, a handheld controller may include a control device with touch sensors (e.g., a capacitive trackpad) and / or a pressure sensor for determining the amount of force associated with pressing the control device. As an example, a handheld controller may include a trackpad (or other sensing array) with capacitance sensors for determining the presence, location, and / or gesture of a user's fingers operating the handheld controller. Additionally, in some cases, a pressure sensor may be disposed on the control device to sense the amount of force associated with pressing the control device. Implementing pressure sensing in a handheld controller may expand the range of natural interactions beyond its current state using a conventional controller. For example, a handheld controller (or a remotely coupled device) may determine the force with which a user presses the control device via a pressure sensor. Using a pressure sensor with a desired response curve, the handheld controller can convert pressure into various digitized numerical values ​​that can be used in a video game to control the gaming machine (e.g., to break rocks, squeeze a balloon, switch between active weapons usable by a game character, etc.).

[0039] In some cases, the pressure sensor may replace a conventional mechanical switch to reduce user fatigue and / or reduce accidental actuation of the control device. For example, in some cases, the pressure sensor of the control device may act as a switch by detecting when an applied force exceeds a threshold. The threshold may be adjusted to a lower value to reduce hand fatigue during gameplay (e.g., when a user presses a control device associated with an FSR to fire a weapon frequently during gameplay). Conversely, the threshold may be adjusted to a higher value to reduce instances of accidental control device operation, which may be useful for thrilling or exciting games in which a user may react to video game cues.

[0040] An exemplary control device for the controller may include a cover, a touch sensor disposed below and coupled to the cover, a carrier disposed below the touch sensor and coupled to the cover, at least one biasing member coupled to the carrier and to a housing of the controller, a metal layer disposed below and coupled to the carrier, and a pressure sensor coupled to the housing, disposed below the metal layer, and spaced a distance from the metal layer. The touch sensor is configured to output touch data indicative of a touch on the cover. The biasing member is configured to apply a biasing force to the carrier in a direction opposite to the direction of the force of the pressure on the cover (i.e., perpendicular to the cover). The pressure sensor utilizes the metal layer to detect the amount of force of the pressure on the cover. For example, the pressure sensor is configured to output force data indicative of the amount of force of the pressure on the cover based at least in part on the proximity of the metal layer to the pressure sensor. The metal layer is coupled to the carrier and may deflect downward in response to pressure of the control device against the cover, such that the metal layer may move closer to the pressure sensor, which may be detectable by the pressure sensor. In some embodiments, the force data output by the pressure sensor includes a capacitance value based on a change in capacitance between the metal layer and the pressure sensor due to pressing the control device against the cover. In this scenario, the pressure sensor (together with the metal layer) may be in the form of a force-sensing capacitor (FSC). Additionally, in some embodiments, the control device may be a trackpad.

[0041] Thus, the control devices (e.g., trackpad) of the controller may include, among other things, touch sensors for sensing when an object touches the cover of the control device (e.g., trackpad) and / or pressure sensors for sensing the amount of force of pressure on the cover of the control device (e.g., trackpad). While conventional handheld controllers include selectable control devices, combining a control device with touch-sensing capabilities, among other things, using pressure sensors to identify the selection of the control device, may increase the amount and richness of inputs that can be provided via the control device. These inputs may include gestures that further enrich the operation of games or other applications controlled by the handheld controller.

[0042] The present disclosure provides a general understanding of the principles of structure, function, manufacture, and use of the systems and methods disclosed herein. One or more examples of the present disclosure are illustrated in the accompanying drawings. Those skilled in the art will understand that the systems and methods specifically described herein and illustrated in the accompanying drawings are non-limiting embodiments. Features illustrated or described in connection with one embodiment, including between systems and methods, may be combined with features of other embodiments. Such modifications and variations are intended to be within the scope of the appended claims.

[0043] 1 illustrates a front view of an exemplary controller 100 according to one embodiment of the present disclosure. Controller 100 may be considered handheld when operated by a user's hand, regardless of whether the entire controller 100 is supported by or in the user's hand. However, in accordance with various embodiments described herein, the terms "device," "handheld device," "handheld gaming device," "handheld console," "handheld gaming console," "controller," and "handheld controller" may be used interchangeably herein to describe any device such as controller 100.

[0044] The controller 100 may include a controller body 102 having a front surface 104. The controller body 102 may further include a back surface (or rear surface), a top surface (or top edge or top portion), a bottom surface (or bottom edge or bottom portion), a left surface (or left edge or left portion), and a right surface (or right edge or right portion). Thus, the controller body 102 may be cuboid-shaped. The front surface 104 and the back surface may be relatively large surfaces compared to the top surface, bottom surface, left surface, and right surface.

[0045] As illustrated in FIG. 1 , the front surface 104 of the controller body 102 may include multiple controls configured to receive user input. Touch data generated by the controls may be used to detect the presence, location, and / or gesture of a user's fingers operating the controller 100. In some cases, the front surface 104 of the controller body 102 may include one or more front controls, which in some cases are controllable by one or more thumbs of a user operating the controller 100. The handheld controller 100 may further include one or more top controls present on the top surface (or top edge) of the controller body 102, examples of which are depicted in FIG. 2 . Additionally or alternatively, the handheld controller 100 may include one or more back controls present on the back surface of the controller body 102 and operable by the fingers of a user's left and / or right hands. Additionally or alternatively, the handheld controller 100 may include one or more left and / or right controls present on the left and right surfaces, respectively, of the controller body 102.

[0046] The front control device may include one or more trackpads, trackballs, joysticks, buttons, directional pads (D-pads), etc., as described in more detail below. For example, front face 104 may include left joystick 106, left trackpad 108, and / or left D-pad 110 controllable by a user's left thumb. In some embodiments, front face 104 may include additional left buttons controllable by the left thumb, such as button 112 and button 114. Front face 104 may also include right joystick 116, right trackpad 118, and / or one or more right buttons 120(1)-(4) (e.g., X, Y, A, and B buttons) controllable by a user's right thumb. In some embodiments, front face 104 may include additional right buttons controllable by the right thumb, such as button 122 and button 124. However, front face 104 may include other controls, such as tilt buttons, triggers, knobs, wheels, and / or trackballs, and multiple controls may be configured to receive input from any combination of a user's thumbs and / or fingers. If controller 100 includes a trigger, the trigger may be a multi-directional trigger configured to be pressed away from controller 100 and pulled toward controller 100. Additionally, controller 100 may include paddles, panels, or wings configured to be pressed and / or pulled. Panels may be used to provide additional game controls to controller 100, such as shifting in a racing game (e.g., pressing may be a downshift and pulling may be an upshift).

[0047] In some embodiments, the track pads 108 and 118 are quadrilateral-shaped track pads. For example, the track pads 108 and 118 may be generally square-shaped track pads. Furthermore, the quadrilateral-shaped track pads 108 and 118 may have rounded corners. Additionally, as shown in FIGS. 1 and 2 , the straight side edges of each track pad 108 and 118 are aligned (e.g., parallel) with the side edges (e.g., left and right edges) of the display 126 at the center of the controller body 102 on the front face 104 of the controller body 102. Compared to circular track pads, the quadrilateral-shaped track pads 108 and 118 provide additional space in the corners that can be accessed by a user's fingers (e.g., thumbs). Thus, the quadrilateral-shaped track pads 108 and 118 may be more ergonomic than circular track pads due to the additional area provided by the track pads 108 and 118. For example, the quadrilateral shape of trackpads 108 and 118 may give a user the ability to access trackpads 108 and 118 with their thumbs even as the user re-orients their hands on controller 100. Additionally or alternatively, a user may choose to grip controller body 102 in slightly different ways, such that the corners of the trackpads (e.g., trackpads 108 and 118) are used as the north, south, east, and west sides of the trackpad (e.g., like a diamond-shaped trackpad).

[0048] The controller body 102 may further include a left handle 128 and a right handle 130, with which a user may hold the controller 100 via the user's right and left hands, respectively. Holding the left handle 128 with the left hand may provide access to the left joystick 106, the left trackpad 108, and / or the left D-pad 110. Holding the right handle 130 with the right hand may provide access to the right joystick 116, the right trackpad 118, and / or one or more right buttons 120(1)-(4).

[0049] FIG. 2 illustrates a top view of the controller 100, showing the top surface 200 (or upper portion 200) of the controller body 102. The upper portion 200 may include one or more left triggers 202 and / or one or more right triggers 204. In some cases, each of the one or more left triggers 202 and / or one or more right triggers 204 may be located along the top portion 200 of the controller body 102. The one or more left triggers 202 and / or one or more right triggers 204 may be controlled by a user's index finger during normal operation while the controller 100 is held by the user. The upper portion 200 may additionally or alternatively include buttons (or other additional input controls controllable by a user's finger). In some cases, the upper portion 200 may include touch sensors for detecting the presence, position, and / or gesture of a finger on the control device. Additionally or alternatively, the upper portion 200 may include a receiver such as a wired communication interface (e.g., a port, plug, jack, etc.) for communicatively coupling the controller 100 to an external device (e.g., a charger, a game console, a display, a computing device, etc.).

[0050] The handheld controllers described herein allow for different configurations or functions to change the configuration of the controller to meet the needs of different applications (e.g., game titles), users, etc. For example, a first gaming application may be best played and / or a user may prefer to play the first gaming application using a first control device such as a trackpad, while a second gaming application may be best played and / or a user may prefer to play the second gaming application using a second control device such as a D-pad. Here, a user may select which control device to use depending on the currently running gaming application. Thus, a user may configure the handheld controller with a first control device and / or a second control device depending on their specific needs and / or preferences. In some instances, the handheld controller may be dynamically configured depending on which user is currently operating the handheld controller. Furthermore, in some instances, the handheld controller or a remote system may determine the configuration of the handheld controller and which control device is currently being operated or can be operated. This information can be provided to the system running the current application, which can then make changes based on the configuration of the handheld controller. Thus, the techniques described herein enable dynamically configurable handheld controllers that ameliorate some of the current shortcomings of conventional handheld controllers, as discussed above.

[0051] 3A-3C illustrate an exemplary control device 300 for sensing a touch on the control device 300 and the amount of force associated with the touch or press on the control device 300. In some instances, the control device 300 may include a stack or layer of components stacked in a stacking direction (e.g., the Z direction). The stack may include at least one sensor for sensing the press and the amount of force associated with the press. In some embodiments, the control device 300 includes multiple sensors, such as touch sensors and pressure sensors. The sensors of the control device 300, individually or in combination, may detect the presence, location, force, and / or gesture of a user's finger. In some instances, the control device 300 may resemble, represent, and / or be used for a trackpad disclosed herein (e.g., the quadrilateral-shaped trackpads 108 and 118 of the controller 100). Thus, in some examples, the control device 300 may be a trackpad.

[0052] 3A illustrates a perspective exploded view of an exemplary control device 300. The control device 300 includes a cover 302 (sometimes referred to herein as a “top cover 302” or a “cap 302”), a touch sensor 304 (e.g., a capacitive array), a carrier 306, at least one biasing member 308, a metal layer (e.g., copper foil) 310, and / or a pressure sensor 312. In some embodiments, the control device 300 may further include a haptic actuator 314.

[0053] It should be understood that the stacking orientation of the control device 300 shown in FIG. 3A is reversed in the sense that the cover 302 is generally the uppermost component of the control device 300 when the control device 300 is mounted on the front face 104 of the controller 100, and when the controller 100 is placed on a flat surface with the front face 104 facing up. For this reason, the positive Z direction faces downward in FIG. 3A. Based on this orientation (i.e., the positive Z direction faces downward in FIG. 3A), the cover 302 may be disposed on (or above) the touch sensor 304, the touch sensor 304 may be disposed on (or above) the carrier 306, the carrier 306 may be disposed on (or above) the metal layer 310, and the metal layer 310 may be disposed on (or above) the pressure sensor 312. In other words, the pressure sensor 312 may be disposed under the metal layer 310, the metal layer 310 may be disposed under the carrier 306, the carrier 306 may be disposed under the touch sensor 304, and the touch sensor 304 may be disposed under the cover 302.

[0054] The haptic actuator 314 may be disposed below the touch sensor 304. In other words, the touch sensor 304 may be disposed at (or above) the haptic actuator 314. In such implementations, the carrier 306 may include cutouts 316 and / or recessed areas that provide space in which the haptic actuator 314 may be disposed within the assembled control device 300.

[0055] As its name implies, the cover 302 may cover the components of the control device 300 that are disposed underneath the cover 302. Thus, because the cover 302 is the outward-facing component of the control device 300, the remaining components of the control device 300, such as the touch sensor 304, the carrier 306, the biasing member 308, the metal layer 310, the pressure sensor 312, and / or the haptic actuator 314, may be hidden by the cover 302. In some examples, the control device 300, and therefore the cover 302, may be disposed within an opening 318 defined in a housing 320 of the controller 100. The housing 320 depicted in FIGS. 3A-3C may represent a portion of the controller body 102 that houses the internal components of the controller 100. For example, the cover 302 may represent a visible portion of each of the track pads 108 and 118 depicted in FIG. 1. Generally, the cover 302 is configured to be touched and pressed to operate the control device 300. For example, a user may touch the cover 302 with a finger and / or drag a finger across the cover 302 to move a cursor on the display 126 or control some other aspect of a running application. Additionally or alternatively, a user may operate the control device 300 by pressing the cover 302 (e.g., exerting a force on the cover 302 in the negative Z direction). If the amount of force of the press on the cover 302 meets (e.g., strictly exceeds, meets, or exceeds, etc.) a threshold, a processor of a controller system disclosed herein may register an input event indicating that the user has “clicked” the control device 300. Accordingly, if the amount of force of the press does not meet (e.g., remains low) such a threshold, an input event is not registered. However, as soon as the amount of force meets the threshold, an input event may be registered to control an aspect of the running application (e.g., a video game) based at least in part on the registered press of the control device 300. The threshold may be configurable so that it is not too difficult for the user to provide a pressure input to the control device 300 and / or the threshold can be adjusted to a level that provides optimal sensitivity so that the control device 300 does not register spurious pressure inputs that were not intended by the user.

[0056] 3B , cover 302 is shown coupled to carrier 306. For example, protrusions extending from the back side of cover 302 may be received within corresponding openings in the front side of carrier 306 (e.g., press-fit, snap-fit, etc.). Additionally or alternatively, an adhesive may be used to couple cover 302 to carrier 306. This coupling may cause a pressing action on cover 302 to cause carrier 306 to deflect or otherwise move toward pressure sensor 312 (e.g., in the negative Z direction), as the coupling between cover 302 and carrier 306 transfers deflection of cover 302 to carrier 306. In some examples, housing 320 may represent a surface of controller body 120, such as front surface 104 of controller body 102. In one example, opening 318 may be defined in housing 320, and cover 302 may include a lip 322 positioned below, or at least partially below, the edge of opening 318 defined in housing 320 to prevent cover 302 from falling off controller body 120 during use of controller 300. In some instances, the top surface of cover 302 is slightly raised above the surface of housing 320 that surrounds cover 302. In other cases, the top surface of cover 302 may be flush with or slightly recessed below the surface of housing 320 that surrounds cover 302. Cover 302 may be made of plastic (e.g., acrylonitrile butadiene styrene (ABS) plastic) or any other suitable polymeric material that is relatively smooth and comfortable to the touch, yet rigid enough to transfer forces from a user's finger to carrier 306 positioned below and coupled to cover 302. In some examples, cover 302 is a single piece of injection-molded plastic. Additionally, cover 302 may be of any suitable size, such as approximately 25 millimeters (mm) wide, approximately 25 mm long, and 1 mm to 3 mm thick (thickness measured in the Z direction). A thicker cover 302 increases the distance between the fingertip and touch sensor 304, which has the effect of diffusing the electric field formed between them.However, the reduction in touch contact capacitance can be compensated for by, among other things, increasing the size of the touch sensor 304.

[0057] The touch sensor 304 may be coupled to the cover 302 (e.g., with an adhesive). For example, the touch sensor 304 may be coupled to the back (or underside, rear side, etc.) of the cover 302. This coupling may hold the touch sensor 304 in a fixed position relative to the cover 302 and may keep the touch sensor 304 positioned as close as possible to the top (or front) of the cover 302. The touch sensor 304 may be used to determine the contact, presence, location, and / or gesture of a finger operating the control device 300. In some examples, the touch sensor 304 may include a capacitive sensing array for detecting touch input on the control device 300 or on the surface of the cover 302. In some cases, the touch sensor 304 includes an array of capacitive pads across some or substantially all of the surface area of ​​the cover 302. In some examples, the touch sensor 304 may be used to detect when a finger touches and is dragged over the cover 302 for a predetermined distance and / or to detect the presence of a finger hovering over, but not touching, the cover 302. Thus, the touch sensor 1704 may be configured to detect the presence and location of a touch input on and / or near (e.g., in proximity to) the cover 302. In implementations utilizing capacitance-based sensing, the touch sensor 304 may include electrodes (e.g., transmitting and receiving electrodes of a transcapacitive sensor), and a voltage may be applied to the electrodes, whereby the electrodes are configured to measure a capacitance change at the electrodes, which may be converted into sensor data in the form of a capacitance value indicative of the proximity of an object to the sensor 304. For example, a capacitance change at an electrode of a capacitance-based touch sensor 304 may be affected by an object (such as a finger) in proximity to the electrode. In some examples, a voltage is applied to a conductive layer to provide a substantially uniform electrostatic field. When a conductor, such as a user's finger, touches the cover 302 and / or moves near (e.g., within a threshold distance from) the touch sensor 304, a change in capacitance occurs. The capacitance value is measured across a capacitance array of the touch sensor 304 to determine the presence and / or location of the conductor, such as a finger.In some instances, these capacitance values ​​may be measured over time for use in identifying a user's finger gesture, such as a swipe. Although discussed herein as a capacitive sensing array, touch sensor 304 may include, but is not limited to, resistive touch sensors, infrared touch sensors, and touch sensors that utilize acoustic waves to detect the presence or location of an object. Touch sensor 304 may provide touch data to one or more processors of a controller system disclosed herein via a first connector (not shown) of touch sensor 304, the touch data generated based on finger contact or presence detected or sensed on or near cover 302.

[0058] The carrier 306 may be coupled to the cover 302 and may be configured to deflect or otherwise move (e.g., in the Z direction) in response to an object (e.g., a finger) pressing against or releasing pressure from the cover 302. For example, the carrier 306 may be configured to deflect or move toward the pressure sensor 312 (e.g., in the negative Z direction) in response to an object (e.g., a finger) pressing against the cover 302. As shown in FIG. 3A , the carrier 306 may have a quadrilateral shape (e.g., a square shape) with a central cutout 316. The carrier 306 may be made of metal (e.g., sheet metal, curved steel spring, etc.). Alternatively, the carrier 306 may be made of plastic or any other suitably rigid polymer.

[0059] 3A-3C depict a pair of biasing members 308(1) and 308(2), in some embodiments, a single biasing member 308 or more than two biasing members 308 may be implemented. Each biasing member 308 is coupled to the carrier 306 and to the housing 320. For example, the ends of the biasing members 308 may be attached to protrusions extending from the rear surface of the housing 320, and a central portion of the biasing members 308 may include one or more holes configured to receive corresponding protrusions extending from the rear side of the carrier 306. In this manner, the biasing members 308 are anchored to the housing 320, and the biasing members 308 bias the carrier 306 upward (in the positive Z direction) toward the housing 320. Because the cover 302 is coupled to the carrier 306, this biasing force physically biases a portion of the cover 302 (e.g., the lip 322 of the cover 302) against the inner surface of the housing 320. Biasing member 308 may be a resilient element configured to deflect and / or deform in response to an object (e.g., a finger) pressing against cover 302 and to return to its original form and / or position when pressure on cover 302 ceases (e.g., when the finger is removed from cover 302 or when pressure ceases to be applied). In some implementations, biasing member 308 is a spring made of metal (e.g., spring steel). FIGS. 3A and 3C illustrate biasing members 308(1) and 308(2) as elongated members positioned side-by-side on opposite sides of carrier 306 and attached to mounting protrusions 324 extending from the interior surface of housing 320. In some embodiments, first biasing member 308(1) is a first anisotropic spring coupled to a first side of carrier 306 (i.e., a first side between the top and bottom surfaces of carrier 306), and second biasing member 308(2) is a second anisotropic spring coupled to a second side of carrier 306 opposite the first side. In this manner, the pair of anisotropic springs 308 apply an upward biasing force (e.g., in the positive Z direction) to carrier 306 from both sides of carrier 306 to provide a balanced upward biasing force to carrier 306. Elongated biasing member 308 may include relatively straight middle and end portions, with the material of biasing member 308 curved in an accordion-style or zigzag configuration.This structure of biasing member 308 provides biasing member 308 with anisotropic properties that optimize the force of biasing member 308 on carrier 306 in orthogonal directions. For example, a biasing force in the positive Z direction is optimized for pressing against cover 302, and a biasing force in the X and / or Y directions is optimized for vibration of haptic actuator 314, which vibrates the carrier when haptic feedback is provided by haptic actuator 314.

[0060] The metal layer 310 may be coupled (e.g., with an adhesive) to the carrier 306, such as to the bottom surface of the carrier 306. In some embodiments, the metal layer 310 is a relatively thin copper foil (or tape) compared to the other components of the control device 300. The metal layer 310 may have a quadrilateral shape (e.g., a square shape) with a cutout in the center to facilitate coupling of the metal layer 310 to the similarly shaped bottom of the carrier 306. Because the metal layer 310 is attached to the bottom surface of the carrier 306, deflection or movement of the carrier 306 in response to an object (e.g., a finger) pressing against the cover 302 causes the metal layer 310 to deflect or move toward the pressure sensor 312.

[0061] The pressure sensor 312 and metal layer 310 may represent a force-sensing capacitor (FSC). For example, FIG. 3D illustrates the pressure sensor 312 as including a substrate 326 (e.g., a substrate) that includes an electrode 328 (or "sensing electrode 328"). The pressure sensor 312 (e.g., or its substrate 326) may be coupled to the housing 320 to keep the pressure sensor 312 a constant distance from the housing 320 so that the pressure sensor 312 does not move relative to the housing 320, even when the cover 302 is pressed. FIG. 3C depicts the substrate 326 of the pressure sensor 312 attached to a protrusion 330 extending from the inner surface of the housing 320. The height of the protrusion 330 at least partially controls the distance the pressure sensor 312 (e.g., or its substrate 326) is spaced from the metal layer 310. In other words, the pressure sensor 312 may be spaced a distance from the metal layer 310, such as by an air gap disposed between the metal layer 310 and the pressure sensor 312. The distance by which the pressure sensor 312 is spaced from the metal layer 310 in the assembled control device 300 may be at least approximately 0.5 millimeters (mm). In some embodiments, this distance (or air gap) may be in the range of approximately 0.5 mm to 1 mm in the Z direction. Although the air gap between the pressure sensor 312 and the metal layer 310 is relatively small (e.g., approximately 0.5 mm), the electrode 328 of the pressure sensor 312 may be able to sense or detect relatively small displacements of the metal layer 310 within the air gap between the metal layer 310 and the pressure sensor 312. In some embodiments, a voltage is applied to the electrode 328 of the pressure sensor 312 to provide a substantially uniform electrostatic field. When the metal layer 310 (which is a conductor) moves toward the pressure sensor 312 in response to pressure on the cover 302, a change in capacitance occurs. A capacitance value is measured by pressure sensor 312 (e.g., using sensing electrode 328 and using substrate 326 as a ground reference) to determine the force of a press on cover 302. In some cases, the capacitance value may be measured over time for use in determining whether the capacitance value meets a threshold for registering a press input event (e.g., a "click" of control device 300).Although discussed herein as an FSC, other pressure sensing technologies may be employed, such as using a force sensing resistor (FSR), a piezoelectric pressure sensor, etc. The pressure sensor 312 may provide force data to one or more processors of the controller system disclosed herein via a second connector of the pressure sensor 312, the force data indicating the amount of force of the press on the cover 302 based at least in part on the proximity of the metal layer 310 to the pressure sensor 312.

[0062] Haptic actuator 314 (shown in FIG. 3A but not shown in FIG. 3B ) may be directly or indirectly coupled to carrier 306 and may be configured to provide haptic feedback (e.g., via vibration, pulse, etc.) in response to satisfying one or more criteria. An exemplary criterion may be met if the amount of force of a press on cover 302 meets a threshold. In other words, the criterion may be met if force data provided by pressure sensor 312 includes one or more values ​​(e.g., one or more capacitance values) that meet a threshold, the force data indicating the amount of force of a press on cover 302. Thus, if a user presses cover 302 hard enough to register a press input event, the user may feel haptic feedback in the form of a haptic vibration of cover 302. Another exemplary criterion may be met if touch data provided by touch sensor 304 indicates that a finger touches cover 302 and subsequently drags across cover 302 a predetermined distance while touching cover 302. In this manner, the user may feel a haptic vibration of the cover 302 whenever the user drags a finger a predetermined distance across the cover 302, which may indicate a switch between user interface elements on the display 126. The processor of the controller system disclosed herein may be configured to process touch and / or force data from the touch sensor 304 and / or pressure sensor 312, respectively, to determine whether one or more criteria are met, and if so, send a control signal to the haptic actuator 314 to provide haptic feedback. The control signal may specify a frequency (e.g., a value in Hertz (Hz)) to drive the haptic actuator 314 at a specified frequency. The haptic actuator 314 may be any suitable type of haptic actuator, including, but not limited to, a linear resonant actuator (LRA), an eccentric rotating mass (ERM), etc. The haptic actuator 314 may vibrate or resonate in any suitable direction, such as the X, Y, and / or Z directions depicted in FIGS. 3A-3C .

[0063] The controller 300 depicted in Figures 3A-3C and the pressure sensor 312 depicted in Figure 3D may offer several benefits. For example, the pressure sensor 312 is relatively inexpensive and easy to manufacture, and the intelligence for sensing the amount of force of a press on the cover 302 is provided by the pressure sensor 312 with respect to a "dumb" metal layer 310 proximate to the pressure sensor 312. In this manner, the pressure sensor 312 can be configured to operate with any suitable type of metal layer 310 that can be manufactured without the need to adhere to tight manufacturing tolerances, making the entire FSC (e.g., the pressure sensor 312 and metal layer 310) relatively inexpensive to manufacture and assemble in the controller 300. An alternative to this design is to have two "intelligent" circuit boards spaced apart and configured to measure capacitance changes between the boards based on the relative displacement of the two boards, but this would require more wiring and circuitry to sense pressure than the disclosed FSC (e.g., the pressure sensor 312 and metal layer 310). Additionally, the dual biasing members 308 enable multi-mode deflection, optimizing the amount of movement of the movable components (e.g., cover 302, touch sensor 304, carrier 306, and metal layer 310) both in response to pressure on cover 302 and in response to tactile feedback provided by haptic actuator 314. That is, the pair of biasing members 308(1) and 308(2) (e.g., anisotropic springs) provide optimized pressure and vibration responses independently of each other. In one example, the anisotropic spring (308) may be relatively more flexible in the X or Y direction than in the Z direction.

[0064] FIG. 4 illustrates a back view of the controller 100, showing the back surface 400 of the controller 100. In some cases, the back surface 400 of the controller body 102 may include controls conveniently operated by a user's index or middle finger. In some cases, the back surface 400 may include a portion that is depressible to control one or more underlying buttons within the controller 100. For example, the left portion 402 of the controller 100 may include a first upper control 404 and a first lower control 406. The first upper control 404 and the first lower control 406 may be divided by a first divider line 408 such that a user may selectively engage the first upper control 404 and the first lower control 406. Additionally or alternatively, the right portion 410 of the back surface 400 of the controller 100 may include a second upper control 412 and a second lower control 414. The second upper control device 412 and the second lower control device 414 may be divided by a second divider line 416 such that a user may selectively engage the second upper control device 412 and the second lower control device 414. In some cases, pressure sensors (e.g., FSR, FSC, etc.) may be located beneath the first upper control device 404, the first lower control device 406, the second upper control device 412, and the second lower control device 414, respectively. The pressure sensors (e.g., FSR, FSC, etc.) may detect the amount of force associated with pressing the respective control device. Additionally or alternatively, switches or other actuators may be located beneath the controls on the back surface 400 of the controller body 102.

[0065] FIG. 5 illustrates a front view of an exemplary controller 500 according to one embodiment of the present disclosure. In some instances, the controller 500 may include similar features or components as the controller 100. For example, a front surface 504 of a controller body 502 of the controller 500 may include multiple controls configured to receive user input. Compared to the controller 100, the controller 500 may include a left joystick 506, a left trackpad 508, and / or a left D-pad 510 (e.g., in the form of four separate buttons) controllable by a user's left thumb. The controller 500 may also include a right joystick 512, a right trackpad 514, and / or one or more right buttons 516 controllable by a user's right thumb. Additionally, as shown in FIG. 5, the trackpads 508 and 514 may be circular trackpads. Touch data generated by the controls may be used to detect the presence, location, and / or gesture of a user's fingers operating the controller 500. However, the controller 500 may additionally or alternatively include one or more tilt buttons, triggers, knobs, wheels, and / or trackballs.

[0066] 6 illustrates a top view of the controller 500, showing the upper portion 600 of the controller body 502. The upper portion 600 of the controller 500 may include similar features or components as the upper portion 200 of the controller 100. For example, the upper portion 600 may include one or more left triggers 602, one or more right triggers 604, depressible buttons, a receiver such as a wired communication interface (e.g., port, plug, jack, etc.) for communicatively coupling the controller 500 to an external device (e.g., a charger, a game console, a display, a computing device, etc.), and / or a touch sensor for detecting the presence, position, and / or gesture of a finger on the control device.

[0067] 7 illustrates a back view of the controller 500, showing the back surface 700 of the controller body 502. Also visible in the back view of FIG. 7 are one or more left triggers 602 and one or more right triggers 604. The back surface 700 of the controller body 502 may also include one or more left controls 702 and / or one or more right controls 704, which may be conveniently operated by a user's index or middle finger during normal operation while the controller 500 is held in the user's hand. The one or more left controls 702 and / or one or more right controls 704 may be touch-sensitive to identify the presence, position, and / or gesture of one or more fingers on the controls.

[0068] 8A-8C illustrate various views of a control device 800 having a protrusion 802 for engaging a switch 804 (e.g., a tactile switch) and / or FSR 806 of a controller (e.g., controller 100 and / or controller 500). In this example, control device 800 includes a touch sensor 808 adjacent to a top cover 810, a switch 804 for detecting a press of control device 800, and an FSR 806 for determining an amount of force associated with the press or touch received by control device 800. In some instances, control device 800 may be similar to, represent, and / or be used for a trackpad (e.g., trackpad 108, trackpad 118, trackpad 508, trackpad 514) of controller 100 and / or controller 500, and / or D-pad 110 of controller 100, or D-pad 510 of controller 500. In this manner, the actuatable control device 800 (e.g., a trackpad) may be deflected or depressed to activate a switch 804 below the trackpad. In some instances, the switch 804 and / or FSR 806 may enable D-pad functionality or may be located below the trackpad similar to a D-pad. For example, the control device 800 or trackpad may be pressed in four directions (e.g., left, right, up, and down) or in four locations. In this manner, the control device 800 may operate as a trackpad as well as a D-pad to detect the touch (e.g., presence, location, and / or gesture) and / or pressure of a user's finger operating the handheld controller. Providing the switch 804 below the trackpad area may provide the user with improved feedback when pressing the control device 800 and / or enhance the gameplay experience while using the handheld controller.

[0069] The controller 800 may include a touch sensor 808 disposed on, within, and / or beneath the controller 800 or within the body of the controller 800 for sensing touch and / or proximity to the top cover 810. The touch sensor 808 may include a capacitive sensing array for detecting touch input at or on the surface of the controller 800. In some cases, the touch sensor 808 includes an array of capacitive pads covering some or substantially all of the surface area of ​​the controller 800. In this example, the touch sensor 808 may be adhered or otherwise attached to the underside of the top cover 810 of the controller 800. Although discussed herein as a capacitive sensing array, the touch sensor 808 or the controller 800 may include a resistive touch sensor, an infrared touch sensor, or a touch sensor that utilizes acoustic waves to detect the presence or location of an object. The touch sensor 808 may be configured to detect the presence and location of a touch input on and / or near (e.g., in proximity to) the controller 800. In these cases, a voltage is applied to the conductive layer, resulting in a substantially uniform electrostatic field. When a conductor, such as a user's finger, touches the top cover 810 or moves close to (e.g., within a threshold distance of) the touch sensor 808, a change in capacitance occurs. Capacitance values ​​are measured across the capacitance array to determine the presence and / or location of the conductor, such as a finger. In some cases, these capacitance values ​​may be measured over time for use in identifying a user's finger gesture, such as a swipe.

[0070] In addition to the touch sensor 808, the control device 800 may include a protrusion 802 for contacting or engaging a switch 804 and / or FSR 806 within the controller. In some cases, the switch 804 and / or FSR 806 may be located within the controller body of the controller. In this manner, the controller includes a switch 804 that is selectable via a depression of the control device 800 depending on where a user presses the top cover 810 and the FSR 806, which detects or measures the amount of force associated with the depression. The top cover 810 may include a single piece of injection-molded plastic or any other material that is rigid enough to transfer force from the user's finger to the switch 804 and FSR 806, and thin enough to allow capacitive coupling between the user's finger and the touch sensor 808.

[0071] As illustrated, protrusion 802 may extend from a bottom surface of touch sensor 808 to engage switch 804 and / or FSR 806. In some cases, touch sensor 808 may be molded around protrusion 802 and / or controller may include additional layers vertically above and / or below touch sensor 808 to support protrusion 802. Thus, in some cases, when a user's finger presses top cover 810, controller 800 depresses the associated switch 804 as well as the associated FSR 806.

[0072] Each of the switch 804 and the FSR 806 may be coupled (e.g., via a connector, transceiver, etc.) to one or more processors (e.g., PCB) of the controller system (e.g., a processor within the controller body, a processor of a separate computing device, etc.) such that a press of the control device 800 may result in selection data indicative of the press of the control device 800 being provided from the switch 804 to the processor. The FSR 806 may provide force data indicative of the amount of force of the press to the processor. The selection data and / or force data along with the touch data may be provided to a game or other application, which may translate the data into one or more commands within the game or application. In some cases, the touch data, selection data, and / or force data may be translated together and associated with a predefined command. In some cases, a remote system (e.g., a host computing device, a game console, etc.) with which the controller interacts may determine the presence and / or location of the touch and / or the amount of force associated with the touch (or press).

[0073] In some cases, the data generated by the touch sensor 808 and the data generated by the switch 804 may be combined to determine the presence of a touch on the controller 800. For example, the touch data generated by the touch sensor 808 may be used in combination with the selection data generated by the switch 804 (or the switch being pressed) to confirm the presence of a touch on the controller 800 and / or the location of the touch on the controller 800. The touch data generated by the touch sensor 808 may indicate that the user touched the right-hand side of the top cover 810 (e.g., to the right of the D-pad). If the switch 804, also below the touch sensor 808 on the right side, also detects an input, the presence and / or location of a touch on the top cover 810 at this location may be confirmed or determined. Such a determination may be used to control a game or application operated by the controller 800. For example, a processor in the controller or remote device may compare those generated by the sensors, switches, and FSRs of the controller to determine a command.

[0074] In some cases, after the touch data generated by the touch sensor 808 and the selection data generated by the switch 804 are used to confirm the presence of a touch, only one of the touch data or the selection data may be used, for example, to take an action. In some cases, the controller or remote device may include logic to implement a sensor fusion algorithm based on force data provided by the controller's FSR that combines the touch data provided by the touch sensor and the selection data generated by the switch. Furthermore, in cases where one of the switches detects a touch but the touch sensor does not detect the presence of a touch, the selection detected by the switch may be ignored.

[0075] Thus, data received from the touch sensor 808, the switch 804, and / or the FSR 806 can be used to determine a user's gesture and / or intent with the control device. As illustrated, the control device 800 can include four protrusions to function as a D-pad. The control device 800 can include a touch sensor 808 to detect touches and can be depressible to engage switches 804 and / or the FSR 806 disposed within the controller. In some cases, the control device 800 can be configured to move in four directions (e.g., four cardinal directions). However, in some cases, other track pads with any other range of movement can be used. For example, the control device 800 can be movable in eight directions (e.g., four cardinal directions and four intermediate cardinal directions) to function as an eight-way D-pad.

[0076] The controller 800 may move or flex from a rest position due to the force of a user's pressure, but return to a rest position when not under load. For example, a resilient dome 812 may be disposed over the switch 804 and / or the FSR 806. The resilient dome 812 may represent a spring-like structure that collapses and expands to provide mechanical feedback (e.g., a click) to a user of the controller 800 and / or to place the controller 800 in a rest position. The resilient nature of the controller 800 or the resilient dome 812 may allow the user to selectively depress the switch 804 in response to a force or pressure selectively applied by the user. In some cases, the resilient dome 812 may comprise a conductive material (e.g., stainless steel) and form one pole of a binary switch (e.g., a momentary-contact switch) that may selectively contact the FSR 806. In that case, the binary presence or absence of contact between the elastic dome 812 and the FSR 806 can act as an electrical switching mechanism that changes state in a binary manner (from conductive to non-conductive, or vice versa), while the FSR 806 can sense the magnitude of the crushing force in an analog manner after making contact with the elastic dome 812.

[0077] In some instances, the switch 804 may include a tactile switch, a depressible mechanical switch, a lever arm, or other button that detects a press (or selection) on or at the control device. Additionally, although the control device 800 (or controller) is discussed as having an FSR 806 for detecting force, the control device 800 may include other sensors, such as piezoelectric sensors, load cells, strain gauges, capacitance-type pressure sensors that measure capacitive force measurements, or any other type of pressure sensor. In instances where a user applies a press or touch that is received across multiple switches and / or FSRs, such values ​​may be combined to determine an associated press. This press may also be associated with an amount of force.

[0078] Additionally, while illustrated as being generally flat or planar, the control device 800 may be concave and / or convex. Such features may enhance a user's comfort and / or feel when manipulating the control device 800. For example, the top cover 810 may be concave or curved for user comfort. In such cases, the touch sensor 808 may follow the contours of the top cover 810 to sense touch input.

[0079] 8C , the switch 804 may be positioned vertically below the FSR 806. However, in some cases, the switch 804 may be above the FSR 806, and / or the FSR 806 may be integrated into or coupled to the top cover 810. In some cases, the FSR 806 may be adhered to the underside of the touch sensor 808. In some cases, by mounting the FSR 806 adjacent to the touch sensor 808 and / or top cover 810, the FSR 806 may measure a resistance value corresponding to the amount of force applied to an associated portion of the controller 800 (e.g., force applied to the outer surface of the top cover 810).

[0080] In some instances, the handheld controller may include a lockout feature to disable one or more features of the control device. For example, in an instance where the control device operates as a trackpad and a D-pad, the lockout feature may disable the D-pad function and prevent the control device and / or the D-pad from being pressed down. The control device may then function as a trackpad but not be operable as a D-pad. The lockout feature may be movable to enable and disable features or functions of the control device. For example, if a user does not want the control device to operate as a D-pad, the user may insert a lockout feature or otherwise utilize or activate a lockout to prevent the control device from pressing down on the D-pad and functioning as a D-pad. However, even with the lockout, the control device may still function as a trackpad to receive touch input.

[0081] In some cases, the lockout feature may be mechanically moved by the user (e.g., an insert that prevents the control device from being moved, etc.) or may be controlled by the handheld controller system. For example, depending on the game or application being controlled by the handheld controller, the lockout feature may be automatically enabled or disabled to allow certain functions of the control device. Additionally or alternatively, the handheld controller may include an arm, lever, or brace under the control device that, when moved into position or activated, prevents the control device from being pressed. In some cases, the user may activate the lockout feature on the handheld controller via a button or slide that is pressed or controlled by the user. For example, the user may slide a knob that positions a brace under the control device to prevent the control device from being pressed.

[0082] As an example, the lockout feature may slide between the control device 800 and the controller to prevent the control device 800 from being depressible. Additionally or alternatively, the controller may include an actuatable slide that may be inserted into the control device 800 (e.g., between the control device 800 and the controller) and prevent the control device 800 from being depressible. In another example, a mechanical feature may be inserted into an opening in the controller in which the control device 800 resides to prevent the control device 800 from being depressible. Regardless of how the lockout feature is implemented, the lockout feature may represent a mechanical structure that prevents the control device 800 from being depressible. However, in instances in which a lockout feature is implemented, the touch sensor 808 of the control device may continue to receive touch input to determine the touch, the location of the touch, and / or the presence of a gesture. Thus, disabling the depressible feature of the control device 800 (e.g., disabling the D-pad functionality) may still allow the touch sensor 808 of the control device 800 to function. Removing the lockout feature may allow the controller 800 to be depressible and function as a D-pad.

[0083] In some cases, the lockout feature of the control device 800 (or controller) may be mechanically enabled and / or disabled by a user of the controller (e.g., an insertable wedge, slide, etc.) and / or one or more motors. Additionally or alternatively, the lockout may be automatically enabled and disabled via the controller (or remote device) and based on the game or current application being operated. For example, in certain implementations, the D-pad functionality of the control device 800 may not be needed, the application may not be able to receive D-pad input, etc. In response to this determination, the D-pad may be automatically disabled by the controller. For example, the logic or processor of the controller system may implement a lockout feature to prevent the control device 800 from being pressable. Conversely, if the game or application is configured to be operated using the D-pad, the D-pad functionality may be enabled. However, in some cases, the D-pad functionality may be enabled and disabled depending on user preferences. For example, in certain applications, a user may want to disable the D-pad, while in other applications, a user may want to disable the D-pad. In some cases, disabling the D-pad may correspondingly disable FSR 806 from generating data indicative of the amount of force associated with a touch. However, in some cases, FSR 806 may be integrated into controller 800, vertically above or below touch sensor 808, but may still operate even when touch sensor 808 is disabled. In some embodiments, a lockout feature may disable D-pad functionality of controller 800 by disabling controller 800 from being independently depressible in one of multiple (e.g., four) actuatable regions, but controller 800 may still remain depressible as a whole (e.g., all switches 804 may be actuated simultaneously by pressing controller 800, but each switch 804 may be prevented from being pressed without also simultaneously pressing the remaining switches 804 while the lockout feature is enabled).

[0084] 9A-9C illustrate an exemplary control device 900 having a trackpad 902 and a D-pad 904. As shown, the trackpad 902 may be generally circular in shape with a cross-shaped cutout 906 in the center. This cutout 906 may form an area or opening occupied by the D-pad 904 when the D-pad 904 is coupled to a controller or when the control device 900 is assembled. In this sense, the control device 900 may act as a touch sensor (via the trackpad 902) and a D-pad (via the D-pad 904) for detecting touches and presses on the control device 900. In some instances, the control device 900 may resemble, represent, and / or be used for the trackpad (e.g., trackpad 108, trackpad 118, trackpad 508, trackpad 514) of the controller 100 and / or controller 500, and / or the D-pad 110 of the controller 100 and / or the D-pad 510 of the controller 500.

[0085] A switch 908 for detecting a press may be located at each corner of the D-pad 904 or under each depressible direction (e.g., up, down, left, right). The switches 908 may detect a press of the D-pad 904 at their corresponding locations. In some cases, the trackpad 902 may remain stationary (i.e., not depressible), but the D-pad 904 may be depressible in four directions (e.g., left, right, up, and down) to engage the switch 908. For example, a user may press the D-pad 904 right, left, up, and down to depress the associated switch 908, but the trackpad 902 remains stationary and is not depressed. Thus, the D-pad 904 may be depressible and capable of being depressed into the trackpad 902, but the trackpad 902 may remain stationary and sense the presence, location, and gesture of a touch. The D-pad 904 may reside within the trackpad 902, such as in the center. For example, the trackpad 902 or the body of the control device 900 may include a cutout in the shape of a D-pad (e.g., a cross), and the D-pad 904 may reside within the cutout of the trackpad 902. The trackpad and D-pad may be separately addressable or actuatable and may be configured to receive their own respective inputs.

[0086] The trackpad 902 and the D-pad 904 may have a minimum spacing between them to provide a substantially seamless feel to the user. For example, the size of the D-pad 904 may be slightly smaller than the size of the cutout 906 in the trackpad 902 to provide a substantially seamless look and feel. As such, there may be a minimum spacing between the outer surface (or edge) of the D-pad 904 and the inner surface of the cutout 906. However, the spacing between the D-pad 904 and the trackpad 902 may provide sufficient tolerance to allow the D-pad 904 to be depressible.

[0087] In some cases, the surface of the D-pad 904 may be substantially continuous with the surface of the trackpad 902, such that the contours of the D-pad 904 may be complementary to the contours of the trackpad 902, and vice versa. For example, the trackpad 902 may include a concave shape, and the D-pad 904 may mimic, mirror, or be complementary to the recessed features of the trackpad 902. The complementary contours of the trackpad 902 and the D-pad 904 may provide a smooth surface for the user to manipulate the controller.

[0088] Additionally or alternatively, in some cases, the D-pad 904 may be slightly raised above or recessed below the surface of the trackpad 902 to provide physical feedback and allow a user to position the D-pad 904 within the trackpad 902 or on the control device 900. For example, by slightly raising the surface of the D-pad 904 above or relative to the surface of the trackpad 902, the user may sense (e.g., feel) where the D-pad 904 is located and / or which parts of the D-pad 904 are depressible (e.g., left, right, up, and down), within which the user may find the corresponding directional position to press on the D-pad 904.

[0089] In some cases, the controller 900 or a portion of the controller may include an FSR 910 for sensing the amount of force applied to an area of ​​the trackpad 902 and / or the amount of force applied to a particular button (or direction) of the D-pad 904. In some cases, the FSR 910 may be located within the controller, below the controller 900, and / or on the controller 900 itself. For example, the FSR 910 may be located on or adhered to the trackpad 902 and / or D-pad 904. In some cases, the FSR 910 may be adhered to the cover of the trackpad 902 and / or the cover of the D-pad 904. Additionally, as shown in FIG. 9C , the FSR 910 may be located below a resilient dome 912. The resilient dome 912 may be depressible via protrusions 914 extending from the D-pad 904 or areas of the D-pad 904 corresponding to up, down, left, and right. When a user presses a particular direction on the D-pad 904, a corresponding press may be sensed via a switch under a particular protrusion 914. An associated FSR 910 may also detect the amount of force associated with the press. Thus, the switch 908 and / or FSR 910 may engage or sense the press based on the protrusion 914 collapsing the elastic dome 912.

[0090] 9 illustrates a particular embodiment or configuration of switch 908 and / or FSR 910, switch 908 and / or FSR 910 may be located anywhere on controller 900 and / or within a controller for sensing a press on controller 900 and the amount of force associated with the press. Additionally, switch 908 and / or FSR 910 may be engaged using a mechanism other than protrusion 914.

[0091] Each of the switches 908 and the FSRs 910 may be coupled (e.g., via connectors, transceivers, etc.) to one or more processors (e.g., PCBs) of the controller system (e.g., a processor within the controller body, a processor of a separate computing device, etc.) such that a press of the control device 900 may result in selection data indicative of the press of the control device 900 being provided from the switches 908 and the FSRs 910 to the processor. The FSRs 910 may provide force data indicative of the amount of force of the press to the processor. The selection and / or force data along with the touch data may be provided to a game or other application for interpretation of the data as one or more commands. In some instances, the touch data, selection data, and / or force data may be interpreted together and associated with predefined commands. In some instances, a remote system with which the controller interacts (e.g., a host computing device, a game console, etc.) may determine the presence and / or location of the touch and / or the amount of force associated with the touch (or press).

[0092] As discussed above with respect to the controller 800, in some cases, the controller 900 or the controller on which the controller 900 is implemented may include a lockout feature. The lockout may prevent a portion of the controller 900, such as the D-pad 904, from being depressible. For example, the lockout may slide between the controller 900 and the controller, the controller may include an actuable slide inserted into the controller 900, and / or the lockout may be inserted into an opening in the controller in which the controller 900 resides to prevent the controller 900 from being depressible. The lockout may prevent the D-pad 904 from being depressible (i.e., disable the D-pad 904) but allow the trackpad 902 (e.g., touch sensors of the trackpad 902 and / or touch sensors on the D-pad 904) to receive touch input to determine a touch, the location of the touch, and / or the presence of a gesture. In some instances, the lockout feature of the control device 900 (or controller) may be enabled and disabled mechanically by the user and / or one or more motors of the controller. Additionally or alternatively, the lockout may be enabled and disabled automatically via the controller and based on the game or current application being operated by the controller.

[0093] In some cases, the D-pad and / or the switch under the control device (which functions as a D-pad) may be backlit to indicate the location of the D-pad on / in the control device and / or the location of the switch under the control device. The lighting may be turned on to reveal the location of the D-pad and / or the switch, and may be turned off to hide the location of the D-pad and / or the switch (e.g., in cases where the D-pad and / or the switch are disabled). In some cases, the control device or its cover may include minute crevices (e.g., slits, openings, holes, etc.) to allow light emitted by the light-emitting element to pass through the control device (or a portion thereof) and radiate outside the handheld controller. Additionally, components of the control device (e.g., the trackpad) may be fabricated from double-shot materials, including transparent and opaque materials. The transparent material allows light to pass through the switch and / or D-pad to indicate their location. Additionally or alternatively, portions of the control device may include thinned areas to allow light to pass therethrough. In cases where the control device includes a trackpad with a cutout for a D-pad, the emitted light may pass through or be within the cutout between the wall of the cutout and the D-pad.

[0094] In some cases, the light-emitting element may also indicate the function or mode of the control device. For example, in cases where the D-pad is enabled or configured to receive input, the D-pad may be illuminated (e.g., the control device may be illuminated to have a D-pad shape). In cases where the D-pad is disabled (e.g., mechanically locked out) and the trackpad is enabled, for example, the trackpad may be illuminated (e.g., the control device may be illuminated to have a circular outline shape). Thus, the control device may include a first illumination state (or mode) to indicate D-pad mode and a second illumination state (or mode) to indicate trackpad mode. However, the control device may have a mode in which the D-pad and trackpad are usable simultaneously.

[0095] 10A and 10B illustrate example control devices 1000 and 1002, respectively, with backlighting features. Control device 1000 and / or control device 1002 may have holes or other features to allow light to shine through or pass through its cover or body. For example, light-emitting components (e.g., light-emitting diodes (LEDs), organic light-emitting diodes (OLEDs), etc.) may be disposed within the controller and oriented to emit light through a surface of control device 1000 and / or control device 1002. In some cases, the controller or control device may include a diffuser or light guide to direct emitted light toward the surface of the controller. Additionally or alternatively, the light-emitting components may be disposed in a portion of control device 1000 and / or control device 1002. In some cases, control device 1000 and / or control device 1002 may be similar to, represent, and / or be used for, a trackpad (e.g., trackpad 108, trackpad 118, trackpad 508, trackpad 514) of controller 100 and / or controller 500, and / or D-pad 110 of controller 100, and / or D-pad 510 of controller 500.

[0096] The control device 1000 and / or the control device 1002 may include minute fissures (e.g., slits, holes, etc.) to allow light emitted by the light-emitting components to radiate through the surface. Additionally, the control device 1000 and / or the control device 1002 may be fabricated from double-shot materials, including transparent and opaque materials, where the transparent material allows light to pass therethrough. Additionally or alternatively, portions of the control device 1000 and / or the control device 1002 may include thinned regions to allow light to pass therethrough. In the case of the control device 1002, and in instances where the control device includes a cutout for a D-pad, the emitted light may pass through or be within the cutout, between the wall of the cutout and the D-pad.

[0097] The light-emitting components may serve to indicate the location of buttons or switches within the controller. For example, light may pass through the control device to indicate the portion of the control device that corresponds to the D-pad. In the case of FIG. 10A , for example, light may shine through the top cover of the control device 1000 to indicate that a user can press the top, bottom, left, or right of the control device 1000 to activate a switch. That is, light may indicate the location of the switches below the control device 1000 to visually indicate the switches below the control device 1000. When the control device 1000 is operated as a D-pad, light may shine through each portion of the control device 1000 (or trackpad) to visually indicate to the user the location of the buttons on the control device 1000. For example, as shown in FIG. 10A , switches 804 located below the control device 1000 and the location of these switches 804 may be indicated by openings 1004 that surround or enclose the switches 804. As noted above, light may be emitted through these openings 1004 to indicate the presence or location of switches 804 and that a user may operate the controller 1000 as a D-pad. However, rather than the openings 1004 enclosing the switches 804, the openings 1004 may indicate the associated features of a D-pad (e.g., left arrow, right arrow, up arrow, down arrow). Alternatively, the openings 1004 or their arrangement on the controller 1000 may be shaped differently than shown. For example, the openings 1004 may form a square outline or a hexagonal outline.

[0098] In the case of FIG. 10B , the light may indicate the location of a D-pad within the control device 1002. In this sense, in FIG. 10B , the light may outline the shape of a D-pad within the control device 1002. For example, the control device 1002 may include an opening 1006 arranged in the shape of a cross. That is, FIG. 10B illustrates that rather than having an opening 1004 including four circles that shines through the cover of the control device 1000, the shape of a D-pad may be outlined on the cover of the control device 1002 via a light-emitting component. In some instances, FIG. 10B and the opening 1006 may more clearly indicate to a user that the control device 1002 functions as a D-pad (e.g., by including a cross-shaped outline) compared to including four circles (e.g., FIG. 10A ). Regardless, the control device 1000 and / or the control device 1002 may be operable to depress respective switches 804 to cause one or more actions to be performed. The opening of the control, whether 1004 or 1006, may visually indicate the function of the control and that the user may click on a respective portion of the control to depress a switch 804 underneath the control. In some instances, the controller may backlight the control in response to receiving or sensing a touch on the control to determine that the control is being operated, or may continuously illuminate the control.

[0099] 11A and 11B illustrate utilizing light-emitting components of the controller to visually indicate various states or modes of the control device 1100. In some cases, the control device 1100 may represent or be similar to the control device 900. For example, the control device 1100 may include a D-pad 1102 surrounded by a trackpad 1104. The D-pad 1102 may be located within or reside within a cutout 1106 in the trackpad 1104. In this manner, the control device 1100 may be operable as a D-pad and a touch sensor. In some cases, the control device 1100 may resemble, represent, and / or be used for a trackpad (e.g., trackpad 108, trackpad 118, trackpad 508, trackpad 514) of the controller 100 and / or controller 500, and / or the D-pad 110 of the controller 100, and / or the D-pad 510 of the controller 500.

[0100] To indicate the functionality of the control device 1100, the control device 1100 may be illuminated, or respective portions of the control device 1100 may be illuminated. For example, in FIG. 11A , the track pad 1104 may be enabled, and a light-emitting component may be configured to emit light around the outer ring or periphery of the track pad 1104. For example, FIG. 11A illustrates an outline 1108 disposed around the periphery of the track pad 1104. This outline 1108 (e.g., a halo) may be generated via a light-emitting light-emitting component disposed beneath the control device 1100 within the controller. Thus, light may illuminate around the track pad 1104 in the shape of the outline 1108. In such a case, the D-pad 1102 may be disabled and / or may not be able to sense or receive touch input (e.g., presses). Therefore, to visually indicate to the user that the D-pad 1102 is disabled, the D-pad 1102 may not be illuminated or a light may not outline the D-pad 1102 within the controller 1100. However, in this mode, the trackpad 1104 may be configured as a touch sensor to receive input from the user. The user or controller may switch the functionality of the controller 1100 depending on the application being controlled. In such cases, the controller 1100 may illuminate a second appearance state or mode.

[0101] For example, as shown in FIG. 11B , the light-emitting components of the controller may illuminate the control device 1100 to indicate or outline the D-pad 1102. Here, as discussed above, light emitted via the light-emitting components may shine in the shape of outline 1110 through the cutout in which the D-pad 1102 resides. As shown, outline 1110 may generally include a cross shape similar to the D-pad. Here, in this mode, or when the D-pad 1102 is backlit, the D-pad 1102 may be configured to receive input from a user to engage a switch located thereunder. That is, in FIG. 11B , the illumination of the D-pad 1102 may indicate that a user may utilize the D-pad 1102 or that the D-pad 1102 is functional to receive input. In such a case, the light-emitting components around the perimeter of the trackpad 1104 that indicate its functionality (as shown in FIG. 11A ) may be disabled. However, as discussed above, in some cases, the control device 1100 may be usable as a D-pad and a touch sensor. In such a scenario, the trackpad 1104 and D-pad 1102 may be illuminated (as shown in FIGS. 11A and 11B, respectively).

[0102] Additionally, in some instances, the trackpad 1104 and the D-pad 1102 may be illuminated in response to detecting a press, touch, or other input. For example, when a user touches the trackpad 1104, the controller 1100 may be illuminated to indicate that the user is manipulating a portion of the trackpad 1104 of the controller 1100 (e.g., as shown in FIG. 11A ). When a user touches or presses a portion of the D-pad 1102, the controller 1100 may be illuminated to indicate that the user is manipulating a portion of the D-pad 1102 of the controller 1100 (e.g., as shown in FIG. 11B ). Thus, the light-emitting components of the controller may indicate the current function of the controller 1100.

[0103] More generally, the control device 1100 may be illuminated to indicate the current mode or function of the control device (e.g., capable of receiving and / or detecting inputs). In this sense, the control device 1100 may be switched between modes depending on the configuration of the controller in which the control device 1100 is implemented and / or user preferences. Regardless, the control device 1100 may visually indicate its function via backlighting. Furthermore, in some cases, the controller may include respective light-emitting components for indicating the mode of the control device 1100. For example, a first light-emitting component may illuminate to indicate a first mode, and a second light-emitting component may illuminate to indicate a second mode. The light-emitting components may be turned on and off depending on the configuration of the control device, as determined by the controller. For example, in a first mode, the processor of the controller may cause a first light-emitting component to illuminate and indicate the function of track pad 1104, as shown in FIG. 11A, and in a second mode, the processor may cause a second light-emitting component to illuminate and indicate the function of D-pad 1102, as shown in FIG. 11B. In some embodiments, the controller 1000, controller 1002, and / or controller 1100 with light features may be obscured or hidden when the light-emitting elements of the controller are not emitting light and may reveal (e.g., highlight) the location of the controller on the controller body when the light-emitting elements emit light. For example, the front of the controller body may not include any features of the controller 1000 / 1002 / 1100 that are visible to the naked eye when the light-emitting elements of the controller are turned off and not emitting light, such as a flush surface. However, once the light emitting element is turned on, the user can see and therefore determine where the control device 1000 / 1002 / 1100 is located on the controller body.

[0104] FIG. 12 illustrates a controller 1200 having a touch sensor 1202 for sensing touches across the controller 1200. In some cases, the controller 1200 may be similar to or representative of the controller 900. Generally, the touch sensor 1202 may include a first portion 1204 corresponding to a track pad and a second portion 1206 corresponding to a D-pad. In some cases, the first portion 1204 may correspond to a first touch sensor or a first capacitive array, while the second portion 1206 may correspond to a second touch sensor or a second capacitive array. The first portion 1204 and the second portion 1206 may combine to form the touch sensor 1202. In other words, the D-pad and the track pad may include separate touch sensors for detecting touch inputs across the entire controller. For example, the first capacitive sensing array 1204 may be disposed on, within, or beneath the track pad (e.g., a cover for the track pad). The first capacitive sensing array 1204 may be generally circular in shape (in cases where the trackpad includes a circular shape) with a cutout corresponding to the D-pad. The cutout may correspond to the area or portion of the trackpad where the D-pad is located. The second capacitive sensing array 1206 may be disposed above, within, or below the D-pad (e.g., a cover for the D-pad). The second capacitive sensing array 1206 may be cross-shaped, allowing the D-pad to be depressed in four directions (e.g., left, right, up, and down). The first capacitive sensing array 1204 and the second capacitive sensing array 1206 may collectively form a capacitive array across the surface of the controller 1200. Thus, when a user moves their finger across the controller 1200 (e.g., the trackpad and D-pad), the controller 1200 may sense the presence, location, and / or gesture of the finger.

[0105] As illustrated, first portion 1204 includes a cutout 1208 in the form of a cross, which may correspond to the shape of a D-pad. First portion 1204 may be configured to sense touches on controller 1200 outside of cutout 1208 and over the area of ​​a trackpad. Meanwhile, the D-pad may include a cross-shaped second portion 1206. Collectively, first portion 1204 and second portion 1206 may form a capacitance array across substantially all of the surface of controller 1200. As a user moves their finger across controller 1200 (e.g., trackpad and D-pad), controller 1200 may sense the presence, location, and / or gesture associated therewith of the touch. In some instances, logic in the controller may combine touches received at first portion 1204 and second portion 1206 to combine the inputs and determine the presence, location, and / or gesture associated therewith of the touch. In some cases, the controller or remote device may utilize one or more fusion algorithms to combine inputs received at the first portion 1204 and the second portion 1206. For example, a software filter may combine the outputs of the first portion 1204 and the second portion 1206, allowing multiple capacitive sensing arrays to function as a complete circular touch sensor. As an example, if a user slides their finger across the D-pad from the left side of the controller 1200 to the right side of the controller 1200, portions of the touches received at the first portion 1204 and the second portion 1206 may be combined to determine the user's gesture or swipe. Thus, the user may utilize the entire surface of the controller (or substantially the entire surface of the controller) as a trackpad and may also use the controller as a D-pad.

[0106] Additionally, the D-pad may still function as a D-pad and may be depressible to detect pressure. In this manner, the controller 1200 may receive touch input across substantially all of its surface and still act as a D-pad. Given the operation of the D-pad, or the depressible nature of the D-pad, the controller 1200 may not include a touch sensor within the cutout 1208 (to allow the D-pad to be depressed).

[0107] As discussed above, the handheld controller may also include one or more joysticks, commonly referred to as "thumbsticks." In some cases, the joystick may include a circular base frame having a flexible, cross-shaped support member for supporting the joystick. A portion of the flexible, cross-shaped support member may be attached to the circular base frame. The flexible, cross-shaped support member may allow 360-degree deflection of a joystick mounted within or at the center of the flexible, cross-shaped support member. A strain gauge may be attached to a portion of the flexible, cross-shaped support member to sense the degree of deflection when a user manipulates the joystick. The degree of deflection may be associated with a particular position of the joystick (e.g., up, down, left, right, pressed in, etc.).

[0108] In some cases, the flexible cross-shaped support member may include multiple strain gauges located on a portion (or member) of the flexible cross-shaped support member to determine the location or position of the joystick. In such cases, each of the strain gauges may sense or generate data representing the degree of deflection of a respective member (or portion) of the flexible cross-shaped support member. The values ​​sensed or generated from the strain gauges, when combined, may indicate the position of the joystick.

[0109] 13A-13C illustrate various views of an exemplary control device 1300. FIG. 13A illustrates a front perspective view of control device 1300, FIG. 13B illustrates a rear perspective view of control device 1300, and FIG. 13C illustrates a rear plan view of control device 1300. In some instances, control device 1300 may resemble or represent a thumbstick or joystick operable by a user's thumb when control device 1300 is coupled to or disposed with a controller. In some instances, control device 1300 may resemble, represent, and / or be used for a joystick (e.g., joystick 106, joystick 116, joystick 506, joystick 512) of controller 100 and / or controller 500.

[0110] The controller 1300 includes a support member 1302 for supporting a thumbstick 1304 that is operable by a user's thumb. A portion of the support member 1302 may operably couple the thumbstick 1304 to a circular base frame 1306 or to other members disposed around the thumbstick 1304. The support member 1302 may support or hold the controller 1300 within the controller. For example, the support member 1302, such as the circular base frame 1306, may couple to the controller (or controller body) to position the thumbstick 1304 on the front of the controller and for use by a user.

[0111] The support member 1302 may include features to allow the thumbstick 1304 to be manipulated (e.g., rotated) within the controller. For example, as shown, the support member 1302 may include a cross-shaped feature that, in some cases, is flexible to allow the thumbstick 1304 to undergo 360 degrees of deflection. As an example, the support member 1302 may include a first member 1308, a second member 1310, and a third member 1312. Each of the first member 1308, second member 1310, and / or third member 1312 may be flexible (e.g., pliable, bendable, pushed, pulled, etc.) to allow the thumbstick 1304 to be rotated and manipulated.

[0112] The first member 1308 may couple to the thumbstick 1304 via a post 1314. The first member 1308 is also shown disposed within a housing 1316. In some cases, the housing 1316 may include a generally rectangular shape. The first member 1308 may couple to the housing 1316 at both ends. For example, a first end of the first member 1308 may couple to the housing 1316 at a first end, while a second end of the second member 1310 may couple to an opposing second end of the housing 1316. In some cases, the coupling of the first member 1308 within the housing 1316, or the point at which the first member 1308 couples to the housing 1316, may allow the thumbstick 1304 to be manipulated to left and right positions. Additionally, as shown, the housing 1316 may be positioned away from the circular base frame 1306 and may not be coupled to the circular base frame 1306. Such an offset may allow the joystick to be operated within the circular base frame 1306.

[0113] The second member 1310 and the third member 1312 may be coupled to both sides or both surfaces of the circular base frame 1306 and the housing 1316. For example, the second member 1310 may include a first end that couples to a first side or surface of the circular base frame 1306 and a second end that couples to a first side of the housing 1316. The third member 1312 may include a first end that couples to a second side or surface of the circular base frame 1306 and a second end that couples to a second side of the housing 1316 opposite the first side of the housing 1316. In some cases, the second member 1310 and / or the third member 1312 may be oriented orthogonal to or perpendicular to the first member 1308 (or housing 1316). In some instances, the coupling of the second member 1310 and the third member 1312 with the circular base frame 1306 and the housing 1316 may allow the thumbstick to be manipulated into an upward and downward position.

[0114] Thus, the coupling of the second member 1310, the third member 1312, and their respective housings 1316 and / or the circular base frame 1306 via the first member 1308 may allow the thumbstick 1304 to be manipulated 360 degrees. In some instances, the thumbstick 1304 may be mounted within or at the center of the support member 1302.

[0115] The first member 1308, the second member 1310, and / or the third member 1312 may include shapes or features that allow the thumbstick 1304 to be manipulated as described above. For example, the first member 1308, the second member 1310, and / or the third member 1312 may include shapes that allow the first member 1308, the second member 1310, and / or the third member 1312 to flex, bend, and / or rotate, respectively. As an example, the first member 1308, the second member 1310, and / or the third member 1312 may include a particular cross-sectional shape / feature that allows it to flex. In some cases, the cross-section may be cross-shaped, T-shaped, oval, or circular. Such cross-sections may allow the first member 1308, the second member 1310, and / or the third member 1312 to flex to manipulate the thumbstick 1304. In some cases, the cross-sections may be uniform throughout the length of the members, or the cross-sections may vary in size and / or shape along the length of the members.

[0116] The cross-sections of the first member 1308, second member 1310, and / or third member 1312 may also be modified or changed to adjust the amount of force or pressure required by a user to flex or manipulate the thumbstick 1304. For example, to make the thumbstick 1304 more rigid, the thumbstick 1304 may include different shapes or thicknesses.

[0117] Strain gauges may be attached to portions of the support member 1302 to sense movement of the thumbstick 1304. The strain gauges may sense the degree of deflection associated with each member. For example, as shown in FIG. 13C , one or more first strain gauges 1318 may be attached to the first member 1308 to measure the amount of deflection the first member 1308 experiences upon manipulation of the thumbstick 1304 by a user. Additionally or alternatively, one or more second strain gauges 1320 may be attached to the second member 1310 to measure the amount of deflection the second member 1310 experiences. Additionally or alternatively, one or more third strain gauges 1322 may be attached to the third member 1312 to measure the amount of deflection the third member 1312 experiences.

[0118] The degree of deflection experienced by the first member 1308, the second member 1310, and the third member 1312 may be associated with a particular position of the thumbstick 1304 (e.g., up, down, left, right, pressed in, etc.). For example, based on movement of the thumbstick 1304, each of the members may experience a particular degree of flexion. This flexion may be detected by strain gauges, or the strain gauges may generate data indicative of the strain experienced. In some instances, each strain gauge may sense a respective degree of deflection of the member, which, when combined, may indicate the position of the thumbstick 1304. That is, by knowing the strain experienced by each strain gauge, it may be possible to determine the position and orientation of the thumbstick.

[0119] Each of the strain gauges of the first member 1308, second member 1310, and third member 1312 may be communicatively coupled (e.g., via a connector, transceiver, etc.) to one or more processors (e.g., PCB) of the controller system (e.g., a processor within the controller body, a processor of a separate computing device, etc.) so that the position of the thumbstick 1304 may be determined. The data or the position of the thumbstick 1304 may be provided to a game or other application for interpretation as one or more commands, such as controlling the user's position within an environment. In some instances, a remote system (e.g., a host computing device, a game console, etc.) with which the controller interacts may receive data from the strain gauges to determine the amount of deflection of the thumbstick 1304 and / or the position of the thumbstick 1304 to effect a command.

[0120] In some cases, one or more first strain gauges 1318, one or more second strain gauges 1320, and / or one or more third strain gauges 1322 may be coupled to the first member 1308, the second member 1310, and the third member 1312, respectively, at various locations along the length of the member or at different positions in the cross section of the member. For example, strain gauges may be coupled to the top, bottom, and / or sides of the first member 1308, the second member 1310, and the third member 1312 to sense the degree of deflection of the first member 1308, the second member 1310, and the third member 1312, respectively.

[0121] In some instances, a user may press the thumbstick 1304, and the amount and degree of deflection experienced by the first member 1308, the second member 1310, and the third member 1312, respectively, may be determined for use in detecting the amount of pressure and / or force associated with the pressure. Additionally, in some instances, the thumbstick 1304, such as on the top of the thumbstick 1304, may include a touch sensor or trackpad for sensing movement of the user's thumb or finger. Including a trackpad on the top of the thumbstick 1304 allows the thumbstick 1304 to be utilized as a trackpad for detecting the presence, location, and / or gesture associated with a touch on the thumbstick 1304. In some instances, the thumbstick 1304 may be utilized as a trackpad without deflecting the thumbstick 1304.

[0122] In some cases, the cap or top of the joystick may include a touch sensor (e.g., a capacitive sensing array) for sensing the movement of a user's thumb or finger. Including a touch sensor on the top of the joystick may enable the joystick to be operated as a trackpad for detecting the presence, location, and / or gestures associated with the joystick touch. In some cases, the joystick may be utilized as a trackpad without deflecting the joystick. In some cases, the joystick may be utilized as a joystick without utilizing a trackpad. However, in some cases, the joystick may serve as both a joystick and a trackpad for simultaneously detecting the position / deflection of the joystick and the presence, touch, or gestures of the trackpad.

[0123] In some cases, the joystick of a handheld controller may include capacitance sensors or other electrodes spaced apart on the top of the joystick to sense thumb movement. The electrodes may detect the initial movement of the thumb using the capacitance electrodes and before the handheld controller senses the joystick movement. For example, conventional handheld controllers may be associated with a potentiometer that detects the initial movement of the joystick and include a "dead band" that is not detectable by the handheld controller. For example, in some cases, the initial movement may not be detectable until the joystick deflects or moves a threshold amount. In such cases, a user may begin to deflect the joystick, but corresponding movement in the video game (e.g., cursor movement) may not occur until the threshold amount of displacement is detectable by the potentiometer. As disclosed herein, to detect this initial movement, multiple capacitance electrodes on the joystick cap may detect the initial movement of the thumb across the joystick cap. The capacitance electrodes may detect the direction of the thumb movement to control corresponding aspects of the video game according to the direction of the movement. In some cases, the capacitive electrodes may continue to detect movement (and / or direction) until the potentiometer begins to detect deflection of the joystick.

[0124] The joystick or the cap or top surface of the joystick may include any number of capacitive electrodes. For example, the joystick may include a first capacitive electrode located in the center of the cap and three capacitive electrodes arranged radially around the center of the cap.

[0125] 14 illustrates an example control device 1400, which in some cases may resemble a thumbstick operable by a user's thumb. In some cases, control device 1400 may include a trackpad (e.g., a capacitive sensing array) for sensing movement of a user's thumb or finger across a top 1402 or surface of control device 1400. In some cases, control device 1400 may resemble, represent, and / or be used for a joystick (e.g., joystick 106, joystick 116, joystick 506, joystick 512) of controller 100 and / or controller 500.

[0126] In some cases, the control device 1400 may include electrodes 1404 (e.g., capacitance sensors) spaced apart on the upper portion 1402 to sense thumb movement. The electrodes 1404 may, in some cases, detect the initial movement of the thumb on the control device 1400 before the control device 1400 or a controller detects the movement of the control device 1400. For example, in some cases, the control device 1400 may include a "dead band" associated with a potentiometer of the controller that detects the initial movement of the control device 1400. This dead band may be undetectable by the controller. That is, even though the user is moving the control device 1400 (e.g., a joystick), the controller may include a delay or "dead band." This initial movement of the control device 1400 by the user may be undetectable or undetectable by the controller until the control device 1400 deflects a threshold amount. In such cases, a user may begin to deflect or move the control device 1400, but a corresponding movement in the video game (e.g., cursor movement) may not occur until a threshold amount of displacement is detectable by the potentiometer.

[0127] Thus, electrodes 1404 may be disposed in or on the top 1402 of the control device 1400 to detect this initial movement. The electrodes 1404 may detect the initial movement of the thumb and correlate the movement to an application being operated by the controller. The electrodes 1404 may detect the direction of movement to control corresponding aspects of a video game according to the direction of movement of the control device 1400. In some instances, the electrodes 1404 may continue to detect movement (and / or direction) until the potentiometer can detect a deflection of the thumbstick, after which the electrodes 1404 may be disabled or ignored. In this sense, the electrodes 1404 may sense movement of the control device 1400 during a first period and before the movement of the control device 1400 is detected by the potentiometer. Thereafter, the potentiometer of the controller may sense movement during a second period and after the amount of movement of the control device is greater than a threshold amount. In some cases, during the second time period, the electrodes 1404 may be disabled and data generated by the electrodes 1404 may be ignored. However, in some cases, the controller 1400 may use thumb movement (detected by the electrodes 1404) and joystick movement (detected by the potentiometer) to control movement. Thus, the electrodes 1404 and the potentiometer may be used in combination to sense movement of the control device and / or movement of the user's thumb.

[0128] In some cases, the electrodes 1404 may sense the movement of a user's thumb compared to the movement of a thumbstick. For example, as a finger moves across the top 1402 of the control device 1400, the electrodes 1404 may sense this movement and anticipate movement of the control device 1400 in a particular direction.

[0129] In some cases, the control device 1400 or the upper portion 1402 of the control device 1400 may include any number of electrodes 1404. For example, as shown in FIG. 14 , the control device 1400 may include a centrally located electrode and four electrodes arranged radially around the centrally located electrode. In some cases, the peripheral electrodes may be arranged near the periphery of the control device 1400. However, in some cases, any number of electrodes 1404 may be used to detect the initial movement of the control device 1400 and / or the thumb. For example, the control device 1400 may include a single centrally located electrode and four electrodes arranged around the periphery and / or elsewhere of the control device 1400.

[0130] 14 also illustrates a connector 1406 for communicatively coupling the control device 1400 (or other control device) to the processor of the controller. For example, the connector 1406 may provide movement data from electrodes 1404 and / or touch sensors disposed on the control device 1400. In some cases, the control device 1400 may represent a ball-and-socket type interface, and the connector 1406 may be routed from inside the control device 1400 to hide a portion of the connector 1406. In some cases, the connector 1406 may represent a flex circuit or wiring that runs inside the control device 1400 to the top 1402 or to a portion of the control device 1400 (e.g., the electrodes 1404, buttons, etc.).

[0131] In some cases, a handheld controller may include a control device having a trackpad and electrodes for determining the amount of force associated with a press. For example, to detect a press on the trackpad, the control device or handheld controller may include electrodes disposed below (e.g., vertically below) the trackpad. The force may be detected by a change in capacitance between the electrodes and the trackpad's capacitance array. When a user presses an area on the trackpad (or the top surface of the control device) to vary the amount of force, the trackpad may deflect, and the amount of force may be sensed by a change in capacitance between the electrodes and the capacitance array. In such cases, the trackpad may be fabricated from a flexible material to allow the trackpad to deflect toward the electrodes and, in response, the amount of force to be detected by the handheld controller or remote device.

[0132] 15A-15C illustrate an example controller 1500 for sensing a touch on the controller 1500 and the amount of force associated with the touch or press on the controller 1500. In some cases, the controller 1500 may include a stack or layer of sensors for sensing the press and the amount of force associated with the press. For example, the controller 1500 may detect the presence, location, force, and / or gesture of a user's finger. In some cases, the controller 1500 may be similar to, represent, and / or be used for, a trackpad (e.g., trackpad 108, trackpad 118, trackpad 508, trackpad 514) of the controller 100 and / or the D-pad 110 of the controller 100 and / or the D-pad 510 of the controller 500.

[0133] 15A illustrates a diagram of a simplified or assembled control device 1500 showing a top cover 1502, a touch sensor 1504 (e.g., a capacitance array), and / or a pressure sensor 1506 (e.g., electrodes). In some cases, the top cover 1502 may be disposed above the touch sensor 1504 and the pressure sensor 1506, and the touch sensor 1504 may be disposed above the pressure sensor 1506. Additionally, one or more insulating layers 1508 may be disposed between the touch sensor 1504 and the pressure sensor 1506. In some cases, the top cover 1502, the touch sensor 1504, the pressure sensor 1506, and / or the one or more insulating layers 1508 may be bonded together using an adhesive.

[0134] A touch sensed by the touch sensor 1504 may be transmitted to one or more processors of the controller via a first connector 1510, and an amount of force associated with the touch may be transmitted to one or more processors of the controller via a second connector 1512.

[0135] FIG. 15B illustrates an exploded view of the controller 1500, showing components of the controller 1500, including a top cover 1502, a touch sensor 1504, a pressure sensor 1506, and one or more insulating layers 1508. FIG. 15C illustrates a side view of the controller 1500. As discussed above, the controller 1500 may include a touch sensor 1504 as well as a pressure sensor 1506 to determine the amount of force associated with a press on the controller 1500. In some cases, the pressure sensor 1506 may include one electrode or multiple electrodes configured to detect a change in capacitance by the touch sensor 1504. For example, in cases where the touch sensor 1504 includes a capacitance array, a change in capacitance between the capacitance array and the electrode may correlate to the amount of force associated with the press. In this sense, the change in capacitance between the touch sensor 1504 and the pressure sensor 1506, measured by the pressure sensor 1506, may be used to determine the amount of force associated with the press.

[0136] The touch sensor 1504 and / or one or more insulating layers 1508 may deflect such that a portion of the touch sensor 1504 may contact the pressure sensor 1506 or move closer toward the pressure sensor. For example, the touch sensor 1504 may move closer to the pressure sensor 1506 in response to a user pressing the controller 1500. This movement or deflection, bringing the touch sensor 1504 closer to the pressure sensor 1506, may result in a change in capacitance experienced by the touch sensor 1504 and / or the pressure sensor 1506. This change in capacitance may be correlated with the amount of force to determine the amount of force with which the user presses the controller 1500. That is, as a user presses an area of ​​the touch sensor 1504 (or top cover 1502) and varies the amount of force, the amount of force may be sensed by a change in capacitance between the electrodes and the capacitance array.

[0137] The top cover 1502, the touch sensor 1504, and / or the insulating layer 1508 may be fabricated from a flexible material to allow them to deflect toward the pressure sensor 1506. Thus, the amount of force can be detected. Additionally or alternatively, the insulating layer may be compressed to allow the touch sensor 1504 to deflect toward the pressure sensor 1506. After the touch or pressure is removed, the top cover 1502, the pressure sensor 1506, and the insulating layer 1508 may return to their respective rest positions.

[0138] In some cases, while the pressure sensor 1506 is illustrated as a component of the controller 1500, the pressure sensor 1506 may be a separate part or may be removed from the controller 1500. For example, the pressure sensor 1506 may be located below the touch sensor 1504 within the body of the controller. Here, the touch sensor 1504 may deflect toward the pressure sensor 1506 when a user presses the touch sensor 1504. This deflection or depression of the touch sensor 1504 may bring the touch sensor 1504 into close proximity or proximity to the pressure sensor 1506. In some cases, the touch sensor 1504 and / or the pressure sensor 1506 may be substantially circular in shape and / or may be substantially the same size as one another.

[0139] Additionally or alternatively, a rigid or fixed portion of the handheld controller (e.g., a cover) may include an element for detecting the amount of force received at the control device. For example, a portion of the handheld controller surrounding the control device (e.g., an opening or receiver in the handheld controller) may include a metal layer or metal element. A capacitance sensor array in the track pad of the control device may detect the amount of force applied to the control device when the capacitance sensor array moves away from the metal layer or metal element. For example, if a user presses the control device, the control device may deflect downward into the handheld controller (e.g., into the controller body). This deflection may move an area or portion of the track pad away from or away from a respective portion of the metal layer or respective metal element. A capacitance sensor array in the track pad (or another sensor) may detect a change in capacitance due to the metal layer and / or respective metal element. Logic in the handheld controller system may then convert this change in capacitance or amount of capacitance into an amount of force received at the track pad. In other words, the deflection of the controller can be used to determine the amount of force associated with pressing the trackpad.

[0140] 16A-16C illustrate a control device 1600 disposed within a housing 1602 of a controller 1604. In some cases, the control device 1600 may include a touch sensor 1606 (e.g., a trackpad) for sensing a touch. Additionally, the control device 1600 may include functionality for determining an amount of force associated with a touch or press on the control device 1600. In some cases, the control device 1600 may be similar to, represent, and / or be used for, a trackpad (e.g., trackpad 108, trackpad 118, trackpad 508, trackpad 514) of the controller 100 and / or controller 500, and / or the D-pad 110 of the controller 100 and / or the D-pad 510 of the controller 500.

[0141] As shown, the control device 1600 may reside within the housing 1602 and may be disposed in front of the controller 1604. In some cases, the controller 1604 or a portion of the housing 1602 may include components for determining the amount of deflection experienced by the control device 1600. For example, a metal element 1608 may be disposed on a sidewall of the housing 1602 around the control device 1600. Additionally or alternatively, the portion of the controller 1604 surrounding the housing 1602 may include a metal layer. Whether embodied as a metal element 1608 or a metal layer, the metal element 1608 or metal layer may be disposed on a rigid or fixed portion of the controller 1604 and may surround the control device 1600. For example, the metal element 1608 or metal layer may be disposed on top of a cover of the controller 1604, around the housing 1602.

[0142] The touch sensor 1606 may include a capacitance sensor array operable to detect the amount of force at the controller 1604. For example, as a portion of the touch sensor 1606 moves away from the metal element 1608 (or metal layer), a corresponding change in capacitance may be sensed. For example, as shown in FIG. 16C , if a user presses the touch sensor 1606, the portion of the touch sensor 1606 touched by the user may deflect downward into the housing 1602 (or controller 1604). This deflection may cause an area or portion of the touch sensor 1606 to move or be positioned away from the respective metal element 1608 (or metal layer). The touch sensor 1606 (or its capacitance pad) may detect the change in capacitance between the metal elements 1608, and logic in the handheld controller may translate this change in capacitance into the amount of force received at the control device 1600. In other words, the amount of deflection of the touch sensor 1606 may be used to determine the amount of force associated with the press.

[0143] FIG. 17 illustrates exemplary computing components of a controller 1700, such as controller 100 and / or controller 500. As illustrated, the controller includes one or more input / output (I / O) devices 1702, such as the controls described above (e.g., joystick, trackpad, trigger, etc.), and potentially any other type of input or output device. For example, the I / O devices 1702 may include one or more microphones for receiving audio input, such as user voice input. In some implementations, one or more cameras or other types of sensors (e.g., inertial measurement units (IMUs)) may function as input devices for receiving gesture input, such as movement of a handheld controller. In some embodiments, additional input devices may be provided in the form of a keyboard, keypad, mouse, touchscreen, joystick, control device buttons, etc. The input devices may further include control mechanisms, such as basic volume control buttons for increasing / decreasing the volume, as well as power and reset buttons.

[0144] On the other hand, output devices may include displays, light elements (e.g., LEDs), vibrators that create tactile sensations, speakers (e.g., headphones), etc. For example, there may also be simple light elements (e.g., LEDs) to indicate status such as when power and / or a function (e.g., mode) of the controller is on. Although several examples are provided, the controller may additionally or alternatively include any other type of output device.

[0145] In some cases, output by one or more output devices may be based on input received by one or more of the input devices. For example, selection of a control device may result in the output of a haptic response by a vibrator located adjacent (e.g., underneath) the control device or anywhere else. In some cases, the output may vary based at least in part on the characteristics of a touch input on a touch sensor, such as a touch sensor associated with the control device. For example, touch input at a first location on the touch sensor may result in a first haptic output, while touch input at a second location on the touch sensor may result in a second haptic output. Furthermore, a particular gesture on the touch sensor may result in a particular haptic output (or other type of output). For example, a swipe gesture on the control device may result in a first type of haptic output, a tap on the control device (detected by the touch sensor) may result in a second type of haptic output, and a hard press of the control device may result in a third type of haptic output. Additionally, a particular control device or portion of the control device may be illuminated based on the received input.

[0146] Additionally, the handheld controller 1700 may include one or more communication interfaces 1704 to facilitate wireless connection to a network and / or one or more remote systems and / or devices 1705 (e.g., host computing devices running applications, game consoles, etc.). The communication interface 1704 may implement one or more of a variety of wireless technologies, such as Wi-Fi, Bluetooth, radio frequency (RF), etc. It should be appreciated that the handheld controller 1700 may further include physical ports to facilitate wired connections to networks, connected peripheral devices, or plug-in network devices that communicate with other wireless networks.

[0147] In the illustrated implementation, the handheld controller 1700 further includes one or more processors 1706 and a computer-readable medium 1708. In some implementations, the processor 1706 may include a central processing unit (CPU), a graphics processing unit (GPU), both a CPU and a GPU, a microprocessor, a digital signal processor, or other processing units or components known in the art. Alternatively or additionally, the functions described herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used may include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems-on-chips (SOCs), complex programmable logic devices (CPLDs), etc. Additionally, each of the processors 1706 may have its own local memory, which may also store program modules, program data, and / or one or more operating systems.

[0148] The computer-readable medium 1708 may include removable and non-removable media implemented in any method or technology for storing information, such as volatile and non-volatile memory, computer-readable instructions, data structures, program modules, or other data. Such memory includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVDs) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, RAID storage systems, or any other medium that can be used to store desired information and that can be accessed by a computing device. The computer-readable medium 1708 may be implemented as a computer-readable storage medium (“CRSM”), which may be any available physical medium accessible by the processor 1706 to execute instructions stored on the computer-readable medium 1708. In one basic implementation, the CRSM may include random access memory (“RAM”) and flash memory. In other implementations, the CRSM may include, but is not limited to, read-only memory (“ROM”), electrically erasable programmable read-only memory (“EEPROM”), or any other tangible medium that can be used to store desired information and that can be accessed by the processor 1706.

[0149] Some modules, such as instructions, data stores, etc., may be stored in the computer-readable medium 1708 and configured to execute on the processor 1706. Some example functional modules are illustrated as being stored in the computer-readable medium 1708 and executed on the processor 1706, although the same functions may alternatively be implemented in hardware, firmware, or as a system on a chip (SOC).

[0150] The operating system module 1710 may be configured to manage hardware within and coupled to the handheld controller for the benefit of the other modules. Additionally, the computer-readable medium 1708 may store a network communication module 1712 that enables the handheld controller to communicate with one or more other devices 1705, such as personal computing devices running applications (e.g., game applications), game consoles, remote servers, etc., via the communication interface 1404. The computer-readable medium 1708 may further include a game session database 1714 for storing data associated with games (or other applications) running on the controller or on a computing device to which the controller couples. The computer-readable medium 1708 may also include a device record database 1716 that stores data associated with devices to which the controller couples, such as personal computing devices, game consoles, remote servers, etc. The computer-readable medium 1708 may further store game control instructions 1718 that configure the controller to function as a gaming controller and universal control instructions 1720 that configure the handheld controller to function as a controller for other non-gaming devices.

[0151] In some instances, some or all of the components (software) shown in FIG. 17 may be implemented in a separate computing device 1705 that is part of a controller system 1707 that includes the controller. In such instances, the processes and / or functions described herein may be performed by the other computing device 1705 and / or the controller 1700. As an example, the controller 1700 may couple to a host PC or console, computing device / server in the same environment, and provide data to the device 1705 indicative of presses, selections, etc. received at the controller 1700. The controller 1700 may, for example, send data indicative of touch input received on the trackpad of the controller to the computing device, and the computing device may determine the nature of the data and / or the location where the touch input was received on the controller (or a control device on the controller). The computing device 1705 may then cause an associated action within a game or application to occur. In another example, the computing device 1705 may receive data indicative of the amount of strain detected on a strain gauge on a control device (e.g., the control device 1300). Based on the data, the computing device can determine the strain experienced and the corresponding position of the thumbstick 1304. The position of the thumbstick can then be used to control a gaming application. However, although some scenarios have been described, the controller and computing device 1705 may be communicatively coupled to each other such that the controller 1700, computing device 1705, and / or other devices of the controller system 1707 may perform the operations and processes described herein. Example clauses 1. A controller system comprising: one or more processors; a controller including a controller body having a front surface; and a control device present on the front surface of the controller body, the control device including: a top cover; a touch sensor adjacent to the top cover and configured to provide touch data indicative of a touch input at the top cover to the one or more processors; a first switch at least partially beneath the top cover and configured to provide first selection data indicative of a first selection to the one or more processors based on a first pressing of a first actuatable area of ​​the top cover; and a second switch at least partially beneath the top cover and configured to provide second selection data indicative of a second selection to the one or more processors based on a second pressing of a second actuatable area of ​​the top cover. 2. The controller system of clause 1, wherein the control device includes a circular track pad, the first switch includes a first tactile switch, the second switch includes a second tactile switch, and the controller further includes a third tactile switch and a fourth tactile switch, and the first tactile switch, the second tactile switch, the third tactile switch, and the fourth tactile switch are spaced equidistantly around the periphery of the circular track pad below respective actuatable areas of the top cover. 3. The controller system of clause 1, further including a pressure sensor configured to provide to one or more processors at least one of first force data indicative of the amount of force of the first press, or second force data indicative of the amount of force of the second press. 4. The controller system of clause 3, wherein the pressure sensor includes a first pressure sensor and a second pressure sensor, the first pressure sensor configured to provide first force data indicative of the amount of force of the first press, and the second pressure sensor configured to provide second force data indicative of the amount of force of the second press. 5. The controller system of clause 1, further comprising a light-emitting element, wherein the control device comprises at least one of an opening, a cutout, or a thinned area, and wherein light emitted by the light-emitting element is configured to radiate through the at least one of the opening, cutout, or thinned area to indicate a first position of the first switch and a second position of the second switch. 6. The controller system of clause 1, wherein the control device is configured to function as a directional pad (D-pad). 7. The controller system of clause 6, further comprising a light emitting diode, the controller configured to illuminate in a first state to indicate that the control device is configured as a trackpad, and the controller configured to illuminate in a second state to indicate that the control device is configured as a D-pad. 8. The controller system of clause 1, further comprising a lockout mechanism, the lockout mechanism functioning to prevent the control device from being depressed. 9. A controller system comprising: one or more processors; a controller including a controller body having a front surface; and a control device residing on the front surface of the controller body, wherein the control device includes a circular trackpad configured to provide touch data indicative of touch input to the one or more processors, the circular trackpad including a cutout; a directional pad (D-pad) disposed within the cutout of the circular trackpad; a first switch at least partially under a first actuatable area of ​​the D-pad and configured to provide first selection data indicative of a first selection to the one or more processors based on a first press of the first actuatable area; and a second switch at least partially under a second actuatable area of ​​the D-pad and configured to provide second selection data indicative of a second selection to the one or more processors based on a second press of the second actuatable area. 10. The controller system of clause 9, wherein the circular trackpad includes a first touch sensor configured to provide touch data indicative of the touch input to one or more processors, and the D-pad includes a second touch sensor configured to provide additional touch data indicative of the touch input to one or more processors. 11. The controller system of clause 10, wherein the first touch sensor includes a substantially circular shape with a substantially cross-shaped cutout, the first touch sensor being positioned around the D-pad, and the second touch sensor is substantially cross-shaped, the second touch sensor being positioned on the D-pad. 12. The controller system of clause 10, wherein the first touch sensor and the second touch sensor collectively form a substantially circular touch sensor of the control device. 13. The controller system of clause 9, wherein the surface of the D-pad is substantially coplanar with the surface of the circular trackpad, the surface of the D-pad is positioned above the surface of the circular trackpad, or the surface of the D-pad is positioned below the surface of the circular trackpad. 14. The controller system of clause 9, further comprising a light-emitting component disposed beneath the circular trackpad and the D-pad, the light-emitting component being arranged to emit light through a first opening disposed around the circular trackpad or a second opening disposed around the D-pad. 15. The controller system of clause 9, further including a first light-emitting component disposed below the circular trackpad and a second light-emitting component disposed below the D-pad, wherein the first light-emitting component is configured to emit light during a first mode when the circular trackpad is in use, and the second light-emitting component is configured to emit light during a second mode when the D-pad is in use. 16. A controller including: a controller body having a front surface; and a control device present on the front surface of the controller body, the control device including: a circular base frame; a joystick; a first member coupled to the joystick, the first member configured to flex; a housing disposed around the first member, the housing coupling to a first end of the first member and a second end of the second member; a second member coupled to the circular base frame and the housing, the second member configured to flex; and a third member coupled to the circular base frame and the housing, the third member configured to flex. 17. The controller of clause 16, wherein a second member is coupled to a first side of the circular base frame and a first side of the housing, and a third member is coupled to a second side of the circular base frame and a second side of the housing, the second side of the circular base frame being directly opposite the first side of the circular base frame. 18. The controller of clause 16, further comprising a touch sensor disposed on top of the joystick and configured to provide touch data indicative of touch input to one or more processors. 19. The controller of clause 16, further including at least one of: one or more first strain gauges disposed on the first member, wherein the one or more first strain gauges measure a degree of deflection of the first member and the one or more first strain gauges are configured to provide data indicative of the degree of deflection of the first member to one or more processors; one or more second strain gauges disposed on the second member, wherein the one or more second gauges measure a degree of deflection of the second member and the one or more second strain gauges are configured to provide data indicative of the degree of deflection of the second member to one or more processors; or one or more third strain gauges disposed on the third member, wherein the one or more third strain gauges measure a degree of deflection of the third member and the one or more third strain gauges are configured to provide data indicative of the degree of deflection of the third member to one or more processors. 20. The controller of clause 16, wherein the first member, second member, and third member collectively provide a joystick that rotates 360 degrees. 21. The controller of clause 16, wherein a cross section of at least the first member, the second member, or the third member is at least one of a cylindrical shape, a cross shape, or a T-shape. 22. A controller as described in clause 16, wherein the joystick is substantially centered within the circular base frame. 23. A controller system comprising: one or more processors; a controller including a controller body having a front face; and a control device residing on the front face of the controller body, the control device including a thumbstick; a first capacitive electrode disposed centrally on the thumbstick, the first capacitive electrode configured to sense a user's thumb and provide first data indicative of the thumb to the one or more processors; and one or more second capacitive electrodes disposed around the center of the thumbstick, the one or more second capacitive electrodes configured to sense a user's thumb and provide second data indicative of the thumb to the one or more processors. 24. The controller system of clause 23, further comprising a potentiometer, wherein the first capacitive electrode and the one or more second capacitive electrodes are configured to sense a first movement of the thumb before the potentiometer senses a second movement of the thumbstick. 25. The controller system of clause 24, wherein the potentiometer is configured to sense a second movement of the thumbstick after the second movement of a threshold amount, and wherein the one or more processors are configured to disable at least one of the first capacitive electrode or the one or more second capacitive electrodes based at least in part on detecting the second movement of the threshold amount. 26. The controller system of clause 23, wherein the one or more processors are configured to determine a direction of thumb movement based at least in part on the first data and the second data. 27. The controller system of clause 26, wherein the one or more processors are configured to provide the direction of movement to a communicatively coupled computing device. 28. The controller of clause 23, wherein the one or more second capacitance electrodes include four capacitance electrodes, the four capacitance electrodes being radially spaced around the first capacitance electrode. 29. The controller system of clause 23, further comprising a potentiometer, wherein the first capacitive electrode and the one or more second capacitive electrodes are configured to sense a first movement of the thumb during a first period of time, and the potentiometer is configured to sense a second movement of the thumbstick during a second period of time that is after the first period of time. 30. A controller system comprising: one or more processors; and a controller including a controller body having a front surface, an opening defined in the front surface of the controller body, and a control device within the opening and on the front surface of the controller body, the control device including a top cover; a touch sensor disposed adjacent to the top cover and configured to provide touch data indicative of a touch input at the top cover to the one or more processors; and an electrode disposed adjacent to the touch sensor, the touch sensor configured to flex toward the electrode in response to a touch input at the top cover, and the electrode configured to provide data to the one or more processors indicative of a change in capacitance when the touch sensor flexes toward the electrode. 31. The controller system of clause 30, wherein a change in capacitance indicates an amount of touch input force received at the top cover. 32. The controller system of clause 30, further comprising at least one insulating layer disposed between the touch sensor and the electrode, the at least one insulating layer configured to flex or compress. 33. A controller system comprising: one or more processors; a controller body having a front surface; an opening defined in the front surface of the controller body; a metal element disposed around or within at least one of the openings; and a control device within the opening and on the front surface of the controller body, the control device including a top cover and a touch sensor adjacent to the top cover, the touch sensor configured to flex in response to a pressure applied to the top cover and to provide data to the one or more processors indicative of an amount of force of the pressure based at least in part on a change in capacitance between the touch sensor and the metal element. 34. The controller system of clause 33, wherein a pressure applied to the top cover positions the touch sensor a distance away from at least a portion of the metal element, the distance being related to the amount of force. 35. The controller system of clause 33, wherein the metal element comprises a metal layer embedded in the controller body. 36. The controller system of clause 33, wherein the metal element includes a plurality of metal elements arranged around the opening. 37. The controller system of clause 33, further comprising a switch at least partially beneath the top cover and configured to provide selection data to the one or more processors indicative of a selection based on a pressure applied to the top cover.

[0152] Unless otherwise indicated, all numbers expressing quantities, properties, conditions, and the like used in the specification and claims are to be understood as being modified in all instances by the term "about." Accordingly, unless indicated to the contrary, the numerical parameters set forth in the specification and appended claims are approximations that may vary depending upon the desired properties sought to be obtained by the present disclosure. At the very least, and not as an attempt to limit the application of the doctrine of equivalents to the scope of the claims, each numerical parameter should be construed in light of at least the number of reported significant digits and by applying ordinary rounding techniques. Where further clarification is needed, the term "about" has the meaning reasonably regarded by one of ordinary skill in the art, and when used in conjunction with a stated numerical value or range, denotes some degree of greater than or some degree of less than the stated value or range, i.e., within ±20% of the stated value, ±19% of the stated value, ±18% of the stated value, ±17% of the stated value, ±16% of the stated value, ±15% of the stated value, ±14% of the stated value, ±13% of the stated value, ±12% of the stated value, ±11% of the stated value, ±10% of the stated value, ±9% of the stated value, ±8% of the stated value, ±7% of the stated value, ±6% of the stated value, ±5% of the stated value, ±4% of the stated value, ±3% of the stated value, ±2% of the stated value, or ±1% of the stated value.

[0153] Although various examples and embodiments are described individually herein, the examples and embodiments can be combined, rearranged, and modified to arrive at other variations within the scope of the present disclosure. Moreover, while the present subject matter has been described in language specific to structural features and / or methodological acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as exemplary forms of implementing the claims.

Claims

1. 1. A controller system comprising: one or more processors; a controller, a housing having an opening defined therein; and a controller comprising a track pad disposed within the opening defined in the housing, the track pad comprising: Cover and a touch sensor disposed beneath and coupled to the cover, the touch sensor configured to provide touch data to the one or more processors indicative of an object touching the cover; a carrier disposed below the touch sensor and coupled to the cover; at least one biasing member coupled to the carrier and to the housing, the at least one biasing member biasing a portion of the cover against an inner surface of the housing and configured to deflect in response to the object pressing against the cover; a metal layer disposed below and coupled to the carrier; a pressure sensor coupled to the housing, positioned below the metal layer, and spaced a distance from the metal layer, the pressure sensor configured to provide force data to the one or more processors indicative of an amount of force pressing on the cover based at least in part on a proximity of the metal layer to the pressure sensor.

2. The controller system of claim 1 , wherein the metal layer comprises copper foil.

3. The controller system of claim 1 , wherein the metal layer is attached to a bottom surface of the carrier.

4. 2. The controller system of claim 1, wherein the track pad further comprises a haptic actuator disposed beneath the touch sensor and configured to provide haptic feedback in response to the amount of force of the press satisfying a threshold.

5. the at least one biasing member is a first anisotropic spring coupled to a first side of the carrier, and the track pad comprises: a second anisotropic spring coupled to the housing and to a second side of the carrier opposite the first side; the second anisotropic spring is configured to deflect in response to the object pressing against the cover; The controller system of claim 4 , wherein the first anisotropic spring and the second anisotropic spring are configured to deflect in response to the haptic feedback provided by the haptic actuator.

6. The controller system of claim 1 , wherein the force data comprises a capacitance value that changes in response to varying proximity of the metal layer to the pressure sensor.

7. The controller system of claim 1 , wherein the pressure sensor comprises a substrate including electrodes configured to measure a change in capacitance based on movement of the metal layer relative to the pressure sensor.

8. 1. A controller system comprising: one or more processors; a controller, Housing, and a controller comprising a control device configured to be operated by a finger, the control device comprising: Cover and a touch sensor disposed beneath and coupled to a cover, the touch sensor configured to provide touch data to the one or more processors indicative of the finger touching the cover; a carrier disposed below the touch sensor and coupled to the cover; at least one biasing member coupled to the carrier and to the housing, the at least one biasing member configured to apply a biasing force to the carrier in a direction opposite to a direction of a force of the finger pressing on the cover; a metal layer disposed below and coupled to the carrier; a pressure sensor coupled to the housing, positioned below the metal layer, and spaced a distance from the metal layer, the pressure sensor configured to provide force data to the one or more processors indicative of the amount of force of the pressing of the finger against the cover based at least in part on the proximity of the metal layer to the pressure sensor.

9. 9. The controller system of claim 8, wherein the carrier is configured to deflect toward the pressure sensor in response to the finger pressing against the cover, and the metal layer is configured to deflect toward the pressure sensor in response to the carrier deflecting toward the pressure sensor.

10. The controller system of claim 8 , wherein the metal layer comprises copper foil.

11. 9. The controller system of claim 8, wherein the control device further comprises a haptic actuator disposed beneath the touch sensor and configured to provide haptic feedback in response to the amount of force of the press satisfying a threshold value.

12. The controller system of claim 8 , wherein the control device includes a track pad.

13. The controller system of claim 12 , wherein the at least one biasing member biases a portion of the cover against an inner surface of the housing.

14. 9. The controller system of claim 8, wherein the distance the pressure sensor is spaced from the metal layer is at least about 0.5 millimeters (mm).

15. The controller further includes a thumbstick, the thumbstick comprising: a potentiometer configured to sense deflection of the thumbstick; 9. The controller system of claim 8, comprising: a capacitance sensor disposed in or on a top portion of the thumbstick, the capacitance sensor configured to sense movement of a thumb on the top portion of the thumbstick before the potentiometer senses the deflection of the thumbstick.

16. A trackpad for a controller, the trackpad comprising: Cover and a touch sensor disposed beneath and coupled to the cover, the touch sensor configured to output touch data indicative of a touch on the cover; a carrier disposed below the touch sensor and coupled to the cover; at least one biasing member coupled to the carrier and to a housing of the controller, the at least one biasing member configured to apply a biasing force to the carrier in a direction opposite to a direction of a pressing force on the cover; a metal layer disposed below and coupled to the carrier; a pressure sensor coupled to the housing, positioned below the metal layer, and spaced a distance from the metal layer, the pressure sensor configured to output force data indicative of an amount of force applied to the cover based at least in part on a proximity of the metal layer to the pressure sensor.

17. The track pad of claim 16 , wherein the force data comprises a capacitance value that changes in response to a variable force of the pressure on the cover.

18. The track pad of claim 16 , wherein the metal layer is attached to a bottom surface of the carrier.

19. 17. The track pad of claim 16, further comprising a haptic actuator disposed beneath the touch sensor and configured to vibrate in response to the amount of force of the press satisfying a threshold.

20. the at least one biasing member is a first spring coupled to a first side of the carrier, and the track pad is a second spring coupled to the housing and to a second side of the carrier opposite the first side; The track pad of claim 16 , wherein the second spring is configured to apply a second biasing force to the carrier in a direction opposite to the direction of the force of the press on the cover.

21. 17. The track pad of claim 16, wherein an air gap is disposed between the metal layer and the pressure sensor to enable the cover, the carrier, and the metal layer to deflect toward the pressure sensor in response to the pressure on the cover.

Images