Devices and methods for game controllers

Abstract

The device and process configurations are provided for a game controller. The game controller may include an input control sensor having an input surface and at least one optical sensor for detecting input to the input surface. The game controller may also include a controller coupled to the input control sensor for receiving the game controller input, identifying at least one input command, and outputting a control signal. The input control sensor enables input based on one or more of touch, tap, swipe, press, pinch, and joystick input to one or more surfaces of the controller. The input may include a pre-touch with respect to the input surface, where pre-touch includes an input approaching the input surface and an input prior to engagement with the surface. The game controller may present at least one reference point for input control, including the use of lighting and a touchscreen to detect one or more of heat and pressure.

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims priority to U.S. Patent Application No. 18 / 168,451, filed February 13, 2023, entitled "5 DEVICES AND METHODS FOR A GAME CONTROLLER." That specification is expressly incorporated herein by reference in its entirety.

[0002] The present disclosure relates to a controller configuration, a gaming device controller, a gaming device, The present invention is directed to sensing arrangements and game controllers for electronic games, including arrangements for operating the controllers and for interactive entertainment devices. [Background technology]

[0003] Computer and console games often utilize controllers or computer keypads as a control interface for users. These conventional controllers typically require users to press buttons or control moving elements to provide game control. Often, these controllers adhere to a similar control interface, with a directional pad on one side of the controller and buttons on the other side of the controller. One drawback of existing designs can be a fixed configuration. For example, a fixed layout may be too small or too large for a user. Similarly, a fixed layout may be uncomfortable for a user. Manufacturers typically do not vary the layout or controller size to reduce costs. As a result, controllers may include button configurations for hand sizes that do not accommodate all players. There is a need for a game controller that allows for different configurations and accommodates hand sizes without the need to customize or manufacture controller sizes.

[0004] Another drawback of conventional controllers can be the fixed nature of the input controls. For example, the controller only has enough space to include a directional pad and joystick, and each element is usually located in a different position. The size of the physical control elements can limit game control. Furthermore, the inclusion of controls can increase the size of the controller. There is a need and desire to enable improvements and modifications to game controllers. Summary of the Invention

[0005] A game controller device, sensor, and method are disclosed and described herein. In one embodiment, the game controller device includes a main body and at least one input control sensor supported by the main body, the at least one input control sensor including an input surface and at least one optical sensor that detects game controller input to the input surface. The game controller device also includes a controller coupled to the at least one input control sensor. The controller is configured to receive game controller input to the input control sensor, identify at least one input command based on the input, and output a control signal based on the at least one input command.

[0006] In one embodiment, the at least one input control sensor is configured to detect at least one of a touch, a tap, a swipe, a press, a pinch, and a joystick input.

[0007] In one embodiment, the at least one optical sensor is configured to detect input to at least one region of the input surface.

[0008] In one embodiment, the at least one optical sensor is configured to detect a pre-touch on the input surface, which is at least one of an input approaching at least one region of the input surface and an input prior to engaging at least one region of the input surface.

[0009] In one embodiment, the input surface optionally includes a light-transmitting surface.

[0010] In one embodiment, the controller identifies at least one input command for at least one reference point of the control sensor.

[0011] In one embodiment, the controller is configured to present at least one reference point for the input control position.

[0012] In one embodiment, the controller is configured to detect the input control position based on at least one input reference update, the input reference update being a user-specified position relative to the input control position.

[0013] In one embodiment, the controller is configured to identify a user and configure the game controller based on the user identification to include at least one input control position.

[0014] In one embodiment, the game controller device includes a memory coupled to the controller and configured to store executable instructions, the memory further configured to store at least one input control position.

[0015] In one embodiment, the game controller device includes at least one of a temperature sensor and a pressure sensor configured to detect a condition of the input surface.

[0016] Another embodiment is directed to an input control sensor for a game controller device, the input control sensor including an input surface, at least one optical sensor for detecting input to the input surface, and a controller coupled to the at least one optical sensor, the controller configured to receive input to the input control sensor, identify at least one input command based on the input, and output a control signal based on the at least one input command.

[0017] In one embodiment, the at least one optical sensor is configured to detect at least one of a touch, a tap, a swipe, a press, a pinch, and a joystick input.

[0018] In one embodiment, the at least one optical sensor is configured to detect input to at least one region of the input surface.

[0019] In one embodiment, the at least one optical sensor is configured to detect a pre-touch on the input surface, the pre-touch being at least one of an input approaching at least one area of ​​the input surface and an input prior to engaging at least one area of ​​the input surface.

[0020] In one embodiment, the input surface optionally includes a light-transmitting surface.

[0021] In one embodiment, the controller identifies at least one input command for at least one reference point of the control sensor.

[0022] In one embodiment, the controller is configured to present at least one reference point for the input control position.

[0023] In one embodiment, the controller is configured to detect the input control position based on at least one input reference update, the input reference update being a user-specified position relative to the input control position.

[0024] In one embodiment, the controller is configured to identify a user and configure the game controller based on the user identification to include at least one input control position.

[0025] In one embodiment, the input control sensor includes a memory coupled to the controller, the memory configured to store executable instructions and to store at least one input control position.

[0026] In one embodiment, the input control sensor includes at least one of a temperature sensor and a pressure sensor configured to detect a condition of the input surface.

[0027] Other aspects, features, and techniques will become apparent to those skilled in the relevant art(s) in view of the following detailed description of the embodiments.

[0028] The features, objects, and advantages of the present disclosure will become more apparent from the detailed description set forth below when taken in conjunction with the drawings in which like reference characters identify correspondingly throughout. [Brief explanation of the drawings]

[0029] [Figure 1A] 1 is a graphical representation of a game controller device according to one or more embodiments. [Figure 1B] 1 is a graphical representation of an input control sensor according to one or more embodiments. [Figure 2] 1 illustrates a process for controller operation according to one or more embodiments. [Figure 3] 1 illustrates a graphical representation of a configuration of a game controller device according to one or more embodiments. [Figure 4] 1A-B show graphical representations of configurations of game controller devices, according to one or more embodiments. [Figure 5] 1 illustrates a process for determining a controller reference point, according to one or more embodiments. [Figure 6] 1 illustrates a graphical representation of a game controller update in accordance with one or more embodiments. [Figure 7] 8A-8B show graphical representations of game controller reference points, according to one or more embodiments. [Figure 8] 1 illustrates a graphical representation of game controller inputs according to one or more embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0030] Overview and Terminology One aspect of the present disclosure is directed to game controller configurations and game controller input devices. Embodiments are directed to systems, devices, and methods for detecting user input and outputting control signals to a gaming device or interactive entertainment device. Gaming systems may include consoles that play game media, consoles that provide network data for games, handheld devices, mobile devices (e.g., tablets, mobile phones, etc.), and devices generally configured for electronic gaming. Game controller devices may be standalone or integrated devices configured to provide user control to a gaming system. According to embodiments, game controller designs are provided that include at least one input surface that includes at least one sensor for detecting user inputs such as touch, tap, swipe, press, pinch, and joystick control. Game controllers may include one or more input regions and one or more input control sensors. Unlike traditional game controllers with a fixed arrangement of physical buttons, input control locations may be selected and / or adjusted by the user.

[0031] According to embodiments, an input configuration for a buttonless game controller is provided. Configurations and input sensors are provided that enable a game controller that includes at least one input surface that does not require buttons or joysticks. The controller's input surface may be configured to detect user touch and user input similar to button activation or directional pad operation, without the need for actual push buttons or a directional pad. The game controller configuration can be used in addition to and / or independent of physical push buttons. According to embodiments, input control sensors are provided to enable buttonless operation with the game controller. The input control sensors can be used for game control and non-game applications.

[0032] Embodiments are also directed to input control sensors. According to embodiments, the input control sensor may include an input surface, which may generally be supported by the body or housing of the game controller. According to embodiments, one or more optical sensors may be used to detect user contact and interaction with the input surface. The input surface may eliminate the need for physical buttons, allowing a single surface to detect one or more of touches, taps, swipes, slides, presses, pinches, etc. Unlike traditional buttons configured to provide a single function at a single location, the input control sensors described herein may allow one or more input control locations to be provided on the input surface. In this manner, traditional button functionality may be provided by the input control sensor in that a user may press or contact a location on the input surface such that contact is identified as a button press. Similarly, one or more regions of the input surface may be associated with a directional pad or joystick direction, such that contact with the region may be interpreted as a directional pad operation. The input control sensor may include one or more input control locations. Additionally, the input control sensor may allow a user to move to reposition the input control locations. One advantage of rearranging the input control locations is that it accommodates different hand and / or finger sizes. Another advantage may be that it allows the controller's location to be modified and / or reversed. For example, instead of allowing the directional pad to be only on the left side of the controller, the controller can be configured to allow for including a directional pad on the right side of the controller. Similarly, the directional pad input locations of the buttons may be positioned further apart or closer together. In that way, the controller can provide a personalized experience for the player.

[0033] The input control sensor may be configured to operate using one or more optical sensors configured therein. The optical control sensor can detect contact with the input surface. According to an embodiment, the optical control sensor may detect a user's finger or hand approaching the input surface. By detecting contact, the input control sensor may detect the duration and movement of the user relative to the input surface, enabling detection of a press or a direction associated with a swipe or movement. The input control sensor may also detect a user's pre-touch. The pre-touch may be used to more accurately characterize multiple button presses. The input control sensor may include an input surface that is translucent or at least partially translucent, allowing the optical sensor to detect an object in proximity to and / or in contact with the controller. The input control sensor also includes a temperature sensor and a pressure sensor. One or more of the temperature output and the pressure output can be used to generate an output control signal.

[0034] As used herein, the terms "a" or "an" shall mean one or more. The term "plurality" shall mean two or more. The term "another" is defined as second or more. The terms "including" and / or "having" are open-ended (e.g., comprising). As used herein, the term "or" shall be interpreted to include or mean any one or any combination. Thus, "A, B, or C" means any of "A, B, C, A and B, A and B, A and C, B and C, A, B, and C." Exceptions to this definition occur only when combinations of elements, features, steps, or actions are inherently inconsistent with each other in some way.

[0035] Throughout this specification, references to "one embodiment," "particular embodiment," "embodiment," or similar terms mean that a particular feature, structure, or characteristic described in connection with this embodiment is included in at least one embodiment. Thus, the appearances of such phrases in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments without limitation. Illustrative Embodiments

[0036] 1A is a diagrammatic representation of a game controller device according to one or more embodiments. According to an embodiment, the device includes a main body 105 and input control sensors 110. 1~n 1A is a top view of a game controller device 100. The game controller device 100 may be configured to detect user input and output control signals for control of a game and / or interactive entertainment device. According to an embodiment, the game control device 100 includes one or more input control sensors 110 configured to provide a surface with which a user can interact. 1~n According to an embodiment, the input control sensor 110 1~n The input surface may include a surface and one or more optical sensors that detect user contact with the surface (e.g., a user's finger, hand, etc.). According to embodiments, user contact with the input surface may provide one or more game controller functions, including, but not limited to, game control elements, functions triggered by a button press, multiple button presses, directional pad input, joystick input, swipe input, tap input, pinch input, and game control input in general. FIG. 1A illustrates input control sensor 110. 1~n While the input control sensors 110 are shown as being on the top surface, it should be understood that the game controller 100 may include additional game control surfaces. 1~n may be provided on other shapes and body configurations. FIG. 1A shows game controller 100 in a dual handle configuration, with input control sensors 1101~n are located on the left and right sides for left and right hand operation. 1~n The shape or profile of the input control sensor 110 is not limited to the shape shown in FIG. 1~n may include flat, curved, and / or variable surface curvature.

[0037] According to an embodiment, operation of the game controller device 100 is controlled by input control sensors 110. 1~n These interactions may be detected by the game controller device 100 to determine or identify commands for the game console. According to an embodiment, the input control sensors 110 1~n In certain configurations, the game controller 100 may support multiple input control positions. 1~n The input control sensor 1101 may detect user input to the input control sensor 1101. By way of example, a user tapping or swiping on the input control sensor 1101 may be detected, and the tap, swipe, or both may be communicated to the device being controlled, such as a gaming device. According to an embodiment, the game controller 100 may detect a user input on the input control sensor 1101. 1~n may be able to detect inputs and identify commands from inputs such as directional commands or button presses. Embodiments provide multiple configurations that allow regions to be associated with buttons or directional pads. Additionally, configurations allow detecting user preferences or inputs to globally configure regions as buttons, directional pads, or game control functions. Embodiments also include outputting control criteria to assist the user in determining input control locations.

[0038] According to an embodiment, the input control sensor 110 1~nThe game controller 100 may include a controller configured to detect and output input commands. FIG. 3 illustrates a configuration that may be utilized by the game controller 100. According to an embodiment, the body 105 may be configured to support at least one input control sensor, and may include input control sensors 110 on one or more of the top, bottom, side, front, and back surfaces. 1~n Input control sensor 110 1~n Each of the input control sensors 110 may include an input surface and one or more optical sensors. FIG. 1B illustrates an input control sensor configuration according to one or more embodiments. The input surface may be flush with and / or integral with the exterior surface of the body 105. According to an embodiment, each input control sensor 110 1~n The input control sensor 110 includes at least one optical sensor for detecting input of the game controller to the input surface. 1~n The input control sensor 110 may be configured to detect at least one of a touch, a tap, a swipe, a press, a pinch, and a joystick input. 1~n A command to the input surface may be based on one or more reference points. By way of example, an optical sensor may detect a command to a reference point associated with a particular command input. The command may be based on an input control position, which in turn is associated with a reference point to the input surface. According to an embodiment, the game controller 100 may optionally include one or more control inputs, such as a control input 106, which may generally be a push button, a joystick input, or other control input. The optional control input 106 may be supported on an exterior surface of the body 105.

[0039] 1B is a diagrammatic representation of an input control sensor 1101 according to one or more embodiments. According to an embodiment, the input control sensor 1101 includes an input surface 115 and a plurality of optical sensors 125. 1~nThe input surface 115 may be an optional light-transmitting surface including one or more layers and elements. The input surface 115 may be formed from one or more layers of plastic or glass including one or more sensors and light emitting elements. According to an embodiment, the input control sensor 1101 includes an optical sensor 125. 1~n , and detect user input to the top or touch surface 120. Each of the optical sensors 125 1-n detects a region 130 1~n The optical sensor 125 may include a detection area or region such as a 1~n may be positioned to include a detection area for a portion of input surface 115. In response to a user's touch, optical sensor 125 1~n may monitor and track movement across the surface of the game controller. 1~n The input command to the optical sensor 125 1~n The optical sensor 125 may detect the light. 1~n The output of may be output to a controller, such as the controller of FIG. 3 . According to an embodiment, user input to input surface 115 may be based on one or more reference points. By way of example, input surface 115 may include a mapping, grid, or reference system that includes one or more reference points. Input surface 115 may associate contact with one or more reference points within a particular region as an input control location. By way of example, user contact with region 1301 may be associated with a button press and detected by optical sensor 1251. According to an embodiment, a portion of region 1301 may be associated with a button press or control command. As discussed herein, a game controller may provide one or more reference points to notify a user of a location. Alternatively, input surface 115 may be used, at least in part or in whole, as an input surface for user actions. A user may use a downward or curved motion from region 1301 to region 1302 and then to region 1303 as an input. n You can also swipe to the optical sensor 125. 1~nmay detect contact and movement, and the controller may identify output controls for a game or interactive entertainment system. As discussed herein, game controllers may allow input control positions to be set or modified by a user.

[0040] The input control sensor 1101 may be configured to include a top surface 120 that includes multiple flat surfaces, one or more curved surfaces, and one or more shapes. The shape and configuration of the input surface 115 may be based on the outer contour of the game controller.

[0041] According to an embodiment, the optical sensor 125 1~n may be configured to detect touch and contact location, contact duration, contact rate, and contact shape (e.g., swipe pattern, swipe arc, slide shape, drawing shape, etc.). According to an embodiment, the input control sensor 1101 includes an optical sensor 125 configured to identify a user. 1~n The user identification may be based on one or more of finger size, finger characteristics, fingerprint detection, and controller grip type. Based on the user identification and / or detection, the game controller may configure at least one input control position. The input control sensors 1101 may include one or more of a temperature sensor and a pressure sensor to detect the user's temperature and pressure. According to an embodiment, the temperature sensor and the pressure sensor may be integrated into the input surface 115. For example, the input surface 115 may include a touchscreen configuration.

[0042] FIG. 2 illustrates a process for controller operation according to one or more embodiments. According to an embodiment, a game controller (e.g., game controller 100) includes an input control sensor 110. 1~n and / or optical sensor 125 1~nThe process 200 may include a controller receiving input from one or more sensors, such as a touch sensor, a swipe sensor, a pinch sensor, a joystick sensor, or the like. Process 200 may be executed by a controller of a game controller to detect user input and output one or more commands and controls to a game device. Process 200 may be executed by a device, such as game controller 100 of FIG. 1, device 300 and / or controller 310 of FIG. 3. Process 200 may begin at block 205 by a device (e.g., device 300) receiving and / or detecting input. According to an embodiment, the game controller includes one or more input limit sensors configured to detect user input via an input surface. Detecting input at block 205 may include at least one optical sensor that detects at least one of a touch, tap, swipe, press, pinch, and joystick input to the input surface. The input may be detected by the controller from one or more input control sensors. In block 205, the at least one optical sensor is configured to detect input relative to at least one region of the input surface. By way of example, if reference points are set for the user, the optical input sensor may detect input relative to the one or more reference points. Block 205 may include receiving a game controller input to one or more input control sensors. Each input control sensor may include one or more sensors coupled to a controller of the game controller, the game controller configured to include an optical sensor output. Detecting the input may include detecting an input to an input surface of a light-transmissive surface.

[0043] According to an embodiment, the input control sensor may detect a user's finger or hand approaching the input surface, which may be the pre-touch of block 205. The pre-touch may be used as an input. According to an embodiment, the pre-touch may be detected as an input for using contact approaching at least one region of the input surface. Alternatively, or in combination, the pre-touch may be an input before a finger or user engages at least one region of the input surface. A pre-touch may be detected relative to the input surface in one or more regions to provide commands from any input type before the user contacts the input surface, such as a user's fingertip. The detected touch input and pre-touch projection may be detected and stored to provide an aggregated data set for player input data. According to an embodiment, the pre-touch data may be used to provide an alternative or optimized input scheme to the player. The pre-touch may also provide a proximity-based input scheme that does not rely on physically touching the surface. According to an embodiment, a pre-touch may be detected and / or sensed for tracking when one or more of the user's fingers are in proximity to the input surface. A pre-touch may be detected to track the movement of a user's finger relative to the input surface, including patterns or movements. The systems and processes herein may detect the pre-touch to enable increased response time. By detecting the pre-touch, the game controller can provide an output to a game system or console to initiate one or more controls or processes prior to user contact.

[0044] In block 210, the process includes identifying and / or determining a command. Based on the received optical sensor output, the controller may identify at least one input command based on the input detected for the user. Identifying the command by the controller allows the input control sensor and game controller to provide multiple uses of the detection area. Unlike requiring a directional pad and joystick to enable directional input and joystick functions at different locations, pressing on an input contact location and swiping, sliding, or moving relative to an input control location may allow one input control location to provide multiple functions. In block 210, the controller may identify at least one input command relative to at least one reference point of the control sensor. The input control sensor may be configured to output a control reference or reference element to notify the user of the control position.

[0045] At block 215, the device may be configured to output control commands. The control commands may be based on user inputs or contacts detected by the input control sensors. According to an embodiment, the game controller may detect user inputs such as taps, touches, presses, and swipes and output the detected contacts to the gaming device. Alternatively, or in combination, the game controller may include one or more input control locations associated with regions or reference points of the input control sensors. As an example, a directional pad may be provided by including at least four reference points, i.e., a reference point for each of up, down, left, and right relative to the position of the input surface. The game controller may allow a user to specify the location of the directional pad reference point on the input surface. According to an embodiment, the game controller may provide a reference for the location of the reference point. The reference point may be provided by providing an illuminated output or display. As an example, the locations of the four reference points of the directional pad may be illuminated on the controller surface using one or more of a touchscreen backlight and light elements. When a user provides a request to modify the position of the reference point, the game controller can adjust or move the position of the directional pad component to a different reference point to allow for different input control positions of the directional pad. Additionally, the game controller can include reference points for multiple controls. By way of example, the game controller can include a reference point for the directional pad, a reference point for a position associated with a button or type of control input for a game (e.g., square button, X button, triangle button, plus button, home button, menu button, etc.). The game controller outputs a control signal based on the detected and identified input command.

[0046] Process 200 may optionally include identifying a user at block 206. According to an embodiment, the game controller may be configured to detect one or more characteristics of the user and identify the user. User identification may be based on prior use, such that one or more of the user's hand size, grip position, fingerprint, and user characteristics may be detected to identify the user. Based on the user identified at optional block 206, one or more reference points may be determined or set at block 210 for determining commands.

[0047] Process 200 may optionally include outputting control references at block 207. According to an embodiment, one or more reference points may be indicated to the user. The display of control references or reference points may be optional, so that the controller may detect input to the controller based on repetitive user manipulation. Alternatively, an indication of a reference point or area associated with a particular command on the controller may be provided. In a gaming space, game controllers are often tied to a game console or platform. As such, a game console may include a controller with a fixed layout or fixed controls, including a directional pad, often multiple buttons, and possibly one or more joystick controls, trigger / paddle keys, menu / home buttons, etc. Outputting reference controls at optional block 207 may include providing one or more illuminated indications of the control input location for each control feature. Alternatively, or in combination, the control references may be provided by a tactile or movable surface.

[0048] According to an embodiment, a game controller may allow control input positions for game controller commands to be modified. Therefore, users with different hand or finger sizes can reposition game controls to their liking. Alternatively, the modification may be based on user preference rather than user characteristics. For example, a user may desire to flip the control positions, having the directional pad on the right side of the control instead of the left side, or vice versa. Process 200 may optionally include detecting a reference update at block 208 and optionally storing one or more reference positions at block 209. For example, using a game console display or other game controller functionality, a user may request to modify one or more game control input positions. The user's modification may include, for example, a request to reposition the directional pad to move down and right. According to an embodiment, at block 208, the control input position may be determined by the user pressing a desired position on the game controller. At block 209, one or more reference points may be identified based on the updated input position and used to store the user's one or more control input positions. According to an embodiment, the reference update may be determined by the game controller when the user repeatedly touches a particular location on the feature, such that the game controller can automatically perform the operations in blocks 208 and 209 .

[0049] 3 shows a diagrammatic representation of the configuration of a game controller device, according to one or more embodiments. According to an embodiment, the game controller device may include one or more components and devices. FIG. 3 illustrates an input control sensor 305. 1~n3 illustrates a game controller device 300 according to an embodiment that may include a controller 310, a memory 315, and an input / output (I / O) interface 320. The game controller device 300 may be a controller for one or more of a game console, a computing device, and generally an electronic device configured to output controls to a console. The game controller 300 may be integrated with a game device, as in the case of a handheld game console. With respect to game control, the game controller 300 may be configured to output controls for one or more game platforms. By way of example, the game controller 300 may be configured for control of a platform such as the PlayStation® platform and may include platform-based controls (e.g., square button, X button, triangle button, plus button, home button, menu button, etc.). It should be understood that the game controller 300 may be configured for other game and device platforms. The game controller 300 may include multiple input control sensors, and thus multiple input control sensors 305 for each input control sensor. 1~n may include:

[0050] According to an embodiment, the game controller device 300 includes an input control sensor 305 1~n The controller 310 may be associated with a processor or control device configured to perform one or more operations stored in memory 315, such as processes for detecting and outputting player controls. The controller 310 includes an input control sensor 305. 1~n, memory 315, and I / O interface 320 may be coupled to the device 300. The memory 315 may be a non-transitory memory configured to provide data storage and working memory operations for the device 300. The memory 315 may be configured to store computer-readable instructions to be executed by the controller 300 for one or more processes described herein. The memory 315 may also be configured to store at least one input control position. The I / O interface 320 may be a communications module configured to send and receive data, such as commands or controls, to a gaming device. The game controller 300 may be configured for at least one of wired and wireless communication with a game console via the I / O interface 320.

[0051] According to one embodiment, the controller 310 may be configured to support multiple control input positions. The controller 310 may also be configured to allow a user to modify one or more of the control input positions. According to an embodiment, the game controller 300 may optionally include one or more input reference elements 330. The input reference element 330 may comprise an illuminated element that illuminates at least a portion of the input surface to notify the user of the input control position. In certain embodiments, the input reference element 330 may include a touchscreen surface integrated with the input surface that allows control of the illuminated element. According to an embodiment, the input reference element 330 may include one or more tactile or deformable surface elements that allow a user to feel the position of the element. The tactile or deformable surface may adjust its configuration to allow a user to feel the input control position.

[0052] According to embodiments, the game controller 300 may optionally include one or more of an optional pressure sensor and a temperature sensor 335. The optional pressure sensor and temperature sensor 335 may be configured to detect one or more of a surface temperature, a temperature of a user's finger, a control temperature, and pressure applied to one or more portions of the game controller. According to embodiments, one or more of the pressure detection and temperature detection may be used in combination with the sensor output to detect and characterize user touch and the state of the input surface. By combining the temperature and / or pressure with the touch location, information may be provided to the game console regarding the amount of force and the state of the user.

[0053] 4A-4B show graphical representations of game controller device configurations according to one or more embodiments. FIG. 4A shows an exemplary top view of game controller 400. FIG. 4B shows a front view of game controller 400. Game controller device 400 may incorporate one or more elements described herein, including elements of game controller 100 and game controller device 300. According to an embodiment, game controller device 100 includes a body 405 and one or more input control sensors 410 configured to provide a surface with which a user can interact. 1~n According to an embodiment, the input control sensor 410 1~n The input control sensor 410 may include a surface and one or more optical sensors that detect user contact with the surface (e.g., a user's finger, hand, etc.). 1~2 FIG. 4B shows an example configuration including a front input control sensor 410. 3~n FIG. 4A shows a game controller 400 in a dual handle configuration, with input control sensors 410 1~2 are located on the left and right sides for left and right hand operation. 1~n It should be understood that the shape or profile of the input control sensor 410 is not limited to the shapes shown in FIGS. 1A-1B. 1~n may include flat, curved, and / or variable surface curvature.

[0054] 4A shows input control locations 411 and 412. Input control locations 411 may be for left-handed operation and include input control location 415 for a directional pad and input control location 416 for a joystick controller. Input control locations 412 may be for right-handed operation and include input control location 412 having multiple control elements, such as triangular control element 420 and input control location 416 for a joystick controller. According to an embodiment, input control locations 412, 415, 416, and 421 are not physical buttons, but instead include input control sensors 410 associated with the control features. 1~2 Thus, when a user presses or touches the up direction of input control location 415, an up command is output by the game controller. Similarly, when a user touches the input control location 412 in a position associated with triangle control element 420, a triangle command is output by the game controller.

[0055] According to an embodiment, FIG. 4A shows the top surface of the controller and includes input control sensors 410, which may include a touchscreen that detects both pressure and heat and stores position data for input controls. 1~2On either side of the controller, including the surface incorporating the touchscreen, a set of optical sensors (e.g., microcameras) may be configured to detect different zones and look up and through the touchscreen. The optical sensors can record player movements and actions, including touches, taps, and swipes. The game controller 400 may store and aggregate data to create areas for predictive input. According to embodiments, the game controller 400 includes a controller surface that displays stored input locations, providing the player with a visible point of reference on the screen. Inputs may be mirrored to support player preferences, creating a tailored experience for left-handed players. The game controller 400 may be configured for fingerprint recognition to ensure multiple players can use the same controller and to provide players with a personalized experience across shared devices. According to embodiments, the surface of the game controller 400 is configured to detect both pressure and heat and to map and store positional data related to pressure and heat. Pressure sensor data and heat sensor data, along with the optical sensors, may be used to map player intent and execute game commands in place of buttons, sticks, and triggers. Commands may be mapped and stored to provide improved performance over time. Unique users may be "recognized" and settings default to each individual player.

[0056] According to an embodiment, the game controller 400 includes at least three optical sensors (e.g., cameras) to track contact and movement across each input control sensor. The input control sensors may be configured to capture and store movement and last touch location as unique data points, creating a privatized input location. While FIG. 4A illustrates input locations that provide a reference point for the player, it should be understood that the input locations may be modified. Based on the stored reference points, player data may be used to refresh the control locations as the controller is used. Additionally, inputs may be mirrored to support left-handed play. The inclusion of input control sensors may provide a buttonless touch controller that does not require actual physical push buttons. Additionally, the game controller 400 provides an enhanced experience for players with different hand shapes and sizes.

[0057] 4B shows an exemplary view of the front of the game controller 400. FIG. 4B shows input control sensors 410, each of which may include a touchscreen. 3~n Input control sensor 410 3~n may detect both pressure and heat and store position data. On either side of the front of the game controller 400, there may be an optical camera configuration including at least two optical sensors (e.g., micro-cameras) configured to detect at least one zone or area. The optical sensors may look through the touchscreen to detect and record player movements and actions, which may include touches, taps, and swipes. Data may be stored and aggregated to create areas for predictive input. Inputs can be mirrored to support player preferences, creating a tailored experience for left-handed players. Input Control Sensors 410 3~n may be configured to provide a trigger position.

[0058] FIG. 5 illustrates a process for determining a reference point of a controller, according to one or more embodiments. Process 500 may be configured to modify or set user input parameters. According to an embodiment, a game controller may include one or more input control sensors. The input control sensor may include one or more areas for receiving input, such as a control input position. The input may be an input reference update, which is a user-specified position relative to the input control position. Process 500 enables a game controller to modify or adjust a preset or predetermined control input position. Process 500 may begin by detecting a user input at block 505. According to an embodiment, the controller may detect and record the user input and set the control input position based on the user-detected input. Process 500 optionally includes outputting a reference at block 506 prior to detecting the input at block 505. Outputting a reference at block 506 may include controlling a touchscreen of the input control sensor to illuminate a portion of an input surface. The game controller may detect a user-activated region relative to an output reference and / or a control input position, and / or may determine a position of the user contacting an input sensor of the game controller. At block 510, the game controller may store a control input position for the user for one or more game commands. For example, at block 515, the game controller may detect one or more directional pad inputs. One or more regions of the input control sensor may be associated with the user input. These regions may be identified based on a reference point associated with the sensor. Thus, the game controller may store control input positions in multiple regions of the control sensor. The controller may also be configured to detect the input control position based on at least one input reference update.

[0059] 6 shows a graphical representation of updating a game controller according to one or more embodiments. Process 600 may be performed by a game controller device. Process 600 includes a body 605 and an input control sensor 610 having a control input arrangement 610. 1~n The control input configuration 601 includes a game controller having an input control sensor 6101 and an input control sensor 610. n The game controller 600 can detect a user's hand 615 and when the hand contacts the input control sensor 6101. According to an embodiment, the game controller can detect the user's hand 615 for contact with the input control sensor 6101 and one or more of a pre-touch with the input surface or the input control sensor 6101. While FIG. 6 shows a left hand, it should be understood that a right hand may also be detected. According to an embodiment, the process 600 may include modifying the position of the control input position based on the hand position, size, location, and / or placement history. FIG. 6 illustrates modification of the control input configuration 601 to the control input position 602, where the directional pad provided by the input control sensor 6101 is in alignment with the user's finger and the input control sensor 6101. n The game controller may move the control input position downward to be positioned at a position modification of the plurality of command elements provided by the controller. The control input position modification may include updating one or more reference points that the controller utilizes for hand position detection and / or touch sensing. In addition to moving the control input position, updating the game controller may also include setting the control input position farther away or closer together.

[0060] 7A-7B show a graphical representation of a game controller reference point, according to one or more embodiments. The game controller reference point may be provided to project a control area or control input location and assist a user in game control location. According to an embodiment, the game controller may be configured to provide a user with the location of a control input location. FIG. 7A illustrates a main body 705 and an input control sensor 710. 1~n7B shows a controller reference point configuration 700 for a game controller including a directional pad and multiple command elements. The controller reference point configuration 700 includes illumination 720 of an area surrounding a control input location including a directional pad and multiple command elements. According to an embodiment, the illumination may be provided by one or more elements of a touchscreen display. Alternatively, or in combination, one or more lighting elements may be positioned with optical sensor elements to illuminate one or more portions of the input surface. FIG. 7B shows a controller reference point configuration 750 including illumination 755 of a control input location including a directional pad and multiple command elements.

[0061] FIG. 8 illustrates an input control sensor 810 of a game controller. 1~n 8 shows an exemplary input to a game device. According to an embodiment, the input control sensors can detect one or more types of user interactions. Input control sensor 8101 is shown with a control input position for directional pad 805 and swipe input 806. The swipe input contacts the top portion of directional pad 805 and swipes downward below the bottom of directional pad 805. According to an embodiment, the game controller may detect the command as an up then down output to the game device. Input control sensor 8102 is shown with multiple control elements and control input positions for press 807. Although the illustrated press 807 does not completely cover the control elements, the game controller may detect the input command based on the control input position. Input control sensor 8103 is shown with a control input position for directional pad 805 and press input 808. The press input 808 may result in the output of a left command on the game controller for the period that press input 808 is held. Input control sensor 810 n is shown with control input locations for multiple control elements and multiple presses 809. The multiple presses 809 may cause the game controller to output commands based on the number of presses associated with the multiple presses 809.

[0062] While the present disclosure has been particularly shown and described with reference to exemplary embodiments, it will be understood by those skilled in the art that various changes in form and details can be made therein without departing from the scope of the claimed embodiments.

Claims

1. 1. A game controller device, comprising: The main body and at least one input control sensor supported by the body, the at least one input control sensor including an input surface and at least one optical sensor for detecting game controller input to the input surface; a controller coupled to the at least one input control sensor, the controller comprising: receiving a game controller input to the input control sensor; identifying at least one input command based on the input; the controller configured to output a control signal based on the at least one input command; A game controller device comprising:

2. The game controller device of claim 1 , wherein the at least one input control sensor is configured to detect at least one of a touch, a tap, a swipe, a press, a pinch, and a joystick input.

3. The game controller device of claim 1 , wherein the at least one optical sensor is configured to detect input to at least one region of the input surface.

4. 2. The game controller device of claim 1, wherein the at least one optical sensor is configured to detect a pre-touch on the input surface, the pre-touch being at least one of an input approaching at least one area of ​​the input surface and an input prior to engaging at least one area of ​​the input surface.

5. The game controller device of claim 1 , wherein the input surface comprises a light-transmitting surface.

6. The game controller device of claim 1 , wherein the controller identifies the at least one input command relative to at least one reference point of the control sensor.

7. The game controller device of claim 1 , wherein the controller is configured to present at least one reference point for input control position.

8. The game controller device of claim 1 , wherein the controller is configured to detect an input control position based on at least one input reference update, the input reference update being a user-specified position relative to the input control position.

9. The game controller device of claim 1 , wherein the controller identifies a user and configures the game controller based on the user identification to include at least one input control position.

10. The game controller device of claim 1 , further comprising a memory coupled to the controller and configured to store executable instructions, the memory further configured to store at least one input control position.

11. The game controller device of claim 1 , further comprising at least one of a temperature sensor and a pressure sensor configured to detect a condition of the input surface.

12. 1. An input control sensor for a game controller device, comprising: An input surface; at least one optical sensor for detecting input to the input surface; a controller coupled to the at least one optical sensor, the controller comprising: receiving an input to the input control sensor; identifying at least one input command based on the input; the controller configured to output a control signal based on the at least one input command; An input control sensor comprising:

13. The input control sensor of claim 12 , wherein the at least one optical sensor is configured to detect at least one of a touch, a tap, a swipe, a press, a pinch, and a joystick input.

14. The input control sensor of claim 12 , wherein the at least one optical sensor is configured to detect input to at least one region of the input surface.

15. 13. The input control sensor of claim 12, wherein the at least one optical sensor is configured to detect a pre-touch on the input surface, the pre-touch being at least one of an input approaching at least one area of ​​the input surface and an input prior to engaging at least one area of ​​the input surface.

16. The input control sensor of claim 12 , wherein the input surface comprises a light-transmissive surface.

17. The input control sensor of claim 12 , wherein the controller identifies the at least one input command relative to at least one reference point of the control sensor.

18. The input control sensor of claim 12 , wherein the controller is configured to provide at least one reference point for input control position.

19. The input control sensor of claim 12 , wherein the controller is configured to detect an input control position based on at least one input reference update, the input reference update being a user-specified position relative to the input control position.

20. The input control sensor of claim 12 , wherein the controller identifies a user and configures a game controller based on the user identification to include at least one input control position.

21. The input control sensor of claim 12 , further comprising a memory coupled to the controller, the memory configured to store executable instructions and to store at least one input control position.

22. The input control sensor of claim 12 , further comprising at least one of a temperature sensor and a pressure sensor configured to detect a condition of the input surface.

Images