Apparatus and method for game controller

Abstract

Apparatus and process configurations for a game controller are provided. A game controller may include an input control sensor having an input surface and at least one optical sensor for detecting an input to the input surface. The game controller may also include a controller coupled to the input control sensor to receive game controller input, identify at least one input command, and output a control signal. An input control sensor allows input to one or more surfaces of the controller based on one or more of touch, tap, slide, press, pinch, and joystick inputs. Input may include a pre-touch relative to the input surface, the pre-touch including an input proximate to the input surface and an input prior to engagement with a surface. The game controller may present at least one reference point for input control that includes one or more of lighting and detecting heat and pressure using a touch screen.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to U.S. patent application Ser. No. 18 / 168,451, filed on February 13, 2023, entitled “DEVICES AND METHODS FOR GAME CONTROLLERS,” the specification of which is expressly incorporated herein by reference in its entirety. Technical Field

[0003] The present disclosure relates to sensing configurations and game controllers for electronic games, including controller configurations, gaming device controllers, gaming device controller operations, and interactive entertainment device configurations. Background Art

[0004] Computer and console games typically utilize a controller or computer keyboard as the user's control interface. These traditional controllers typically require the user to press buttons or manipulate movable elements to provide game control. These controllers typically follow a similar control interface, with a directional pad on one side of the controller and buttons on the other. One drawback of existing designs can be the fixed configuration. For example, a fixed layout may be too small or too large for the user. Similarly, a fixed layout may be uncomfortable for the user. Manufacturers typically do not change the layout or controller size to reduce costs. As a result, the controller may include a button configuration that is not suitable for all player hand sizes. It is desirable for game controllers to allow for different configurations and adapt to hand sizes without requiring custom or manufactured controller sizes.

[0005] Another drawback of traditional controllers can be the fixed nature of input controls. For example, a controller may only have enough space to accommodate a directional pad and a joystick, and each element is often located in a different location. Game control can be limited due to the size of the physical control elements. Furthermore, accommodating the controls can increase the size of the controller. There is a need and desire for improvements and modifications to game controllers. Summary of the Invention

[0006] Game controller devices, sensors, and methods are disclosed and described herein. In one embodiment, a game controller device includes a body and at least one input control sensor supported by the body, wherein the at least one input control sensor includes an input surface and at least one optical sensor for detecting game controller input to the input surface. The game controller device also includes a controller coupled to the at least one input control sensor. The controller is configured to receive game controller input to the input control sensor, identify at least one input command based on the input, and output a control signal based on the at least one input command.

[0007] In one embodiment, the at least one input control sensor is configured to detect at least one of a touch, a tap, a swipe, a press, a pinch, and a joystick input.

[0008] In one embodiment, the at least one optical sensor is configured to detect input relative to at least one area of ​​the input surface.

[0009] In one embodiment, the at least one optical sensor is configured to detect a pre-touch relative to the input surface, wherein the pre-touch is at least one of an input approaching at least one area of ​​the input surface and an input prior to engagement with at least one area of ​​the input surface.

[0010] In one embodiment, the input surface comprises an optically transmissive surface.

[0011] In one embodiment, the controller recognizes at least one input command relative to at least one reference point of the control sensor.

[0012] In one embodiment, the controller is configured to present at least one reference point for inputting a control position.

[0013] In one embodiment, the controller is configured to detect the input control position based on at least one input reference update, wherein the input reference update is a user-specified position for the input control position.

[0014] In one embodiment, the controller is configured to identify a user and configure the game controller to include at least one input control location based on the user identification.

[0015] In one embodiment, the game controller apparatus includes a memory coupled to the controller and configured to store executable instructions, wherein the memory is further configured to store at least one input control position.

[0016] In one embodiment, the game controller device includes at least one of a temperature sensor and a pressure sensor configured to detect a condition of the input surface.

[0017] Another embodiment relates to an input control sensor for a game controller device. The input control sensor includes an input surface, at least one optical sensor for detecting input to the input surface, and a controller coupled to the at least one optical sensor. The controller is configured to receive input to the input control sensor, identify at least one input command based on the input, and output a control signal based on the at least one input command.

[0018] In one embodiment, the at least one input control sensor is configured to detect at least one of a touch, a tap, a swipe, a press, a pinch, and a joystick input.

[0019] In one embodiment, the at least one optical sensor is configured to detect input relative to at least one area of ​​the input surface.

[0020] In one embodiment, the at least one optical sensor is configured to detect a pre-touch relative to the input surface, wherein the pre-touch is at least one of an input approaching at least one area of ​​the input surface and an input prior to engagement with at least one area of ​​the input surface.

[0021] In one embodiment, the input surface comprises an optically transmissive surface.

[0022] In one embodiment, the controller recognizes at least one input command relative to at least one reference point of the control sensor.

[0023] In one embodiment, the controller is configured to present at least one reference point for inputting a control position.

[0024] In one embodiment, the controller is configured to detect the input control position based on at least one input reference update, wherein the input reference update is a user-specified position for the input control position.

[0025] In one embodiment, the controller is configured to identify a user and configure the game controller to include at least one input control location based on the user identification.

[0026] In one embodiment, the input control sensor includes a memory coupled to the controller, the memory configured to store executable instructions and to store at least one input control position.

[0027] In one embodiment, the input control sensor includes at least one of a temperature sensor and a pressure sensor, the sensor being configured to detect a condition of the input surface.

[0028]

[0011] Additional aspects, features, and techniques will become apparent to those skilled in the relevant art(s) in view of the following detailed description of the embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The features, objects and advantages of the present disclosure will become more apparent from the following detailed description set forth in conjunction with the accompanying drawings, in which like reference characters are identified in a corresponding manner throughout, and in which:

[0030] Figure 1Ais a graphical representation of a game controller device according to one or more embodiments;

[0031] Figure 1B is a graphical representation of an input control sensor according to one or more embodiments;

[0032] Figure 2 illustrates a process for controller operation according to one or more embodiments;

[0033] Figure 3 shows a graphical representation of a game controller device configuration according to one or more embodiments;

[0034] Figures 4A to 4B shows a graphical representation of a game controller device configuration according to one or more embodiments;

[0035] Figure 5 A process for controller reference point determination according to one or more embodiments is shown;

[0036] Figure 6 A graphical representation of a game controller update is shown according to one or more embodiments;

[0037] 7A to 7B showing a graphical representation of a game controller reference point according to one or more embodiments; and

[0038] Figure 8 A graphical representation of game controller input is shown according to one or more embodiments. DETAILED DESCRIPTION

[0039] Overview and Terminology

[0040] One aspect of the present disclosure relates to game controller configurations and input devices for game controllers. Embodiments relate to systems, devices, and methods for detecting user input and outputting control signals to a game device or interactive entertainment device. A game system may include a console for playing game media, a console that provides network data for a game, a handheld device, a mobile device (e.g., a tablet computer, a mobile phone, etc.), and a device generally configured for electronic games. A game controller device may be an independent or integrated device configured to provide user control to a game system. According to an embodiment, a game controller design is provided, comprising at least one input surface, the at least one input surface comprising at least one sensor for detecting user input (such as touch, tap, slide, press, pinch, and joystick control). The game controller may include one or more input areas and one or more input control sensors. Unlike traditional game controllers with fixedly arranged physical buttons, users can select and / or adjust input control positions.

[0041] According to an embodiment, a buttonless game controller input configuration is provided. Configurations and input sensors are provided to allow a game controller to include at least one input surface that does not require buttons or joysticks. The controller's input surface can be configured to detect user touch and user input, similar to the activation of a button or the manipulation of a directional pad, without the need for actual buttons or directional pads. The game controller configuration can be used in addition to or independently of physical buttons. According to an embodiment, input control sensors are provided to allow buttonless operation of the game controller. The input control sensors can be used for both game control and non-gaming applications.

[0042] Embodiments also relate to input control sensors. According to embodiments, the input control sensor may include an input surface that may be supported by the main body or, more generally, the housing of the game controller. According to embodiments, one or more optical sensors may be used to detect user contact and interaction with the input surface. The input surface can eliminate the need for physical buttons and allow a single surface to detect one or more of touches, taps, swipes, presses, pinches, and the like. Unlike traditional buttons that are configured to provide a single function at a single location, the input control sensor described herein may allow for one or more input control locations to be provided on the input surface. In this way, the input control sensor can provide traditional button functionality, where a user can press or touch a location on the input surface, causing the contact to be recognized as a button press. Similarly, one or more areas of the input surface may be associated with the direction of a directional pad or joystick, so that contact with that area can be interpreted as a directional pad operation. The input control sensor may include one or more input control locations. Furthermore, the input control sensor may allow the user to move and reposition the input control locations. One benefit of repositioning the input control locations is that it can accommodate different hand and / or finger sizes. Another benefit may be that it allows for the controller layout to be modified and / or reversed. For example, instead of only allowing the D-pad to be placed on the left side of the controller, the controller can be configured to include a D-pad on the right side of the controller. Similarly, the D-pad input position of the button position can be placed farther or closer. Thus, the controller can provide a personalized experience for the player.

[0043] The input control sensor can be configured to operate using one or more optical sensors configured inside the input control sensor. The optical control sensor can detect contact with the input surface. According to an embodiment, the optical control sensor can detect a user's finger or hand approaching the input surface. By detecting contact, the input control sensor can detect the duration of the user's movement relative to the input surface, thereby allowing detection of a press or a direction associated with a slide or movement. The input control sensor can also detect a pre-touch by the user. The pre-touch can be used to more accurately characterize multiple button presses. The input control sensor may include an input surface that is translucent or at least partially translucent so that the optical sensor detects objects approaching the controller and / or in contact with the controller. The input control sensor may also include one or more of a temperature sensor and a pressure sensor. One or more of the temperature and pressure outputs can be used to generate an output control signal.

[0044] As used herein, the terms "a / an" shall mean one or more. The term "plurality" shall mean two or more. The term "another" is defined as a second or more. The terms "including" and / or "having" are open-ended (e.g., comprising). The term "or" as used herein shall be interpreted as inclusive or meaning any one or any combination. Thus, "A, B, or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B, and C." Exceptions to this definition will only occur if the combination of elements, functions, steps, or actions is inherently mutually exclusive to some extent.

[0045] Reference throughout this document to "one embodiment," "certain embodiments," "an embodiment," or similar terms means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, the appearances of these phrases in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0046] Exemplary embodiments

[0047] Figure 1A is a diagrammatic representation of a game controller device according to one or more embodiments. According to an embodiment, a game controller device 100 is provided, which includes a body 105 and input control sensors 110. 1-n . Figure 1AThe game controller device 100 is shown in a top view in FIG. The game controller device 100 may be configured to detect user input for controlling a game and / or interactive entertainment device and output a control signal. According to an embodiment, the game controller device 100 may include one or more input control sensors 110 1-n , which is configured to provide a surface with which a user can interact. According to an embodiment, the input control sensor 110 1-n The input surface may include a surface and one or more optical sensors for detecting user contact with the surface (e.g., a user's finger, hand, etc.) According to an embodiment, user contact with the input surface may provide one or more game controller functions, including but not limited to game control elements, functions triggered by button presses, multiple button presses, directional pad inputs, joystick inputs, swipe inputs, tap inputs, pinching, and generally game control inputs. Figure 1A The input control sensor 110 is shown 1-n Located on the top surface, but it should be understood that the game controller 100 may include additional game control surfaces. Additionally, the input control sensor 110 1-n Can be provided in other shapes and body configurations. Figure 1A The game controller 100 is shown as a dual handle configuration with input control sensors 110 on the left and right sides. 1-n It should be understood that the input control sensor 110 1-n The shape or outline is not limited to Figure 1A According to the embodiment, the input control sensor 110 1-n Planar, curved, and / or varying surface curvatures may be included.

[0048] According to an embodiment, operation of the game controller device 100 may include user contact with the input control sensor 110 1-n These interactions may be detected by the game controller device 100 to determine or identify commands for the game console. 1-n Multiple input control locations may be supported. In some configurations, the game controller 100 may detect input control sensors 110 without a reference point. 1-n For example, a user tapping or sliding the input control sensor 1101 may be detected, and the tap, slide, or both may be communicated to a controlled device, such as a gaming device. 1-nDetects input and recognizes commands from input, such as directional commands or button presses. Embodiments provide multiple configurations that allow regions to be associated with buttons or directional keys. Additionally, configurations allow for detecting user preferences or input to set regions as buttons, directional keys, or generally, game control features. Embodiments also include output control references to help users determine input control locations.

[0049] According to an embodiment, the input control sensor 110 1-n The game controller 100 may be supported by a body 105. The body 105 may be made of plastic, a molded material, or other material and may include one or more handles, grips, or surfaces for a user to grasp. The body 105 may house one or more electronics, a power source, and the like for the game controller 100. The game controller may include a controller configured to detect and output input commands. Figure 3 1 shows configurations that may be employed by the game controller 100. According to an embodiment, the body may be configured to support at least one input control sensor and may include input control sensors 110 on one or more of the top surface, bottom surface, side surface, front surface, and rear surface. 1-n Input control sensor 110 1-n Each of can include an input surface and one or more optical sensors. Figure 1B 1 shows an input control sensor configuration according to one or more embodiments. The input surface can be flush with and / or integrated with the outer surface of the body 105. According to an embodiment, each input control sensor 110 1-n Includes at least one optical sensor for detecting game controller input to the input surface. Input control sensor 110 1-n It can be configured to detect at least one of touch, tap, slide, press, pinch and joystick input. 1-n The commands can be based on one or more reference points. For example, an optical sensor can detect commands relative to a reference point to associate the command with a particular command input. The commands can be based on input control positions that are associated with reference points relative to the input surface. Depending on the embodiment, the game controller 100 can optionally include one or more control inputs, such as control input 106, which can be buttons, joystick inputs, or generally other control inputs. The optional control input 106 can be supported on an outer surface of the body 105.

[0050] Figure 1B is a diagrammatic representation of an input control sensor according to one or more embodiments. According to an embodiment, the input control sensor 1101 includes an input surface 115 and a plurality of optical sensors 125 1-nThe input surface 115 may be an optically transmissive surface comprising one or more layers and elements. The input surface 115 may be formed of one or more layers of plastic or glass and include one or more sensors and light emitting elements. According to an embodiment, the input control sensor 1101 uses an optical sensor 125 1-n to detect user input to the top surface or contact surface 120. Optical sensor 125 1-n Each may include a detection zone or region, such as region 130 1-n Optical sensor 125 1-n The optical sensor 125 may be arranged to include a detection area for a portion of the input surface 115. In response to user contact, the optical sensor 125 1-n Movement across the surface of the game controller can be observed and tracked. 1-n The input command can be generated by one or more optical sensors 125 1-n Detection. Optical sensor 125 1-n The output can be output to a controller such as Figure 3 controller. According to an embodiment, user input to the input surface 115 can be based on one or more reference points. For example, the input surface 115 can include a map, grid, or reference system including one or more reference points. The input surface 115 can associate contact with one or more reference points in a particular area as an input control location. For example, a user's contact with area 1301 can be associated with a button press and can be detected by the optical sensor 1251. According to an embodiment, a portion of area 1301 can be associated with a button press or a control command. As discussed herein, the game controller can provide one or more references to inform the user of the location. Alternatively, the input surface 115 can be used, at least in part or in its entirety, as an input surface for user actions. The user can slide from area 1301 to area 1302 and then to area 130n in a downward motion or a bending motion as input. Optical sensor 125 1-n Contact and motion may be detected, and the controller may identify output controls for the game or interactive entertainment system.As discussed herein, a game controller may allow input control locations to be set or modified by a user.

[0051] The input control sensor 1101 can be configured to include a top surface 120 that includes multiple flat surfaces, one or more curved surfaces, and one or more shapes. The shape and configuration of the input surface 115 can be based on the outer contours of the game controller.

[0052] According to an embodiment, the optical sensor 125 1-nIt can be configured to detect touch and contact position, contact duration, contact rate and contact shape (e.g., sliding pattern, sliding arc, sliding shape, drawing shape, etc.). According to an embodiment, the input control sensor 1101 includes an optical sensor 125 configured to identify the user. 1-n . User identification can be based on one or more of finger size, finger characteristics, fingerprint detection, and controller grip type. Based on the user identification and / or detection, the game controller can configure at least one input control location. The input control sensors 1101 can include one or more of a temperature sensor and a pressure sensor for detecting the temperature and pressure of the user. According to an embodiment, the temperature sensor and the pressure sensor can be integrated into the input surface 115. For example, the input surface 115 can include a touch screen configuration.

[0053] Figure 2 A process for controller operation according to one or more embodiments is shown. According to an embodiment, a game controller (e.g., game controller 100) may include a controller for receiving information from one or more sensors (such as input control sensor 110). 1-n and / or optical sensor 125 1-n ) receives input from a controller. Process 200 may be performed by a controller of a game controller to detect user input and output one or more commands and controls to a gaming device. Process 200 may be performed by a controller such as game controller 100 of FIG. 1 , Figure 3 The process 200 may be performed by a device (e.g., device 300) that receives and / or detects input at block 205. According to an embodiment, the game controller includes one or more input control sensors configured to detect user input through an input surface. Detecting input at block 205 may include at least one optical sensor detecting at least one of a touch, tap, slide, press, pinch, and joystick input to the input surface. The input may be detected by the controller from the one or more input control sensors. At block 205, at least one optical sensor is configured to detect input relative to at least one area of ​​the input surface. For example, if reference points are set for the user, the optical input sensor may detect input relative to one or more reference points. Block 205 may include receiving the game controller input to the one or more input control sensors. Each input control sensor may include one or more optical sensors coupled to the game controller, the game controller being configured to receive optical sensor output. Detecting input may include detecting input to the input surface of an optically transmissive surface.

[0054] According to an embodiment, the optical control sensor can detect a user's finger or hand approaching the input surface, which can be a pre-touch at block 205. Pre-touch can be used as input. According to an embodiment, pre-touch can be detected as input of user contact approaching at least one area of ​​the input surface. Alternatively, or in combination, pre-touch can be input before a finger or user engages at least one area of ​​the input surface. Pre-touch can be detected relative to the input surface in one or more areas to provide commands from any input type before a user (such as a user's fingertip) contacts the input surface. Detected touch input and pre-touch projections can be detected and stored to provide an aggregated dataset of player input data. According to an embodiment, pre-touch data can be used to provide alternative or optimized input schemes for the player. Pre-touch can also provide proximity-based input schemes that do not rely on physically contacting the surface. According to an embodiment, pre-touch can be detected and / or sensed to track when one or more of the user's fingers approach the input surface. Pre-touch can be detected to track the movement of the user's fingers relative to the input surface, including patterns or movements. The systems and processes herein can detect pre-touch to allow for increased response time. By detecting pre-touch, the game controller can provide output to the gaming system or console to initiate one or more controls or processes prior to user contact.

[0055] At block 210, the process includes identifying and / or determining a command. Based on the received optical sensor output, the controller may identify at least one input command based on the detected user input. Recognition of commands by the controller allows the input control sensor and game controller to provide multiple uses of the detection area. Unlike requiring a directional pad and joystick to allow directional input and joystick functions in different positions, pressing an input contact position and sliding, gliding, or moving relative to an input control position may allow a single input control position to provide multiple functions. At block 210, the controller may identify at least one input command relative to at least one reference point of the control sensor. The input control sensor may be configured to output a control reference or reference element to inform the user of the control position.

[0056] At block 215, the device may be configured to output control commands. The control commands may be based on user input or contact detected by the input control sensors. In some embodiments, the game controller may detect user input, such as a tap, touch, press, swipe, etc., and output the detected contact to the gaming device. Alternatively, or in combination, the game controller may include one or more input control locations associated with regions or reference points of the input control sensors. For example, a directional pad may include at least four reference points: one each for top, bottom, left, and right relative to the position of the input surface. The game controller may allow the user to specify the location of the directional pad reference points on the input surface. In some embodiments, the game controller may provide a reference for the locations of the reference points. The reference points may be provided by providing a light output or indication. For example, using one or more backlights and light-emitting elements of a touch screen, the locations of the four reference points of the directional pad may be illuminated on the controller surface. If and when the user requests to modify the locations of the reference points, the game controller may adjust or move the position of the directional pad component to different reference points to allow for different input control locations for the directional pad. Furthermore, the game controller may include multiple control reference points. For example, a game controller may include reference points for a directional pad, locations associated with buttons or game control input types (e.g., a square button, an X button, a triangle button, a plus button, a home button, a menu button, etc.) The game controller may output control signals based on the detected and recognized input commands.

[0057] Process 200 may optionally include identifying a user at block 206. Depending on the embodiment, the game controller may be configured to detect one or more characteristics of the user and identify the user. User identification may be based on prior use, such that one or more of the user's hand size, grip position, fingerprint, and user characteristics may be detected to identify the user. Based on the user identified at optional block 206, one or more reference points may be determined or set at block 210 for determining commands.

[0058] Process 200 may optionally include outputting a control reference at block 207. Depending on the embodiment, one or more reference points may be indicated to the user. The control reference or reference point indication may be optional so that the controller can detect input to the controller based on repeated user actions. Alternatively, an indication of a reference point or area associated with a specific command of the controller may be provided. In the gaming space, a game controller is typically bound to a gaming console or platform. Thus, a gaming console may include a controller with a fixed layout or fixed controls, the fixed controls including a directional pad, typically multiple buttons, and possibly one or more joystick controls, trigger / paddle keys, menu / home buttons, and the like. Outputting a reference control at optional block 207 may include providing one or more illuminated indications of the control input location for each control feature. Alternatively or in combination, a control reference may be provided by a tactile or movable surface.

[0059] According to embodiments, a game controller may allow for modification of the control input locations for game controller commands. This allows users with different hand or finger sizes to reposition game controls according to their preferences. Alternatively, modifications may be based on user preferences rather than user characteristics. For example, a user may wish to reverse control locations and place the directional pad on the right side of the controls instead of the left, or vice versa. Process 200 may optionally include detecting a reference update at block 208 and storing one or more reference locations at optional block 209. For example, using a game console display or other game controller features, a user may request to modify one or more game control input locations. For example, a user modification may include a request to reposition the directional pad to move downward and rightward. According to embodiments, at block 208, a control input location may be determined by the user pressing a desired location on the game controller. At block 209, one or more reference points may be identified based on the updated input location and used to store the user's control input location or locations. According to embodiments, when a user repeatedly touches a particular location on a feature, the game controller may determine a reference update, allowing the game controller to automatically perform the operations at blocks 208 and 209.

[0060] Figure 3 A graphical representation of a game controller device configuration is shown according to one or more embodiments. Depending on the embodiment, a game controller device may include one or more components and devices. Figure 3 A game controller device 300 is shown according to an embodiment, which may include input control sensors 305. 1-n, controller 310, memory 315 and input / output (I / O) interface 320. The game controller device 300 can be a controller for one or more of a game console, a computing device, and an electronic device that is generally configured to output controls to a console. The game controller 300 can be integrated with a gaming device, such as in the case of a handheld gaming console. With respect to game control, the game controller 300 can be configured to output controls for one or more gaming platforms. For example, the game controller 300 can be configured for control of a platform, such as a PlayStation® platform, and include platform-based controls (e.g., a square button, an X button, a triangle button, a plus button, a home button, a menu button, etc.). It should be understood that the game controller 300 can be configured for other gaming and device platforms. The game controller 300 can include multiple input control sensors, and thus can include multiple input control sensors 305 for each input control sensor. 1-n .

[0061] According to an embodiment, the game controller device 300 is configured to control the sensor 305 via the input 1-n Detects input to one or more input surfaces and outputs control signals. The controller 310 may refer to a processor or control device configured to execute one or more operations stored in the memory 315, such as a process for detecting and outputting player controls. The controller 310 may be coupled to the input control sensor 305. 1-n , memory 315, and I / O interface 320. Memory 315 can be a non-transitory memory configured to provide data storage and working memory operations for device 300. Memory 315 can be configured to store computer-readable instructions executed by controller 300 for one or more processes described herein. Memory 315 can also be configured to store at least one input control location. I / O interface 320 can be a communication module configured to receive data, such as commands or controls, and transmit it to the gaming device. Game controller 300 can be configured to communicate with the gaming console via I / O interface 320 in at least one of wired and wireless communication.

[0062] According to one embodiment, the controller 310 can be configured to support multiple control input locations. The controller 310 can also be configured to allow a user to modify one or more control input locations. According to an embodiment, the game controller 300 can optionally include one or more input reference elements 330. The input reference element 330 can include a light-emitting element to illuminate at least a portion of the input surface to notify the user of the input control location. In certain embodiments, the input reference element 330 can include a touch screen surface integrated with the input surface that allows control of the light-emitting element. According to an embodiment, the input reference element 330 can include one or more tactile or deformable surface elements that allow the user to feel the element location. The tactile or deformable surface can adjust its configuration so that the user can feel the input control location.

[0063] Depending on the embodiment, the game controller 300 may optionally include one or more of the optional pressure and temperature sensors 335. The optional pressure and temperature sensors 335 may be configured to detect one or more of the following: surface temperature, user finger temperature, control temperature, and pressure applied to one or more parts of the game controller. Depending on the embodiment, one or more of the pressure and temperature detections may be used in conjunction with the sensor output to detect and characterize the condition of the user contact and input surface. By combining temperature and / or pressure with contact location, information about force and user condition may be provided to the game console.

[0064] Figures 4A to 4B A graphical representation of a game controller device configuration is shown according to one or more embodiments. Figure 4A An exemplary top-down representation of game controller 400 is shown. Figure 4B A front view of a game controller 400 is shown. The game controller device 400 may incorporate one or more elements described herein, including elements of the game controller 100 and the game controller device 300. According to an embodiment, the game controller device 100 may include a body 405 and one or more input control sensors 410. 1-n , the input control sensor is configured to provide a surface with which a user can interact. According to an embodiment, the input control sensor 410 1-n May include a surface and one or more optical sensors for detecting user contact with the surface (eg, user finger, hand, etc.). Figure 4A The diagram includes an input control sensor 410 located on the top surface. 1-2 An exemplary configuration of . Figure 4B Input control sensor 410 is shown located on the front surface 3-n . Figure 4A The game controller 400 is shown as a dual handle configuration with input control sensors 410 on the left and right sides.1-2 It should be understood that the input control sensor 410 1-n The shape or outline is not limited to Figure 1A to Figure 1B According to the embodiment, the input control sensor 410 1-n Planar, curved, and / or varying surface curvatures may be included.

[0065] Figure 4A Input control locations 411 and 412 are shown. Input control location 411 may be used for left-handed operation and includes input control location 415 for a directional pad and input control location 416 for a joystick controller. Input control location 412 may be used for right-handed operation and includes input control location 412 having multiple control elements (such as a triangular control element 420) and input control location 416 for a joystick controller. According to an embodiment, input control locations 412, 415, 416, and 421 are not physical buttons but rather are input control sensors 410 associated with control features. 1-2 Thus, a user pressing or touching the upward direction of input control location 415 will result in an upward command being output by the game controller. Similarly, touching the position associated with the triangular control element 420 of input control location 412 will result in a triangle command being output by the game controller.

[0066] According to the implementation plan, Figure 4A The top surface of the controller is shown and includes an input control sensor 410 incorporated therein. 1-2The surface of the controller may include a touch screen that detects both pressure and heat and stores positional data for input controls. On either side of the controller, a set of optical sensors (e.g., miniature cameras) may be configured to detect different zones and view the touch screen. The optical sensors can record player motion and actions, including touches, taps, and swipes. The game controller 400 may store and aggregate data to create predicted input zones. In some embodiments, the game controller 400 includes a controller surface that displays memorized input locations, providing players with visible reference points on the screen. Inputs can be mirrored to support player preferences, creating a customized experience for left-handed players. The game controller 400 may be configured for fingerprint recognition to ensure that multiple players can use the same controller and provide a personalized experience for players on shared devices. In some embodiments, the surface of the game controller 400 detects both pressure and heat and is configured to map and store pressure and heat positional data. The pressure and heat sensor data can be used in conjunction with the optical sensors to map player intent and execute game commands instead of buttons, joysticks, and triggers. Commands can be mapped and memorized to provide improved performance over time. Unique users can be 'identified' and default settings made for each individual player.

[0067] According to an embodiment, the game controller 400 includes at least three optical sensors (e.g., cameras) to track contact and movement on each input control sensor. The input control sensors can be configured to capture and store movement and final touch locations as unique data points and create personalized input locations. Although Figure 4A The input locations are shown to provide a reference point for the player, but it should be understood that the input locations can be modified. Based on the stored reference points, the player data can be used to refresh the control positions when using the controller. In addition, the inputs can be mirrored to support left-handed gameplay. By including input control sensors, a buttonless touch controller can be provided without the need for actual physical buttons. Furthermore, the game controller 400 provides an enhanced experience for players of different hand shapes and sizes.

[0068] Figure 4B An exemplary representation of the front surface of game controller 400 is shown. Figure 4B Input control sensors 410 are shown which may each include a touch screen 3-n Input control sensor 410 3-nBoth pressure and heat can be detected and the position data stored. On either side of the front of the game controller 400 can be an optical camera configuration that includes at least two optical sensors (e.g., miniature cameras) configured to detect at least one zone or area. The touch sensor can view the touch screen to detect and record player motion and actions, which can include touches, taps, and swipes. The data can be stored and aggregated to create predicted inputs. Inputs can be mirrored to support player preferences, creating a tailored experience for left-handed players. Input control sensor 410 3-n Can be configured to provide a trigger position.

[0069] Figure 5 A process for controller reference point determination according to one or more embodiments is shown. Process 500 can be configured to modify or set user input parameters. Depending on the embodiment, a game controller may include one or more input control sensors. The input control sensors may include one or more areas for receiving input, such as control input locations. The input may be an input reference update, which specifies a user-specified location for inputting a control location. Process 500 allows a game controller to modify or adjust preset or predefined control input locations. Process 500 may be initiated by detecting user input at block 505. Depending on the embodiment, the controller may detect and record user input to set the control input location based on the detected user input. Process 500 may optionally include outputting a reference at block 506 before detecting the input at block 505. Outputting the reference at block 506 may include controlling a touch screen of the input control sensor to illuminate a portion of the input surface. The game controller may detect the user activation area relative to the output reference and / or the control input location and determine the location where the user contacted the game controller input sensor. At block 510, the game controller may store the user's control input location for one or more game commands. For example, the game controller may detect input in one or more directions of a directional key at block 515. One or more regions of the input control sensor may be associated with the user input. These regions may be identified based on reference points associated with the sensor. Thus, the game controller may store control input locations in multiple regions of the control sensor. The controller may also be configured to detect input control locations based on at least one input reference update.

[0070] Figure 6 A graphical representation of a game controller update according to one or more embodiments is shown. Process 600 may be performed by a game controller device. Process 600 includes a game controller having a body 605 and an input control sensor 610 having a control input configuration 610. 1-n The control input configuration 601 includes a direction key provided by an input control sensor 6101 and a direction key provided by an input control sensor 610n The game controller 600 can detect the user's hand 615 and when the hand contacts the input control sensor 6101. According to an embodiment, the game controller can detect one or more contacts of the user's hand 615 with the input control sensor 6101 and pre-touch with the input surface or input control sensor 6101. Figure 6 A left hand is shown, but it is understood that a right hand may also be detected. According to an embodiment, based on the position, size, location, and / or placement history of the hand, process 600 may include modifying the location of the control input position. Figure 6 The control input configuration 601 shows a modification of the control input position 602, wherein the direction key provided by the input control sensor 6101 is moved downward to be in the same position as the user's finger; and the direction key provided by the input control sensor 610 n Provided are modifications to the positions of multiple command elements. Modifications to the control input positions may include updating one or more reference points used by the controller to detect and / or sense hand position contact. In addition to moving the control input positions, game controller updates may also include setting the control input positions farther away or closer.

[0071] 7A to 7B A graphical representation of a game controller reference point is shown according to one or more embodiments. A game controller reference point can be provided to project control areas or control input locations and help a user determine game control locations. According to an embodiment, a game controller can be configured to provide a user with the location of control input locations. Figure 7A Controller reference point configuration 700 of a game controller is shown, the game controller including a body 705 and input control sensors 710 1-n The controller reference point configuration 700 includes illumination 720 for an area surrounding a control input location, including a directional pad and a plurality of command elements. Depending on the embodiment, the illumination may be provided by one or more elements of the touch screen display. Alternatively, or in combination, one or more illumination elements may be co-located with an optical sensor element to illuminate one or more portions of the input surface. Figure 7B Controller reference point configuration 750 is shown including illumination 755 of control input locations, including a directional pad and a plurality of command elements.

[0072] Figure 8 The input control sensor 810 of the game controller is shown 1-n. According to an embodiment, the input control sensor can detect one or more types of user interactions. Input control sensor 8101 is shown as having control input positions for the direction key 805 and the slide input 806. The slide input contacts the upper portion of the direction key 805 and slides downward to below the downward direction of the direction key 805. According to an embodiment, the game controller can detect commands as up-then-down outputs to the gaming device. Input control sensor 8102 is shown as having control input positions for multiple control elements and press 807. As shown, press 807 does not completely cover the control element, but the game controller can detect input commands based on the control input position. Input control sensor 8103 is shown as having control input positions for the direction key 805 and the press input 808. Press input 808 may cause the game controller to output a left command for the duration that press input 808 is held. Input control sensor 810 n Shown are control input locations for multiple control elements and a multi-press 809. The multi-press 809 may cause the game controller to output a command based on the number of presses associated with the multi-press 809.

[0073] While the present disclosure has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the claimed embodiments.

Claims

1. A game controller device, comprising: main body; at least one input control sensor supported by the body, wherein the at least one input control sensor includes an input surface and at least one optical sensor for detecting input to the input surface; as well as a controller coupled to the at least one input control sensor, wherein the controller is configured to receiving a game controller input to the input control sensor, identifying at least one input command based on the input, and A control signal is output based on the at least one input command.

2. The game controller device of claim 1, wherein the at least one input control sensor is configured to detect at least one of a touch, a tap, a swipe, a press, a pinch, and a joystick input.

3. The game controller apparatus of claim 1, wherein the at least one optical sensor is configured to detect input relative to at least one area of ​​the input surface.

4. The game controller device of claim 1 , wherein the at least one optical sensor is configured to detect a pre-touch relative to the input surface, wherein the pre-touch is at least one of an input approaching at least one area of ​​the input surface and an input prior to engagement with at least one area of ​​the input surface.

5. The game controller device of claim 1, wherein the input surface comprises an optically transmissive surface.

6. The game controller apparatus of claim 1, wherein the controller recognizes the at least one input command relative to at least one reference point of the control sensor.

7. The game controller apparatus of claim 1, wherein the controller is configured to present at least one reference point for inputting a control position.

8. The game controller apparatus of claim 1, wherein the controller is configured to detect the input control position based on at least one input reference update, wherein the input reference update is a user-specified position for the input control position.

9. The game controller apparatus of claim 1, wherein the controller is configured to identify a user and configure the game controller to include at least one input control location based on the user identification.

10. The game controller apparatus of claim 1, further comprising a memory coupled to the controller and configured to store executable instructions, wherein the memory is further configured to store at least one input control position.

11. The game controller apparatus of claim 1, further comprising at least one of a temperature sensor and a pressure sensor configured to detect a condition of the input surface.

12. An input control sensor for a game controller device, comprising: Input surface; at least one optical sensor for detecting input to the input surface; as well as a controller coupled to the at least one optical sensor, wherein the controller is configured to receiving input from the input sensor, identifying at least one input command based on the input, and A control signal is output based on the at least one input command.

13. The input control sensor of claim 12, wherein the at least one optical sensor is configured to detect at least one of a touch, a tap, a slide, a press, a pinch, and a joystick input.

14. The input control sensor of claim 12, wherein the at least one optical sensor is configured to detect input relative to at least one area of ​​the input surface.

15. The input control sensor of claim 12, wherein the at least one optical sensor is configured to detect a pre-touch relative to the input surface, wherein the pre-touch is at least one of an input approaching at least one area of ​​the input surface and an input prior to engagement with at least one area of ​​the input surface.

16. The input control sensor of claim 12, wherein the input surface comprises an optically transmissive surface.

17. The input control sensor of claim 12, wherein the controller identifies the at least one input command relative to at least one reference point of the control sensor.

18. The input control sensor of claim 12, wherein the controller is configured to present at least one reference point for an input control location.

19. The input control sensor of claim 12, wherein the controller is configured to detect the input control position based on at least one input reference update, wherein the input reference update is a user-specified position for the input control position.

20. The input control sensor of claim 12, wherein the controller is configured to identify a user and configure the game controller to include at least one input control location based on the user identification.

21. The input control sensor of claim 12, further comprising a memory coupled to the controller, the memory configured to store executable instructions and to store at least one input control location.

22. The input control sensor of claim 12, further comprising at least one of a temperature sensor and a pressure sensor configured to detect a condition of the input surface.

Images