Controller device for extended reality

Abstract

The present application relates to a controller device for extended reality. The controller device comprises one or more communication modules, one or more vibration feedback modules, a holding portion configured for a user to hold with one hand, and one or more extension interfaces configured for detachably attaching an extension accessory. The solution of the present disclosure can enable a user to quickly and conveniently attach and detach different extension accessories, reduce the interruption time of the game, and thus improve the immersive game experience of the user.

Description

Technical Field

[0001] This disclosure relates to controller devices for use in extended reality environments. Background Technology

[0002] In recent years, the development of devices for extended (augmented / virtual / mixed) reality has increased significantly. Various controllers (such as the Meta Quest 3 Touch Plus controller and the Sony PlayStation Move motion controller) are used for controlling extended reality games. Playing games with extended reality devices can provide a realistic and immersive experience. To achieve better immersion, different types of extended reality games require controllers with different shapes, weights, and / or functions. For example, tennis games in extended reality require controllers that can be held with one hand and have no protruding buttons on the grip. Shooting games in extended reality require controllers with trigger buttons on the grip. Existing controllers are designed with fixed shapes, weights, and functions, and therefore cannot be well adapted to various types of extended reality games, thus affecting the user's immersive experience in extended reality games. Summary of the Invention

[0003] Extended reality games require improved controller devices and corresponding accessories to better adapt to different weapons or items in the game, thereby enabling users to have a better and more immersive experience in extended reality games.

[0004] In this disclosure, according to some embodiments, a controller device communicatively connected to a host device may include one or more communication modules, one or more vibration feedback modules, a grip portion configured for one-handed holding by a user, and one or more expansion interfaces configured for detachably attaching an extension accessory. The grip portion may extend in a longitudinal direction. A first expansion interface of the one or more expansion interfaces is located at the top of the controller device in that longitudinal direction. The angle between the transverse section of the first expansion interface and the longitudinal direction may be greater than or equal to 45 degrees and less than or equal to 90 degrees. The radius of the inscribed circle of the first expansion interface in the transverse section may be greater than 2 mm and less than 2 cm. The first expansion interface may include a magnetic engagement, a snap-fit ​​mechanism, a threaded connection, or a rotation lock for securely attaching the extension accessory.

[0005] In one embodiment, the controller device may include a housing. The housing may include the grip portion and the one or more expansion interfaces. The housing may include a transition portion between the grip portion and the one or more expansion interfaces. The one or more communication modules and the one or more vibration feedback modules may be located inside the housing.

[0006] In one embodiment, the grip portion may include a tactile or pressure-sensitive module covering part or all of the grip portion. The grip portion may not include keys protruding from the surface of the grip portion.

[0007] In one embodiment, one of the one or more extended interfaces may be circular, elliptical, polygonal, square, rectangular, trapezoidal, rhomboid, or triangular. One of the one or more extended interfaces may include one or more notches, the shape of which is circular, elliptical, polygonal, square, rectangular, trapezoidal, rhomboid, or triangular.

[0008] In one embodiment, one of the one or more expansion interfaces may include a data interface, a power interface, or an interface that combines both a data interface and a power interface.

[0009] In one embodiment, the magnetic attraction may include permanent magnet attraction, electromagnetic induction attraction, a combination of permanent magnet attraction and electromagnetic induction attraction, or a combination of permanent magnet attraction or electromagnetic induction attraction with a slot, a snap-fit ​​mechanism, a threaded connection, a rotary lock, a positioning pin, or a spring.

[0010] In one embodiment, the one or more expansion interfaces may include a second expansion interface. The second expansion interface may be located at the bottom of the controller device. The appearance of the second expansion interface may differ from that of the first expansion interface. Through the second expansion interface, the controller device can connect to the first expansion interface of another controller device.

[0011] In one embodiment, the controller device may include one or more input modules located between the first expansion interface and the grip portion. One of the one or more input modules may include a joystick button, a set of buttons, a touchpad, or a touchscreen.

[0012] In one embodiment, the accessory attached to the controller device via the one or more expansion interfaces may include a racket-type expansion accessory, a one-handed melee weapon-type expansion accessory, a two-handed melee weapon-type expansion accessory, a one-handed gun-type expansion accessory, a two-handed gun-type expansion accessory, a cover, an external housing, a counterweight, a soft strap, an external battery, or one or a set of buttons.

[0013] In one embodiment, the accessory attached to the controller device via the one or more expansion interfaces may include one or more buttons for switching weapons or items in a game, an identifier for identifying the accessory's level, function, or attribute, or one or more weight modules for adjusting the accessory's mass distribution.

[0014] The embodiments disclosed herein provide improved controller devices and corresponding accessories for extended reality games, which can flexibly adapt to different weapons or props in the game, thereby enabling users to obtain an improved immersive experience in extended reality games and increase user satisfaction.

[0015] It should be noted that the various embodiments described above can be combined with any other embodiments described herein. The features and advantages described in this specification are not exhaustive; in particular, many additional features and advantages will be apparent to those skilled in the art from the accompanying drawings, description, and claims. Furthermore, it should be pointed out that the language used in this specification has been chosen in principle for readability and instruction purposes, and such choice may not be necessary to depict or define the subject matter of this disclosure. Attached Figure Description

[0016] To better understand the various embodiments described, reference should be made to the following detailed description in conjunction with the accompanying drawings, wherein similar reference numerals indicate corresponding parts in all the drawings.

[0017] Figure 1 This is a schematic diagram illustrating an extended reality experience according to some implementation schemes.

[0018] Figure 2 This is a schematic diagram of a controller device based on some implementation schemes.

[0019] Figure 3 This is a schematic diagram of the expansion interface of a controller device according to some implementation schemes.

[0020] Figure 4 This is a top view of the expansion interface of a controller device according to some implementation schemes.

[0021] Figure 5 This is a schematic diagram of an extended accessory based on some implementation schemes. Detailed Implementation

[0022] This disclosure relates to controller devices for use in extended reality environments.

[0023] Figure 1 This is a schematic diagram illustrating an extended reality experience according to some implementation schemes.

[0024] In some implementation schemes, such as Figure 1As shown, a computer-generated reality (CGR) experience is provided to a user via an operating environment 100 including a computer system 101. The CGR experience may include gaming experiences, audiovisual experiences, educational experiences, remote collaboration experiences, and other immersive experiences. The computer system 101 may include at least a processor 110 (e.g., a processor of an electronic device and / or a remote server) and a display generation component 120 (e.g., a head-mounted device (HMD), a monitor, a touchscreen, etc.). The computer system 101 may be (including, or run on) a host device (e.g., in a head-mounted device or a handheld device) that integrates the display generation component 120. The processor 110 may also be separate from the display generation component 120. For example, the processor 110 may run on a host device (e.g., a portable multifunction device) separate from the display generation component 120, which is connected to the display generation component 120 via a wired or wireless connection. The computer system may be referred to as (e.g., called, or simply) a host device. The terms "computer system" and "host device" are used interchangeably. A host device can be a game console, a portable multi-functional device (e.g., a smartphone, tablet, portable game console, or portable device for extended reality computing), or a head-mounted device.

[0025] When describing a CGR experience, various terms may be used to refer differently to several related but different environments in which the user can perceive and / or interact (e.g., using inputs detected by the computer system 101 that generates the CGR experience; these inputs cause the computer system generating the CGR experience to generate audio, visual, and / or haptic feedback corresponding to the various inputs provided to the computer system 101). The following is a subset of these terms.

[0026] Physical environment: The physical environment refers to the physical world that people can sense and / or interact with without the aid of electronic systems. Physical environments, such as physical parks, include physical objects such as physical trees, physical buildings, and physical people. People can directly sense and / or interact with the physical environment through senses such as sight, touch, hearing, taste, and smell.

[0027] Computer-Generated Reality (CGR): A computer-generated reality (CGR) environment is a fully or partially simulated environment that people perceive and / or interact with via electronic systems. In CGR, a subset of a person's physical motion or a representation thereof is tracked, and in response, one or more characteristics of one or more virtual objects simulated in the CGR environment are modulated in a manner that conforms to at least one physical law. A person can use any of their senses to sense and / or interact with CGR objects, including sight, hearing, touch, taste, and smell. CGR can refer to Extended Reality (XR). The terms "CGR" and "Extended Reality" are used interchangeably. Examples of CGR (Extended Reality) include Virtual Reality, Mixed Reality, and Augmented Reality. XR can be a collective term for VR, MR, AR, and AV. A CGR experience can refer to an Extended Reality experience.

[0028] Virtual Reality (VR): A virtual reality (VR) environment is a simulated environment designed to be entirely based on computer-generated sensory input for one or more senses. A VR environment includes one or more virtual objects that a person can perceive and / or interact with. Examples of virtual objects include trees, buildings, and computer-generated images representing human avatars.

[0029] Mixed Reality (MR): A mixed reality (MR) environment is a simulated environment designed to incorporate sensory input from the physical environment, or a representation thereof, in addition to computer-generated sensory input (e.g., virtual objects). A mixed reality environment is any situation between a purely physical environment as one end and a virtual reality environment as the other, but not both. In some MR environments, computer-generated sensory input can respond to changes in sensory input from the physical environment. Additionally, some electronic systems used to present an MR environment can track position and / or orientation relative to the physical environment to enable virtual objects to interact with real objects (i.e., physical objects or representations thereof from the physical environment). Examples of mixed reality can include augmented reality and augmented virtual reality.

[0030] Augmented Reality (AR): An augmented reality (AR) environment is a simulated environment in which one or more virtual objects are superimposed on a physical environment or a representation of the physical environment. For example, an electronic system for presenting an AR environment may have a transparent or semi-transparent display through which a person can directly view the physical environment. The system can be configured to present virtual objects on the transparent or semi-transparent display, allowing a person to perceive the virtual objects superimposed on the physical environment. The system may have an opaque display and one or more imaging sensors that capture images or videos of the physical environment, which are representations of the physical environment. The system combines the images or videos with virtual objects and presents the combination on the opaque display. A person uses the system to indirectly view the physical environment via images or videos of the physical environment and perceives the virtual objects superimposed on the physical environment. In this disclosure, the video of the physical environment displayed on the opaque display is referred to as "pass-through video," meaning that the system uses one or more image sensors to capture images of the physical environment and uses those images when presenting the AR environment on the opaque display.

[0031] Augmented Virtuality (AV): An augmented virtuality (AV) environment is a simulated environment in which a virtual or computer-generated environment combines one or more sensory inputs from a physical environment. Sensory input can be a representation of one or more characteristics of the physical environment. For example, an AV park could have virtual trees and virtual buildings, but a person's face could be realistically reproduced from an image taken of a physical person. Similarly, virtual objects could adopt the shape or color of a physical object imaged by one or more imaging sensors. Furthermore, virtual objects could use shadows that correspond to the sun's position within the physical environment.

[0032] Hardware: Many different types of electronic systems enable humans to sense and / or interact with various CGR environments. Examples include head-mounted systems, projection-based systems, head-up displays, vehicle windshields with integrated display capabilities, windows with integrated display capabilities, contact lenses with integrated display capabilities, displays shaped as lenses designed to be placed on a person's eyes (e.g., similar to contact lenses), headphones / earpieces, speaker arrays, input systems (e.g., wearable or handheld controllers with or without haptic feedback), smartphones, tablets, and desktop / laptop computers. Head-mounted systems may have one or more speakers and an integrated opaque display. Alternatively, head-mounted systems may be configured to receive an external opaque display (e.g., a smartphone). Head-mounted systems may incorporate one or more imaging sensors for capturing images or video of the physical environment, and / or one or more microphones for capturing audio of the physical environment. Head-mounted systems may have transparent or translucent displays instead of opaque displays. Transparent or translucent displays may have a medium through which light representing the image is directed to the person's eyes. The display can utilize digital light projection, OLED, LED, uLED, liquid crystal on silicon, laser scanning light source, or any combination of these technologies. The medium can be optical waveguide, holographic medium, optical combiner, optical reflector, or any combination thereof.

[0033] In some implementations, processor 110 may be configured to manage and coordinate the user's CGR experience. Processor 110 may include a suitable combination of software, firmware, and / or hardware. Processor 110 may be a computing device located locally or remotely relative to scene 105 (e.g., physical set / environment). For example, processor 110 may be a local server located within scene 105. Alternatively, processor 110 may be a remote server (e.g., a cloud server, central server, etc.) located outside scene 105. Processor 110 may be communicatively coupled to display generation component 120 via one or more wired or wireless communication channels. Processor 110 may be included within, or share with, the housing (e.g., physical enclosure) of the peripheral device of display generation component 120 (e.g., an HMD or a portable electronic device including a display and one or more processors).

[0034] In some implementations, the display generation component 120 is worn on a part of the user's body (e.g., on the head, hand, etc.). The display generation component 120 may include one or more CGR displays provided for displaying CGR content. For example, the display generation component 120 may surround the user's field of view. In one example, the display generation component 120 may be configured as a handheld device (such as a smartphone or tablet) to present CGR content, and the user holds the device with a display facing the user's field of view and a camera facing scene 105. In one example, the display generation component 120 may be configured as a CGR chamber, housing, or room to present CGR content, in which the user does not wear or hold the display generation component 120. Many user interfaces described with reference to one type of hardware for displaying CGR content (e.g., a handheld device or a device on a tripod) can be implemented on another type of hardware for displaying CGR content (e.g., an HMD or other wearable computing device).

[0035] In some implementation schemes, such as Figure 1 As shown, the user can use controller device 150 to send control commands to computer system 101. Controller device 150 can be connected to computer system 101 via wired or wireless means (e.g., coupled or communicating).

[0036] In some implementations, the display generation component 120 can be configured to provide a user with a CGR experience (e.g., at least the visual components of the CGR experience). The display generation component 120 may include a suitable combination of software, firmware, and / or hardware. The functionality of the processor 110 may be provided by and / or combined with the display generation component 120. The display generation component 120 provides a CGR experience to the user when the user is virtually and / or physically present within scene 105. When the user places the display generation component 120 of the computer system 101 in a predefined position relative to the user (e.g., wearing a head-mounted device on the user's head), the user's view of the real world is obstructed by the display generation component, and the content presented by the display generation component (e.g., extended reality) may dominate the user's field of vision. For example, in Figure 1In this context, the display generation component 120 presents user interface objects 102, 103, and 106'. User interface object 102 may include an application icon, text input box, control, menu item, or other similar user interface object that does not correspond to a real-world object. User interface object 106' may be a user interface object that corresponds to a real-world object. For example, user interface object 106' corresponds to object 106 in scene 105. The display generation component 120 may present user interface object 106' as having the same or similar appearance as object 106. User interface object 103 may be a user interface object corresponding to controller device 150. The display generation component 120 may present user interface object 103 as having the same or similar appearance as controller device 150. The display generation component 120 may also present user interface object 103 as having a different appearance from controller device 150 (e.g., the appearance of a weapon or prop in a game). Movement may be caused by movement of the head-mounted device relative to the physical environment (e.g., scene 105 or a part of the user's body (e.g., the user's eyes, head, or hand)).

[0037] Despite Figure 1 The relevant features of the operating environment 100 are shown in this disclosure, but those skilled in the art will recognize from this disclosure that various other features are not shown for the sake of brevity and so as not to obscure further relevant aspects of the exemplary embodiments disclosed herein.

[0038] Figure 2 This is a schematic diagram of a controller device based on some implementation schemes.

[0039] In some implementation schemes, such as Figure 2 As shown, controller device 150 may include a grip portion 160, an expansion interface 170, and one or more input modules 180. The housing of controller device 150 may include the grip portion 160 and the expansion interface 170. One or more input modules 180 may protrude, recess, or be flush with the surface of the housing. Controller device 150 may include one or more communication modules. Controller device 150 may include one or more vibration feedback modules. The grip portion 160 may be configured for a user to grip using the palm and all fingers of one of the user's hands. The grip portion 160 may extend in a longitudinal direction (e.g., perpendicular to the horizontal plane and upward). For example, this longitudinal direction may be... Figure 2The grip portion 160 may include one or more tactile modules covering the surface of the grip portion 160. The one or more tactile modules may cover part or all of the grip portion 160. The grip portion 160 may not include keys protruding from the surface of the grip portion 160 (or the housing). An expansion interface 170 may be configured for detachably attaching an expansion accessory. The expansion interface 170 may be configured to be located at the top of the controller device 150 in the longitudinal direction. The expansion interface 170 may not coincide with the grip portion 160. The lateral section of the expansion interface 170 (as a plane) forms an angle (as a line-plane angle) between 45 degrees and 90 degrees with the longitudinal direction (as a straight line). The lateral section of the expansion interface 170 may be a plane formed by the x-axis and z-axis. One or more input modules 180 are disposed between the expansion interface 170 and the grip portion 160. The controller device 150 (or the housing) may include a transition portion located between the expansion interface 170 and the grip portion 160. The transition section may include one or more input modules 180.

[0040] In some implementations, a controller device (e.g., controller device 150) may be communicatively connected to a host device (e.g., computer system 101). The controller device may include one or more communication modules. The controller device may include one or more vibration feedback modules. The controller device may include a grip portion (e.g., grip portion 160). The grip portion may be configured for one-handed gripping. The grip portion extends in a longitudinal direction. The controller device may include one or more expansion interfaces. The one or more expansion interfaces may be configured for detachably attaching expansion accessories. The one or more expansion interfaces may include a first expansion interface. The first expansion interface may be located at the top of the controller device in the longitudinal direction. The angle between the transverse section of the first expansion interface and the longitudinal direction may be greater than or equal to 45 degrees and less than or equal to 90 degrees. The radius of the inscribed circle of the first expansion interface in the transverse section may be greater than 2 mm and less than 2 cm. The first expansion interface may include a magnetic engagement, a snap-fit ​​mechanism, a threaded connection, or a rotation lock. The magnetic engagement, snap-fit ​​mechanism, threaded connection, or rotation lock may be used to securely attach the expansion accessory. One or more input modules can be configured between the first expansion interface and the grip portion.

[0041] In this disclosure, a controller device (e.g., controller device 150) can be a device that provides input to a host device (e.g., computer system 101). The controller device may include a handheld device (e.g., a game controller, VR controller), a console, a joystick (also called a joystick, actuator, or joystick), a mouse, and a keyboard. The controller device may include wired and wireless controller devices. The controller device may include controller devices with feedback and controller devices without feedback. The controller device can be used for control in games, audio / video playback, and / or operating systems. The controller device may include one or more processors. The terms "controller device," "game controller," "game console," "gamepad," "game handle," and "console device" have the same meaning and are used interchangeably.

[0042] In this disclosure, the terms "module," "element," "device," "part," "component," "assembly," "unit," and "cell" have the same meaning and are used interchangeably. A module may include a processor module, a vibration feedback module, a battery module, a communication module, a housing, an expansion interface, and a key. The terms "vibration" and "vibration" have the same meaning and are used interchangeably.

[0043] In this disclosure, a communication module is an electronic device with communication capabilities (e.g., wireless or wired communication). The controller device can communicatively connect to the host device via one or more communication modules (e.g., wireless communication connections including Bluetooth, WiFi, 5G, 6G, etc.). The one or more communication modules can send user-input control commands to the host device. The one or more communication modules can receive commands or feedback information (e.g., instructions for the controller device to vibrate) from the host device.

[0044] In this disclosure, a vibration feedback module is an electronic device with vibration functionality. The vibration feedback module can be a motor that generates vibration (e.g., a vibratory motor or a linear vibrator). When the user inputs a control command or when the controller device receives a vibration feedback command, the one or more vibration feedback modules can vibrate to provide vibration feedback to the user.

[0045] In some embodiments, the controller device may include a housing. The grip portion may be (or be configured as) part of the housing. The one or more communication modules and the one or more vibration feedback modules may be located (or configured) inside the housing.

[0046] In the present disclosure, the holding portion (e.g., holding portion 160) can be part of the controller device (e.g., controller device 150). The holding portion can be configured for a user to hold the controller device in a natural manner. The natural manner can be a first holding manner (e.g., the manner in which the user holds the controller device with all fingers and the palm of one hand), a second holding manner (e.g., the manner in which the user holds the controller device with some fingers (e.g., index finger, middle finger, ring finger, and little finger) and the palm of one hand), a third holding manner in which only the user's palm touches the controller device (e.g., all of the user's fingers do not touch the controller device, while the user's palm touches the controller device and is fixed to the controller device by a strap), or other natural holding manners. The holding portion may not include keys. The holding portion may include keys. For example, when the user holds the controller device in a natural manner and the user's palm or finger touches a key, then the holding portion includes the key. The terms "hold", "grasp", "grip", "clutch", and "hold" have the same meaning and can be used interchangeably.

[0047] For example, when the user holds the controller device 160, the user's hand only touches the holding portion 160 and does not touch one or more input modules 180 or the expansion interface 170. The length 165 of the holding portion 160 can range between 5 centimeters and 15 centimeters. For example, the length 165 can range between 8 centimeters and 10 centimeters. For example, the length 165 can range between 9 centimeters and 12 centimeters.

[0048] In the present disclosure, the input module can be an electronic component for inputting control instructions. The input module can include (or be) keys, a touchpad, or a touch screen. A key can be a switch (or called a circuit breaker). A key can be used to control one or more functions of a device or program. Keys can include push buttons, direction keys, volume keys, triggers, joysticks, piano keys, keys on a keyboard, keys on a mouse, and vibration simulation keys. A push button can be a mechanical push button or a vibration simulation push button. The mechanical push button can be pressed. The mechanical push button can automatically bounce back after being pressed. The vibration simulation push button can provide vibration feedback when the user presses it to simulate the experience of pressing a mechanical push button. A key can protrude, recess, or be flush with the plane or curved surface around the key. The terms "key" and "button" have the same meaning and can be used interchangeably. The terms "push button" and "button" have the same meaning and can be used interchangeably.

[0049] In the present disclosure, the included angle is a line-plane angle. The line-plane angle between a plane and a first straight line can refer to the included angle formed between the second straight line projected by the first straight line on the plane and the first straight line. The range of the line-plane angle can be greater than 0 degrees and less than or equal to 90 degrees.

[0050] In some embodiments, the grip portion 160 may include one or more haptic modules. The one or more haptic modules may be one or more tactile sensors. The one or more haptic modules may cover the surface of the grip portion. The one or more haptic modules are configured to sense / recognize the posture of the user's hand holding the controller device. For example, the one or more haptic modules may sense / recognize that the user's grip posture corresponds to a first grip, a second grip, a third grip, or other natural grip. The one or more haptic modules may include a first haptic module corresponding to the thumb. The one or more haptic modules may include a second haptic module corresponding to the index finger. The one or more haptic modules may include a third haptic module corresponding to the middle finger. The one or more haptic modules may include a fourth haptic module corresponding to the ring finger. The one or more haptic modules may include a fifth haptic module corresponding to the little finger. The one or more haptic modules may include a sixth haptic module corresponding to the palm (e.g., the center of the hand). The one or more haptic modules may sense / recognize whether one or more fingers are in contact with the grip portion. The one or more haptic modules may sense / recognize whether the palm is in contact with the grip portion. The grip portion 160 may include one or more pressure-sensitive modules. These pressure-sensitive modules may be one or more pressure sensors. The pressure-sensitive modules are configured to sense / identify the force with which a user grips the controller device. This force can be quantified as a pressure value. The controller device can send the identified pressure value to a host device (e.g., after processing by one or more processors and transmitted using one or more communication modules). The pressure-sensitive modules may be located beneath one or more haptic modules. The pressure-sensitive modules may cover the surface of the grip portion and be arranged alternately with one or more haptic modules. The pressure-sensitive modules may be integrated within one or more haptic modules. Through the haptic modules and / or pressure-sensitive modules, the controller device can sense the user's detailed grip state and provide corresponding feedback in the game, thereby enhancing the user's immersive gaming experience.

[0051] In some embodiments, the grip portion 160 may not include any buttons (e.g., physical buttons that can be pressed or ejected). The grip portion 160 may not include any buttons protruding from the surface of the grip portion 160. The grip portion 160 may include one or more (e.g., one or two) buttons recessed into the surface of the grip portion 160. The grip portion 160 may include one or more protrusions. The one or more protrusions may include a first protrusion corresponding to the web of the user's hand. The first protrusion is located between the transition portion and the upper edge of the hand when the user holds the controller device. The one or more protrusions may include a second protrusion corresponding to the space between the index and middle fingers of the hand. Such a configuration allows the user to hold the controller device without discomfort (e.g., it can prevent the user from accidentally pressing buttons while holding the controller device in a game, thus disrupting the gaming experience), which is beneficial to improving the user's immersive experience.

[0052] In some embodiments, one or more input modules 180 may be configured in the portion between the expansion interface 170 and the grip portion 160 (e.g., referred to as the transition portion). One or more input modules 180 may include / or a joystick button configured for directional control. The joystick button may protrude from the surface of the housing. The user can press the joystick button to input a first control command (e.g., a confirm command or a cancel command). One or more input modules 180 may include a button or a set of buttons. A button may protrude or be recessed from the surface of the housing. The set of buttons may be a pair of volume keys, a set of directional keys (e.g., up, down, left, and right keys), or a similar combination of buttons. The user can press the button to input a second control command. The second control command may be different from the first control command. The second control command may be a cancel command, a pause command, a photo capture command, a screen recording command, a main interface call command, or other commands. One or more input modules 180 may include / or a touchpad or touchscreen configured to input multiple commands (e.g., directional control, confirm, or cancel commands). The touchpad may include multiple areas, each area being distinguished by different colors and / or textures. Configuring the input module between the grip and the expansion interface can prevent the user's input actions and grip actions from interfering with each other (for example, preventing the user from accidentally pressing buttons and making incorrect inputs while holding the controller device in the game), thereby enhancing the user's immersive gaming experience.

[0053] In some embodiments, the expansion interface 170 may protrude or recess relative to the surface of the housing. The expansion interface 170 may be flush with the surface of the housing (e.g., the surface of the expansion interface 170 is in the same plane as the surface of the housing). Figure 2The lateral cross-section of the expansion interface 170 shown forms a 90-degree angle with the longitudinal direction. That is, the lateral cross-section of the expansion interface 170 is perpendicular to the longitudinal direction. The lateral cross-section of the expansion interface 170 may not be perpendicular to the longitudinal direction. For example, the lateral cross-section of the expansion interface 170 may form an angle less than 90 degrees and greater than 75 degrees with the longitudinal direction. Configuring the expansion interface position in this way allows the user to quickly and easily install and remove expansion accessories, reducing game interruption time and thus improving the user's immersive gaming experience.

[0054] Figure 3 This is a schematic diagram of the expansion interface of a controller device according to some implementation schemes.

[0055] In some embodiments, the controller device may include a plurality of expansion interfaces. The plurality of expansion interfaces may include a first expansion interface (e.g., Figure 2 and Figure 3 The expansion interface 170 shown is an example of this. These multiple expansion interfaces may include a second expansion interface (e.g., ...). Figure 3 The second expansion interface is shown as expansion interface 175. This second expansion interface is located at the bottom of the controller device (e.g., below the grip portion). This second expansion interface can be the same as the first expansion interface (e.g., as shown in the diagram). Figure 3 (As shown in A). For example, both the second expansion interface and the first expansion interface protrude from or are recessed into the surface. The second expansion interface may differ from the first expansion interface (e.g., as shown in Figure A). Figure 3 (As shown in A). The second expansion interface can be directly or indirectly connected to the first expansion interface. For example, the second expansion interface and the first expansion interface can be either female or male, respectively. A male interface can refer to an interface structure where the interface portion protrudes from the surface. A female interface can refer to an interface structure where the interface portion is recessed into the surface. For example, the first expansion interface and the second expansion interface can each be configured with one female and one male, or one male and one female. The controller device can attach accessories such as pressure-sensitive pen tips through the second expansion interface. The user can use multiple expansion interfaces to attach multiple expansion accessories to form various weapon configurations. The user can also connect multiple controller devices through multiple expansion interfaces to form long-handled weapon configurations. Using multiple different weapon configurations in the game can enhance the user's immersive gaming experience.

[0056] In some embodiments, the expansion interface 170 may include a magnetic attraction. This magnetic attraction may be a permanent magnet attraction, an electromagnetic induction attraction, or a combination of both. For example, the permanent magnet attraction may be used to guide the user to accurately attach the expansion accessory to the expansion interface 170. The permanent magnet attraction may be used to secure the expansion accessory. The expansion interface may also include other securing devices, such as snap-fit ​​mechanisms. The electromagnetic induction attraction may also be used to secure the expansion accessory. The controller device may include a control module for the electromagnetic induction attraction. When the control module senses that no expansion accessory is connected, it reduces or eliminates the current used for electromagnetic induction. When the control module senses that the expansion accessory is connected, it provides the current used for electromagnetic induction. When the control module senses that the expansion accessory is connected and the user moves the controller device, it increases / strengthens the current used for electromagnetic induction to prevent the expansion accessory from falling off. The controller device may include a knob or slider (and a corresponding potentiometer), or a combination of buttons, for the user to manually adjust the magnetic attraction strength. The expansion interface 170 may also include one or more slots, one or more snap-fit ​​mechanisms, threaded connections, rotation locks, one or more locating pins, or one or more springs to prevent or reduce slippage and / or detachment between the expansion interface and the expansion accessory.

[0057] Figure 4 This is a top view of the expansion interface of a controller device according to some implementation schemes.

[0058] In some embodiments (such as) Figure 4 As shown in Figure A, expansion interface 170 may include a data interface and / or a power interface. The data interface can be used to transfer data (e.g., control commands, etc.) between the controller device and the expansion accessory. The controller device can power the expansion accessory via the power interface. The expansion accessory (e.g., the expansion accessory includes a battery) can power the controller device via the power interface. The size of the data interface and / or power interface may be compatible with the size of a USB Type C or USB Type A interface.

[0059] In some embodiments (such as) Figure 4 As shown in Figure B), the expansion interface 170 may include (or be configured with) one or more notches to prevent expansion accessories attached to the expansion interface 170 from sliding. The user can accurately attach the expansion accessory according to the position and / or arrangement of the notches. The notches may be circular, elliptical, polygonal, square, rectangular, trapezoidal, rhomboid, or triangular.

[0060] In some embodiments (such as) Figure 4 As shown in Figure C, from a top view, the expansion interface 170 can be circular, elliptical, polygonal (e.g., octagonal, hexagonal, or pentagonal), regular polygonal, square, rectangular, trapezoidal, rhomboid, or triangular.

[0061] In some implementations, an expansion accessory can refer to an accessory that connects to the controller device via an expansion interface. Different expansion accessories can be used to adapt to different (e.g., different types) augmented reality games. Different expansion accessories can have different appearances, different sizes, different weights, and / or different materials. For example, the expansion accessory can include racket-type expansion accessories (e.g., golf club type, croquet club type, hockey stick type, ice hockey stick type, polo stick type, baseball bat type, softball bat type, or cricket bat type accessories), one-handed melee weapon type expansion accessories (e.g., knife type, dagger type, saber type, sword type, axe type, hammer type, mace type, hook type, or flail type, etc.), two-handed melee weapon type expansion accessories (e.g., two-handed greatsword type, long-handled axe type, spear type, club type, halberd type, spear type, etc.), one-handed gun type expansion accessories (e.g. Accessories may include, but are not limited to, crossbow-type, pistol-type, submachine gun-type, etc.; two-handed gun-type extension accessories (e.g., assault rifles, shotguns, sniper rifles, etc.); covers (e.g., for protecting the extension interface); external housings (e.g., for forming a two-handed gamepad with the controller device); weights (e.g., weight accessories for fitness or sports); soft straps (e.g., for securing the controller device to the user's hands); external batteries (e.g., power banks); or one or more buttons (e.g., buttons, directional keys, triggers, joysticks, etc.). The accessory may (e.g., in the game) have information such as level, function, or attributes (e.g., associated with this information). The accessory may include or be marked with a QR code, barcode, etc. The host device or the controller device may (e.g., by the appearance of the accessory or the markings) identify the accessory's level, function, or attributes. The accessory may include one or more buttons for the user to switch weapons or items in the game.

[0062] Figure 5 This is a schematic diagram of an extended accessory based on some implementation schemes.

[0063] In some implementation schemes (such as) Figure 5 As shown), the mass distribution (e.g., center of gravity) of the expansion accessory is adjustable. The expansion accessory (e.g., expansion accessory 190) may include one or more weight modules (e.g., weight module 192, weight module 194, and weight module 196). Expansion accessory 190 includes one or more interface portions (e.g., interface 199). Expansion accessory 190 can be attached to an expansion interface of the controller device (e.g., ...) via interface 199. Figure 2 or Figure 3The expansion interface 170 is used in the expansion accessory. By adjusting the position of one or more weight modules in the expansion accessory, the mass distribution of the expansion accessory can be adjusted to adapt to different weapons or items in the game. For example, the user can manually adjust one or more of weight modules 192, 194, and 196. For example, the expansion accessory and / or the controller device may include hardware and / or software for adjusting the expansion accessory. The expansion accessory and / or the controller device can automatically adjust one or more of weight modules 192, 194, and 196 according to the weapon or item used in the game. By adjusting weight modules 192, 194, and 196, the mass distribution of the expansion accessory 190 can be adjusted to be evenly distributed on the expansion accessory 190 (e.g., ...). Figure 5 As shown in Figure A), the mass distribution of the extension accessory 190 can be adjusted so that it is (more) distributed on the upper part of the extension accessory 190 (as shown in Figure A). Figure 5 (As shown in B), or the mass distribution of the extension accessory 190 can be adjusted so that it is (more) distributed in the lower part of the extension accessory 190 (as shown in B). Figure 5 (as shown in C).

[0064] For purposes of explanation, the foregoing description has been given by reference to specific embodiments. However, the illustrative discussion above is not intended to be exhaustive or to limit this disclosure to the precise form disclosed. Many modifications and variations are possible in accordance with the foregoing teachings. The embodiments were chosen and described in order to best elucidate the principles of this disclosure and its practical application, thereby enabling others skilled in the art to best utilize this disclosure with various modifications suitable for the particular intended use, as well as the various described embodiments.

Claims

1. A controller device for extended reality, comprising: One or more communication modules; One or more vibration feedback modules; A grip portion configured for a user to hold with one hand, wherein the grip portion extends in the longitudinal direction; as well as One or more expansion interfaces configured for detachably attaching expansion accessories, wherein: The first of the one or more expansion interfaces is located at the top of the controller device in the longitudinal direction; The angle between the transverse cross section of the first expansion interface and the longitudinal direction is greater than or equal to 45 degrees and less than or equal to 90 degrees; The radius of the inscribed circle of the first expansion interface in the transverse section is greater than 2 mm and less than 2 cm; as well as The first expansion interface includes a magnetic engagement, a snap-fit ​​mechanism, a threaded connection, or a rotation lock for securely attaching the expansion accessory.

2. The controller device according to claim 1, comprising a housing, wherein: The housing includes the grip portion and the one or more expansion interfaces; The housing includes a transition portion between the grip portion and the one or more expansion interfaces; and The one or more communication modules and the one or more vibration feedback modules are located inside the housing.

3. The controller device according to claim 1, wherein the gripping portion: Includes a tactile or pressure-sensitive module covering part or all of the grip portion; or Keys that protrude from the surface of the grip portion are excluded.

4. The controller device according to claim 1, wherein one of the one or more expansion interfaces is: It can be a circle, an oval, a polygon, a square, a rectangle, a trapezoid, a rhombus, or a triangle; or It includes one or more notches, the shape of which is circular, elliptical, polygonal, square, rectangular, trapezoidal, rhomboid, or triangular.

5. The controller device according to claim 1, wherein one of the one or more expansion interfaces comprises: A data interface; One power connector; or An interface that serves as both a data interface and a power interface.

6. The controller device according to claim 1, wherein the magnetic engagement comprises: Permanent magnet magnetic attraction; Electromagnetic induction magnetic attraction; A combination of permanent magnet magnetic attraction and electromagnetic induction magnetic attraction; or A combination of permanent magnet magnetic attraction or electromagnetic induction magnetic attraction with slots, snap-fit ​​mechanisms, threaded connections, rotary locks, locating pins, or springs.

7. The controller device of claim 1, wherein the one or more expansion interfaces include a second expansion interface, wherein: The second expansion interface is located at the bottom of the controller device; The appearance of the second expansion interface is different from that of the first expansion interface; as well as Through the second expansion interface, the controller device can connect to the first expansion interface of another controller device.

8. The controller device of claim 1, comprising one or more input modules located between the first expansion interface and the grip portion, wherein one of the one or more input modules comprises: One joystick button; A set of buttons; A touchpad; or A touch screen.

9. The controller device of claim 1, wherein the accessory attached to the controller device via the one or more expansion interfaces includes: Racket-shaped extension accessories; One-handed melee weapon extension accessory; Dual-wielding melee weapon extension accessories; One-handed gun-wielding extension accessories; Dual-hand gun-type expansion accessory; cover; External housing; Counterweight; Soft band; External battery; or One or a group of buttons.

10. The controller device of claim 9, wherein the accessory attached to the controller device via the one or more expansion interfaces comprises: One or more buttons used to switch weapons or items in the game; Identifiers used to identify the grade, function, or attribute of the accessory; or One or more weight modules for adjusting the mass distribution of the accessory.

Images