Handheld video game controller

Abstract

A hand-held controller (101) includes a body (102) supporting an input element layout (103) for detecting user input, and a set of mechanically connected body components (301-309) transformable between a plurality of different configurations (401, 1101, 1201, 1401). The body components (301-309) include a base component (301), a plurality of primary connecting components (302-305) each directly connected to the base component (301), and a plurality of secondary connecting components (306-309) each indirectly connected to the base component (301) through at least one primary connecting component (302-305). The hand-held controller (101) is preferably transformable between at least a game controller configuration (401), a steering wheel configuration (1401), and at least one weapon configuration (1101, 1201). A method of assembling a hand-held controller (101) is provided.

Description

Technical Field

[0001] This application relates to a handheld controller, and more particularly to a handheld game controller that can switch between different configurations. Background Technology

[0002] As is well known, various handheld controllers allow users to control the functions of electronic devices by manually operating the input elements of the handheld controller. For example, remote control devices can wirelessly control home audio-visual equipment (e.g., televisions, optical media players, radios, and media streaming players), and game controllers allow users to control the performance of games (e.g., games on PCs or game consoles).

[0003] The common form factor and general architecture of handheld game controllers have long focused on a monolithic design, typically characterized by a central stop area between the gripping areas. A type of game controller, often called a "universal" or "one-size-fits-all" controller, offers a fixed layout of input elements (e.g., buttons and joysticks) that can be mapped to the menu navigation and gameplay actions of a specific gaming platform. This type of controller is immutable; the same fixed input element layout is used regardless of the type of game the player plays, which can negatively impact the user experience.

[0004] Another type of game controller can be called a "dedicated" or "custom" game controller, which attempts to provide a better user experience for players with a more targeted and realistic design. Therefore, it may resemble a steering wheel, pedals, an aircraft joystick, a specific type of weapon, or a specific sports equipment. However, this type of game controller lacks versatility, which may result in players having different game controllers that can only be used selectively and are difficult to switch between during gameplay.

[0005] It is desired that users of handheld game controllers can switch their configurations to suit specific game genres. It is also desired that users can change the configuration of their handheld game controllers during gameplay to match specific scenes or actions within the game. For example, during gameplay, a character could transition from driving a vehicle to engaging in combat. Furthermore, it is desired that handheld game controllers integrate one or more functions that can provide audio and / or visual and / or haptic effects, and can connect to at least one other peripheral device, such as a camera or motion sensor, to enhance the immersive experience. Summary of the Invention

[0006] According to a first aspect, a handheld controller is provided. The handheld controller includes a body supporting an input element layout for detecting user input. The body includes a set of mechanically connected body components that can be switched between various configurations. Each body component includes a base component, a plurality of primary connection components, and a plurality of secondary connection components. Each primary connection component is movably fixed to the base component via a connection between the primary connection component and the base component to guide movement of the primary connection component relative to the base component. Each primary connection component is directly connected to the base component. Each secondary connection component is movably fixed to the primary connection component or the other secondary connection component via a connection between the secondary connection component and a primary connection component or another secondary connection component to guide movement of the secondary connection component relative to the primary connection component or the other secondary connection component. Each secondary connection component is indirectly connected to the base component via at least one primary connection component.

[0007] The handheld controller can switch between at least 3, 4, 5, 6, 7, 8, 9, or 10 different configurations. Therefore, the ability to switch between a large number of different configurations for the aforementioned set of mechanically connected main components contributes to an improved user experience.

[0008] In one example, the various configurations include at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration.

[0009] The at least one weapon configuration may include one or more of a knife-shaped or rod-shaped configuration and a gun-shaped configuration.

[0010] The "knife-shaped" configuration can represent any other similar implement with a blade, such as a broadsword, sword, or similar implement. The "stick-shaped" configuration can represent any other similar item with a long, thin shape, such as a club or similar item. The "gun-shaped" configuration can resemble any type of firearm, such as a shotgun, submachine gun, sniper rifle, assault rifle, pistol, or similar firearm.

[0011] In one example, the main components of the set of mechanical connections include a primary connection component that is slidable relative to the base component along a single axis.

[0012] In one example, the main body assembly of the set of mechanical connections includes two or more primary connection components, each of which is rotatable relative to the base assembly about a single axis. The handheld controller may include two or more primary connection components, each of which is rotatable relative to the base assembly about a common axis.

[0013] Using a single-axis coupling has several advantages, including but not limited to: reducing the degrees of freedom of movement between the connected main components, which helps maintain reliable electrical pass-through signal transmission; enabling self-guided movement of one main component relative to other main components, which facilitates quick, easy and reliable conversion between different configurations; and enabling low-cost manufacturing.

[0014] In one example, the main components of the set of mechanical connections include at least one secondary connection component, the secondary connection component being (i) movably fixed to the primary connection component via a connection between the secondary connection component and the primary connection component to guide movement of the secondary connection component relative to the primary connection component, and (ii) movably fixed to the other secondary connection components via a connection between the secondary connection component and other secondary connection components to guide movement between the secondary connection component and the other secondary connection components.

[0015] In one example, the base component has a first end and a second end, and the set of mechanically connected body components includes a first subset of body components extending from the first end of the base component and a second subset of body components extending from the second end of the base component. The first subset of body components may include multiple primary connecting components, and the second subset of body components may include one primary connecting component and multiple secondary connecting components. The set of mechanically connected body components can form a configuration in which the body has an upper stop portion and a left handle and a right handle.

[0016] The main body may include a power actuator layout that can selectively operate to activate automatic switching between different configurations of the set of mechanically connected main body components. In one example, the switching between configurations can be achieved manually or automatically via the power actuator layout.

[0017] The input element layout of the handheld controller may include multiple buttons.

[0018] The main body can support at least one camera. The main body can support an omnidirectional camera. The main body can support at least one speaker. The main body can support a microphone. The main body can support at least one motion sensor. The main body can support a haptic actuator.

[0019] In one example, the body includes a configuration sensing layout for sensing the relative layout of the body components, thereby determining the current configuration of the set of mechanically connected body components.

[0020] The main body may include an orientation sensing layout, which is used to determine the current orientation of the main body components of the set of mechanical connections.

[0021] In one example, the main body includes a wireless communication device for enabling wireless communication between the handheld controller and at least one host device that supports wireless communication. For example, the host device supporting wireless communication could be a game console, smart TV, AR / VR headset, smartphone, or similar device.

[0022] In one example, the main body includes a binaural renderer for providing audio output for headphones to reproduce, the binaural renderer functioning to render sound with reference to the calculated relative position of the handheld controller and the user's head.

[0023] The handheld controller can be used for low-latency communication with a wireless headset that is connected to the communication network.

[0024] In one example, the handheld controller includes a pair of true wireless stereo earbuds, and the body defines a receiving area for releasably accommodating the pair of true wireless earbuds. The earbuds can be detachably secured via a snap-fit ​​arrangement in the receiving area.

[0025] The main body may include a charging layout for charging the earphones when they are placed in the receiving area.

[0026] In one example, the main body includes a mobile device docking station for releasably and physically attaching a mobile device to and communicatively connecting it to the handheld controller.

[0027] Integrated connectivity and audiovisual functions can be used in various ways to enhance the user experience.

[0028] According to a second aspect, a method for assembling a handheld controller is provided. The handheld controller includes a body supporting an input element layout for detecting user input. The method includes assembling the body by connecting a plurality of body components to form a set of mechanically connected body components that can be switched between multiple different configurations, such that: first plurality of body components are respectively directly connected to a base component among the plurality of body components, each of the first plurality of body components being movably fixed to the base component via a connection between the body component and the base component to guide movement of the body component relative to the base component; second plurality of body components are indirectly connected to the base component via at least one of the first plurality of body components, each of the second plurality of body components being movably fixed to the body component among the first plurality of body components or the other body component among the second plurality of body components via a connection between the body component and a body component among the first plurality of body components or the other body component among the second plurality of body components to guide movement of the body component among the second plurality of body components relative to the first plurality of body components or the body component among the second plurality of body components.

[0029] The various configurations may include at least 3, 4, 5, 6, 7, 8, 9, or 10 different configurations. These configurations may include at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration. The at least one weapon configuration may include at least one of a knife-type or stick-type configuration and a gun-type configuration.

[0030] Other specific and preferred aspects of the invention are described below. Attached Figure Description

[0031] The invention will now be described in more detail with reference to the accompanying drawings, in which:

[0032] Figure 1 A front perspective view of the handheld controller is shown;

[0033] Figure 2 A rear perspective view of the handheld controller is shown;

[0034] Figure 3 An exploded view of the handheld controller is shown;

[0035] Figure 4 The handheld controller in game controller configuration is shown;

[0036] Figures 5 to 13 The handheld controllers are shown in different weapon configurations;

[0037] Figure 14 The handheld controller is shown in a steering wheel configuration;

[0038] Figures 15 to 23 The different transitions of the handheld controller from one configuration to other configurations are illustrated;

[0039] Figure 24 This demonstrates the convertibility of the handheld controller during gameplay, allowing for switching between different configurations to suit various game scenarios;

[0040] Figure 25 A first handheld controller in one configuration and a second handheld controller in other configurations are shown;

[0041] Figure 26 The optional actuation functions of the handheld controller are shown;

[0042] Figure 27 The architecture of the handheld controller is shown;

[0043] Figure 28 and Figure 29 The device connectivity features of the handheld controller are shown;

[0044] Figures 30 to 32 The audio output function of the handheld controller is shown;

[0045] Figure 33 Other functions of the handheld controller are shown;

[0046] Figure 34 The camera functionality of the handheld controller is shown;

[0047] Figure 35 The audio processing capabilities of the handheld controller are demonstrated;

[0048] Figure 36 The earphone storage function of the handheld controller is shown. Detailed Implementation

[0049] The examples are described in sufficient detail below with reference to the accompanying drawings to enable those skilled in the art to implement the apparatus, systems, and / or processes described herein. However, it should be understood that the invention is not limited to the precise examples described and / or shown, and that various changes and modifications can be made by those skilled in the art without departing from the scope of the invention as defined by the appended claims.

[0050] In the following description, all directional terms (e.g., up, down, radial, and axial) are used in relation to the drawings and should not be construed as limiting the scope of the invention as defined by the appended claims unless the context clearly indicates otherwise.

[0051] The accompanying drawings are not necessarily drawn to scale, and in some cases may be exaggerated or simplified for reference only.

[0052] Unless otherwise defined, all terms used herein (including technical and scientific terms) shall be interpreted in accordance with the conventions of the art. Furthermore, unless the context clearly indicates otherwise, a feature referred to herein in the singular may be one or more features. Similarly, the terms “comprising” and / or “having” as used herein mean the presence of the one or more features and do not exclude the presence or addition of one or more other features unless the context clearly indicates otherwise.

[0053] This document discloses the following: A handheld controller includes a body supporting an input element layout for detecting user input. The body includes a set of mechanically connected body components, which are convertible between multiple different configurations (preferably at least three different configurations), preferably between at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration. The body components include a base component, multiple primary connection components, and multiple secondary connection components. Each primary connection component is movably fixed to the base component via a connection between the primary connection component and the base component to guide movement of the primary connection component relative to the base component; each primary connection component is directly connected to the base component. Each secondary connection component is movably fixed to the primary connection component or the other secondary connection component via a connection between the secondary connection component and a primary connection component or other secondary connection components to guide movement of the secondary connection component relative to the primary connection component or the other secondary connection component; each secondary connection component is indirectly connected to the base component via at least one primary connection component.

[0054] This document also discloses the following: a method for assembling a handheld controller comprising a body including a layout supporting input elements for detecting user input. The method includes assembling the body by connecting a plurality of body components to form a set of mechanically connected body components that can be switched between multiple different configurations. The assembly of the body components is such that: first plurality of body components are each directly connected to a base component among the plurality of body components, each of the first plurality of body components being movably fixed to the base component via a connection between the body component and the base component to guide movement of the body component relative to the base component; second plurality of body components are indirectly connected to the base component via at least one of the first plurality of body components, each of the second plurality of body components being movably fixed to the body component among the first plurality of body components or the other body component among the second plurality of body components via a connection between the body component and a body component among the first plurality of body components or the other body component among the second plurality of body components to guide movement of the body component among the second plurality of body components relative to the first plurality of body components or the body component among the second plurality of body components.

[0055] The following figures provide further details.

[0056] Figure 1 and Figure 2 A specific example of a provided handheld controller 101 is shown, which has a front 100 and a back 200. Figure 1 A perspective view of the front 100 is shown. Figure 2 A perspective view of the rear 200 is shown. The handheld controller also has a first side 110, a second side 120, a top 130, and a bottom 140. As detailed below, the handheld controller 101 is designed to switch between a variety of different configurations. The handheld controller 101 provided in this specific example is designed for gaming, but can also be used for non-gaming applications.

[0057] The handheld controller 101 includes a body as shown in 102, which supports an input element layout as shown in 103 for detecting user input. The input element layout 103 may include any suitable one or more types of input elements, such as buttons, joysticks, dials, trackballs, toggle switches, touchpads, squeeze switches, and microphones. In this illustrated example, the input element layout 103 includes multiple buttons, such as button 104.

[0058] Figure 3An exploded view of body 102 is shown. Body 102 includes a set of mechanically connected body components that can be switched between various configurations. Further detailed below, the body components include a base component, a plurality of primary connecting components, and a plurality of secondary connecting components. Each primary connecting component is movably fixed to the base component via a connection between the primary connecting component and the base component to guide movement of the primary connecting component relative to the base component; each primary connecting component is directly connected to the base component. Each secondary connecting component is movably fixed to the primary connecting component or other secondary connecting components via a connection between the secondary connecting component and a primary connecting component or other secondary connecting components to guide movement of the secondary connecting component relative to the primary connecting component or other secondary connecting components; each secondary connecting component is indirectly connected to the base component via at least one primary connecting component.

[0059] In this specific example, the main component includes a base component 301, a plurality of primary connection components including first, second, third and fourth primary connection components 302 to 305, and a plurality of secondary connection components including first, second, third and fourth primary connection components 306 to 309.

[0060] In one example, the first-level connecting component can slide relative to the base component.

[0061] In this specific example, the first-level connection component 302 is slidably connected to the base component 301. As indicated by arrow 310, the first-level connection component 302 can slide relative to the base component 301 along a single axis (in two directions).

[0062] In one example, each of at least two primary connecting components can rotate about a single axis relative to the base component.

[0063] In this specific example, the second primary connection component 303 is rotatably connected to the base component 301 and is rotatable relative to the base component 301 about the first rotation axis 311.

[0064] In one example, the main component includes two or more primary connecting components that are rotatable relative to the base component about a common axis.

[0065] In this specific example, the third primary connecting component 304 and the fourth primary connecting component 305 are rotatably connected to the base component 301 and can rotate relative to the base component 301 about the second rotation axis 312; the third primary connecting component 304 and the fourth primary connecting component 305 are arranged on opposite sides of the base component 301 (the third primary connecting component 304 faces the front 100 of the body 102, and the fourth primary connecting component 305 faces the back 200).

[0066] In one example, the main component includes at least one secondary connecting component that is movably fixed to the primary connecting component via a connection between the secondary connecting component and the primary connecting component to guide movement of the secondary connecting component relative to the primary connecting component. The secondary connecting component is also movably fixed to other secondary connecting components via connections between the secondary connecting component and other secondary connecting components to guide movement between the secondary connecting component and other secondary connecting components.

[0067] In this specific example, the first secondary connection component 306 is rotatably connected to the second primary connection component 303 to rotate about the third rotation axis 313, the third secondary connection component 307 is rotatably connected to the first secondary connection component 306 to rotate about the third rotation axis 314, the third secondary connection component 308 is rotatably connected to the second secondary connection component 307 to rotate about the fourth rotation axis 315, and the fourth secondary connection component 309 is rotatably connected to the third secondary connection component 308 to rotate about the fourth rotation axis 316.

[0068] Therefore, as shown in the figure, the first secondary connection component 306 is mechanically connected to the first-level connection component (second-level connection component 303) and the second-level connection component (second-level connection component 307), the second-level connection component 307 and the third-level connection component 308 are mechanically connected to two secondary connection components (first-level connection component 306 and third-level connection component 308, and second-level connection component 307 and fourth-level connection component 309), and the fourth-level connection component 309 is mechanically connected to another secondary connection component (third-level connection component 308).

[0069] In the primary connecting components 303 to 305, which are rotatable relative to the base component 301, the third primary connecting component 304 has a free end 316, and the fourth primary connecting component 305 has a free end 317. In the second connecting components 306 to 309, the fourth secondary connecting component 309 has a free end 318.

[0070] Figure 3 The XYZ coordinates are shown. The depth of the body 102 (between the front 100 and the back 200) is indicated in the Z direction, the width of the body 102 (between the first side 110 and the second side 120) is indicated in the X direction, and the height of the body 102 (between the top 130 and the bottom 140) is indicated in the Y direction.

[0071] As shown in the figure, among the rotation axes 311 to 316, axes 311, 312, 314 and 316 extend in the Z direction, axis 313 extends in the X direction, and axis 315 extends in the Y direction.

[0072] In one example, the main components of the aforementioned set of mechanical connections include a first subset of main components extending from a first end of the base component and a second subset of main components extending from a second end of the base component.

[0073] In one example, the first subset of main components includes multiple first-level connection components, and the second subset of main components includes one first-level connection component and multiple second-level connection components.

[0074] In this specific example, the aforementioned set of mechanically connected main components 301 to 309 includes a first subset of main components extending from the first end 320 of the base component 301 (generally as shown in 319) and a second subset of main components extending from the second opposite end 322 of the base component 301 (generally as shown in 320). The first subset of main components 319 includes a fourth primary connecting component 304 and a fifth primary connecting component 305, and the second subset of main components 321 includes a second primary connecting component 303 and first to fourth secondary connecting components 306 to 309.

[0075] As shown in the figure, the main body components 301 to 309 of the above-mentioned set of mechanical connections can form a configuration in which the main body 102 has an upper stop portion 323 and a left handle 324 and a right handle 325.

[0076] In one example, the main component can switch between at least 3 different configurations. In other examples, the main component can switch between at least 4, 5, 6, 7, 8, 9, or 10 different configurations.

[0077] In a preferred example, the main component can switch between several different configurations, including at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration. The at least one weapon configuration can include one or more of a knife-shaped or club-shaped configuration and a gun-shaped configuration. The term "knife-shaped" as used herein is intended to cover other items with blades, such as broadswords, swords, and similar items. The term "club-shaped" as used herein is also intended to cover other items with elongated shapes, such as sticks and similar items. The term "gun-shaped" as used herein is intended to cover many types of firearms, such as shotguns, submachine guns, sniper rifles, assault rifles, pistols, and similar firearms.

[0078] Based on this specific example, the main components of the handheld controller 101 can be switched between 10 different configurations.

[0079] like Figure 4 As shown, the main body 102 is positioned within a game controller configuration 401 (which may be referred to as a "standard game controller configuration" layout, but it should be understood that the handheld controller 101 is intended for non-gaming applications); as Figure 5As shown, the main body 102 is positioned under the first weapon configuration 501 (which can be referred to as a "shotgun type" layout), which is configured as a gun; as Figure 6 As shown, the main body 102 is positioned under the second weapon configuration 601 (which can be referred to as a "mini submachine gun" layout), which is configured as a gun; as Figure 7 As shown, the main body 102 is positioned under the third weapon configuration 701 (which can be referred to as a "submachine gun type" layout), which is configured as a gun; as Figure 8 As shown, the main body 102 is positioned under the fourth weapon configuration 801 (which can be referred to as a "long assault rifle type" layout), which is configured as a gun; as Figure 9 As shown, the main body 102 is positioned under the fifth weapon configuration 901 (which can be referred to as a "long assault rifle type" layout), which is configured as a gun; as Figure 10 In the middle, the main body 102 is located under the sixth weapon configuration 1001 (which can be called a "short assault rifle type" layout), which is configured as a gun; such as Figure 11 As shown, the main body 102 is positioned under the seventh weapon configuration 1101 (which can be referred to as a "pistol-type" layout), which is configured as a gun; as Figure 12 As shown, the main body 102 is positioned under the eighth weapon configuration 1201 (which can be referred to as a "short rod" layout) in a rod-shaped configuration; as Figure 13 As shown, the main body 102 is positioned under the ninth weapon configuration 1301 (which can be referred to as a "long sword type" layout), which is configured as a sword; as Figure 14 As shown, the main body 102 is located under the steering wheel configuration 1401.

[0080] Figure 15 The main body 102 is shown from Figure 4 The game controller configuration 401 shown is converted to Figure 14 The steering wheel configuration shown is 1401.

[0081] As shown in A and B, when the main body 102 is in the game controller configuration 401, the first, second, third, and fourth secondary connecting components 306 to 309 rotate together around the rotation axis 313 until they reach the unfolded position shown in C. As shown in B and C, the third secondary connecting component 308 and the fourth secondary connecting component 309 rotate together around the rotation axis 315 until they reach the unfolded position shown in E. As shown in E, the third primary connecting component 304 rotates around the rotation axis 312 until it reaches the position shown in F, where the free end 318 of the fourth secondary connecting component 309 connects to the free end 317 of the fourth primary connecting component 305, completing the conversion to the steering wheel configuration 1401.

[0082] Figure 16 The main body 102 is shown from Figure 4 The game controller configuration 401 shown is converted to Figure 13 The long-blade configuration 1301 is shown.

[0083] As shown in A, when the main body 102 is in the game controller configuration 401, the fourth primary connecting component 305 rotates around the rotation axis 312, and the first, second, third, and fourth secondary connecting components 306 to 309 rotate together around the rotation axis 311 until they reach the layout shown in B. In this layout, the third primary connecting component 304 rotates around the rotation axis 312 until it reaches the position shown in C, completing the transformation to the long blade configuration 1301. It should be understood that the third primary connecting component 304 rotates around the axis 312 in the opposite direction to the rotation direction of the fourth primary connecting component 305; the free end 318 of the fourth primary connecting component 305 moves towards the base element 301, and the free end 317 of the third primary connecting component 304 moves away from the base element 301.

[0084] Figure 17 The main body 102 is shown from Figure 4 The game controller configuration 401 shown is converted to Figure 11 The pistol-type configuration 1101 is shown. As shown in A, when the main body 102 is in the game controller configuration 401, the third primary connection component 304 and the fourth primary connection component 305 rotate in the same direction about the rotation axis 312 to move their free ends 317, 318 toward the base element 301 until they reach the position shown in B, completing the conversion to the pistol-type configuration 1101.

[0085] Figure 18 The main body 102 is shown from Figure 4 The game controller configuration 401 shown is converted to Figure 6 The mini submachine gun configuration 601 is shown. As shown in A, the main body 102 initially transforms from the game controller configuration 401 to the pistol configuration 1101 shown in B. As shown in B, when the main body 102 is in the pistol configuration 1101, the first primary connecting component 302 moves to the extended position shown in C, completing the transformation to the mini submachine gun configuration 601.

[0086] Figure 19 The main body 102 is shown from Figure 4 The game controller configuration 401 shown is converted to Figure 12 The short rod configuration 1201 is shown. As shown in A, the main body 102 initially transforms from the game controller configuration 401 to the pistol configuration 1101 shown in B. As shown in B, when the main body 102 is in the pistol configuration 1101, the first, second, third, and fourth secondary connecting components 306 to 309 rotate together about the rotation axis 313 until they reach the extended position shown in C, completing the transformation to the short rod configuration 1201.

[0087] Figure 20 The main body 102 is shown from Figure 4 The game controller configuration 401 shown is converted to Figure 10 The short assault rifle configuration 1001 is shown. As shown in A, when the main body 102 is in the game controller configuration 401, the third primary connecting component 304 rotates about the rotation axis 312 to move its free end 317 away from the base element 301 until it reaches the position shown in B, completing the conversion to the short assault rifle configuration 1001.

[0088] Figure 21 The main body 102 is shown from Figure 4 The game controller configuration 401 shown is converted to Figure 5 The sniper rifle configuration 501 is shown. As shown in A, when the main body 102 is in the game controller configuration 401, the third primary connecting component 304 rotates about the rotation axis 312 to move its free end 317 toward the base element 301, and the fourth primary connecting component 305 rotates about the rotation axis 312 to move its free end 318 away from the base element 301, until the layout shown in B is reached. As shown in B, the first primary connecting component 302 moves to the extended position shown in C, completing the conversion to the sniper rifle configuration 501.

[0089] Figure 22 The main body 102 is shown from Figure 4 The game controller configuration 401 shown is converted to Figure 7 The submachine gun-type layout 701 is shown. As shown in A, when the main body 102 is in the game controller configuration 401, the third primary connecting component 304 rotates about the rotation axis 312 to move its free end 317 away from the base element 301, and the fourth primary connecting component 305 rotates about the rotation axis 312 to move its free end 318 towards the base element 301, until the layout shown in B is reached. As shown in B, the first primary connecting component 302 moves to the extended position shown in C, completing the conversion to the submachine gun-type layout 701.

[0090] Figure 23 The main body 102 is shown from Figure 4 The game controller configuration 401 shown is converted to Figure 8 The long assault rifle type layout 801 is shown. As shown in A, when the main body 102 is in the game controller configuration 401, the fourth primary connecting component 305 rotates about the rotation axis 312 to move its free end 318 away from the base element 301 until it reaches the layout shown in B. As shown in B, the first primary connecting component 302 moves to the extended position shown in C, completing the conversion to the long assault rifle type layout 801.

[0091] The handheld controller 101 can easily switch between different configurations during gameplay, allowing users to achieve such transitions quickly and reliably.

[0092] For example, such as Figure 24 As shown, the main body 102 of the handheld controller 101 can be in the steering wheel configuration 1401 in the driving scene, then switch to the gun configuration 801 in the shooting scene 2402, then switch to the gun configuration 101 in the subsequent shooting scene 2403, then switch to the standard game controller configuration 401, and then switch to the bat configuration 1201 in the ball hitting scene 2405.

[0093] like Figure 25 As shown, two players 2501 and 2502 can play the game together, each using their own handheld controllers 101A and 101B. However, one player 2501 uses handheld controller 101A in one configuration, while the other player 2502 uses handheld controller 101B in a different configuration. For example, one player 2501 can control a character driving a vehicle, thus using handheld controller 101A in steering wheel configuration 1401, while the other player 2501 can control a character who is a passenger in the vehicle but is fighting enemies outside, thus using handheld controller 101A in gun configuration 1101. Therefore, handheld controller 101 provides the following benefits in multiplayer mode: multiple players can share the same gameplay and switch characters by using different configurations of handheld controller 101, thereby increasing realism and improving the team gaming experience.

[0094] It should be understood that the aforementioned set of mechanically connected components is assembled using the most suitable (limited / minimum) number of single-axis couplings (axial joints and linear (sliding) connections). In an example of a specific illustration of the body 102 of the handheld controller 101, from... Figure 3 As can be clearly seen, only a single linear (sliding) connection is used. Using a single-axis coupling reduces the degrees of freedom of movement between the connected main components, which helps maintain reliable electrical pass-through signal transmission; it enables self-guided movement of one main component relative to other main components, facilitating quick, easy, and reliable transitions between different configurations without affecting game smoothness; and it also enables low-cost manufacturing. Furthermore, this feature facilitates the electrification of the aforementioned set of mechanically connected main components.

[0095] In one embodiment, such as Figure 26As shown, body 102 includes a power actuator layout, generally as shown in 2601, which is selectively operable to activate automatic switching between different configurations of the aforementioned set of mechanically connected body components. Therefore, the switching of body 102 from at least one configuration to other configurations can be electrically activated. In a preferred embodiment, each available switching between configurations can be achieved via the power actuator layout. In one embodiment, the switching between configurations can be achieved manually or automatically via the power actuator layout.

[0096] The power actuator layout can include any suitable component layout for switching between different configurations. Rotary motors such as DC motor 2602, electromagnetic solenoid actuators, piezoelectric actuators, and shape memory alloy actuators with or without transmission components (e.g., bevel gears 2603, spur gears 2604, worm gears 2605, or internal gears 2606 for rotary connections, and racks and pinions 2607 for linear (sliding) connections) can be used to drive moving system components.

[0097] Any suitable activation layout (generally as shown in 2608) can be used to activate the power actuator layout to enable transition to different configurations of the body 102. The activation layout may include at least one control element of any suitable type, such as a button, dial, or suitable sensor.

[0098] In one embodiment, body 102 includes a configuration sensing layout, generally as shown in 2605, for sensing the relative layout of body components, thereby determining the current configuration of the aforementioned set of mechanically connected body components.

[0099] The convertible handheld controller 101 provides a more immersive user experience for third-person, first-person, or multiplayer games based on action, adventure, and racing genres. Quick gameplay requires rapid switching between modes, which can be completed manually in just a few seconds. Optionally, the connector between the main components can also include small Hall sensors with moving magnets that electrically indicate the position of the moving component to the processing unit; the handheld controller can then send feedback signals to the console game console indicating which UI mode is currently in use.

[0100] Figure 27 The architecture of the handheld controller 101 is shown.

[0101] The figure shows the multimedia module 2701 of the main body 102. The multimedia module 2701 may include any number of components, including but not limited to a camera, speaker, microphone, sensor, and processor, to provide one or more different functions, including but not limited to those specifically described below.

[0102] Understandably, different layouts of the main components can be used in different examples. The number of main components can vary, the way the main components are mechanically connected to form a set of mechanically connected main components can vary, the size of the main components can vary, and the type of the main components can also vary. For example, the main component can be a single component or an adjustable multi-part component. In a specific example, a main component 304 is shown to have a single form, but an alternative main component 304' is also shown to include multiple parts, namely a first part 304A and a second part 304B, which are rotatable together about axis 212, and the second part 304B is rotatable relative to the first part 304A about a different axis 2702.

[0103] A method of assembling a handheld controller, as disclosed herein, including a body supporting an input element layout for detecting user input, comprises: assembling the body by connecting a plurality of body components to form a set of mechanically connected body components that can be switched between a variety of different configurations, such that: a first plurality of body components are respectively directly connected to a base component among the plurality of body components, each of the first plurality of body components being movably fixed to the base component via a connection between the body component and the base component to guide movement of the body component relative to the base component; and a second plurality of body components are indirectly connected to the base component via at least one of the first plurality of body components, each of the second plurality of body components being movably fixed to the body component among the first plurality of body components or the other body component among the second plurality of body components via a connection between the body component and a body component among the first plurality of body components or the other body component among the second plurality of body components to guide movement of the body component among the second plurality of body components relative to the first plurality of body components or the body component among the second plurality of body components.

[0104] In one example, the resulting handheld controller can switch between at least three different configurations, preferably at least between a game controller configuration, a steering wheel configuration, and at least one weapon configuration, which may include one or more of a knife or stick configuration and a gun configuration.

[0105] As described below, the handheld controller 101 can be configured to be used with a variety of different media devices.

[0106] The following is for reference. Figure 28 and Figure 29In one embodiment, as shown, the body 102 includes a mobile device docking station 2801 for releasably and physically attaching a mobile device 2802 to and communicatively connecting it to a handheld controller 101. The mobile device docking station 2801 can be used to physically attach a smartphone to and communicatively connect it to the handheld controller 101. Therefore, the handheld controller can be used as a telephone accessory. In this specific example, the mobile device docking station 2801 is positioned on top 130 of the handheld controller 101 and is designed to support the mobile device 2702, such that switching between different configurations of the handheld controller 101 does not affect the body 102. Figure 28 As shown, the mobile device 2802 is docked with the handheld controller 101, and the main body 102 is in the first configuration (the steering wheel configuration shown); as Figure 29 As shown, the mobile device 2802 is docked with the handheld controller 101, and the main body 102 is in a second different configuration (the weapon (gun) configuration shown).

[0107] In this specific example, the mobile device docking station 2801 is provided by or electrically connected to the multimedia module 2701.

[0108] The following is for reference. Figures 30 to 32 In one embodiment, the body 102 supports at least one speaker. Figure 30 As shown, the main body 102 is positioned in a weapon configuration (i.e., a long assault rifle layout 801) and includes at least one speaker, such as speaker 3001. During gameplay, various audio effects can be output to match in-game actions. For example, when firing, two sounds can be produced: a "bang" sound output by the first speaker 3001 at a position 3002 (facing the firing end of the weapon), and a "cartridge ejection" sound (similar to a metallic "click") output by the second speaker 3003 at different positions 3004 (facing the handle end of the weapon). The different speaker positions outputting specific sounds are selected with reference to the positions where each sound is emitted by a real weapon. Figure 31 As shown, the main body 102 is in another weapon configuration (i.e., pistol-type layout 1101) and supports speakers (not shown) that can be used to output the sound of "casing ejection" from position 3002, the sound of "bang bang" from position 3101, and so on. Figure 32As shown, the main body 102 is in another weapon configuration (i.e., the short rod layout 1201) and supports a speaker layout for outputting a "swoosh" sound when the handheld controller 101 is moved (e.g., in the direction indicated by arrow 3201). It should be understood that any suitable audio effects (SFX) can be provided. The function of the speaker layout is to provide an immersive audio experience to enhance the user experience. One or each speaker in the speaker layout may be provided by or electrically connected to the audiovisual module 2701.

[0109] The following is for reference. Figure 33 In one embodiment, the body 102 of the handheld controller 101 supports at least one microphone, such as microphone 3301. The microphone can be of any suitable type and can be used for any suitable one or more purposes. For example, the microphone can be used to record a user's voice, control menu navigation and / or game actions on a particular gaming platform, control the functions of the handheld controller 101, and / or enable the user to communicate with other people at a remote location.

[0110] In one embodiment, body 102 supports at least one camera, such as camera 3302. The camera can be of any suitable type and can be used for any suitable purpose or purpose. The camera can be an omnidirectional camera. The camera can be an RGB or IR camera.

[0111] In one embodiment, the body 102 supports at least one motion sensor, such as motion sensor 3303. The motion sensor can be of any suitable type and can be used for any suitable purpose or purpose. The motion sensor can be a gyroscope, accelerometer, or inertial measurement unit (IMU). The motion sensor can be used to detect the pointing position of the handheld controller 101 and the movement of the handheld controller 101.

[0112] For example, motion sensors can be used to control menu navigation and / or game actions on a specific gaming platform and / or to control the functions of the handheld controller 101.

[0113] In one embodiment, body 102 supports at least one haptic actuator sensor, such as haptic actuator 3304. The haptic actuator can be of any suitable type and can be used for any suitable purpose or purpose. For example, a haptic actuator can be used to confirm menu selections and / or to provide feedback corresponding to game actions to enhance the user experience.

[0114] In one embodiment, body 102 includes a general orientation sensing layout as shown in 3305, the function of which is to determine the current orientation of the aforementioned set of mechanically connected body components. The orientation sensing layout can be of any suitable type and can be used for any suitable one or more purposes.

[0115] In one embodiment, the main body 102 includes a wireless communication device, typically as shown in 3306, which functions to enable wireless communication between the handheld controller 101 and at least one wireless communication-enabled host (typically shown in 3307). For example, the wireless communication-enabled host 3307 may be a game console, smart TV, AR / VR headset, smartphone, or similar device.

[0116] In one embodiment, body 102 includes a binaural renderer, generally as shown in 3308, which functions to provide audio output for headphone reproduction. In a specific example, the binaural renderer functions to render sound with reference to a calculated relative position of the handheld controller 101 and the user's head.

[0117] Based on this specific example, and referring again to the previous figures, the base component 301 houses the main hardware components, such as a battery, processor, haptic feedback actuator, audio drive circuitry, camera and motion sensors (e.g., gyroscope, accelerometer), and wireless transmitters such as Bluetooth or Wi-Fi. Different electromechanical connections exist between the base component 301 and the left handlebar 324 and right handlebar 325, as well as the first-level connection component 302. The front of the base component 301 supports an input element array 3309.

[0118] The first primary connection assembly 302 surrounds the base assembly 302 and supports the audiovisual module 2701 and the input element array 310 on its front. Audio elements may include stereo microphones and speakers to provide special audio effects for the handheld controller 101. For example, the camera may be an ultra-wide-angle or 360-degree RGB or IR camera capable of monitoring / tracking the surrounding environment to identify factors such as user behavior or spatial elements. The left handlebar 324 and right handlebar 325, hinged to the base assembly 301 and rotatable 180 degrees (along the Y-axis), do not include any active electronics, although in other examples, one or both handlebars may include active electronics. The right handlebar 325 is critical for providing the steering wheel configuration 1401. The second primary connection assembly 303 is axially hinged to the base assembly 301 (along the Y-axis) and also includes an axially hinged connector connected to the first secondary connection assembly 306 (along the X-axis), which depends on another axial connector (along the Y-axis) of the second secondary connection assembly 307. The second-level connecting component 307 is axially connected to the third-level connecting component 308 (along the Z-axis), and the third-level connecting component 308 is also axially connected to the fourth-level connecting component 309 (along the Y-axis).

[0119] The following is for reference. Figure 34 The figure shows the field of view 3401 of a 360-degree camera 3302 supported on the top 130 of the body 102 of the handheld controller 101. As indicated by line 3402, in this example, the function of the camera 3302 is to scan the environment and record 3D data, which can be used for gaming. The camera 3302 can be used to monitor the user's movement and surrounding events, especially when used with mobile media devices (smartphones, VR / AR headsets) and the handheld controller 101. The camera 3302 can provide depth functionality and can scan the real-world spatial environment and convert it into a 3D digital representation (simultaneous localization and mapping, SLAM).

[0120] The following is for reference. Figure 35 and Figure 36 The integrated audio functionality offers numerous benefits. For example... Figure 35 As shown, the integration of the head / earphone with the controller enables binaural rendering within the handheld controller 101.

[0121] In one example, handheld controller 101 receives multi-channel (e.g., 7.1) or object audio as indicated by arrow 3501 from a game console or HMD 3502, calculates (e.g., using an IMU sensor in handheld controller 101) the head orientation of user 3503 and the position of handheld controller 101, and renders virtual sound sources (e.g., gunshots from the direction of handheld controller 101, other sounds from virtual directions in the game environment) at the correct location for output to user's head / headset 3504, as indicated by arrow 3505.

[0122] like Figure 36 As shown, in this specific example, the handheld controller 101 includes earphones 3601, preferably a true wireless stereo earphone pair (TWS earbuds), and the body 102 defines a receiving area, as shown in 3602, for releasably accommodating the earphones 3601. Furthermore, the body 102 includes a charging layout (as shown in 3603) for charging the earphones when they are placed in the receiving area 3602.

[0123] By connecting the earphone 3601 wirelessly to the handheld controller 101 instead of an external host, the binaural function described above can be achieved.

[0124] The handheld controller 101 is best used for low-latency communication with a wireless headset connected to a communication network. The low-latency connection is preferably a proprietary connection.

[0125] Many gamers lack multi-speaker Hi-Fi audio setups, especially in mobile gaming. Therefore, using headphones to reproduce game sound effects directly to the user's ears is an excellent compromise. In fact, headphones are often the only viable audio setup for achieving high-quality 3D audio. Since extended reality (xR) games rely heavily on 3D audio to provide an authentic sound experience, it's best to include wireless headphones as part of your gaming setup.

[0126] In this specific example, when in use, the earphone 3601 can be "popped" out of the handheld controller 101 and placed on the user's ear. When not in use, the earphone 3601 can be "pushed" back into the handheld controller 101 for charging and storage.

[0127] One advantage of using TWS headsets integrated into the game controller is that audio or other data can be transmitted between the handheld controller 101 and the headset 3601 using a proprietary RF codec, resulting in significantly lower latency than allowed by standards such as Bluetooth. This leads to a smoother gaming experience and better immersion. For 3D audio, the headset can be equipped with an inertial measurement unit (IMU) sensor, which helps determine the user's head orientation (potentially by supplementing data from the xR head-mounted display (HMD)).

[0128] For example, the low-latency proprietary connection between the IMU sensor (in the TWS headset 3601 and handheld controller 101), the binaural renderer 3308 (in the handheld controller 101), and the playback (TWS earphone 3601) is particularly advantageous for games that require fast-paced responses, such as first-person shooter games.

[0129] The handheld controller described in this article may have the following characteristics:

[0130] Single-unit architecture, integrated;

[0131] Inexpensive and easy-to-manufacture electromechanical architecture;

[0132] It is highly compatible and portable (similar in size to existing single-chip controllers), and can be used with various media devices (monitors, VR glasses, smartphones);

[0133] Numerous conversion functions (+10 options);

[0134] Fast and reliable conversion between different configurations (achieved through a self-guided architecture, supported by a single-axis joint (without using ball joints);

[0135] The operating mode can be electrically switched using a small actuator, which can also be achieved through a single-axis connector design;

[0136] Realistic transformation modes, with realistic appearances for different UI settings (wheels, rifles, pistols, machine guns, knives);

[0137] This device supports integrated haptic and audio effects.

[0138] Integrated connectivity and audiovisual functions can be used in various ways to enhance the user experience.

Claims

1. A handheld controller, characterized in that, The handheld controller includes: A main body supporting the layout of input elements for detecting user input, wherein the main body includes: A set of mechanically connected main components that can be switched between multiple different configurations, wherein the main components include: Basic components; Multiple primary connection components, wherein each primary connection component is movably fixed to the base component via a connection between the primary connection component and the base component to guide movement of the primary connection component relative to the base component. Each primary connection component is directly connected to the underlying component; Multiple secondary connection components, wherein each secondary connection component is movably fixed to the primary connection component or the other secondary connection component via a connection between the secondary connection component and the primary connection component or other secondary connection components to guide the movement of the secondary connection component relative to the primary connection component or the other secondary connection component, and each secondary connection component is indirectly connected to the base component via at least one primary connection component.

2. The handheld controller according to claim 1, characterized in that, The various configurations include at least 3, 4, 5, 6, 7, 8, 9, or 10 different configurations.

3. The handheld controller according to claim 1 or 2, characterized in that, The various different configurations include at least: Game controller configuration; Steering wheel configuration; At least one weapon configuration.

4. The handheld controller according to claim 3, characterized in that, The at least one weapon configuration includes one or more of the following configurations: Blade-shaped or rod-shaped configuration; Gun configuration.

5. The handheld controller according to any one of claims 1 to 4, characterized in that, The handheld controller includes a primary connection component that is slidable relative to the base component along a single axis.

6. The handheld controller according to any one of claims 1 to 5, characterized in that, The handheld controller includes two or more primary connection components, each of which can rotate about a single axis relative to the base component.

7. The handheld controller according to claim 6, characterized in that, The handheld controller includes two or more primary connection components, which are rotatable relative to the base component about a common axis.

8. The handheld controller according to any one of claims 1 to 7, characterized in that, The handheld controller includes at least one secondary connection component, which is movably fixed to the primary connection component via a connection between the secondary connection component and the primary connection component to guide the movement of the secondary connection component relative to the primary connection component. The secondary connection component is also movably fixed to other secondary connection components via a connection between the secondary connection component and other secondary connection components to guide the movement between the secondary connection component and the other secondary connection components.

9. The handheld controller according to any one of claims 1 to 8, characterized in that, The basic component has a first end and a second end, and the main components of the set of mechanical connections include: A subset of the first main components extending from the first end of the basic component; A subset of the second main components extending from the second end of the basic component.

10. The handheld controller according to claim 9, characterized in that, The first subset of main components includes multiple primary connection components, and the second subset of main components includes one primary connection component and multiple secondary connection components.

11. The handheld controller according to any one of claims 1 to 10, characterized in that, The main body includes a power actuator layout that can be selectively operated to activate automatic switching between different configurations of the set of mechanically connected main body components.

12. The handheld controller according to any one of claims 1 to 11, characterized in that, The main body supports at least one of the following: At least one camera, optionally an omnidirectional camera; At least one speaker; microphone; At least one motion sensor; Tactile actuator.

13. The handheld controller according to any one of claims 1 to 12, characterized in that, The main body includes a configuration sensing layout for sensing the relative layout of the main body components, thereby determining the current configuration of the set of mechanically connected main body components.

14. The handheld controller according to any one of claims 1 to 13, characterized in that, The main body includes an orientation sensing layout, which is used to determine the current orientation of the set of mechanically connected main body components.

15. The handheld controller according to any one of claims 1 to 14, characterized in that, The main body includes a wireless communication device, which is used to enable wireless communication between the handheld controller and at least one host computer that supports wireless communication.

16. The handheld controller according to claim 15, characterized in that, The main body includes a binaural renderer, which provides audio output for headphones to reproduce the sound. The function of the binaural renderer is to render sound with reference to the calculated relative position of the handheld controller and the user's head.

17. The handheld controller according to claim 15 or 16, characterized in that, The handheld controller is used for low-latency communication with a wireless headset that is connected to the communication network.

18. The handheld controller according to any one of claims 1 to 17, characterized in that, The handheld controller includes a pair of true wireless stereo earphones, and the main body defines a receiving area for releasably accommodating the pair of true wireless stereo earphones.

19. The handheld controller according to claim 18, characterized in that, The main body includes a charging layout for charging the earphones when they are placed in the receiving area.

20. The handheld controller according to any one of claims 1 to 19, characterized in that, The main body includes a mobile device docking station for releasably and physically attaching a mobile device to and communicatively connecting it to the handheld controller.

21. The handheld controller according to any one of claims 1 to 20, characterized in that, The input element layout includes multiple buttons.

22. A method for assembling a handheld controller, characterized in that, The handheld controller includes a main body supporting an input element layout for detecting user input, and the method includes: The body is assembled by connecting multiple main components to form a set of mechanically connected main components that can be switched between a variety of different configurations, such that: The first plurality of main components in the main body assembly are respectively directly connected to the base component in the plurality of main components. Each of the first plurality of main components is movably fixed to the base component through the connection between the main component and the base component to guide the movement of the main component relative to the base component. The second plurality of main components in the main body assembly are indirectly connected to the base component through at least one of the first plurality of main components. Each of the second plurality of main components is movably fixed to the main component in the first plurality of main components or the other main component in the second plurality of main components through a connection between the main component and the main component in the first plurality of main components or the other main component in the second plurality of main components, so as to guide the movement of the main component in the second plurality of main components relative to the first plurality of main components or the main component in the second plurality of main components.

23. The method according to claim 22, characterized in that, The various configurations include at least 3, 4, 5, 6, 7, 8, 9, or 10 different configurations.

24. The method according to claim 22 or 23, characterized in that, The various different configurations include at least: Game controller configuration; Steering wheel configuration; At least one weapon configuration.

25. The method according to claim 24, characterized in that, The at least one weapon configuration includes one or more of the following configurations: Blade-shaped or rod-shaped configuration; Gun configuration.

Images