Handheld video game controller

Abstract

A handheld controller (101) comprises a body (102) supporting a layout (103) of input elements for detecting user input and comprising a set of mechanically connected body assemblies (301 to 309) switchable between a plurality of different configurations (401, 1101, 1201, 1401). The main body assemblies (301 to 309) comprise a basic assembly (301), a plurality of primary connecting assemblies (302 to 305) and a plurality of secondary connecting assemblies (306 to 309), the plurality of primary connecting assemblies are directly connected to the basic assembly (301) respectively, and the plurality of secondary connecting assemblies are indirectly connected to the basic assembly (301) through at least one primary connecting assembly (302 to 305) respectively. The handheld controller (101) is preferably switchable at least between a game controller configuration (401), a steering wheel configuration (1401) and at least one weapon configuration (1101, 1201). A method of assembling a handheld controller (101) is provided.

Description

Technical Field

[0001] The present application relates to a handheld controller, and more particularly to a handheld game controller that can be converted between different configurations. Background Art

[0002] As is well known, various handheld controllers enable users to control functions of electronic devices by manually operating input elements of the handheld controllers. For example, remote control devices can wirelessly control home audio-visual devices (e.g., televisions, optical media players, radios, and media streaming players), and game controllers enable users to control the progress of games (e.g., games on a PC or game console).

[0003] The common form factor and general architecture of handheld game controllers has been focused on a monolithic design, which is typically characterized by a center stop area between the grip areas. One type of game controller can be called a "universal" or "universal" game controller, which provides a fixed layout of input elements (e.g., buttons and joysticks) that can be mapped to menu navigation and gameplay actions for a specific gaming platform. This type of game controller is immutable and uses the same fixed layout of input elements regardless of the type of game the player plays, which may affect the user experience.

[0004] Another type of game controller can be called a "dedicated" or "custom" game controller, which attempts to provide players with a better user experience with a more targeted and realistic design, and may therefore resemble a steering wheel, pedals, an aircraft joystick, a specific type of weapon, or a specific piece of sports equipment. However, this type of game controller lacks versatility and may result in players having different game controllers that can only be used selectively and are difficult to switch between during gameplay.

[0005] It is desirable for a user of a handheld game controller to be able to switch its configuration to match a particular type of game. It is also desirable for a user to be able to change the configuration of a handheld game controller during a game to match a particular scene or action taking place in a game. For example, during the course of a game, a character may transition from driving a vehicle to engaging in combat. It is also desirable for a handheld game controller to be able to integrate one or more functions that can provide audio and / or visual and / or tactile effects, and to be able to connect to at least one other peripheral device, such as a camera or motion sensor, to enhance the immersive experience. Summary of the invention

[0006] According to a first aspect, a handheld controller is provided. The handheld controller comprises a body supporting an input element layout for detecting user input, the body comprising a set of mechanically connected body components that can be converted between multiple different configurations, the body components comprising a base component, a plurality of primary connection components and a plurality of secondary connection components, wherein each primary connection component is movably fixed to the base component through a connection between the primary connection component and the base component to guide the movement of the primary connection component relative to the base component, and each primary connection component is directly connected to the base component; each secondary connection component is movably fixed to the primary connection component or the other secondary connection component through a connection between the secondary connection component and the primary connection component or the other secondary connection component to guide the movement of the secondary connection component relative to the primary connection component or the other secondary connection component, and each secondary connection component is indirectly connected to the base component through at least one primary connection component.

[0007] The handheld controller can be transformed between at least 3, 4, 5, 6, 7, 8, 9 or 10 different configurations. Therefore, the above set of mechanically connected main components can be transformed between a large number of different configurations, which helps to improve the user experience.

[0008] In one example, the plurality of different configurations includes at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration.

[0009] The at least one weapon configuration may include one or more of a knife-type or stick-type configuration and a gun-type configuration.

[0010] The "knife-type" configuration may represent any other similar implement with a blade, such as a broadsword, sword, or the like. The "stick-type" configuration may represent any other similar object with an elongated shape, such as a stick, or the like. The "gun-type" configuration may resemble any of various types of firearms, such as a shotgun, submachine gun, sniper rifle, assault rifle, pistol, or the like.

[0011] In one example, the set of mechanically connected body components includes a primary connection component that is slidable along a single axis relative to the base component.

[0012] In one example, the set of mechanically connected main body components includes two or more primary connection components, and the two or more primary connection components can rotate relative to the base component around a single axis. The handheld controller can include two or more primary connection components, and the two or more primary connection components can rotate relative to the base component around a common axis.

[0013] There are several benefits to using a single-axis coupling, including but not limited to: reducing the freedom of movement between the connected body components, which is beneficial to maintaining reliable electrical direct signal transmission; achieving self-guided movement of one body component relative to other body components, which is beneficial to achieving quick, easy and reliable conversion between different configurations; and achieving low-cost manufacturing.

[0014] In one example, the set of mechanically connected main body components includes at least one secondary connection component, which is (i) movably fixed to the primary connection component through a connection between the secondary connection component and the primary connection component to guide the movement of the secondary connection component relative to the primary connection component, and (ii) movably fixed to other secondary connection components through a connection between the secondary connection component and other secondary connection components to guide the movement between the secondary connection component and the other secondary connection components.

[0015] In one example, the base assembly has a first end and a second end, and the set of mechanically connected body assemblies includes a first subset of body assemblies extending from the first end of the base assembly and a second subset of body assemblies extending from the second end of the base assembly. The first subset of body assemblies may include a plurality of primary connection assemblies, and the second subset of body assemblies may include a primary connection assembly and a plurality of secondary connection assemblies. The set of mechanically connected body assemblies may form a configuration in which the body has an upper block portion and a left handle and a right handle.

[0016] The body may include a power actuator arrangement that is selectively operable to activate automatic conversion of the set of mechanically connected body components between different configurations. In one example, conversion between configurations may be manually or automatically achieved by the power actuator arrangement.

[0017] The input element arrangement of the handheld controller may include a plurality of buttons.

[0018] The body may support at least one camera. The body may support an omnidirectional camera. The body may support at least one speaker. The body may support a microphone. The body may support at least one motion sensor. The body may support a tactile actuator.

[0019] In one example, the body includes a configuration sensing layout for sensing a relative layout of body components to thereby determine a current configuration of the set of mechanically connected body components.

[0020] The body may include a position sensing arrangement for determining a current position of the set of mechanically connected body components.

[0021] In one example, the main body includes a wireless communication device, and the wireless communication device is used to implement wireless communication between the handheld controller and at least one host supporting wireless communication. For example, the host supporting wireless communication can be a game console, a smart TV, an AR / VR head-mounted device, a smart phone, or the like.

[0022] In one example, the main body includes a binaural renderer for providing audio output for reproduction by headphones, the function of the binaural renderer is to render sound with reference to the calculated relative position of the handheld controller and the user's head.

[0023] The handheld controller can be used to communicate with a wireless headset in a communication connection with low latency.

[0024] In one example, the handheld controller includes a pair of true wireless stereo headphones, and the body defines a receiving area for releasably receiving the pair of true wireless headphones. The earplugs can be removably fixed by a snap-fit ​​arrangement of the receiving area.

[0025] The main body may include a charging arrangement for charging the earphones when the earphones are placed in the receiving area.

[0026] In one example, the body includes a mobile device docking station for releasably physically securing and communicatively coupling a mobile device to the handheld controller.

[0027] Integrated connectivity and audio-visual features can be used in different ways to enhance the user experience.

[0028] According to a second aspect, a method for assembling a handheld controller is provided. The handheld controller includes a body supporting an input element layout for detecting user input, the method comprising: assembling the body by connecting a plurality of body components to form a set of mechanically connected body components that can be converted between a plurality of different configurations, so that: a first plurality of body components in the body components are directly connected to a base component in the plurality of body components, each of the first plurality of body components is movably fixed to the base component through a connection between the body component and the base component to guide the movement of the body component relative to the base component; a second plurality of body components in the body components are indirectly connected to the base component through at least one of the first plurality of body components, each of the second plurality of body components is movably fixed to the body component in the first plurality of body components or the other body component in the second plurality of body components through a connection between the body component and the body component in the first plurality of body components or the other body component in the second plurality of body components to guide the movement of the body component in the second plurality of body components relative to the body component in the first plurality of body components or the other body component in the second plurality of body components.

[0029] The plurality of different configurations may include at least 3, 4, 5, 6, 7, 8, 9 or 10 different configurations, which may include at least a game controller configuration, a steering wheel configuration and at least one weapon configuration, and the at least one weapon configuration may include at least one of a knife-type or stick-type configuration and a gun-type configuration.

[0030] Other specific and preferred aspects of the invention are set forth below. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The present invention will be described in more detail below with reference to the accompanying drawings, in which:

[0032] Figure 1 shows a front perspective view of a handheld controller;

[0033] Figure 2 A rear perspective view of a handheld controller is shown;

[0034] Figure 3 An exploded view of a handheld controller is shown;

[0035] Figure 4 A handheld controller is shown in a game controller configuration;

[0036] Figures 5 to 13 The handheld controller is shown in different weapon configurations;

[0037] Fig.14 A handheld controller is shown in a steering wheel configuration;

[0038] Figures 15 to 23 shows different transitions of the handheld controller from one configuration to other configurations;

[0039] Fig.24 The handheld controller is convertible during the game, and the handheld controller can be converted between different configurations to suit different scenes of the game;

[0040] Fig.25 showing a first handheld controller in one configuration and a second handheld controller in another configuration;

[0041] Fig.26 Shows optional actuation functions of the handheld controller;

[0042] Fig. 27 shows the architecture of the handheld controller;

[0043] Fig.28 and Fig.29 The device connection function of the handheld controller is shown;

[0044] Figure 30 to Figure 32 The audio output function of the handheld controller is shown;

[0045] Fig.33 Other functions of the handheld controller are shown;

[0046] Fig.34 The camera function of the handheld controller is shown;

[0047] Fig.35 shows the audio processing functionality of the handheld controller;

[0048] Fig.36 The headset storage function of the handheld controller is shown. DETAILED DESCRIPTION

[0049] The examples are described in sufficient detail below with reference to the accompanying drawings to enable those of ordinary skill in the art to implement the devices, systems and / or processes described herein. However, it should be understood that the present invention is not limited to the precise examples described and / or shown, and that those skilled in the art may make various changes and modifications without departing from the scope of the present invention as defined in the appended claims.

[0050] In the following description, all directional terms (eg, upper, lower, radial, and axial) are used with reference to the accompanying drawings and should not be construed as limiting the scope of the present invention as defined in the appended claims unless the context clearly indicates otherwise.

[0051] The drawings are not necessarily drawn to scale and in some instances may be exaggerated or simplified for reference purposes only.

[0052] Unless otherwise defined, all terms (including technical and scientific terms) used in this article are interpreted according to the customary interpretation of the art. In addition, unless the context clearly indicates otherwise, the features mentioned in the singular form herein may be one or more features. Similarly, the terms "including" and / or "having" used in this article all refer to the presence of the one or more features, and do not exclude the presence or addition of one or more other features, unless the context clearly indicates otherwise.

[0053] The present invention discloses the following: A handheld controller includes a body supporting an input element layout for detecting user input, the body including a set of mechanically connected body components, the body components can be transformed between a plurality of different configurations (preferably at least 3 different configurations), preferably at least between a game controller configuration, a steering wheel configuration and at least one weapon configuration. The body component includes a base component, a plurality of primary connection components and a plurality of secondary connection components. Each primary connection component is movably fixed to the base component through a connection between the primary connection component and the base component to guide the movement of the primary connection component relative to the base component, and each primary connection component is directly connected to the base component. Each secondary connection component is movably fixed to the primary connection component or the other secondary connection component through a connection between the secondary connection component and the primary connection component or the other secondary connection component to guide the movement of the secondary connection component relative to the primary connection component or the other secondary connection component, and each secondary connection component is indirectly connected to the base component through at least one primary connection component.

[0054] The present invention also discloses the following: a method for assembling a handheld controller including a body supporting an input element layout for detecting user input. The method includes: assembling the body by connecting a plurality of body components to form a set of mechanically connected body components that can be converted between a plurality of different configurations. The assembly of the body components is such that: a first plurality of body components in the body components are directly connected to a base component in the plurality of body components, each of the first plurality of body components is movably fixed to the base component through a connection between the body component and the base component to guide the movement of the body component relative to the base component; a second plurality of body components in the body components are indirectly connected to the base component through at least one of the first plurality of body components, each of the second plurality of body components is movably fixed to the body component in the first plurality of body components or the other body component in the second plurality of body components through a connection between the body component and the body component in the first plurality of body components or the other body component in the second plurality of body components to guide the movement of the body component in the second plurality of body components relative to the body component in the first plurality of body components or the other body component in the second plurality of body components.

[0055] The following further discloses with reference to the accompanying drawings.

[0056] Figure 1 and Figure 2 A handheld controller 101 is provided as a specific example, and the handheld controller 101 has a front side 100 and a back side 200. Figure 1 A perspective view of the front side 100 is shown, Figure 2 A perspective view of the back side 200 is shown. The handheld controller also has a first side 110, a second side 120, a top 130, and a bottom 140. As described in detail below, the handheld controller 101 is designed to be converted between a variety of different configurations. The handheld controller 101 provided in this specific example is designed for gaming, but can also be used for non-gaming applications.

[0057] The handheld controller 101 includes a body as shown in 102, which supports an input element layout as shown in 103 for detecting user input. The input element layout 103 can include any suitable one or more types of input elements, such as buttons, joysticks, dials, trackballs, switches, touch pads, squeeze switches, microphones. In this illustrated example, the input element layout 103 includes a plurality of buttons, such as button 104.

[0058] Figure 3An exploded view of the body 102 is shown. The body 102 includes a set of mechanically connected body components that can be converted between multiple different configurations. As further described below, the body assembly includes a base assembly, a plurality of primary connection assemblies, and a plurality of secondary connection assemblies. Each primary connection assembly is movably fixed to the base assembly through a connection between the primary connection assembly and the base assembly to guide the movement of the primary connection assembly relative to the base assembly, and each primary connection assembly is directly connected to the base assembly. Each secondary connection assembly is movably fixed to the primary connection assembly or other secondary connection assembly through a connection between the secondary connection assembly and the primary connection assembly or other secondary connection assembly to guide the movement of the secondary connection assembly relative to the primary connection assembly or other secondary connection assembly, and each secondary connection assembly is indirectly connected to the base assembly through at least one primary connection assembly.

[0059] In this specific example, the main body assembly includes a base assembly 301, a plurality of primary connection assemblies including first, second, third and fourth primary connection assemblies 302 to 305, and a plurality of secondary connection assemblies including first, second, third and fourth primary connection assemblies 306 to 309.

[0060] In one example, the primary connection assembly is slidable relative to the base assembly.

[0061] In this particular example, the first primary connection assembly 302 is slidably connected to the base assembly 301. As shown by arrow 310, the first primary connection assembly 302 is slidable relative to the base assembly 301 along a single axis (in two directions).

[0062] In one example, each of the at least two primary connection assemblies is rotatable relative to the base assembly about a single axis.

[0063] In this specific example, the second primary connection assembly 303 is rotatably connected to the base assembly 301 and is rotatable relative to the base assembly 301 about the first rotation axis 311 .

[0064] In one example, the body assembly includes two or more primary connection assemblies that are rotatable relative to the base assembly about a common axis.

[0065] In this specific example, the third primary connection component 304 and the fourth primary connection component 305 are respectively rotatably connected to the base component 301, and can rotate around the second rotation axis 312 relative to the base component 301; the third primary connection component 304 and the fourth primary connection component 305 are arranged on opposite sides of the base component 301 (the third primary connection component 304 faces the front side 100 of the main body 102, and the fourth primary connection component 305 faces the back side 200).

[0066] In one example, the main body component includes at least one secondary connection component, which is movably fixed to the primary connection component through the connection between the secondary connection component and the primary connection component to guide the movement of the secondary connection component relative to the primary connection component, and the secondary connection component is also movably fixed to other secondary connection components through the connection between the secondary connection component and other secondary connection components to guide the movement between the secondary connection component and other secondary connection components.

[0067] In this specific example, the first-secondary connection component 306 is rotatably connected to the second-secondary connection component 303 to rotate around a third rotation axis 313, the third-secondary connection component 307 is rotatably connected to the first-secondary connection component 306 to rotate around a third rotation axis 314, the third-secondary connection component 308 is rotatably connected to the second-secondary connection component 307 to rotate around a fourth rotation axis 315, and the fourth-secondary connection component 309 is rotatably connected to the third-secondary connection component 308 to rotate around a fourth rotation axis 316.

[0068] Therefore, as shown in the figure, the first secondary connection component 306 is mechanically connected to the first connection component (the second first connection component 303) and the second connection component (the second second connection component 307), the second second connection component 307 and the third second connection component 308 are respectively mechanically connected to two secondary connection components (the first second connection component 306 and the third second connection component 308, and the second second connection component 307 and the fourth second connection component 309), and the fourth second connection component 309 is mechanically connected to another secondary connection component (the third second connection component 308).

[0069] Among the primary connection components 303 to 305 rotatable relative to the base component 301, the third primary connection component 304 has a free end 316, and the fourth primary connection component 305 has a free end 317. Among the second connection components 306 to 309, the fourth secondary connection component 309 has a free end 318.

[0070] Figure 3 . The depth of the body 102 (between the front face 100 and the back face 200) is indicated in the Z direction, the width of the body 102 (between the first side 110 and the second side 120) is indicated in the X direction, and the height of the body 102 (between the top 130 and the bottom 140) is indicated in the Y direction.

[0071] As shown in the figure, among the rotation axes 311 to 316 , axes 311 , 312 , 314 , and 316 extend in the Z direction, axis 313 extends in the X direction, and axis 315 extends in the Y direction.

[0072] In one example, the set of mechanically connected body components includes a first subset of body components extending from a first end of the base component and a second subset of body components extending from a second end of the base component.

[0073] In one example, a first subset of main components includes a plurality of primary connection components, and a second subset of main components includes one primary connection component and a plurality of secondary connection components.

[0074] In this specific example, the above-mentioned set of mechanically connected main body components 301 to 309 includes a first main body component subset (generally shown as 319) extending from the first end 320 of the base component 301 and a second main body component subset (generally shown as 320) extending from the second opposite end 322 of the base component 301, the first main body component subset 319 includes the fourth primary connection component 304 and the fifth primary connection component 305, and the second main body component subset 321 includes the second primary connection component 303 and the first to fourth secondary connection components 306 to 309.

[0075] As shown in the figure, the above-mentioned set of mechanically connected main body components 301 to 309 can form a configuration in which the main body 102 has an upper block portion 323 and a left handle 324 and a right handle 325.

[0076] In one example, the body assembly can be transformed between at least 3 different configurations. In other examples, the body assembly can be transformed between at least 4, 5, 6, 7, 8, 9 or 10 different configurations.

[0077] In a preferred example, the body assembly can be converted between a plurality of different configurations, including at least a game controller configuration, a steering wheel configuration, and at least one weapon configuration. At least one weapon configuration can include one or more of a knife-type or stick-type configuration and a gun-type configuration. The term "knife-type" as used herein is intended to cover other items with blades, such as broadswords, swords, and the like. The term "stick-type" as used herein is also intended to cover other items with elongated shapes, such as sticks and the like. The term "gun-type" as used herein is intended to cover many types of firearms, such as shotguns, submachine guns, sniper rifles, assault rifles, pistols, and the like.

[0078] According to this particular example, the main body assembly of the handheld controller 101 can be transformed between 10 different configurations.

[0079] like Figure 4 As shown, the main body 102 is in a game controller configuration 401 (which may be referred to as a "standard game controller configuration" layout, but it should be understood that the handheld controller 101 is suitable for non-game applications); Figure 5As shown, the body 102 is in a first weapon configuration 501 (which may be referred to as a "shotgun" configuration) as a gun-type configuration; Figure 6 As shown, the main body 102 is in a second weapon configuration 601 (which may be referred to as a "mini submachine gun type" layout) as a gun type configuration; Figure 7 As shown, the main body 102 is in a third weapon configuration 701 (which may be referred to as a "submachine gun type" layout) as a gun type configuration; Figure 8 As shown, the body 102 is in a fourth weapon configuration 801 (which may be referred to as a "long assault rifle type" layout) as a gun type configuration; Fig. 9 As shown, the body 102 is in a fifth weapon configuration 901 (which may be referred to as a "long assault rifle type" layout) as a gun type configuration; Fig.10 In the embodiment, the main body 102 is in the sixth weapon configuration 1001 (which may be referred to as a "short assault rifle type" layout) as a gun type configuration; Fig.11 As shown, the main body 102 is in a seventh weapon configuration 1101 (which may be referred to as a "pistol-type" layout) as a gun-type configuration; Fig.12 As shown, the body 102 is in an eighth weapon configuration 1201 (which may be referred to as a "short stick" configuration) as a stick configuration; Fig.13 As shown, the main body 102 is in the ninth weapon configuration 1301 (which can be called a "long knife" configuration) as a knife-shaped configuration; Fig.14 As shown, the body 102 is in the steering wheel configuration 1401 .

[0080] Fig.15 The main body 102 is shown Figure 4 The game controller configuration 401 shown translates to Fig.14 Steering wheel configuration 1401 is shown.

[0081] As shown in A and B, when the main body 102 is in the game controller configuration 401, the first, second, third and fourth secondary connection components 306 to 309 rotate together around the rotation axis 313 until they reach the deployed position shown in C. As shown in B and C, the third secondary connection component 308 and the fourth secondary connection component 309 rotate together around the rotation axis 315 until they reach the deployed position shown in E. As shown in E, the third primary connection component 304 rotates around the rotation axis 312 until it reaches the position shown in F, and the free end 318 of the fourth secondary connection component 309 is connected to the free end 317 of the fourth primary connection component 305, completing the conversion to the steering wheel configuration 1401.

[0082] Fig.16 The main body 102 is shown Figure 4 The game controller configuration 401 shown translates to Fig.13 The long blade configuration 1301 is shown.

[0083] As shown in A, when the main body 102 is in the game controller configuration 401, the fourth primary connecting component 305 rotates around the rotation axis 312, and the first, second, third and fourth secondary connecting components 306 to 309 rotate together around the rotation axis 311 until reaching the configuration shown in B, in which the third primary connecting component 304 rotates around the rotation axis 312 until reaching the position shown in C, completing the conversion to the long knife type configuration 1301. It should be understood that the third primary connecting component 304 rotates around the axis 312 in a direction opposite to the rotation direction of the fourth primary connecting component 305; the free end 318 of the fourth primary connecting component 305 moves toward the base element 301, and the free end 317 of the third primary connecting component 304 moves away from the base element 301.

[0084] Fig.17 The main body 102 is shown Figure 4 The game controller configuration 401 shown translates to Fig.11 As shown in A, when the main body 102 is in the game controller configuration 401, the third primary connecting component 304 and the fourth primary connecting component 305 rotate in the same direction around the rotation axis 312 to move their free ends 317 and 318 toward the base element 301 until they reach the position shown in B, completing the conversion to the pistol type configuration 1101.

[0085] Fig.18 The main body 102 is shown Figure 4 The game controller configuration 401 shown translates to Figure 6 As shown in A, the main body 102 is initially converted from the game controller configuration 401 to the pistol configuration 1101 shown in B. As shown in B, when the main body 102 is in the pistol configuration 1101, the first primary connection assembly 302 moves to the extended position shown in C, completing the conversion to the mini submachine gun configuration 601.

[0086] Fig.19 The main body 102 is shown Figure 4 The game controller configuration 401 shown translates to Fig.12 As shown in A, the main body 102 is initially converted from the game controller configuration 401 to the pistol configuration 1101 shown in B. As shown in B, when the main body 102 is in the pistol configuration 1101, the first, second, third and fourth secondary connecting components 306 to 309 rotate together around the rotation axis 313 until they reach the extended position shown in C, completing the conversion to the short stick configuration 1201.

[0087] Fig. 20 The main body 102 is shown Figure 4 The game controller configuration 401 shown translates to Fig.10 As shown in A, when the main body 102 is in the game controller configuration 401, the third primary connection component 304 rotates around the rotation axis 312 to move its free end 317 away from the base element 301 until it reaches the position shown in B, completing the conversion to the short assault rifle type configuration 1001.

[0088] Fig.21 The main body 102 is shown Figure 4 The game controller configuration 401 shown translates to Figure 5 As shown in A, when the main body 102 is in the game controller configuration 401, the third primary connection component 304 rotates around the rotation axis 312 to move its free end 317 toward the base element 301, and the fourth primary connection component 305 rotates around the rotation axis 312 to move its free end 318 away from the base element 301 until reaching the layout shown in B. As shown in B, the first primary connection component 302 moves to the extended position shown in C, completing the conversion to the sniper rifle type configuration 501.

[0089] Fig. 22 The main body 102 is shown Figure 4 The game controller configuration 401 shown translates to Figure 7 As shown in A, when the main body 102 is in the game controller configuration 401, the third primary connection component 304 rotates around the rotation axis 312 to move its free end 317 away from the base element 301, and the fourth primary connection component 305 rotates around the rotation axis 312 to move its free end 318 toward the base element 301 until the layout shown in B is reached. As shown in B, the first primary connection component 302 moves to the extended position shown in C, completing the conversion to the submachine gun type layout 701.

[0090] Fig.23 The main body 102 is shown Figure 4 The game controller configuration 401 shown translates to Figure 8 As shown in A, when the main body 102 is in the game controller configuration 401, the fourth primary connection component 305 rotates around the rotation axis 312 to move its free end 318 away from the base element 301 until reaching the configuration shown in B. As shown in B, the first primary connection component 302 moves to the extended position shown in C, completing the conversion to the long assault rifle type configuration 801.

[0091] The handheld controller 101 is designed to be easily switchable between different configurations during gaming, and the user can make such transitions quickly and robustly.

[0092] For example, Fig.24 As shown, the body 102 of the handheld controller 101 can be in the steering wheel configuration 1401 in the driving scenario, then converted to the gun type configuration 801 in the shooting scenario 2402, then converted to the gun type configuration 101 in the subsequent shooting scenario 2403, then converted to the standard game controller configuration 401, and then converted to the stick type configuration 1201 in the batting scenario 2405.

[0093] like Fig.25 As shown, two players 2501, 2502 can play a game together, each player using their own handheld controller 101A, 101B, but one player 2501 uses the handheld controller 101A in one configuration and the other player 2502 uses the handheld controller 101B in a different configuration. For example, one player 2501 can control a character that is driving a vehicle, and therefore uses the handheld controller 101A in a steering wheel configuration 1401, while the other player 2501 can control a character that is a passenger in the vehicle but is fighting an enemy outside the vehicle, and therefore uses the handheld controller 101A in a gun configuration 1101. Therefore, the handheld controller 101 provides the following benefits in a multiplayer mode: multiple players can share the same gameplay and switch characters by using different configurations of the handheld controller 101, thereby increasing realism and improving the team game experience.

[0094] It should be understood that the above set of mechanically connected components is assembled by the most appropriate (limited / minimum) number of single-axis couplings (axial joints and linear (sliding) connections). In the specific illustrated example of the main body 102 of the handheld controller 101, Figure 3 As can be seen most clearly in the , only a single linear (sliding) connection is used. The use of a single-axis coupling reduces the freedom of motion between the connected body assemblies, which is beneficial for maintaining reliable electrical through-signal transmission; enables self-guided motion of one body assembly relative to the other body assemblies, which is beneficial for fast, easy and reliable conversion between different configurations without affecting the smoothness of the game; and also enables low-cost manufacturing. In addition, this feature also facilitates the motorization of the above set of mechanically connected body assemblies.

[0095] In one embodiment, Fig.26As shown, the body 102 includes a power actuator arrangement generally shown as 2601, which is selectively operable to activate the automatic conversion of the above-mentioned set of mechanically connected body components between different configurations. Therefore, the conversion of the body 102 from at least one configuration to other configurations can be electrically activated. In a preferred embodiment, each available conversion between configurations can be achieved by the power actuator arrangement. In one embodiment, the conversion between configurations can be achieved manually or automatically by the power actuator arrangement.

[0096] The power actuator layout can include any suitable component layout for switching between different configurations. Rotary motors such as DC motors 2602, electromagnetic solenoid actuators, piezoelectric actuators, shape memory alloy actuators with or without transmission members (e.g., bevel gears 2603, spur gears 2604, worm gears 2605, or internal gears 2606 for rotary connections, and racks and pinions 2607 for linear (sliding) connections) can be used to drive the moving system elements.

[0097] The powered actuator arrangement may be activated using any suitable activation arrangement (shown generally at 2608) to effectuate transition to a different configuration of the body 102. The activation arrangement may include at least one control element of any suitable type, such as a button, a dial, or a suitable sensor.

[0098] In one embodiment, the body 102 includes a configuration sensing arrangement, generally shown as 2605, for sensing the relative arrangement of the body components to thereby determine the current configuration of the set of mechanically connected body components.

[0099] The convertible handheld controller 101 provides a more immersive user experience for third-person, first-person, or multiplayer action, adventure, and racing-based games. Fast gameplay requires rapid switching between modes, and manual switching can be done in just a few seconds. Optionally, the joints between the body components can also include small Hall sensors with moving magnets that electrically indicate the position of the moving members to the processing unit; the handheld controller can then send a feedback signal to the host game console as to which UI mode is currently in use.

[0100] Fig. 27 The architecture of the handheld controller 101 is shown.

[0101] The figure shows a multimedia module 2701 of the main body 102. The multimedia module 2701 may include any number of components, including but not limited to cameras, speakers, microphones, sensors, processors, to provide one or more different functions, including but not limited to those described in detail below.

[0102] It will be appreciated that different arrangements of body assemblies may be used in different examples. The number of body assemblies may be different, the manner in which the body assemblies are mechanically connected to form a set of mechanically connected body assemblies may be different, the size of the body assemblies may be different, and the type of body assemblies may be different. For example, the body assembly may be a unitary assembly or an adjustable multi-component assembly. In one specific example, the body assembly 304 is shown as having a unitary form, but an alternative body assembly 304' is also shown to include multiple components, namely a first component 304A and a second component 304B, which are rotatable together about the axis 212, and the second component 304B is rotatable about a different axis 2702 relative to the first component 304A.

[0103] A method of assembling a handheld controller disclosed herein including a body supporting an input element layout for detecting user input includes: assembling the body by connecting a plurality of body components to form a set of mechanically connected body components that can be converted between a plurality of different configurations, such that: a first plurality of body components among the body components are directly connected to a base component among the plurality of body components, each of the first plurality of body components is movably fixed to the base component through a connection between the body component and the base component to guide the movement of the body component relative to the base component; a second plurality of body components among the body components are indirectly connected to the base component through at least one of the first plurality of body components, each of the second plurality of body components is movably fixed to the body component among the first plurality of body components or the other body component among the second plurality of body components through a connection between the body component and the body component among the first plurality of body components or the other body component among the second plurality of body components to guide the movement of the body component among the second plurality of body components relative to the body component among the first plurality of body components or the other body component among the second plurality of body components.

[0104] In one example, the resulting handheld controller is convertible between at least three different configurations, preferably at least between a game controller configuration, a steering wheel configuration, and at least one weapon configuration, wherein the at least one weapon configuration may include one or more of a knife-type or stick-type configuration and a gun-type configuration.

[0105] As described below, handheld controller 101 may be configured for use with a variety of different media devices.

[0106] Reference below Fig.28 and Fig.29In one embodiment, as shown, the body 102 includes a mobile device docking station 2801 for releasably physically securing and communicatively connecting a mobile device 2802 to the handheld controller 101. The mobile device docking station 2801 can be used to physically secure and communicatively connect a smartphone to the handheld controller 101. Thus, the handheld controller can be used as a phone accessory. In this specific example, the mobile device docking station 2801 is disposed on the top 130 of the handheld controller 101 and is designed to support the mobile device 2702 so that the body 102 of the handheld controller 101 is not affected by converting the handheld controller 101 between different configurations. Fig.28 As shown, the mobile device 2802 is docked with the handheld controller 101, and the main body 102 is in the first configuration (the steering wheel configuration shown); Fig.29 As shown, the mobile device 2802 is docked with the handheld controller 101, and the body 102 is in a second different configuration (a weapon (gun) configuration is shown).

[0107] In this specific example, the mobile device docking station 2801 is provided by the multimedia module 2701 or is electrically connected to the multimedia module 2701.

[0108] Reference below Figure 30 to Figure 32 In one embodiment, the body 102 supports at least one speaker. Fig.30 As shown, the main body 102 is in a weapon configuration (i.e., a long assault rifle type layout 801) and includes at least one speaker, for example, speaker 3001. During the game, various audio effects can be output to match the actions in the game. For example, when firing a gun, two sounds can be produced. One is the "bang" sound output by the first speaker 3001 at a position 3002 (towards the shooting end of the weapon), and the other is the "cartridge ejecting" sound (similar to the metal "click" sound) output by the second speaker 3003 at a different position 3004 (towards the handle end of the weapon). The different speaker positions that output specific sounds are selected with reference to the position where each sound is emitted by a real weapon. As shown in FIG. Fig.31 As shown, the body 102 is in another weapon configuration (i.e., pistol-type configuration 1101) and supports speakers (not shown) that can be used to output a "shell ejection" sound from position 3002, a "bang bang" sound from position 3101, and so on. Fig.32As shown, the body 102 is in yet another weapon configuration (i.e., a short stick type layout 1201) and supports a speaker layout for outputting a "swoosh" sound when the handheld controller 101 is moved (e.g., in the direction indicated by arrow 3201). It should be understood that any suitable audio special effects (SFX) may be provided. The function of the speaker layout is to provide an immersive audio experience to enhance the user experience. One or each speaker in the speaker layout may be provided by or electrically connected to the audio-visual module 2701.

[0109] Reference below Fig.33 In one embodiment, the body 102 of the handheld controller 101 supports at least one microphone, such as microphone 3301. The microphone can be of any suitable type and can be used for any suitable purpose or purposes. For example, the microphone can be used to record the user's voice, control menu navigation and / or game actions of a particular gaming platform, control functions of the handheld controller 101, and / or enable the user to communicate with others at a remote location.

[0110] In one embodiment, the body 102 supports at least one camera, for example, camera 3302. The camera can be of any suitable type and can be used for any suitable purpose or purposes. The camera can be an omnidirectional camera. The camera can be an RGB or IR camera.

[0111] In one embodiment, the body 102 supports at least one motion sensor, for example, the motion sensor 3303. The motion sensor can be of any suitable type and can be used for any suitable purpose or purposes. The motion sensor can be a gyroscope, an accelerometer, an inertial measurement unit (IMU). The motion sensor can be used to detect the pointing position of the handheld controller 101 and the movement of the handheld controller 101.

[0112] For example, the motion sensor may be used to control menu navigation and / or game action for a particular gaming platform and / or to control functions of the handheld controller 101 .

[0113] In one embodiment, the body 102 supports at least one tactile actuator sensor, such as tactile actuator 3304. The tactile actuator can be of any suitable type and can be used for any suitable purpose or purposes. For example, the tactile actuator can be used to confirm menu selections and / or to provide feedback corresponding to game actions to enhance the user experience.

[0114] In one embodiment, the body 102 includes a position sensing arrangement generally shown as 3305, the function of which is to determine the current position of the above-mentioned set of mechanically connected body components. The position sensing arrangement can be of any suitable type and can be used for any suitable purpose or purposes.

[0115] In one embodiment, the main body 102 includes a wireless communication device generally shown as 3306, the function of which is to implement wireless communication between the handheld controller 101 and at least one host supporting wireless communication (generally shown as 3307). For example, the host supporting wireless communication 3307 can be a game console, a smart TV, an AR / VR head-mounted device, a smart phone, or the like.

[0116] In one embodiment, the body 102 includes a binaural renderer, generally shown as 3308, which functions to provide audio output for reproduction by headphones. In a specific example, the function of the binaural renderer is to render sound with reference to the calculated relative position of the handheld controller 101 and the user's head.

[0117] According to this particular illustrated example, and again with reference to the previous figures, the base assembly 301 houses the major hardware components, such as a battery, a processor, a haptic feedback actuator, an audio drive circuit, a camera, and a motion sensor (e.g., a gyroscope, an accelerometer), and a wireless transmitter such as Bluetooth or Wi-Fi. The base assembly 301 has various electromechanical connections to the left and right handles 324, 325, and the first primary connection assembly 302. The front face of the base assembly 301 supports an array of input elements 3309.

[0118] The first primary connection component 302 surrounds the base component 302 and supports the audio-visual module 2701 and the input element array 310 on its front. The audio element may include a stereo microphone and a speaker to provide special audio effects for the handheld controller 101. For example, the camera may be an ultra-wide angle or 360-degree RGB or IR camera that can monitor / track the surrounding environment to identify factors such as user behavior or spatial factors. The left handle 324 and the right handle 325 that are hinged to the base component 301 and can rotate 180 degrees (along the Y axis) do not include any active electronic devices, but in other examples, one or both of the handles may include active electronic devices. The right handle 325 is very important for providing the steering wheel configuration 1401. The second primary connection component 303 has an axial hinge connection with the base component 301 (along the Y axis), and also includes an axial hinge joint connected to the first secondary connection component 306 (along the X axis), which has a dependent relationship with another axial joint (along the Y axis) of the second secondary connection component 307. The second secondary connection component 307 is axially connected to the third secondary connection component 308 (along the Z axis), and the third secondary connection component 308 is also axially connected to the fourth secondary connection component 309 (along the Y axis).

[0119] Reference below Fig.34 , the figure shows the field of view 3401 of a 360-degree camera 3302 supported on the top 130 of the body 102 of the handheld controller 101. As shown by the line 3402, in this example, the function of the camera 3302 is to scan the environment and record 3D data, which can be used for gaming. The camera 3302 can be used to monitor the user's movements and surrounding events, especially when a mobile media device (smartphone, VR / AR headset) is used with the handheld controller 101. The camera 3302 can implement depth functions and can scan the spatial environment of the real world and convert the spatial environment into a 3D digital representation (Simultaneous Localization and Mapping (SLAM)).

[0120] Reference below Fig.35 and Fig.36 , integrated audio functionality provides many benefits. Fig.35 As shown, integration of the head / earphones with the controller can enable binaural rendering within the handheld controller 101.

[0121] In one example, the handheld controller 101 receives multi-channel (e.g., 7.1) or object audio as indicated by arrow 3501 from a game console or HMD 3502, calculates (e.g., using an IMU sensor in the handheld controller 101) the head orientation of the user 3503 and the position of the handheld controller 101, and renders virtual sound sources (e.g., gunfire from the direction of the handheld controller 101, other sounds from virtual directions in the game environment) at the correct positions for output to the user's head / headphones 3504, as indicated by arrow 3505.

[0122] like Fig.36 As shown, in this specific example, the handheld controller 101 includes earphones 3601, preferably a pair of true wireless stereo earphones (TWS earbuds), and the body 102 defines a receiving area shown in 3602 for releasably receiving the earphones 3601. In addition, the body 102 includes a charging layout (shown as 3603) for charging the earphones 3601 when the earphones 3601 are placed in the receiving area 3602.

[0123] Wirelessly connecting the headset 3601 directly to the handheld controller 101, rather than to an external host, can achieve binaural functionality as described above.

[0124] The handheld controller 101 is preferably used for low latency communication with a wireless headset connected to the communication link. The low latency link is preferably a proprietary link.

[0125] Many gamers don’t have a multi-speaker Hi-Fi audio setup, especially when gaming on the go. Therefore, using headphones to reproduce the game sound directly into the user’s ears is an excellent compromise. In fact, headphones are often the only viable audio setup for high-quality 3D audio. Since extended reality (xR) games rely heavily on 3D audio to provide the right sound experience, it’s best to have wireless headphones as an integral part of your gaming setup.

[0126] In this particular example, when in use, the earphones 3601 can be "popped out" from the handheld controller 101 and placed on the user's ears. When not in use, the earphones 3601 can be "pushed" into the handheld controller 101 for charging and storage.

[0127] One advantage of using a TWS headset integrated into a game controller is that a proprietary RF codec can be used to transmit audio or other data between the handheld controller 101 and the headset 3601, thereby achieving much lower latency than allowed by Bluetooth standards, etc. This will result in a smoother gaming experience and better immersion. For 3D audio, the headset can be equipped with an inertial measurement unit (IMU) sensor, which helps determine the user's head orientation (possibly by supplementing the xR head-mounted-display (HMD) data).

[0128] For example, a low-latency proprietary connection between the IMU sensor (in the TWS head-mounted device 3601 and the handheld controller 101), the binaural renderer 3308 (in the handheld controller 101), and the playback (TWS headphones 3601) is particularly beneficial for games that require quick reactions (e.g., first-person shooters).

[0129] The handheld controller described in this article may have the following features:

[0130] Single unit architecture, integrated;

[0131] A cheap and easy-to-manufacture electromechanical architecture;

[0132] Strong compatibility, easy to carry (similar in size to existing single-chip controllers), and can be used with different media devices (displays, VR glasses, smartphones);

[0133] A large number of conversion functions (+10 to choose from);

[0134] Fast and reliable transitions between different configurations (achieved through a self-guided architecture supported by a single-axis joint (no ball joints used));

[0135] The electrical switching of the operating modes can optionally be done using a small actuator, which is also possible with the single-axis joint design;

[0136] Realistic transformation mode with realistic appearance of different UI settings (wheels, rifles, pistols, machine guns, knives);

[0137] Native support for integrated haptic and audio effects.

[0138] Integrated connectivity and audio-visual features can be used in different ways to enhance the user experience.

Claims

1. A handheld controller, characterized in that: The handheld controller comprises: A body supporting an input element layout for detecting user input, wherein the body comprises: A set of mechanically connected body components convertible between a plurality of different configurations, wherein the body components include: Basic components; a plurality of primary connection assemblies, wherein each primary connection assembly is movably fixed to the base assembly via a connection between the primary connection assembly and the base assembly to guide movement of the primary connection assembly relative to the base assembly, Each primary connection component is directly connected to the base component; A plurality of secondary connection components, wherein each secondary connection component is movably fixed to the primary connection component or the other secondary connection components through the connection between the secondary connection component and the primary connection component or the other secondary connection components to guide the movement of the secondary connection component relative to the primary connection component or the other secondary connection components, and each secondary connection component is indirectly connected to the base component through at least one primary connection component.

2. The handheld controller according to claim 1, characterized in that: The plurality of different configurations includes at least 3, 4, 5, 6, 7, 8, 9 or 10 different configurations.

3. The handheld controller according to claim 1 or 2, characterized in that: The various configurations include at least: Game controller configuration; Steering wheel configuration; At least one weapon configuration.

4. The handheld controller according to claim 3, characterized in that: The at least one weapon configuration includes one or more of the following configurations: Knife or stick configuration; Gun type configuration.

5. The handheld controller according to any one of claims 1 to 4, characterized in that: The handheld controller includes a primary connection assembly that is slidable along a single axis relative to the base assembly.

6. The handheld controller according to any one of claims 1 to 5, characterized in that: The handheld controller includes two or more primary connection components, each of which is rotatable around a single axis relative to the base component.

7. The handheld controller according to claim 6, characterized in that: The handheld controller includes two or more primary connection components, and the two or more primary connection components can rotate around a common axis relative to the base component.

8. The handheld controller according to any one of claims 1 to 7, characterized in that: The handheld controller includes at least one secondary connection component, which is movably fixed to the primary connection component through the connection between the secondary connection component and the primary connection component to guide the movement of the secondary connection component relative to the primary connection component. The secondary connection component is also movably fixed to other secondary connection components through the connection between the secondary connection component and other secondary connection components to guide the movement between the secondary connection component and the other secondary connection components.

9. The handheld controller according to any one of claims 1 to 8, characterized in that: The base component has a first end and a second end, and the set of mechanically connected body components includes: a first body assembly subset extending from said first end of said base assembly; A second body assembly subset extends from the second end of the base assembly.

10. The handheld controller according to claim 9, characterized in that: The first subset of main body components includes a plurality of primary connection components, and the second subset of main body components includes one primary connection component and a plurality of secondary connection components.

11. The handheld controller according to any one of claims 1 to 10, characterized in that: The body includes an arrangement of powered actuators selectively operable to activate automatic conversion of the set of mechanically connected body components between different configurations.

12. The handheld controller according to any one of claims 1 to 11, characterized in that: The body supports at least one of the following: at least one camera, optionally an omnidirectional camera; at least one speaker; microphone; at least one motion sensor; Haptic actuator.

13. The handheld controller according to any one of claims 1 to 12, characterized in that: The body includes a configuration sensing arrangement for sensing a relative arrangement of body components to thereby determine a current configuration of the set of mechanically connected body components.

14. The handheld controller according to any one of claims 1 to 13, characterized in that: The body includes a position sensing arrangement for determining a current position of the set of mechanically connected body components.

15. The handheld controller according to any one of claims 1 to 14, characterized in that: The main body includes a wireless communication device, and the wireless communication device is used to implement wireless communication between the handheld controller and at least one host supporting wireless communication.

16. The handheld controller according to claim 15, characterized in that: The main body includes a binaural renderer for providing audio output for reproduction by headphones, the function of the binaural renderer is to render sound with reference to the calculated relative position of the handheld controller and the user's head.

17. The handheld controller according to claim 15 or 16, characterized in that: The handheld controller is used to perform low-latency communication with a wireless headset in a communication connection.

18. The handheld controller according to any one of claims 1 to 17, characterized in that: The handheld controller includes a pair of true wireless stereo headphones, and the body defines a receiving area for releasably receiving the pair of true wireless stereo headphones.

19. The handheld controller according to claim 18, characterized in that: The main body includes a charging arrangement for charging the earphone when the earphone is placed in the receiving area.

20. The handheld controller according to any one of claims 1 to 19, characterized in that: The body includes a mobile device docking station for releasably physically securing and communicatively connecting a mobile device to the handheld controller.

21. The handheld controller according to any one of claims 1 to 20, characterized in that: The input element arrangement includes a plurality of buttons.

22. A method for assembling a handheld controller, characterized in that: The handheld controller includes a body supporting an arrangement of input elements for detecting user input, the method comprising: The body is assembled by connecting a plurality of body components to form a set of mechanically connected body components convertible between a plurality of different configurations, such that: A first plurality of body assemblies among the body assemblies are directly connected to a base assembly among the plurality of body assemblies, respectively, and each body assembly among the first plurality of body assemblies is movably fixed to the base assembly through a connection between the body assembly and the base assembly to guide movement of the body assembly relative to the base assembly; A second plurality of body components among the body components are indirectly connected to the base component through at least one body component among the first plurality of body components, and each body component among the second plurality of body components is movably fixed to the body component among the first plurality of body components or the other body components among the second plurality of body components through the connection between the body component and the body components among the first plurality of body components or the other body components among the second plurality of body components to guide the movement of the body components among the second plurality of body components relative to the body components among the first plurality of body components or the second plurality of body components.

23. The method according to claim 22, characterized in that The plurality of different configurations includes at least 3, 4, 5, 6, 7, 8, 9 or 10 different configurations.

24. The method according to claim 22 or 23, characterized in that The various configurations include at least: Game controller configuration; Steering wheel configuration; At least one weapon configuration.

25. The method according to claim 24, characterized in that The at least one weapon configuration includes one or more of the following configurations: Knife or stick configuration; Gun type configuration.

Images