External controller of handheld device and operation method

Abstract

The invention relates to an external controller of a handheld device and an operation method, the external controller of the handheld device comprises a first control part, a second control part and a connecting part for connecting the first control part and the second control part, and the external controller is connected with an external host through a communication interface. In the operation method, the connection between the external controller of the handheld device and the external host is established, so that a control signal generated by operating the external controller of the handheld device by a user is transmitted to the external host, and a signal generated from the external host is received; in addition, connection between the handheld device installed on the handheld device external controller and the external host is also established, so that an image signal transmitted from the external host can be received, an image is displayed on a display of the handheld device, and a user can generate an input signal through a virtual input interface started by the handheld device and then transmit the input signal to the external host.

Description

Technical Field

[0001] This invention relates to an external remote control for a handheld device, and more particularly to an external controller and operating method for a handheld device that provides a solution for connecting, controlling, and displaying with an external host. Background Technology

[0002] Mobile devices, such as mobile phones and tablets, which are ubiquitous, offer users a variety of interactive entertainment functions beyond information transmission, enjoying audio-visual content, and handling daily tasks. For example, users typically use the touchscreen display on their mobile devices as the interface for playing games. The touchscreen displays the game content and shows virtual buttons or joysticks in easily accessible locations for finger operation, allowing users to play the game through a virtual control interface.

[0003] However, the feel of playing games through a virtual control interface still differs from that of a physical game controller. Therefore, some manufacturers have designed external controllers, or external gamepads, specifically for mobile devices. These controllers allow mobile devices to be attached to the external gamepad, establishing a wired or wireless connection to transmit game signals. Users can then operate the physical buttons or joysticks on the external gamepad to play games. Summary of the Invention

[0004] Compared to existing external controllers for mobile devices, this disclosure proposes an external controller and operating method for a handheld device, providing an external control technology that is more flexible than existing external controllers.

[0005] According to one embodiment of a handheld device external controller, the handheld device external controller includes a first control unit, a second control unit, and a connection unit. The two ends of the connection unit are respectively connected to the first control unit and the second control unit via a connection mechanism and an electrical connection line. The handheld device external controller also connects to an external host via a communication interface to transmit control signals generated by the handheld device external controller based on user operation to the external host. The handheld device external controller also mounts the handheld device via the fixing structure of the connection unit and connects to the handheld device via a connection interface located on the first or second control unit.

[0006] Furthermore, the handheld device's external controller receives feedback signals generated by an external host through the communication interface. For example, the feedback signals generated by the external host form sounds or vibrations generated by the first control unit and / or the second control unit.

[0007] Furthermore, both the first and second control units are equipped with an operating interface consisting of a button group and a joystick, enabling the user to operate and generate control signals that are transmitted to an external host.

[0008] Furthermore, the handheld device installed on the external controller can directly connect to an external host via a wireless communication protocol to receive image signals transmitted from the external host and display the images on the handheld device's display.

[0009] Furthermore, the input signals generated by the user operating the handheld device are transmitted to an external host via a wireless communication protocol or through an external controller connected to the handheld device. For example, the handheld device can initiate a virtual input interface, allowing the user to operate this virtual input interface to generate input signals.

[0010] In another embodiment, the handheld device is mounted on an external controller via a fixed structure of a connector, and is connected to the handheld device via a connection interface signal. Furthermore, the handheld device connects to an external host via a wireless communication protocol, allowing control signals generated by the user's operation of the external controller to be transmitted to the handheld device via this connection interface, and then to the external host via the wireless communication protocol.

[0011] Furthermore, the handheld device receives feedback signals generated by an external host via a wireless communication protocol, and then transmits them to the external controller of the handheld device through this connection interface.

[0012] According to an embodiment of the operation method of the handheld device external controller, a first connection is first established between the handheld device external controller and an external host, and a second connection is established between the handheld device installed on the handheld device external controller and the external host.

[0013] When a user operates the external controller of the handheld device to generate a control signal, the control signal can be transmitted to an external host through the first connection, and the user can receive feedback signals generated by the external host, forming the first control unit of the external controller of the handheld device and / or the sound or vibration generated by the second control unit.

[0014] Furthermore, the handheld device receives image signals transmitted from the external host via a second connection with the external host and displays the images on the handheld device's screen. Within the handheld device, a virtual input interface can be run based on the displayed image, allowing the user to operate this virtual input interface to generate input signals, which are then transmitted to the external host.

[0015] To further understand the features and technical content of the present invention, please refer to the following detailed description and drawings of the present invention. However, the drawings provided are for reference and illustration only and are not intended to limit the present invention. Attached Figure Description

[0016] Figure 1 A schematic diagram illustrating an embodiment of the main components of an external controller for a handheld device;

[0017] Figure 2 A schematic diagram illustrating an embodiment of connecting a handheld device to an external host via an external controller;

[0018] Figure 3 An embodiment diagram showing the connection structure between the external controller of the handheld device and the handheld device;

[0019] Figure 4 A schematic diagram illustrating an embodiment of the circuit modules and connections between the handheld device's external controller, the handheld device, and the external host.

[0020] Figure 5 One of the flowcharts illustrating an embodiment of a handheld device external controller and a method for operating between the handheld device and an external host; and

[0021] Figure 6 This is the second flowchart illustrating an embodiment of the operation method between a handheld device and an external controller, and between the handheld device and an external host. Detailed Implementation

[0022] The following specific embodiments illustrate the implementation of the present invention. Those skilled in the art can understand the advantages and effects of the present invention from the content disclosed in this specification. The present invention can be implemented or applied through other different specific embodiments, and various details in this specification can also be modified and changed based on different viewpoints and applications without departing from the concept of the present invention. Furthermore, the accompanying drawings of the present invention are for simple illustrative purposes only and are not depictions of actual dimensions; this is stated beforehand. The following embodiments will further describe the relevant technical content of the present invention in detail, but the disclosed content is not intended to limit the scope of protection of the present invention.

[0023] It should be understood that while terms such as "first," "second," and "third" may be used in this document to describe various components or signals, these components or signals should not be limited by these terms. These terms are primarily used to distinguish one component from another, or one signal from another. Furthermore, the term "or" as used herein should, as appropriate, include any combination of one or more of the related listed items.

[0024] This disclosure proposes an external controller and operating method for a handheld device. The external controller is connected to the handheld device through a mechanical design and connection means, allowing the user to control the handheld device with a physical controller and operate its software, such as running a video game on the handheld device, which the user can operate using the external controller. Furthermore, the external controller for the handheld device proposed in this disclosure can also connect to an external host via wired or wireless communication methods, allowing the user to operate the external controller to control the external host.

[0025] The appearance of the external controller for the handheld device can be referenced. Figure 1 The schematic diagram of the external embodiment shown shows that the main components of the handheld device external controller 100 include a first control unit 101 that allows the user to operate with their left hand and a second control unit 102 that allows the user to operate with their right hand. The first controller 101 and the second controller 102 are connected to each other through a connection part 103 via a connection mechanism (bridging mechanism). Circuitry and connection interface are also provided for interconnection.

[0026] The connecting part 103 can be designed as a bendable hub structure for easy storage, and can be designed with a telescopic mechanism to fix handheld devices of various sizes (not shown in this figure), and is provided with a structure to fix the handheld device, for example, a clamping structure that can be inserted into the handheld device is designed at the part connecting the first controller 101 and the second controller 102 on the left and right.

[0027] Furthermore, in addition to providing a solution for connecting and operating the handheld device via a physical controller, the external controller proposed in this disclosure can also connect to another external host for control, communication, and content transfer. (See reference for details.) Figure 2 The illustrated embodiment is shown in the diagram.

[0028] Figure 2 The handheld device external controller 200 is shown, wherein the main components include a first control unit 201 and a second control unit 202 that allow the user to operate with their left and right hands, respectively. According to an embodiment, the first control unit 201 and the second control unit 202 of the handheld device external controller 200 provide two handles that allow the user to operate with their left and right hands. The first control unit 201, the second control unit 202, and the connecting part 203 are removably assembled on both sides of the handheld device 210, providing a structural design for the user to hold and operate the handheld device 210.

[0029] As shown in the example, the handheld device external controller 200 is equipped with an operating interface, including buttons, knobs, and a joystick, for the user to operate the handheld device external controller 200 and transmit control signals to the handheld device 210 through a communication interface. According to the figures, the first control unit 201 has a first joystick 211 and a first button group 213, and internally contains the relevant circuitry for these control interfaces; the second control unit 202 has a second button group 221 and a second joystick 223, and internally contains the relevant circuitry for these physical control interfaces. Specifically, the handheld device 210 is fixed to the connection part 203 between the first control unit 201 and the second control unit 202 using a clamping structure. The handheld device external controller 200 can be connected to the handheld device 210 via a wired connection (such as USB Type-C) and a relevant connection interface, or via wireless communication (such as Bluetooth communication).

[0030] According to one embodiment, the handheld device 210 can supply power to the handheld device external controller 200 through a communication interface. For example, the handheld device 210 is provided with a power management chip in the handheld device 210 via a universal serial bus (USB) or a specific connection interface, and can output the power in the handheld device 210 to the handheld device external controller 200 through a connection cable (such as a USB cable), so that the handheld device external controller 200 can operate using the power supplied by the handheld device 210.

[0031] Furthermore, according to the embodiment of the handheld device external controller 200, the handheld device external controller 200 is provided with a wireless or wired communication circuit for connecting to the external host 220. The connection method includes radio, Bluetooth™ communication, wireless local area network (such as WiFi™), or other Internet of Things communication protocols. On the other hand, the handheld device 210 can also directly establish a connection with the external host 220, or the handheld device 210 can achieve the purpose of communication with the external host 220 through the handheld device external controller 200.

[0032] According to the embodiments, the external host 220 is such as a television, a video game console, or a personal computer. In one embodiment, after the handheld device external controller 200 is connected to the external host 220, the user can operate the handheld device external controller 200 to control the operating system and applications running on the external host 220. In particular, the handheld device external controller 200 provides the operation interface for electronic games, so the user can operate the handheld device external controller 200 to play the games running on the external host 220.

[0033] Figure 3 A diagram further illustrates an embodiment of the connection structure between the external controller and the handheld device.

[0034] The figure shows that the first control unit 201 of the handheld device external controller 200 is provided with a communication interface 310. It is worth mentioning that the communication interface 310 can be set at any position of the handheld device external controller 200. Its function is to establish a connection with an external host (not shown in this figure) via wired (such as USB) or wired (such as radio, Bluetooth communication, wireless LAN, etc.) communication methods.

[0035] This illustration also shows that the first control unit 201 of the handheld device external controller 200 is provided with a first fixing structure 311, and the second control unit 202 is provided with a second fixing structure 312. The first fixing structure 311 and the second fixing structure 312 are used to clamp the handheld device 300 mounted on the connecting part 203. In one embodiment, the first fixing structure 311 and the second fixing structure 312 have an elastic connection mechanism with each other, which can more securely fix the handheld device 300 through the elastic mechanism.

[0036] The connection part 203 is equipped with circuits and electrical connection lines. For example, the handheld device external controller 200 can be connected to the handheld device 300 via the electrical connection line 316 and the connection interface 317. The first control part 201 and the second control part 202 are electrically connected to each other via the electrical connection line 315 provided in the connection part 203, which is used to transmit control signals generated by the user operating the handheld device external controller 200 and to transmit power signals provided by the handheld device 300.

[0037] According to the handheld device external controller disclosed herein, the operating modes may include operating the clamped handheld device, operating it as a remote control to directly connect to and operate an external host, or controlling the external host through the clamped handheld device, etc. The operation between the handheld device external controller and the handheld device and the external host can be referenced first. Figure 4 A schematic diagram illustrating an embodiment of the connection relationship between the circuit modules and the device in the illustrated apparatus.

[0038] Figure 4 The external controller 41 of the handheld device is provided with a control unit 413 for controlling the operation of the device, and related circuit components electrically connected to the control unit 413, mainly including a button module 411, a joystick module 412, a control unit 413, a communication unit 414, a connector unit 415 and a feedback unit 416.

[0039] refer to Figure 2 In the illustrated embodiment, the handheld device's external controller 200 has a physical user interface, such as a first joystick 211 and a first button group 213 on the first control unit 201, and a second button group 221 and a second joystick 223 on the second control unit 202. According to the embodiment, the button groups and joysticks individually provided on the first control unit 201 and the second control unit 202 form the user interface, enabling the user to generate control signals that are transmitted to the external host 220.

[0040] Figure 4The button module 411 shown is the control circuit for the physical first button group 213 and the second button group 221. The instructions generated by the user operating the physical buttons are converted into control signals through the button module 411. The joystick module 412 is the control circuit for the physical first joystick 211 and the second joystick 223, and is used to process the instructions generated by the user operating the physical joystick.

[0041] The control unit 413 then processes the control signals generated by the button module 411 and the joystick module 412, and transmits them to the handheld device 42 or the external host 43 via the communication unit 414. The handheld device external controller 41 is provided with a connector unit 415 for direct connection to the handheld device 42 to transmit control signals, and can obtain power through the connector unit 415.

[0042] The handheld device external controller 41 may also be equipped with a feedback unit 416. The feedback unit 416 may be various electronic components that can respond to control signals, such as vibrators, buzzers, speakers, and indicator lights, located within the handheld device external controller 41. For example, when a user operates the handheld device external controller 41 to play a game, some signals generated in the game can be fed back to the user through vibration, sound, and light signals via the feedback unit 416. The feedback information forms the vibration, sound, or light signals generated by the first control unit 201 and / or the second control unit 202.

[0043] The diagram shows several main circuit components in the handheld device 42, such as the processor 421 and the display unit 422, input module 423, communication unit 424, and connector unit 425, which are electrically connected to each other. The handheld device 42, such as a mobile phone or tablet computer, can be clipped onto an external controller 41, allowing the user to control the game running on the handheld device 42 by operating the external controller 41. The display unit 422 of the handheld device 42 displays the game screen, and the input module 423 acts as a touch display for the handheld device 42, using software to initiate a virtual input interface.

[0044] The handheld device 42 is equipped with a communication unit 424, which enables wireless communication between the handheld device 42 and the external host 43 for transmitting and receiving signals. In one embodiment, the handheld device 42 can transmit the image projected by the handheld device 42 to the external host 43 via the communication unit 424; or in another embodiment, the handheld device 42 can receive images provided by the external host 43 via the communication unit 424, such as displaying an input interface on the touch screen of the handheld device 42 that allows operation of an electronic game running on the external host 43.

[0045] External host 43, such as a television, game console, or computer host, includes a processor 431 and electrically connected electronic components, primarily a display unit 432, a communication unit 433, and a connector unit 434. The display unit 432 of the external host 43 generates the image displayed on the screen. It connects to an external controller 41 of the handheld device via the communication unit 433, or directly to the handheld device 42, thereby transmitting control and image signals. For example, the image can be transmitted to the handheld device 42 via this communication connection, making the display of the handheld device 42 a second screen for the external host 43. The external host 43 can be wired to the external controller 41 of the handheld device via the connector unit 434.

[0046] It is worth mentioning that, according to the embodiment, the software program running in the external host 43 provides an application programming interface (API) to establish the specifications of the external control software program, so that the handheld device external controller 41 and the handheld device 42 can communicate with the external host 43 through the application programming interface, including controlling the running software program.

[0047] For example, the display of the external host 43 shows the screen of a video game. This game screen can be generated by a game program executed by the computer system of the external host 43 itself, or it can be projected onto the display screen of the external host 43 by the handheld device 42 using a specific communication protocol. According to the embodiment, by first establishing a first connection between the handheld device external controller 41 and the external host 43, and establishing a second connection between the handheld device 42 installed on the handheld device external controller 41 and the external host 43, multiple operating modes can be run. Two of these operating modes are listed below.

[0048] Operating Mode 1:

[0049] Operating mode one involves connecting the handheld device to an external controller and then to an external host device. The operating procedure can be found by referring to [the relevant documentation / guideline]. Figure 5 The flowchart illustrates an embodiment of the operation method between the handheld device external controller 41, the handheld device 42, and the external host 43.

[0050] Initially, the handheld device external controller 41 establishes a first connection with the external host 43 through a specific channel and communication protocol (step S501). On the other hand, the handheld device 42 also establishes a second connection with the external host 43 through a specific channel and wireless communication protocol (step S503).

[0051] The user operates the handheld device's external controller 41 to control the software program running in the external host 43. Control signals are transmitted via the first connection (step S505). The processor in the external host 43 processes the relevant instructions based on the control signals (step S507) and generates feedback signals to the handheld device's external controller 41. This feedback can manifest as vibration, sound, or a light signal in the handheld device's external controller 41 (step S509). These steps are repeated throughout the operation.

[0052] On the other hand, the handheld device 42 receives the image signal generated by the external host 43 through the second connection (step S511), displays the image through the touch screen of the handheld device 42 (step S513), and enables the user to operate the touch screen to control the external host 43, and generates input signals to be transmitted to the external host 43 (step S515). After being processed by the external host 43 (step S517), it similarly generates feedback signals corresponding to these input signals to the handheld device 42 (step S519). The above process will be repeated in the operation process.

[0053] For example, an external host 43 runs a video game, and the user can operate the handheld device's external controller 41 to play the game. During the game, control signals are continuously generated to the external host 43 through the first channel, and the external host 43 then sends back feedback signals, allowing the user to feel the vibrations, sounds, or lights generated by the handheld device's external controller 41, thus enhancing the gaming experience. On the other hand, the touch screen of the handheld device 42 becomes a second screen for the game, displaying images transmitted by the external host 43 and displaying a virtual input interface, allowing the user to control the game with gestures or a virtual keyboard. The relevant input signals are transmitted to the external host 43 through the second channel.

[0054] Operating Mode 2:

[0055] In operating mode two, the handheld device 42 establishes a connection with the external host 43 independently using a specific channel and communication protocol. However, the external controller 41 of the handheld device does not directly connect to the external host 43. Instead, it first connects to the handheld device 42 using a specific channel and communication protocol, and then communicates with the external host 43 through the handheld device 42. Figure 6 The flowchart illustrates an embodiment of the operation method between the handheld device external controller 41, the handheld device 42, and the external host 43.

[0056] According to the steps in the diagram, an external host 43 runs a software program, such as a video game. The handheld device's external controller 41 establishes a first connection with the handheld device 42 (step S601). The handheld device 42 then establishes a second connection with the external host 43 using a wireless communication protocol (step S603). The user operates the handheld device's external controller 41 to generate control signals to operate the software program in the external host 43, which are then transmitted to the handheld device 42 (step S605). The handheld device 42 then forwards the control signals to the external host 43 (step S607).

[0057] The external host 43 processes the received control signals (step S609) and generates corresponding feedback signals. These signals are first transmitted to the handheld device 42 via the second connection (step S611), and then forwarded to the handheld device's external controller 41. The handheld device's external controller 41 can then generate corresponding vibrations, sounds, and / or lights (step S613). These steps are repeated during the operation process.

[0058] On the other hand, the handheld device 42 can simultaneously receive image signals transmitted from the external host 43 (step S615) and display the images on the touch screen of the handheld device 42 (step S617). Taking a game as an example, the handheld device 42 displays the second screen content of the game running on the external host 43. Similarly, the handheld device 42 displays a virtual input interface, allowing the user to control the software program running on the external host 43 through touch gestures, transmitting input signals to the external host 43 (step S619). After processing by the external host 43 (step S621), a feedback signal is generated and transmitted to the handheld device 42 (step S623), which can generate feedback such as vibration, sound, and / or light signals on the handheld device 42.

[0059] In summary, according to the handheld device external controller and operating method described in the above embodiments, the handheld device external controller is designed to clamp the handheld device and establish a connection with the handheld device. On the other hand, the handheld device external controller also establishes a direct or indirect connection with an external host, so that the user can operate the handheld device external controller to control the software program in the handheld device or control the software program in the external host, thereby flexibly providing multiple operating modes.

[0060] The above-disclosed content is only a preferred and feasible embodiment of the present invention, and is not intended to limit the scope of the patent application of the present invention. Therefore, all equivalent technical changes made based on the content of the present invention specification and drawings are included in the scope of the patent application of the present invention.

Claims

1. An external controller for a handheld device, characterized in that, The handheld device external controller includes: First Control Unit; A second control unit; and A connecting part, wherein the two ends of the connecting part are respectively connected to the first control part and the second control part via a connecting mechanism and an electrical connection line; The handheld device external controller connects to an external host via a communication interface to transmit control signals generated by a user operation of the handheld device external controller to the external host; and the handheld device external controller mounts a handheld device via a fixed structure of the connection part and connects to the handheld device via a connection interface provided in the first control part or the second control part.

2. The handheld device external controller as described in claim 1, characterized in that, The handheld device's external controller receives feedback signals generated by the external host through the communication interface.

3. The handheld device external controller as described in claim 2, characterized in that, The feedback signal generated by the external host forms the sound or vibration generated by the first control unit and / or the second control unit.

4. The handheld device external controller as described in claim 1, characterized in that, Both the first control unit and the second control unit are provided with an operating interface formed by a button group and a joystick, so that the user can operate the control signal generated and transmitted to the external host.

5. The handheld device external controller as described in claim 1, characterized in that, The handheld device, which is installed on the external controller of the handheld device, directly connects to the external host via a wireless communication protocol to receive image signals transmitted from the external host and display the images on a display of the handheld device.

6. The handheld device external controller as described in claim 5, characterized in that, The input signal generated by the user operating the handheld device is transmitted to the external host via the wireless communication protocol or via the external controller of the handheld device.

7. The handheld device external controller as described in claim 6, characterized in that, In this handheld device, a virtual input interface is run based on the displayed image, enabling the user to operate the virtual input interface to generate the input signal.

8. An external controller for a handheld device, characterized in that, The handheld device external controller includes: First Control Unit; A second control unit; and A connecting part, wherein the two ends of the connecting part are respectively connected to the first control part and the second control part via a connecting mechanism and an electrical connection line; The handheld device external controller is mounted on a handheld device through a fixed structure of the connection part, and is connected to the handheld device through a connection interface provided in the first control part or the second control part; and the handheld device is connected to an external host through a wireless communication protocol, so that a user operates the control signal generated by the handheld device external controller and transmits it to the handheld device through the connection interface, and then transmits it to the external host through the wireless communication protocol.

9. The handheld device external controller as described in claim 8, characterized in that, The handheld device receives the feedback signal generated by the external host through the wireless communication protocol, and then transmits it to the external controller of the handheld device through the connection interface.

10. The handheld device external controller as described in claim 9, characterized in that, The feedback signal generated by the external host forms the sound or vibration generated by the first control unit and / or the second control unit.

11. The handheld device external controller as described in claim 8, characterized in that, Both the first control unit and the second control unit are provided with an operating interface formed by a button group and a joystick, so that the user can operate the control signal generated and transmitted to the external host.

12. The handheld device external controller as described in claim 8, characterized in that, The handheld device, which is installed on the external controller of the handheld device, receives image signals transmitted from the external host through the wireless communication protocol and displays the images on a display of the handheld device.

13. The handheld device external controller as described in claim 12, characterized in that, The input signal generated by the user operating the handheld device is transmitted to the external host via the wireless communication protocol.

14. The handheld device external controller as described in claim 13, characterized in that, In this handheld device, a virtual input interface is run based on the displayed image, enabling the user to operate the virtual input interface to generate the input signal.

15. A method for operating an external controller for a handheld device as described in claim 1 or 8, characterized in that, The operating method includes: Establish a connection between the handheld device's external controller and the external host, and establish a connection between the handheld device installed on the handheld device's external controller and the external host; The handheld device generates control signals based on the user's operation; The control signal is transmitted to the external host. The system receives feedback signals generated by the external host and generates sounds or vibrations from the first control unit and / or the second control unit. The handheld device receives image signals transmitted from the external host through a connection between the handheld device and the external host, and displays the images on a display of the handheld device; and The handheld device operates a virtual input interface based on the displayed image, enabling the user to generate input signals by operating the virtual input interface and then transmit them to the external host.

Images