Display, method for controlling touch device and key setting method
By storing the correspondence between keyboard and mouse commands and touch operations in the display, the problem of discomfort for mobile game players is solved, enabling touch device control without the need for a computer host, thus improving the user experience and playability of mobile games.
Patent Information
- Application Number
- CN202410553246.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-07
- Publication Date
- 2025-11-07
AI Technical Summary
Mobile game players are used to keyboard and mouse controls, and when they switch to mobile games, they face problems such as visual fatigue and discomfort in their hands. In addition, current technology cannot customize the mapping between touch operation and keyboard/mouse operation, so a connection to a computer host is required for game control.
By setting up a memory and controller in the monitor to store the correspondence between keyboard and mouse commands and touch operations, the touch device can be controlled using a keyboard and mouse, eliminating the need for computer host settings and allowing for customization of the correspondence between keyboard and mouse commands and touch operations.
It reduces the overall cost of computer equipment, increases the convenience of operating touch devices, enhances the user experience and the playability of mobile games, and achieves flexible mapping between keyboard and mouse and touch operations.
Smart Images
Figure CN120909491A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to a display, a method for controlling a touch device and a key setting method. BACKGROUND
[0002] Nowadays, the mobile game market continues to thrive, and many computer games are ported to mobile phones to allow many game players to switch to mobile platforms. However, when switching to mobile platforms, players also face many problems, including: many players are used to keyboard and mouse after years of computer game experience, so they are not used to the operation method of sliding the screen with both hands; the mobile screen is too small, and the player will easily get visual fatigue after a long time; and the fingers cannot rest for a long time while holding the mobile phone with both hands.
[0003] Furthermore, although there are many mobile screen projection software on the market, users cannot define the operation function mapping between touch operation and keyboard / mouse, and when playing games, the mobile phone needs to be connected to the computer host to control the game software on the mobile phone on the computer. SUMMARY
[0004] In view of the above, the present application provides a display, a method for controlling a touch device and a key setting method to solve the above problems.
[0005] According to an embodiment of the present application, the display comprises a memory and a controller. The memory is used to store the correspondence between the plurality of keyboard and mouse instructions and the plurality of touch operations. The controller is connected to the memory, and the controller is used to receive the keyboard and mouse signal and output the touch signal according to the correspondence. The touch signal is used to control the touch device according to the plurality of touch operations.
[0006] According to an embodiment of the present application, the key setting method is executed by the display, comprising: receiving a setting instruction for specifying the correspondence between the plurality of keyboard and mouse instructions and the plurality of touch operations of the touch device; and storing the correspondence.
[0007] According to an embodiment of the present application, the method for controlling a touch device is executed by the display, comprising: triggering by the keyboard and mouse signal to generate the touch operation according to the correspondence between the plurality of keyboard and mouse instructions and the plurality of touch operations; and outputting the touch operation to the touch device.
[0008] In summary, by the correspondence between the keyboard and mouse instructions stored in the memory of the display and the touch operations, the display and the method of controlling the touch device according to one or more embodiments of the present application can be controlled by the keyboard and mouse device inserted on the display, and the setting of the computer host can be omitted, thereby reducing the cost of the overall computer equipment and increasing the convenience of controlling the touch device to improve the user experience. According to the key setting method according to one or more embodiments of the present application, the user can customize the correspondence between the keyboard and mouse instructions and the touch operations, allowing the user to have high freedom and improving the playability of the mobile game.
[0009] The above description of the present application and the following description of the embodiments are used to demonstrate and explain the spirit and principles of the present application, and provide further explanation of the patent application scope of the present application. BRIEF DESCRIPTION OF DRAWINGS
[0010] Figure 1 is a block diagram of a display and a keyboard and mouse device according to an embodiment of the present application;
[0011] Figure 2 is a flowchart of a method of controlling a touch device according to an embodiment of the present application;
[0012] Figure 3 is a block diagram of a display, a keyboard and mouse device, and a touch device according to another embodiment of the present application;
[0013] Figure 4 is a flowchart of a key setting method according to an embodiment of the present application;
[0014] Figure 5 is an application schematic diagram of a display according to an embodiment of the present application;
[0015] Figure 6 is an application schematic diagram of a display according to another embodiment of the present application.
[0016] Among them, the reference signs are:
[0017] 1, 2, 3, 4: display
[0018] 11, 21, 31, 41: memory
[0019] 12, 22, 32, 42: controller
[0020] 23, 33, 43: transmission interface
[0021] 33a, 43a: first sub-interface
[0022] 33b, 43b: second sub-interface
[0023] 33c: third sub-interface
[0024] A1: keyboard and mouse device
[0025] A2: touch device
[0026] A3: audio playing element
[0027] A4: computer
[0028] S101, S103, S201, S203: steps DETAILED DESCRIPTION
[0029] The detailed description is made below in the embodiments to describe the detailed features and advantages of the present application in sufficient details so as to enable those having ordinary skill in the art to understand the technical contents of the present application and to implement the same. According to the contents disclosed in the present specification, the scope of the application and the drawings, those having ordinary skill in the art can easily understand the related purposes and advantages of the present application. The following embodiments further illustrate the ideas of the present application but do not limit the scope of the present application in any way.
[0030] The display and the method of controlling a touch device according to one or more embodiments described below can be used to convert the instructions from a keyboard and mouse device into touch operations that can control a touch device according to the corresponding relationship stored in the memory of the display. The key setting method according to one or more embodiments described below can be used to set the corresponding relationship. The display, the method of controlling a touch device and the key setting method according to one or more embodiments of the present application can be used in the application of controlling the application program (e.g. mobile phone game) of a touch device by a keyboard and mouse device.
[0031] Reference is made to Figure 1 wherein Figure 1 is a block diagram of a display and a keyboard and mouse device according to an embodiment of the present application. As shown in Figure 1 , the display 1 includes a memory 11 and a controller 12. The controller 12 is electrically connected to the memory 11 and a keyboard and mouse device A1, wherein the keyboard and mouse device A1 can include at least one of a keyboard and a mouse. The controller 12 can be further connected to a touch device for the keyboard and mouse device A1 to control the touch device through the display 1. The touch device can include a touchpad, a smart phone, a tablet computer, etc., and the operating system running on the touch device can be an Android operating system.
[0032] The memory 11 is configured to store a plurality of corresponding relationships between a plurality of keyboard and mouse instructions and a plurality of touch operations. The keyboard and mouse instructions are instructions that can be input via the keyboard and mouse device Al, such as instructions input by a right mouse button, a left mouse button, a blank key on a keyboard, a W key, an S key, etc. The touch operations are operations on a touch device, such as a single click, a double click, a swipe, etc. The memory 11 can be an Electrically-Erasable Programmable Read-Only Memory (EEPROM) or other non-volatile memory that can modify stored data.
[0033] The controller 12 is configured to receive the keyboard and mouse signals and output corresponding touch signals according to the corresponding relationships stored in the memory 11. The controller 12 can receive the keyboard and mouse signals from the keyboard and mouse device Al, convert the keyboard and mouse signals into touch signals according to the corresponding relationships, and output the touch signals to the touch device. The touch signals are configured to control the touch device according to the plurality of touch operations. In other words, the touch signals are configured to simulate the touch operations of a finger or a stylus on the touch device. The controller 12 can include one or more processors, such as a central processing unit, a microcontroller, a programmable logic controller, or other processors with signal processing functions.
[0034] Please refer to Figure 1 Figure 2 wherein Figure 2 A flowchart of a method for controlling a touch device according to an embodiment of the present application is shown. The method for controlling a touch device is performed by the display 1 as shown in Figure 1 and includes the following steps as shown in Figure 2 Step S101: triggered by keyboard and mouse signals to generate corresponding touch operations according to a plurality of corresponding relationships between a plurality of keyboard and mouse instructions and a plurality of touch operations; and Step S103: outputting the touch operations to a touch device.
[0035] In step S101, the controller 12 is triggered by the keyboard and mouse signals from the keyboard and mouse device Al to convert the keyboard and mouse signals into corresponding touch operations according to the corresponding relationships between the keyboard and mouse instructions and the touch operations stored in the memory 11. In step S103, the controller 12 outputs the touch operations to the touch device. For example, the corresponding relationship stored in the memory 11 indicates that a right mouse button (keyboard and mouse instruction) corresponds to a single click (touch operation) on the touch device, and the controller 12 converts the keyboard and mouse signals triggered by the right mouse button into a single click (touch operation) on the touch device according to the corresponding relationship stored in the memory 11. Then, the controller 12 outputs the touch operation to the touch device to simulate the click of a finger or a stylus on the touch device.
[0036] Through the correspondence between the mouse instruction stored in the memory of the display and the touch operation, the user can control the touch device through the mouse device inserted on the display, which can omit the setting of the computer host, thereby reducing the cost of the overall computer equipment and increasing the convenience of controlling the touch device to improve the user experience.
[0037] Please refer to Figure 2 and Figure 3 , wherein Figure 3 The block diagram of the display, the mouse device and the touch device according to another embodiment of the present application is shown. As Figure 2 shown, the display 2 includes a memory 21, a controller 22 and a transmission interface 23. The controller 22 is electrically connected to the memory 21, the transmission interface 23 and the mouse device A1. The memory 21, the controller 22 and the mouse device A1 of the display 2 can be the same as the memory 11, the controller 12 and the mouse device A1 of the display 1 of Figure 1 , and details thereof will not be described here.
[0038] The transmission interface 23 can be installed on the shell of the display 2, and the transmission interface 23 can also be a device externally connected to the display 2. The transmission interface 23 is used to connect the touch device A2 to the controller 22, output the touch signal to the touch device A2, and receive the video stream from the touch device A2. The touch device A2 can be the touch device described above, and can include a touchpad, a smart phone, a tablet computer, etc. The controller 22 can output the touch signal to the touch device A2 through the transmission interface 23.
[0039] In addition, Figure 2 The method of controlling the touch device shown can further include that the transmission interface 23 inputs the video stream from the touch device A2 to the display 2, so that the display 2 displays the picture on the touch device A2. In addition, when the transmission interface 23 is connected to the audio playing element A3, Figure 2 The method of controlling the touch device shown can further include that the transmission interface 23 receives the audio stream from the touch device A2, and outputs the audio stream to the audio playing element A3. The audio playing element A3 can include a loudspeaker, a headset, etc., so that the audio of the touch device A2 is played by the audio playing element A3.
[0040] Accordingly, when the touch device is connected to the display, the picture displayed by the touch device can be projected to the display. Moreover, the audio of the touch device can also be output to the audio playing element for playing, so that in the process of the game, the teammate voice and the game sound effect can be synchronously transmitted, achieving the effect of listening to the sound to determine the position and voice communication.
[0041] Please refer to Figure 4 , wherein Figure 4 The flowchart of the key setting method according to an embodiment of the present application is shown. The key setting method is performed by the display 1 asFigure 1 The display shown is 1 or Figure 3 The display 2 shown is executed, and as Figure 4 As shown, the button setting method includes: step S201: receiving a setting instruction specifying the correspondence between multiple keyboard and mouse commands and multiple touch operations of the touch device; and step S203: storing the correspondence. The following uses... Figure 3 The instructions for setting the buttons on monitor 2 are as follows.
[0042] In step S201, the controller 22 receives a setting instruction from the computer or touch device A2, specifying the correspondence between keyboard and mouse commands and touch operations on the touch device A2. For example, the W, S, A, and D keys on the keyboard correspond to the touch coordinates and operations in the up, down, left, and right directions of the lower left corner of the touch device, respectively. In other words, the setting instruction is used to bind keyboard and mouse commands to corresponding touch operations. In step S203, the controller 22 stores the correspondence in its memory.
[0043] Therefore, users can customize the correspondence between keyboard and mouse commands and touch operations, giving users a high degree of freedom and improving the playability of mobile games.
[0044] Please refer to this as well. Figure 3 , Figure 4 and Figure 5 ,in Figure 5 This is a schematic diagram illustrating the application of a display according to an embodiment of the present invention. The display 3 includes a memory 31, a controller 32, and a transmission interface 33. The memory 31 and the controller 32 can be respectively connected to... Figure 1 The memory 11 and controller 12 are the same, so they will not be described in detail here. It should also be noted that... Figure 5 For ease of explanation, the transmission interface 33 is shown as being located outside the display 3. In reality, the transmission interface 33 can be set on the casing of the display 3 or externally connected to the display 3 and connected to the controller 32.
[0045] The transmission interface 33 may include a first sub-interface 33a, a second sub-interface 33b, and a third sub-interface 33c. The first sub-interface 33a can be used to connect the controller 32 of the display 3 to a keyboard and mouse device A1; the second sub-interface 33b can be used to connect the controller 32 of the display 3 to a touch device A2; and the third sub-interface 33c can be used to connect the controller 32 of the display 3 to a computer A4. Each of the first sub-interface 33a, the second sub-interface 33b, and the third sub-interface 33c may include a Universal Serial Bus (USB) hub, wherein the USB hub of each of the first sub-interface 33a, the second sub-interface 33b, and the third sub-interface 33c may be a Type A USB hub, a Type B USB hub, or a Type C USB hub. Furthermore, the third sub-interface 33c may further include a High-Definition Multimedia Interface (HDMI) or DisplayPort connection port.
[0046] At Figure 5 In this embodiment, the display 3 is connected to the computer A4. It should be noted that the computer A4 may have an application with button setting functionality (hereinafter referred to as the "game assistant program"). In the button setting method, the controller 32 may receive setting instructions from the game assistant program, meaning the user can input setting instructions through the game assistant program. Then, the controller 32 stores the corresponding relationship in the memory 31.
[0047] In some embodiments, after the transmission interface 33 is simultaneously connected to both the touch device A2 and the computer A4, and the USB debugging mode of the touch device A2 is activated, a Java Archive (JAR) software package can be pushed from the computer A4 to the touch device A2, allowing the touch device A2 to store and execute the software package. The software package is used to encode (e.g., using the FFmpeg tool) the video stream captured from the touch device A2 and output it to the computer A4. The computer A4 can decode the video stream (e.g., also using the FFmpeg tool) and render the decoded image (e.g., using the OpenGL protocol) to obtain an image, which is then displayed on the screen of the display 3. Therefore, during the button setting method and the method of controlling the touch device, the display 3 can display the screen of the touch device A2.
[0048] Furthermore, the controller 32 can also receive an update instruction from the touch device A2 or the computer A4, and update the corresponding relationship stored in the memory 31 according to the update instruction. The update instruction can indicate to add another corresponding relationship, delete an existing corresponding relationship, or replace the mouse instruction and / or the touch operation. For example, the corresponding relationship can indicate that the right mouse button (mouse instruction) corresponds to the single touch (touch operation) on the touch device, and the update instruction can indicate to replace the mouse instruction of this corresponding relationship with the left mouse button. Here, the update instruction is illustrated by way of example, but the embodiments of the update instruction can also be used in the embodiments of Figure 5 , Figure 1 , Figure 3 and the embodiments described below. Figure 6
[0049] Please refer to Figure 3 , Figure 4 and Figure 6 together, wherein Figure 6 is a schematic diagram of the application of a display according to another embodiment of the present application. The display 4 includes a memory 41, a controller 42, and a transmission interface 43. The memory 41 and the controller 42 can be the same as the memory 11 and the controller 12 of Figure 1 , and thus are not described here. It should be noted that Figure 6 is illustrated as being located outside the display 4 for ease of illustration, and the transmission interface 43 can actually be disposed on the housing of the display 4 or externally connected to the display 4 and connected to the controller 42.
[0050] The transmission interface 43 can include a first sub-interface 43a and a second sub-interface 43b. The first sub-interface 43a can be used to connect the controller 42 of the display 4 to the mouse device A1, and the second sub-interface 43b can be used to connect the controller 42 of the display 4 to the touch device A2. Each of the first sub-interface 43a and the second sub-interface 43b can include a universal serial bus hub, and the universal serial bus hub of each of the first sub-interface 43a and the second sub-interface 43b can be a type-A universal serial bus hub, a type-B universal serial bus hub, or a type-C universal serial bus hub.
[0051] In the embodiments of Figure 6 , in the key setting method, after the transmission interface 43 connects the display 4 to the touch device A2, the controller 42 can receive a setting instruction from the touch device A2, i.e., the user can input the setting instruction on the touch device A2, and the operation of the touch device A2 can be realized by an application installed on the touch device A2. Then, the controller 42 stores the corresponding relationship in the memory 41. In addition, during the key setting method and the method of controlling the touch device, the second sub-interface 43b can transmit the video stream of the touch device A2 to the controller 42, so that the display 4 can display the screen of the touch device A2.
[0052] In Figure 5 and Figure 6 embodiments, the transmission interface can further include another sub-interface for connecting an audio playing element A3 as shown in Figure 3 . The other sub-interface can be a type A universal serial bus hub, a type B universal serial bus hub, or a type C universal serial bus hub. Accordingly, the transmission interface can receive an audio stream from the touch device A2 and output the audio stream to the audio playing element A3 for playing the audio of the touch device A2 by the audio playing element A3.
[0053] In summary, by the correspondence between the mouse and keyboard instructions stored in the memory of the display and the touch operations, the display and the method for controlling the touch device according to one or more embodiments of the present application can be controlled by the mouse and keyboard device plugged into the display, and the setting of the computer host can be omitted, thereby reducing the cost of the overall computer equipment and increasing the convenience of controlling the touch device to improve the user experience. When the touch device is connected to the display, the screen displayed by the touch device can be mirrored to the display. The audio of the touch device can also be output to the audio playing element for playing, so that the teammate voice and game sound effects can be synchronously transmitted during the game, achieving the effect of listening to sound to determine the position and voice communication. According to the key setting method of one or more embodiments of the present application, the user can customize the correspondence between the mouse and keyboard instructions and the touch operations, allowing the user to have high freedom and improving the playability of the mobile game.
[0054] The above description is only the preferred embodiments of the present application, and cannot limit the scope of the present application. Any equivalent changes and modifications made according to the present application should still be within the scope of the present application. The present application can have other various embodiments, and those skilled in the art can make various corresponding changes and modifications according to the present application without departing from the spirit and essence of the present application. However, these corresponding changes and modifications should still be within the protection scope of the claims attached to the present application.
Claims
1. A display, characterized by Comprising: a memory for storing a correspondence between a plurality of keyboard and mouse commands and a plurality of touch operations; and a controller connected to the memory, the controller for receiving a keyboard and mouse signal and for outputting a corresponding touch signal according to the correspondence, the touch signal for controlling a touch device according to the plurality of touch operations.
2. The display of claim 1, wherein, Further comprising: a transmission interface for connecting the touch device to the controller, for outputting the touch signal to the touch device, and for receiving a video stream from the touch device.
3. The display of claim 2, wherein, The transmission interface is further for receiving an audio stream from the touch device and for outputting the audio stream to an audio playback element.
4. The display of claim 1, wherein, The controller is further for receiving an update instruction from the touch device and for updating the correspondence according to the update instruction.
5. The display of claim 1, wherein, The controller is further for receiving an update instruction from a computer and for updating the correspondence according to the update instruction.
6. A key setting method characterized by comprising: For implementation with a display, comprising: receiving a setting instruction specifying a correspondence between a plurality of keyboard and mouse commands and a plurality of touch operations of a touch device; and storing the correspondence.
7. The key setting method of claim 6, wherein The setting instruction is from a computer or the touch device.
8. The key setting method of claim 6, wherein Further comprising: receiving an update instruction; and updating the correspondence according to the update instruction.
9. The key setting method of claim 8, wherein The update instruction is from a computer or the touch device.
10. A method of controlling a touch device, the method comprising: For implementation with a display, comprising: being triggered by a keyboard and mouse signal to generate a corresponding touch operation according to a correspondence between a plurality of keyboard and mouse commands and a plurality of touch operations; and outputting the touch operation to the touch device. 11.The method of claim 10, wherein, Further comprising: receiving a video stream from the touch device; and displaying the video stream. 12.The method of claim 10, wherein, Further comprising: receiving an audio stream from the touch device; and outputting the audio stream to an audio playback element. 13.The method of claim 10, wherein, Further comprising: receiving an update instruction; and updating the correspondence according to the update instruction. 14.The method of claim 13, wherein, The update instruction is from a computer or the touch device.