Game control method and device, and storage medium

Abstract

The application relates to the technical field of human-computer interaction, in particular to a game control method and device and a storage medium. The method is used in a mobile terminal, and the method comprises the following steps: receiving mirror image data sent by a game running device, wherein the mirror image data is used for indicating a first game interface of the game running device; displaying a second game interface according to the mirror image data, wherein the second game interface has a mapping relationship with the first game interface; in the case that a touch event acting on the second game interface is acquired, sending touch parameters corresponding to the touch event to the game running device, wherein the touch parameters are used for instructing the game running device to respond to or not respond to the touch event. According to the embodiment of the application, when the first game interface of the game running device is projected to the mobile terminal, the mobile terminal can realize the control of the game in the game running device through the mirror image control capability, so that the better human-computer interaction effect is ensured.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and in particular to a game control method, device and storage medium. Background Technology

[0002] Gamepad peripherals are a common input device for video games, allowing users to control the game on their device (such as a television) by manipulating buttons on the peripheral. However, due to the differences between video games, gamepad peripherals may not be compatible. Therefore, a universal gamepad peripheral configuration or a method that eliminates the need for gamepad peripherals is needed for game control.

[0003] In related technologies, game assistance applications have emerged that provide game-assisted control functions on mobile terminals. After establishing a connection between the mobile terminal and the game running device, the mobile terminal obtains the game identifier of the game application running on the game running device and displays the game control interface corresponding to that game identifier. When a trigger signal is received on a control of the game control interface, the corresponding control command is determined, such as a control command instructing a virtual object to move to the right. The mobile terminal sends this control command to the game running device, and the game running device controls the virtual object to execute the action corresponding to the control command.

[0004] The above method requires pre-configuration of the game control interface of the game application. If the running game application is not compatible with the pre-configured game control interface or the pre-configured game control interface is not updated in time after the game application is upgraded, the game control will fail. Summary of the Invention

[0005] In view of this, a game control method, device, and storage medium are proposed. This application provides a game control method based on reverse screen mirroring technology. When the current first game interface of the game running device is mirrored to a mobile terminal, the mobile terminal can control the game on the game running device through mirroring control capabilities.

[0006] In a first aspect, embodiments of this application provide a game control method for use in a mobile terminal, the method comprising:

[0007] Receive image data sent by the game running device. The image data is used to indicate the current first game interface of the game running device.

[0008] According to the mirrored data, there is a mapping relationship between the second game interface and the first game interface;

[0009] Upon receiving a touch event that occurs on the second game interface, the touch parameters corresponding to the touch event are sent to the game running device. The touch parameters are used to instruct the game running device to respond to or not respond to the touch event.

[0010] In this implementation, the mobile terminal displays a second game interface based on the mirrored data of the first game interface currently displayed on the game running device. The second game interface and the first game interface are mapped to each other. When a touch event is detected on the second game interface, the touch parameters corresponding to the touch event are sent to the game running device so that the game running device can respond to or not respond to the touch event. That is, when the first game interface currently displayed on the game running device is projected onto the mobile terminal, the mobile terminal can control the game on the game running device through mirrored control capabilities. This avoids the game control failure that may occur due to the pre-configuration of the game control interface in related technologies, and ensures a better human-computer interaction effect.

[0011] In conjunction with the first aspect, in the first possible implementation of the first aspect, upon receiving a touch event acting on the second game interface, the touch parameters corresponding to the touch event are sent to the game running device, including:

[0012] Get touch events that act on the second game interface. The touch events are used to indicate touch actions and the second position information of the touch actions in the second game interface.

[0013] Determine the first position information in the first game interface corresponding to the second position information based on the mapping relationship;

[0014] Touch parameters are sent to the game running device. The touch parameters include the touch action and the first position information of the touch action.

[0015] In this implementation, the mobile terminal acquires touch events acting on the second game interface, determines the first position information in the first game interface corresponding to the second position information indicated by the touch event according to the mapping relationship, and sends touch parameters including touch action and the first position information of the touch action to the game running device. This control method can avoid the problem of whether the game itself is compatible with the game controller. The mobile terminal only needs to transmit position information and touch action to complete the control of the game, which improves the universality of game control.

[0016] In conjunction with the first aspect, in the second possible implementation of the first aspect, after receiving a touch event acting on the second game interface and sending the touch parameters corresponding to the touch event to the game running device, it further includes:

[0017] When the number of touch events acquired reaches a first preset threshold, a control panel is generated. The control panel is used to indicate hotspot locations, which are locations where the number of corresponding touch events exceeds a second preset threshold.

[0018] In this implementation, a new method for generating game control panels is proposed based on reverse screen projection control technology. The mobile terminal actively collects touch events and automatically generates the control panel through hotspot locations. This eliminates the need for customized design of control panels for various games, further improving the universality of game control. It also eliminates the need for application version modification and upgrades to control upgraded games, reducing the functional unavailability caused by differences in game version upgrades.

[0019] In conjunction with the first aspect, the third possible implementation of the first aspect, after displaying the second game interface based on the mirrored data, also includes:

[0020] When the command to activate the panel training mode is received, the second game interface will be switched to display as the data acquisition interface.

[0021] Acquire at least one touch event acting on the data acquisition interface and the second position corresponding to at least one touch event;

[0022] When the end command of the panel training mode is received, the control panel is generated based on at least one touch event and at least one second position corresponding to the touch event.

[0023] In this implementation, a new method for generating the game control panel is proposed based on the reverse screen projection control technology. That is, the mobile terminal generates the control panel in the panel training mode according to at least one touch event and at least one second position corresponding to the touch event, realizing the custom configuration of the control panel and further improving the flexibility of game control.

[0024] In conjunction with the second or third possible implementation of the first aspect, the fourth possible implementation of the first aspect further includes:

[0025] After generating the control panel, switch the current user interface to display the control panel; or,

[0026] Display the control panel switching entry on the current user interface. When a trigger command is received that acts on the switching entry, switch the current user interface to display the control panel.

[0027] In this implementation, after the mobile terminal generates the control panel, the current user interface is switched to display as the control panel directly or according to a preset trigger command, stopping the recording and forwarding capabilities of the game running device, reducing the probability of game lag and / or frame drops, and further ensuring a better human-computer interaction effect.

[0028] In conjunction with the first aspect, in the fifth possible implementation of the first aspect, the method further includes:

[0029] Display custom-configured function icons and / or background images on the control panel;

[0030] When a drag command is received that applies to a function icon, the function icon is dragged and displayed at the specified location on the control panel according to the drag command; and / or,

[0031] When a trigger command is received that applies to the background image, the panel background of the control panel will be displayed as the background image.

[0032] In this implementation, the mobile terminal displays custom-configured function icons and / or background images on the control panel. According to preset instructions, the function icons can be dragged and displayed at a specified position on the control panel, or the panel background of the control panel can be displayed as a background image, thereby realizing the customization of the control panel and further improving the flexibility of game control.

[0033] Secondly, embodiments of this application provide a game control method for use in a game running device, the method comprising:

[0034] Send mirror data to the mobile terminal; the mirror data is used to indicate the current first game screen on the device running the game.

[0035] The system will respond to or not respond to touch events based on the touch parameters corresponding to the touch events sent by the mobile terminal.

[0036] In conjunction with the second aspect, in the first possible implementation of the second aspect, the touch parameters include the touch action and the first position information of the touch action in the first game interface.

[0037] Thirdly, embodiments of this application provide a game control device, which includes at least one unit for implementing the game control method provided in the first aspect or any possible implementation of the first aspect.

[0038] Fourthly, embodiments of this application provide a game control device, which includes at least one unit for implementing the game control method provided in the second aspect or any possible implementation of the second aspect.

[0039] Fifthly, embodiments of this application provide a game control device, the device comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the game control method provided by the first aspect or any possible implementation thereof when executing the instructions.

[0040] In a sixth aspect, embodiments of this application provide a game control device, the device comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the game control method provided by the second aspect or any possible implementation thereof when executing the instructions.

[0041] In a seventh aspect, embodiments of this application provide a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in an electronic device, the processor in the electronic device executes the game control method provided by the first aspect or any possible implementation thereof.

[0042] Eighthly, embodiments of this application provide a computer program product including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in an electronic device, the processor in the electronic device executes the game control method provided by the second aspect or any possible implementation thereof.

[0043] Ninthly, embodiments of this application provide a non-volatile computer-readable storage medium storing computer program instructions thereon, which, when executed by a processor, implement the game control method provided by the first aspect or any possible implementation of the first aspect.

[0044] In a tenth aspect, embodiments of this application provide a non-volatile computer-readable storage medium storing computer program instructions thereon, which, when executed by a processor, implement the game control method provided by the second aspect or any possible implementation thereof. Attached Figure Description

[0045] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this application together with the specification and serve to explain the principles of this application.

[0046] Figure 1 A schematic diagram of the structure of a game control system according to an embodiment of this application is shown.

[0047] Figure 2A flowchart of a game control method provided in an exemplary embodiment of this application is shown.

[0048] Figure 3 A flowchart of a game control method provided by another exemplary embodiment of this application is shown.

[0049] Figure 4 A schematic diagram of the interface involved in the game control method provided by an exemplary embodiment of this application is shown.

[0050] Figure 5 A schematic diagram of the interface involved in the game control method provided by another exemplary embodiment of this application is shown.

[0051] Figure 6 A schematic diagram of the interface involved in the game control method provided by another exemplary embodiment of this application is shown.

[0052] Figure 7 A block diagram of a game control device provided in an exemplary embodiment of this application is shown.

[0053] Figure 8 A block diagram of a game control device provided in another exemplary embodiment of this application is shown.

[0054] Figure 9 A schematic diagram of the structure of a mobile terminal provided in one embodiment of this application is shown.

[0055] Figure 10 A schematic diagram of the structure of a game running device provided in one embodiment of this application is shown. Detailed Implementation

[0056] Various exemplary embodiments, features, and aspects of this application will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0057] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0058] Furthermore, to better illustrate this application, numerous specific details are provided in the following detailed embodiments. Those skilled in the art should understand that this application can be implemented without certain specific details. In some instances, methods, means, components, and circuits well-known to those skilled in the art have not been described in detail in order to highlight the main points of this application.

[0059] Please refer to Figure 1The diagram illustrates a structural schematic of a game control system according to an embodiment of this application. The game control system includes a game running device 120 and a mobile terminal 140.

[0060] The game running device 120, also known as a home media playback device, is an electronic device capable of running game applications, such as a smart TV, TV box, or projector. The game application can be a downloadable and installable application or an instant-play application; this embodiment does not limit the specific application.

[0061] A communication connection can be established between the game running device 120 and the mobile terminal 140, which can be a wired network or a wireless network.

[0062] The mobile terminal 140 has a game assistance application installed. The mobile terminal 140 is used to establish a connection with the game running device 120 through the game assistance application and to exchange data. The game assistance application is an application with game assistance control functions.

[0063] Mobile terminal 140 has a touch screen and is used to collect touch signals from the touch screen. For example, mobile terminal 140 is a mobile phone.

[0064] The following describes the game control method provided in the embodiments of this application using several exemplary models.

[0065] Please refer to Figure 2 It illustrates a flowchart of a game control method provided in an exemplary embodiment of this application, the method being used for Figure 1 The game control system shown includes, but is not limited to, the following steps.

[0066] Step 201: The game running device sends mirror data to the mobile terminal. The mirror data is used to indicate the current first game interface of the game running device.

[0067] The game running device displays the first game interface of the game application and sends mirror data of this first game interface to the mobile terminal. The first game interface is the game interface displayed in the game application currently running on the game running device.

[0068] Optionally, after receiving a mirror channel establishment request from the mobile terminal or after launching the game application and displaying the first game interface, the game running device obtains the mirror data of the current first game interface and sends the mirror data to the mobile terminal. The mirror data is used to indicate the current first game interface of the game running device.

[0069] Optionally, the game running device sends the mirror data of the current first game interface to the mobile terminal in real time, at preset time intervals, or when the first game interface is switched.

[0070] The preset time interval can be a default setting or a custom setting. This application does not limit this.

[0071] Step 202: The mobile terminal displays the second game interface based on the mirrored data. The second game interface has a mapping relationship with the first game interface.

[0072] The mobile terminal receives mirror data of the first game interface sent by the game running device, and displays a second game interface in the game assistance application based on the mirror data. The second game interface is a second game interface displayed in the mobile terminal's game assistance application that has a mapping relationship with the first game interface.

[0073] There is a mapping relationship between the second game interface and the first game interface, that is, the content displayed on the second game interface is the same as and synchronized with the content displayed on the first game interface. This mapping relationship includes the correspondence between the position information of each of the multiple functional controls in the first game interface and the position information of each of the multiple functional controls in the second game interface.

[0074] The functional control is an operable control; optionally, the type of functional control includes at least one of buttons, operable items, and sliders. Optionally, the position information is a relative coordinate position.

[0075] Step 203: When the mobile terminal receives a touch event that acts on the second game interface, it sends the touch parameters corresponding to the touch event to the game running device.

[0076] After the mobile terminal acquires a touch event on the second game interface that is being used by the game assistance application, it sends the touch parameters corresponding to the touch event to the game running device. This sending is also known as pass-through.

[0077] The touch parameter is used to indicate whether the device running the game responds to touch events or not.

[0078] Optionally, the touch event is used to indicate a touch action and a second position information of the touch action in the second game interface. The touch parameters corresponding to the touch event include the touch action and the first position information of the touch action in the first game interface.

[0079] Optionally, the second game interface displays multiple functional controls. It should be noted that the mobile terminal does not need to know the function information corresponding to each of the multiple functional controls; it only needs to transmit the touch parameters corresponding to the touch event (such as the touch action and the first position information of the touch action in the first game interface) to complete the game control.

[0080] Step 204: The game running device responds to or does not respond to the touch event based on the touch parameters corresponding to the touch event sent by the mobile terminal.

[0081] The game running device receives touch parameters corresponding to touch events sent by the mobile terminal, and responds to or does not respond to the touch events based on the touch parameters.

[0082] Optionally, the touch parameters corresponding to the touch event include the touch action and the first position information of the touch action in the first game interface. The game running device searches for the control command corresponding to the touch action and the first position information according to a preset correspondence. The control command is used to control the virtual object to perform the corresponding action. The preset correspondence includes the correspondence between the touch action, the first position information, and the control command.

[0083] When the game running device finds a control command corresponding to the touch action and the first position information, it indicates that the touch event is valid, and responds to the touch event to control the virtual object to perform the corresponding action; when the game running device does not find a control command corresponding to the touch action and the first position information, it indicates that the touch event is invalid, and does not respond to the touch event.

[0084] In this context, a virtual object refers to an object on the current first game interface of the game-running device. For example, a virtual object can be a virtual character or a virtual item. This application does not limit this specific instance.

[0085] In summary, this embodiment of the application displays a second game interface by a mobile terminal based on the mirror data of the current first game interface of the game running device, and the second game interface has a mapping relationship with the first game interface; when a touch event is obtained acting on the second game interface, the touch parameters corresponding to the touch event are sent to the game running device so that the game running device responds or does not respond to the touch event; that is, when the current first game interface of the game running device is projected onto the mobile terminal, the mobile terminal can control the game in the game running device through mirror control capability, avoiding the game control failure that may be caused by pre-configuring the game control interface in related technologies, and ensuring a better human-computer interaction effect.

[0086] Please refer to Figure 3 It illustrates a flowchart of a game control method provided in another exemplary embodiment of this application, which is used for Figure 1The game control system shown includes, but is not limited to, the following steps.

[0087] Step 301: The mobile terminal sends a mirror channel establishment request to the game running device.

[0088] When the game assistance application on the mobile terminal is running in the foreground, it sends a mirror channel establishment request to the game running device. The mirror channel establishment request is used to request the establishment of a mirror channel between the mobile terminal and the game running device. This mirror channel is used to transmit mirror data sent by the game running device.

[0089] Step 302: The game running device sends mirror data to the mobile terminal. The mirror data is used to indicate the current first game interface of the game running device.

[0090] The game running device receives a mirror channel establishment request, establishes a mirror channel with the mobile terminal, and sends mirror data of the first game interface to the mobile terminal through the mirror channel.

[0091] Optionally, the game running device sends a mirror image of the current first game interface to the mobile terminal in real time.

[0092] It should be noted that the process of the game running device sending mirror data to the mobile terminal can be compared with the relevant details in the above embodiments, and will not be repeated here.

[0093] Step 303: The mobile terminal displays the second game interface based on the mirrored data. The second game interface has a mapping relationship with the first game interface.

[0094] The mobile terminal receives mirror data of the first game interface sent by the game running device through a game assistance application, and displays a second game interface that is mapped to the first game interface in the game assistance application based on the mirror data.

[0095] It should be noted that the process of the mobile terminal displaying the second game interface based on the mirrored data can be compared with the relevant details in the above embodiments, and will not be repeated here.

[0096] Step 304: The mobile terminal acquires touch events acting on the second game interface. The touch events are used to indicate touch actions and the second position information of the touch actions in the second game interface.

[0097] The mobile terminal acquires touch events on a second game interface that are applied to the game assistance application. These touch events indicate touch actions and their second location information within the second game interface.

[0098] Touch actions are actions that correspond to user operation signals. For example, touch actions include any one or more combinations of tap, swipe, press, and long press.

[0099] Step 305: The mobile terminal determines the first location information in the first game interface corresponding to the second location information based on the mapping relationship.

[0100] The mobile terminal stores a mapping relationship between a first game interface and a second game interface. This mapping relationship includes the correspondence between the positional information of multiple functional controls in the first game interface and the positional information of multiple functional controls in the second game interface.

[0101] The mobile terminal determines the first location information in the first game interface corresponding to the second location information based on the mapping relationship.

[0102] Step 306: The mobile terminal sends the touch parameters to the game running device. The touch parameters include the touch action and the first position information of the touch action.

[0103] The mobile terminal sends touch parameters to the game running device through a game assistance application. The touch parameters include the touch action and the first position information of the touch action.

[0104] Step 307: The game running device responds to or does not respond to the touch event based on the touch parameters corresponding to the received touch event.

[0105] The game running device responds to or does not respond to touch events based on the touch action corresponding to the received touch event and the first position information of the touch action in the first game interface.

[0106] It should be noted that the process by which the game running device responds to or does not respond to touch events based on the touch parameters corresponding to the received touch events can be compared with the relevant details in the above embodiments, and will not be repeated here.

[0107] Step 308: When the number of touch events acquired by the mobile terminal reaches a first preset threshold, a control panel is generated. The control panel is used to indicate the hotspot location.

[0108] The control panel is used to indicate one or more hotspot locations, where the number of corresponding touch events is greater than a second preset threshold.

[0109] Optionally, the control panel includes at least one functional control at a hotspot location. The functional control is an operable control; illustratively, the type of functional control includes at least one of buttons, operable items, and sliders.

[0110] When a mobile terminal controls a game via mirroring, it actively collects touch events. When the number of acquired touch events reaches a first preset threshold, the mobile terminal analyzes these events, generates a mapping table between hotspot locations and touch actions, creates a control panel configuration file based on the mapping table, and then generates the control panel based on this configuration file. Hotspot locations are those where the number of touch events exceeds a second preset threshold.

[0111] Wherein, the second preset threshold is less than the first preset threshold, and the first or second preset threshold is a default setting or a custom setting. This application embodiment does not limit this.

[0112] Optionally, the control panel configuration file is an Extensible Markup Language (XML) file for the control panel interface.

[0113] The control panel can be generated based on the aforementioned hotspot locations or it can be generated based on user-defined settings. In one possible implementation, when the mobile terminal receives an instruction to start the panel training mode, it switches the second game interface to display as a data acquisition interface; it acquires at least one touch event acting on the data acquisition interface and the second position corresponding to the at least one touch event; when it receives an instruction to end the panel training mode, it generates the control panel based on the at least one touch event and the second position corresponding to the at least one touch event.

[0114] The control panel is used to indicate a second location corresponding to at least one touch event. Optionally, the control panel includes function controls at at least one second location corresponding to a touch event.

[0115] When the mobile terminal controls the game via mirroring, it will activate the panel training mode and switch the second game interface to display as the data acquisition interface when it receives the command to activate the panel training mode.

[0116] The activation command can be a touch signal applied to the data acquisition activation control on the second game interface. The activation command can also be implemented via voice. This application does not limit this approach.

[0117] Optionally, the data acquisition interface is an interface that overlays a prompt message and a data acquisition completion control on the second game interface. The prompt message is used to indicate the start of data acquisition.

[0118] Optionally, when the mobile terminal receives the end command of the panel training mode, it generates a control panel configuration file based on at least one touch event and at least one second position corresponding to the touch event, and generates a control panel based on the control panel configuration file.

[0119] The termination command can be a touch signal applied to the data acquisition termination control on the data acquisition interface, a touch signal applied to the data acquisition interface itself, or it can be implemented via voice. This application does not limit this specific to any particular method.

[0120] Among them, the aforementioned functional controls (such as data acquisition start control or data acquisition end control) are operable controls. Optionally, the types of functional controls include at least one of buttons, operable items, and sliders.

[0121] In an illustrative example, such as Figure 4 As shown, when the mobile terminal receives the command to start the panel training mode, it starts the panel training mode and switches the second game interface to display the data acquisition interface 41. The data acquisition interface 41 displays a prompt message 42 and a "Complete" button 43. The prompt message 42 states: Please click the corresponding position on the screen to collect data. Double-click the screen or click the "Complete" button to complete the collection. The mobile terminal acquires at least one touch event acting on the data acquisition interface 41 and the second position corresponding to the at least one touch event. When the mobile terminal acquires a double-click signal acting on the data acquisition interface 41 or a click signal acting on the "Complete" button 43, it generates a control panel based on the at least one touch event and the second position corresponding to the at least one touch event.

[0122] Optionally, after generating the control panel, the mobile terminal switches the data acquisition interface back to display the second game interface, and displays the control panel switching entry on the second game interface. Alternatively, after generating the control panel, the mobile terminal directly switches the data acquisition interface to display the control panel. Alternatively, after generating the control panel, the mobile terminal displays the control panel switching entry and / or the second game interface switching entry on the data acquisition interface. This application embodiment does not limit this to any particular approach.

[0123] Step 309: The mobile terminal displays the control panel.

[0124] Optionally, the mobile terminal displays the control panel via a game-assisted application.

[0125] Optionally, after the control panel is generated on the mobile terminal, the generated control panel is invoked, the recording and forwarding capabilities of the game running device are stopped, the probability of game lag and / or frame drops is reduced, while the pass-through capability of touch parameters is retained.

[0126] The mobile terminal displays a control panel, including but not limited to the following possible implementation methods.

[0127] In one possible implementation, after generating the control panel, the mobile terminal switches the current user interface to display the control panel.

[0128] That is, after the mobile terminal generates the control panel, it directly switches the current user interface to display as the control panel, where the current user interface is either the second game interface or the data collection interface.

[0129] In another possible implementation, the mobile terminal displays the switching entry of the control panel on the current user interface, and when a trigger command is received that acts on the switching entry, the current user interface is switched to display the control panel.

[0130] Optionally, the mobile terminal displays the switching entry of the control panel on the current user interface, and when a trigger command is received that acts on the switching entry, the current user interface is switched to display the control panel.

[0131] The trigger command applied to the switching entry can be a touch signal applied to the switching entry, or it can be implemented via voice. This application does not limit this aspect.

[0132] In an illustrative example, such as Figure 5 As shown, after the mobile terminal sends a mirror channel establishment request to the game running device through the game auxiliary application, it receives the mirror data of the first game interface sent in real time by the game running device. Based on the mirror data, it synchronously displays the second game interface corresponding to the first game interface. The mobile terminal actively collects touch events acting on the second game interface through the game auxiliary application and sends the touch parameters corresponding to the touch events to the game running device. When the number of touch events acquired by the mobile terminal reaches a first preset threshold, a control panel configuration file for control panel 51 is generated, and a switching entry 52 is displayed on the sidebar of the second game interface. When a click signal acting on the switching entry 52 is obtained, the second game interface is switched to display as control panel 51 according to the control panel configuration file. The control panel 51 includes function controls 53 at multiple hotspot locations.

[0133] Step 310: The mobile terminal customizes the control panel configuration.

[0134] Optionally, the mobile terminal displays custom-configured function icons and / or background images on the control panel; when a drag command is received that applies to a function icon, the function icon is dragged and displayed at a specified position on the control panel according to the drag command; and / or, when a trigger command is received that applies to a background image, the panel background of the control panel is displayed as the background image.

[0135] Optionally, when the mobile terminal receives a configuration trigger command applied to the control panel, a sidebar is displayed on the control panel, and custom configuration parameters are displayed in the sidebar. The custom configuration parameters include at least one function icon and / or at least one background image.

[0136] Optionally, function icons are used to indicate the customization of the type, location, and style of function controls in the control panel.

[0137] The configuration trigger command can be a touch signal acting on a custom configuration control on the control panel, a preset sliding signal, or it can be implemented via voice. This application does not limit this specific to any particular configuration.

[0138] The trigger command applied to the background image can be a touch signal applied to the background image, or it can be implemented through voice. This application does not limit this aspect.

[0139] In an illustrative example, such as Figure 6 As shown, after generating the control panel 61, the mobile terminal switches the second game interface 62 to display the control panel 61. The control panel 61 includes function controls 63 at multiple hotspot locations and custom configuration controls 64. When a click signal is received on a custom configuration control 64 of the control panel 61, a sidebar 65 is displayed on the control panel 61. Custom configuration parameters are displayed in the sidebar 65, including at least one function icon and / or at least one background image. The control panel 61 is customized based on the touch signal corresponding to at least one custom configuration parameter.

[0140] In summary, the game control method provided in this application, on one hand, allows the mobile terminal to control the game on the running device when the second game interface of the game running device is projected onto the mobile terminal via mirroring control capabilities. This control method avoids the issue of whether the game itself is compatible with a game controller; the mobile terminal only needs to transmit location information and touch actions to control the game, improving the versatility of game control. On the other hand, based on reverse projection control technology, a new method for generating game control panels is proposed. The mobile terminal actively collects touch events from the game auxiliary application and automatically generates the control panel based on hotspot locations. This eliminates the need for customized design of control panels for various games, improving the versatility of game control. Furthermore, it eliminates the need to modify or upgrade the application version of the game auxiliary application to control the upgraded game, reducing the functional unavailability caused by differences in game version upgrades.

[0141] Please refer to Figure 7 The diagram illustrates a block diagram of a game control device provided in an exemplary embodiment of this application. This game control device can be implemented using software, hardware, or a combination of both. Figure 1 The mobile terminal shown may be all or part of it. The game control device may include: a receiving unit 710, a display unit 720, and a sending unit 730.

[0142] The receiving unit 710 is used to receive mirror data sent by the game running device, and the mirror data is used to indicate the current first game interface of the game running device;

[0143] Display unit 720 is used to display the second game interface according to the mirrored data, and the second game interface has a mapping relationship with the first game interface;

[0144] The sending unit 730 is used to send the touch parameters corresponding to the touch event to the game running device when a touch event is obtained on the second game interface. The touch parameters are used to instruct the game running device to respond to or not respond to the touch event.

[0145] In one possible implementation, the transmitting unit 730 is further configured to:

[0146] Get touch events that act on the second game interface. The touch events are used to indicate touch actions and the second position information of the touch actions in the second game interface.

[0147] Determine the first position information in the first game interface corresponding to the second position information based on the mapping relationship;

[0148] Touch parameters are sent to the game running device. The touch parameters include the touch action and the first position information of the touch action.

[0149] In another possible implementation, the apparatus further includes: a first generating unit; the first generating unit is configured to:

[0150] When the number of touch events acquired reaches a first preset threshold, a control panel is generated. The control panel is used to indicate hotspot locations, which are locations where the number of corresponding touch events exceeds a second preset threshold.

[0151] In another possible implementation, the apparatus further includes: a second generating unit; the second generating unit is configured to:

[0152] When the command to activate the panel training mode is received, the second game interface will be switched to display as the data acquisition interface.

[0153] Acquire at least one touch event acting on the data acquisition interface and the second position corresponding to at least one touch event;

[0154] When the end command of the panel training mode is received, the control panel is generated based on at least one touch event and at least one second position corresponding to the touch event.

[0155] In another possible implementation, the device further includes: a switching display unit; the switching display unit is used for:

[0156] After generating the control panel, switch the current user interface to display the control panel; or,

[0157] Display the control panel switching entry on the current user interface. When a trigger command is received that acts on the switching entry, switch the current user interface to display the control panel.

[0158] In another possible implementation, the device further includes: a custom configuration unit; the custom configuration unit is used for:

[0159] Display custom-configured function icons and / or background images on the control panel;

[0160] When a drag command is received that applies to a function icon, the function icon is dragged and displayed at the specified location on the control panel according to the drag command; and / or,

[0161] When a trigger command is received that applies to the background image, the panel background of the control panel will be displayed as the background image.

[0162] It should be noted that the above embodiments only illustrate the division of the above functional modules when implementing the device. In actual applications, the above functions can be assigned to different functional modules according to actual needs, that is, the content structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0163] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0164] Please refer to Figure 8 This illustration shows a block diagram of a game control device provided in another exemplary embodiment of this application. The game control device can be implemented through software, hardware, or a combination of both. Figure 1 The game operating device shown may be all or part of the device. The game control device may include: a sending unit 810 and a processing unit 820.

[0165] The sending unit 810 is used to send mirror data to the mobile terminal. The mirror data is used to indicate the current first game interface of the game running device.

[0166] The processing unit 820 is used to respond to or not respond to the touch event based on the touch parameters corresponding to the touch event sent by the mobile terminal.

[0167] In one possible implementation, the touch parameters include the touch action and the first position information of the touch action in the first game interface.

[0168] It should be noted that the above embodiments only illustrate the division of the above functional modules when implementing the device. In actual applications, the above functions can be assigned to different functional modules according to actual needs, that is, the content structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0169] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0170] Please refer to Figure 9 The diagram illustrates the structure of a mobile terminal according to an embodiment of this application. The mobile terminal includes a central processing unit (CPU) 910, a memory 920, and a network interface 930.

[0171] The central processing unit 910 includes one or more processing cores. The central processing unit 910 is used to execute various functional applications of the mobile terminal and to perform data processing.

[0172] Mobile terminals typically include multiple network interfaces 930.

[0173] The memory 920 is connected to the central processing unit 910 via a bus. The memory 920 is used to store instructions, and the processor 910 implements the game control method described above by the mobile terminal by executing the instructions stored in the memory 920.

[0174] The memory 920 can store the operating system 921 and application modules 922 required for at least one function. The operating system 921 includes at least one of the following: LINUX, Unix, and Windows.

[0175] Optionally, the application module 922 includes a receiving unit, a display unit, a sending unit, and other units for implementing the above-described game control method.

[0176] The receiving unit is used to receive image data sent by the game running device. The image data is used to indicate the current first game interface of the game running device.

[0177] The display unit is used to display the second game interface based on the mirrored data. The second game interface has a mapping relationship with the first game interface.

[0178] The sending unit is used to send the touch parameters corresponding to the touch event to the game running device when a touch event is received on the second game interface. The touch parameters are used to instruct the game running device to respond to or not respond to the touch event.

[0179] Optionally, the memory 920 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0180] Please refer to Figure 10 The diagram illustrates the structure of a game running device according to an embodiment of this application. The game running device includes a central processing unit 1010, a memory 1020, and a network interface 1030.

[0181] The central processing unit 1010 includes one or more processing cores. The central processing unit 1010 is used to execute various functional applications of the game running device and to perform data processing.

[0182] Game running devices typically include multiple network interfaces 1030.

[0183] The memory 1020 is connected to the central processing unit 1010 via a bus. The memory 1020 is used to store instructions, and the processor 1010 implements the game control method executed by the game running device by executing the instructions stored in the memory 1020.

[0184] The memory 1020 can store the operating system 1021 and application modules 1022 required for at least one function. The operating system 1021 includes at least one of the following: LINUX, Unix, and Windows operating systems.

[0185] Optionally, the application module 1022 includes a sending unit, a processing unit, and other units for implementing the above-described game control method.

[0186] The sending unit is used to send image data to the mobile terminal. The image data is used to indicate the current first game interface of the game running device.

[0187] The processing unit is used to respond to or not respond to the touch event based on the touch parameters corresponding to the touch event sent by the mobile terminal.

[0188] Optionally, the memory 1020 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0189] An embodiment of this application provides a mobile terminal, which includes: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute instructions to implement the method executed on the mobile terminal side.

[0190] An embodiment of this application provides a game running device, which includes: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute instructions to implement the above-described game running device-side execution method.

[0191] Embodiments of this application provide a computer program product including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in a processor of an electronic device, the processor in the electronic device performs the above-described method.

[0192] Embodiments of this application provide a non-volatile computer-readable storage medium storing computer program instructions thereon, which, when executed by a processor, implement the above-described method.

[0193] Computer-readable storage media can be tangible devices that hold and store instructions for use by an instruction execution device. Examples of computer-readable storage media include, but are not limited to: electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), electrically programmable read-only memory (EPROM or flash memory), static random-access memory (SRAM), compact disc read-only memory (CD-ROM), digital video disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof.

[0194] The computer-readable program instructions or code described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0195] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as "C" or similar languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from computer-readable program instructions. These electronic circuits can execute computer-readable program instructions to implement various aspects of this application.

[0196] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0197] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0198] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0199] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved.

[0200] It should also be noted that each block in the block diagram and / or flowchart, as well as combinations of blocks in the block diagram and / or flowchart, can be implemented using hardware (such as circuits or ASICs (Application Specific Integrated Circuits)) that performs the corresponding function or action, or using a combination of hardware and software, such as firmware.

[0201] Although this application has been described herein in conjunction with various embodiments, those skilled in the art, by reviewing the accompanying drawings, disclosure, and appended claims, will understand and implement other variations of the disclosed embodiments in carrying out the claimed application. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple instances. A single processor or other unit can implement several functions listed in the claims. While different dependent claims may recite certain measures, this does not mean that these measures cannot be combined to produce good results.

[0202] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A game control method, characterized in that, For use in mobile terminals, the method includes: Receive image data sent by the game running device, the image data being used to indicate the current first game interface of the game running device; The second game interface is displayed according to the mirrored data. The second game interface is mapped to the first game interface. The content displayed on the second game interface is the same as and synchronized with the content displayed on the first game interface, so as to project the current first game interface of the game running device to the mobile terminal. Upon receiving a touch event acting on the second game interface, the touch parameters corresponding to the touch event are sent to the game running device. The touch parameters are used to instruct the game running device to respond to or not respond to the touch event. The touch parameters include the touch action and the first position information of the touch action in the first game interface. When the number of touch events acquired reaches a first preset threshold, a control panel is generated. The control panel is used to indicate hotspot locations, where the number of touch events is greater than a second preset threshold.

2. The method according to claim 1, characterized in that, The step of sending the touch parameters corresponding to the touch event to the game running device when a touch event is received on the second game interface includes: The touch event acting on the second game interface is acquired, and the touch event is used to indicate the touch action and the second position information of the touch action in the second game interface; Determine the first location information in the first game interface corresponding to the second location information based on the mapping relationship; The touch parameters are sent to the game running device.

3. The method according to claim 1, characterized in that, After displaying the second game interface based on the mirrored data, the process further includes: When the command to start the panel training mode is received, the second game interface will be switched to display as the data acquisition interface; Acquire at least one touch event acting on the data acquisition interface and at least one second position corresponding to the touch event; When the end command of the panel training mode is received, a control panel is generated based on at least one touch event and the second position corresponding to at least one touch event.

4. The method according to claim 3, characterized in that, The method further includes: After generating the control panel, switch the current user interface to display the control panel; or, The switching entry for the control panel is displayed on the current user interface. When a trigger command is received that acts on the switching entry, the current user interface is switched to display the control panel.

5. The method according to claim 1, characterized in that, The method further includes: The control panel displays custom-configured function icons and / or background images; When a drag command is received that applies to the function icon, the function icon is dragged and displayed at a specified position on the control panel according to the drag command; and / or, When a trigger command is received that applies to the background image, the background of the control panel is displayed as the background image.

6. A game control method, characterized in that, For use in a game running device, the method includes: The system sends mirror data to a mobile terminal, the mirror data being used to indicate the current first game interface of the game running device; wherein, the mobile terminal displays a second game interface based on the mirror data, the second game interface having a mapping relationship with the first game interface, and the displayed content on the second game interface being the same as and synchronized with the displayed content on the first game interface, so as to realize the projection of the current first game interface of the game running device onto the mobile terminal; Based on the touch parameters corresponding to the touch event sent by the mobile terminal that acts on the second game interface, the system responds to or does not respond to the touch event. The touch parameters include the touch action and the first position information of the touch action in the first game interface. When the number of touch events acquired by the mobile terminal reaches a first preset threshold, a control panel is generated. The control panel is used to indicate hotspot locations, where the number of touch events is greater than a second preset threshold.

7. A game control device, characterized in that, The device includes: processor; Memory used to store processor-executable instructions; The processor is configured to implement the method of any one of claims 1-5, or the method of claim 6, when executing the instructions.

8. A non-volatile computer-readable storage medium storing computer program instructions thereon, characterized in that, When the computer program instructions are executed by the processor, they implement the method of any one of claims 1-5, or the method of claim 6.

Images