Interactive control method and device, electronic device and computer-readable storage medium

Abstract

The present disclosure is about an interactive control method and device, equipment and medium, and relates to the field of game interactive control technology, which can be applied to the scene where game users perform interactive control of equipment. The interactive control method includes: displaying a first graphical user interface through a first user terminal, displaying at least part of the game screen displayed by a second user terminal in the first graphical user interface, and the second user terminal is the current control terminal of the target game; displaying an operation test guide through the first graphical user interface to guide the user of the first user terminal to perform an operation test; in response to receiving a target operation corresponding to the operation test guide, determining that the first user terminal has passed the operation test; switching the control terminal of the target game from the second user terminal to the first user terminal, and controlling the execution of the operation of the target game through the control instructions triggered by the first user terminal. The present disclosure provides an interactive method for real-time device handover control between game users.

Description

Background Art

[0002] During the game, a game user may sometimes request other game users to remotely control their game devices to complete the game. For example, game user A may send a remote control request to game user B so that game user B can remotely operate the current game.

[0003] In particular, cloud gaming is a gaming method based on cloud computing. In the cloud gaming operation mode, the storage, calculation and rendering of the content are transferred to the cloud, and the real-time game screen after rendering is compressed and transmitted to the terminal in the form of streaming through the network for display.

[0004] In the cloud gaming scenario, all players' real-time data is calculated in the cloud and then returned to their respective terminals for display. Therefore, when processing in the cloud, the current data of all players can be synchronized in real time. For players, it is possible to obtain the status of others in real time on the terminal display, and even to follow their operations.

[0005] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0006] The purpose of the present disclosure is to provide an interactive control method, an interactive control device, an electronic device and a computer-readable storage medium, thereby overcoming the problem that different users cannot quickly perform real-time interactive control of devices during a game, at least to a certain extent.

[0007] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by the practice of the present invention.

[0008] According to a first aspect of the present disclosure, an interactive control method is provided, wherein a first graphical user interface is displayed through a first user terminal, and at least a portion of a game screen displayed by a second user terminal is displayed in the first graphical user interface, the second user terminal being the current control terminal of a target game; an operation test guide is displayed through the first graphical user interface to guide a user of the first user terminal to perform an operation test based on at least a portion of the screen; in response to receiving a target operation corresponding to the operation test guide, it is determined that the first user terminal has passed the operation test; the control terminal of the target game is switched from the second user terminal to the first user terminal, and the operation for the target game is executed by controlling the control instruction triggered by the first user terminal.

[0009] Optionally, displaying at least a portion of a game screen displayed by a second user terminal in a first graphical user interface includes: receiving screen data corresponding to the game screen displayed by the second user terminal, wherein the game screen includes a game interface and a game scene screen, and the screen data includes at least one of the following data: game interface data corresponding to the game interface, and game scene screen data corresponding to the game scene screen; and displaying the game interface and / or game scene screen corresponding to the screen data in the first graphical user interface.

[0010] Optionally, an operation test guide is displayed through the first graphical user interface, including: providing an image to be matched through the first graphical user interface, and displaying the image to be matched in layers with a game interface and / or a game scene screen; and determining a display position of at least one of the image to be matched, the game interface, and the game scene screen in the first graphical user interface by a control operation received by the first user terminal.

[0011] Optionally, in response to receiving a target operation corresponding to the operation test instructions, determining that the first user terminal has passed the operation test includes: receiving a target operation that controls the image to be matched to overlap with the game interface and / or the game scene screen; in response to the image to be matched overlapping with the game interface and / or the game scene screen, determining that the first user terminal has passed the operation test.

[0012] Optionally, receiving a target operation for controlling the image to be matched to overlap with the game interface and / or the game scene screen includes: receiving an adjustment operation for the first user terminal within a preset time period; controlling the image to be matched to overlap with the game interface and / or the game scene screen through a gravity sensor of the first user terminal.

[0013] Optionally, receiving a target operation for controlling the image to be matched to overlap with the game interface and / or the game scene screen also includes: receiving a touch operation on the first graphical user interface to adjust the display position of the image to be matched and the game interface and / or the game scene screen on the first graphical user interface; controlling the image to be matched to overlap with the game interface and / or the game scene screen within a preset time period.

[0014] Optionally, the image to be matched includes at least one of the following: a first target screen that is the same as the game screen displayed by the second user terminal; a second target screen that is the same as the game interface displayed by the second user terminal; and a third target screen that is the same as the game scene screen displayed by the second user terminal.

[0015] According to a second aspect of the present disclosure, an interactive control device is provided, comprising: a screen display module, used to display a first graphical user interface through a first user terminal, and display at least a portion of a game screen displayed by a second user terminal in the first graphical user interface, the second user terminal being the current control terminal of a target game; a test guide module, used to display an operation test guide through the first graphical user interface to guide a user of the first user terminal to perform an operation test based on at least a portion of the screen; a test operation module, used to determine that the first user terminal passes the operation test in response to receiving a target operation corresponding to the operation test guide; and a switching module, used to switch the control terminal of the target game from the second user terminal to the first user terminal, and control the execution of operations for the target game through control instructions triggered by the first user terminal.

[0016] Optionally, the screen display module includes a screen display unit, which is used to receive screen data corresponding to the game screen displayed by the second user terminal, wherein the game screen includes a game interface and a game scene screen, and the screen data includes at least one of the following data: game interface data corresponding to the game interface, and game scene screen data corresponding to the game scene screen; and the game interface and / or game scene screen corresponding to the screen data is displayed on the first graphical user interface.

[0017] Optionally, the test guidance module includes a test guidance unit, which is used to provide an image to be matched through a first graphical user interface, and the image to be matched is displayed in superimposed layers with the game interface and / or the game scene screen; the control operation received by the first user terminal determines the display position of at least one of the image to be matched, the game interface, and the game scene screen in the first graphical user interface.

[0018] Optionally, the test operation module includes a test operation unit, which is used to receive a target operation to control the image to be matched to overlap with the game interface and / or the game scene screen; in response to the image to be matched overlapping with the game interface and / or the game scene screen, it is determined that the first user terminal passes the operation test.

[0019] Optionally, the test operation unit includes a first operation subunit, which is used to receive an adjustment operation for the first user terminal within a preset time period; and control the image to be matched to overlap with the game interface and / or the game scene screen through the gravity sensor of the first user terminal.

[0020] Optionally, the test operation unit also includes a second operation sub-unit, which is used to receive touch operations on the first graphical user interface to adjust the display position of the image to be matched and the game interface and / or the game scene screen on the first graphical user interface; and control the image to be matched to overlap with the game interface and / or the game scene screen within a preset time period.

[0021] According to a third aspect of the present disclosure, there is provided an electronic device, comprising: a processor; and a memory, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the interactive control method according to any one of the above items is implemented.

[0022] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the interactive control method according to any one of the above items is implemented.

[0023] The technical solution provided by the present disclosure may have the following beneficial effects:

[0024] The interactive control method in the exemplary embodiment of the present disclosure displays a first graphical user interface through a first user terminal, displays at least part of the game screen displayed by a second user terminal in the first graphical user interface, and the second user terminal is the current control terminal of the target game; displays an operation test guide through the first graphical user interface to guide the user of the first user terminal to perform an operation test based on at least part of the screen; in response to receiving a target operation corresponding to the operation test guide, determines that the first user terminal passes the operation test; switches the control terminal of the target game from the second user terminal to the first user terminal, and controls the execution of the operation for the target game through the control instruction triggered by the first user terminal. On the one hand, displaying at least part of the game screen displayed by the second user terminal in the first graphical user interface can ensure that the two user terminals perform device handover control operations based on at least part of the screen, so that the device handover operation can be performed anytime and anywhere. On the other hand, by displaying the operation test guide in the first graphical user interface to guide the user to perform the operation test, the device handover control operation is simple and easy to implement. On the other hand, when it is determined that the first user terminal passes the operation test, the control terminal of the target game is switched, which can increase the interaction between users of different user terminals and improve the user experience.

[0025] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0027] Figure 1 The following schematically shows the structure diagram of the implementation principle of cloud gaming in the prior art;

[0028] Figure 2 A flowchart schematically illustrates an interactive control method according to some exemplary embodiments of the present disclosure;

[0029] Figure 3 Schematically showing a first interface diagram of a first user terminal according to some exemplary embodiments of the present disclosure;

[0030] Figure 4 Schematically showing a second interface diagram of a first user terminal according to some exemplary embodiments of the present disclosure;

[0031] Figure 5 Schematically showing an interface diagram of a second user terminal according to some exemplary embodiments of the present disclosure;

[0032] Figure 6 A block diagram schematically illustrates an interactive control device according to some exemplary embodiments of the present disclosure;

[0033] Figure 7 A block diagram schematically shows an electronic device according to an exemplary embodiment of the present disclosure;

[0034] Figure 8 A schematic diagram of a computer-readable storage medium according to an exemplary embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0035] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be comprehensive and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted.

[0036] In addition, the described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known structures, methods, devices, implementations, materials or operations are not shown or described in detail to avoid blurring the various aspects of the present disclosure.

[0037] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or these functional entities or parts of functional entities may be implemented in one or more software hardened modules, or these functional entities may be implemented in different networks and / or processor devices and / or microcontroller devices.

[0038] During the game, a game user may need other game users to remotely control their terminal devices to help them continue to play the game. In particular, in the cloud game operation mode, all players' real-time data is calculated in the cloud. Figure 1 , the storage, calculation and rendering of the content can be transferred to the cloud, and the real-time game screen after rendering can be compressed and transmitted to the terminal in the form of streaming through the network for display. Specifically, the input instructions can be transmitted to the cloud for rendering calculation through network transmission, and the data obtained by the rendering calculation can be captured and encoded, and the encoded data can be sent to the terminal through network transmission. Cloud gaming enables the cloud to synchronize the current data of all players in real time, making it possible for the user terminal to obtain the status of others in real time, and even for others to operate. In the prior art, there is a lack of an interactive method for real-time handover and control between user terminals corresponding to two game users.

[0039] Based on this, in this example embodiment, an interactive control method is first provided, and the interactive control method of the present disclosure can be run on a terminal device or a server. Wherein, when a terminal device is used to implement the interactive control method of the present disclosure, the terminal device can be a local terminal device or a client device in a cloud interactive system. When the interactive control method is run on a server, the interactive control method can be implemented and executed based on the cloud interactive system, wherein the cloud interactive system includes a server and a client device.

[0040] In an optional implementation, various cloud applications, such as cloud games, can be run under the cloud interaction system. Taking cloud games as an example, cloud games refer to a game mode based on cloud computing. In the operation mode of cloud games, the operating body of the game program and the main body of the game screen presentation are separated, the storage and operation of the interactive control method are completed on the cloud game server, and the role of the client device is used for receiving and sending data and presenting the game screen. For example, the client device can be a display device with data transmission function close to the user side, such as a mobile terminal, a TV, a computer, a handheld computer, etc.; but the terminal device for information processing is a cloud game server in the cloud. When playing the game, the player operates the client device to send an operation instruction to the cloud game server. The cloud game server runs the game according to the operation instruction, encodes and compresses the game screen and other data, and returns it to the client device through the network. Finally, the client device decodes and outputs the game screen.

[0041] In an optional embodiment, the terminal device may be a local terminal device. Taking a game as an example, the local terminal device stores a game program and is used to present a game screen. The local terminal device is used to interact with the player through a graphical user interface, that is, the game program is downloaded and installed by an electronic device and run conventionally. The local terminal device may provide the graphical user interface to the player in a variety of ways, for example, it may be rendered and displayed on a display screen of the terminal, or provided to the player through a holographic projection. For example, the local terminal device may include a display screen and a processor, the display screen is used to present a graphical user interface, the graphical user interface includes a game screen, and the processor is used to run the game, generate a graphical user interface, and control the display of the graphical user interface on the display screen.

[0042] Figure 2 The following is a schematic diagram showing the interactive control method flow according to some embodiments of the present disclosure. Figure 2 , the interactive control method may include the following steps:

[0043] Step S210: displaying a first graphical user interface through a first user terminal, displaying at least a portion of a game screen displayed by a second user terminal in the first graphical user interface, the second user terminal being a current control terminal of the target game.

[0044] Step S220: displaying an operation test guide through the first graphical user interface to guide the user of the first user terminal to perform an operation test based on at least a portion of the screen.

[0045] Step S230: In response to receiving the target operation corresponding to the operation test guide, determining whether the first user terminal passes the operation test.

[0046] Step S240: Switch the control terminal of the target game from the second user terminal to the first user terminal, and control the execution of operations for the target game through the control instructions triggered by the first user terminal.

[0047] According to the interactive control method in this example embodiment, on the one hand, by displaying at least part of the game screen displayed by the second user terminal on the first graphical user interface, it can be ensured that the two user terminals perform device handover control operations based on at least part of the screen, so that the device handover operation can be performed anytime and anywhere. On the other hand, by displaying the operation test guide on the first graphical user interface to guide the user to perform the operation test, the device handover control operation is simple and easy to implement. On the other hand, when it is determined that the first user terminal passes the operation test, the control terminal of the target game is switched, which can increase the interaction between users of different user terminals and improve the user experience.

[0048] The interactive control method in this exemplary embodiment will be further described below.

[0049] In step S210, a first graphical user interface is displayed by a first user terminal, and at least a portion of a game screen displayed by a second user terminal is displayed in the first graphical user interface, and the second user terminal is a current control terminal of the target game.

[0050] In some exemplary embodiments of the present disclosure, the first user terminal may be a user terminal that receives game screen data. The first graphical user interface may be a graphical user interface displayed in the first user terminal. The second user terminal may be the current control terminal of the target game, and the second user terminal may be a user terminal that initiates a device handover control operation. The game screen may be the current screen displayed in the second user terminal. At least part of the screen may be the entire game screen or part of the game screen in the game screen displayed by the second user terminal. The current control terminal may be a user terminal that performs a control operation on the target game at the current moment. For example, in a cloud game scenario, the first user terminal may be a user terminal corresponding to a party that receives shared data in a cloud game scenario. The second user terminal may be a user terminal corresponding to a party that performs a data sharing operation in a cloud game scenario, i.e., the current control terminal of the target game. After the first user terminal completes the device handover control preparation operation based on at least part of the received screen, it may remotely control the second user terminal.

[0051] During the process of the user playing the game, the second user terminal can be the current control terminal of the target game, that is, the second user terminal controls the target game at the current moment. When the user of the second user terminal wants to request the user of the first user terminal to remotely control the target game through the first user terminal to help him continue to control the target game, the user of the second user terminal can send a device handover control request to the first user terminal through the second user terminal. The way for the user of the second user terminal to send the device handover control request to the first user terminal can be to send the game connection of the currently operated target game to the first user terminal, and can be sent to the first user terminal by instant messaging. For example, when the user of the first user terminal opens the same game program as the second user terminal in the first user terminal, the game link will be sent to the first user terminal in the form of an in-game message; in addition, there may be a situation where the user of the first user terminal has not logged into the game. At this time, the game link can be sent to the first user terminal by email or SMS.

[0052] When the user of the first user terminal enters the target game through the game link, at least part of the game screen displayed by the second user terminal can be displayed in the first graphical user interface of the first user terminal to perform device handover control operations based on the at least part of the screen.

[0053] It should be noted that the application scenarios of the interactive control method disclosed herein may include various game scenarios, such as stand-alone games or online games, etc.; in particular, it is applied to the device handover scenario in the cloud game scenario. The present disclosure does not make any special restrictions on the specific application scenarios of the interactive control method.

[0054] According to some exemplary embodiments of the present disclosure, screen data corresponding to a game screen displayed by a second user terminal is received, wherein the game screen includes a game interface and a game scene screen, and the screen data includes at least one of the following data: game interface data corresponding to the game interface, and game scene screen data corresponding to the game scene screen; and the game interface and / or game scene screen corresponding to the screen data are displayed on a first graphical user interface. The game screen may be a screen of a target game displayed in the second user terminal. The screen data may be data corresponding to the game screen, and the game screen of the second user terminal will be transmitted to the first user terminal in the form of screen data to display at least part of the screen on the first user graphical interface of the first user terminal. The game interface may be an operation control interface composed of user interface (UI) controls for controlling the target game, and the game interface may include a joystick control, a skill control, etc. The game scene screen may be a scene screen related to the content of the target game and reflecting the current game state of the target game, and the game scene screen may include a game scene of the target game and a virtual character in the target game, etc. The game screen may include a game interface and a game scene interface. The game interface data may be data corresponding to the game interface. The game scene screen data may be data corresponding to the game scene screen.

[0055] The first user terminal can receive the screen data corresponding to the game screen displayed in the second user terminal. In some application scenarios, the screen data can be sent directly to the first user terminal through the second user terminal; in the cloud game application scenario, the second user terminal can send the screen data to the cloud game server, and can send the screen data to the first user terminal through the cloud game server. The screen data received by the first user terminal includes at least game interface data corresponding to the game interface, and game scene screen data corresponding to the game scene screen. When the screen data is received, the corresponding game interface and / or game scene screen can be displayed in real time in the first graphical user interface according to the screen data. That is, when the screen data only includes game interface data, the game interface is displayed in the first graphical user interface; when the screen data only includes game scene screen data, the game scene screen is displayed in the first graphical user interface; when the screen data includes both game interface data and game scene screen data, the game interface and game scene screen are displayed simultaneously in the first graphical user interface.

[0056] In step S220, an operation test guide is displayed through the first graphical user interface to guide the user of the first user terminal to perform an operation test based on at least a portion of the screen.

[0057] In some exemplary embodiments of the present disclosure, the operation test guide may be an operation guide for guiding a user of the first user terminal to perform a device handover control operation, the operation test guide may be displayed in an animation form, or may be represented in an operation guide logo form. The operation test may be a device handover operation performed by a user of the first user terminal at the first user terminal.

[0058] After displaying at least a portion of the game screen displayed by the second user terminal in the first graphical user interface, an operation test guide can be displayed in the first graphical user interface to guide the user of the first user terminal to perform an operation test according to the operation test guide and based on at least a portion of the screen, and to perform a device handover control operation between the first user terminal and the second user terminal.

[0059] According to some exemplary embodiments of the present disclosure, an image to be matched is provided through a first graphical user interface, and the image to be matched is displayed in a superimposed manner with a game interface and / or a game scene screen; a control operation received by a first user terminal determines a display position of at least one of the image to be matched, the game interface, and the game scene screen in the first graphical user interface. The image to be matched may be an image used for performing a device handover control operation.

[0060] Since the image to be matched in the first graphical user interface is displayed simultaneously with the game interface and / or the game scene screen, when the image to be matched is displayed in the first graphical user interface, the image to be matched is displayed in a superimposed manner with the game interface and / or the game scene screen in the first graphical user interface. In addition, the user of the first user terminal can operate the first user terminal, and the first user terminal receives the user's control operation, and adjusts the display position of at least one of the image to be matched, the game screen, and the game scene screen in the first graphical user interface through the received control operation.

[0061] When the image to be matched is displayed in a first graphical user interface in a superimposed manner with the game interface and / or the game scene screen, the first display style corresponding to the image to be matched and the second display style corresponding to the game interface and / or the game scene screen can be set in the system configuration options. For example, the opacity of different display layers can be set. For example, the opacity corresponding to the first display style can be set to 25%, 50%, 75%, etc., and the image to be matched is displayed in the first user terminal in the first display style; in addition, the game interface and / or the game scene screen is displayed in the first graphical user interface according to the display style of the second user terminal.

[0062] In step S230, in response to receiving the target operation corresponding to the operation test guideline, it is determined that the first user terminal passes the operation test.

[0063] In some exemplary embodiments of the present disclosure, the target operation may be a corresponding user operation performed by a user of the first user terminal according to the operation test guide. For example, the operation test guide prompts the user to perform a specific sliding operation on the first graphical user interface, and the specific sliding operation performed by the user on the first graphical user interface is the target operation.

[0064] The user of the first user terminal can perform the target operation through the first user terminal and according to the operation test guideline. When the first user terminal receives the target operation corresponding to the operation test guideline, the first user terminal can determine that the first user terminal has passed the operation test in response to the received target operation.

[0065] According to some exemplary embodiments of the present disclosure, a target operation of controlling an image to be matched to overlap with a game interface and / or a game scene screen is received; in response to the image to be matched overlapping with the game interface and / or the game scene screen, it is determined that the first user terminal has passed the operation test.

[0066] By displaying the image to be matched and the game interface and / or the game scene screen through the first graphical user interface, the target operation of the user of the first user terminal for the first user terminal can be received, and the user of the first user terminal can adjust the display position of the image to be matched and the game interface and / or the game scene screen in the first graphical user interface to control the image to be matched to overlap with the game interface and / or the game scene screen. When it is detected that the image to be matched overlaps with the game interface and / or the game scene screen, it can be determined that the first user terminal passes the operation test. Specifically, in the process of detecting whether the image to be matched overlaps with the game interface and / or the game scene screen, the overlap area of ​​the image to be matched and the game interface and / or the game scene screen can be obtained, and the overlap area can be compared with the pre-configured overlap area threshold; wherein the overlap area threshold can be a pre-set value for comparison with the overlap area. If the overlap area is greater than the overlap area threshold, it can be considered that the image to be matched overlaps with the game interface and / or the game scene screen.

[0067] According to another exemplary embodiment of the present disclosure, an adjustment operation for the first user terminal is received within a preset time period; the image to be matched is controlled to overlap with the game interface and / or the game scene screen through the gravity sensor of the first user terminal. The preset time period can be a value of a pre-configured time period, for example, the preset time period can be configured as 3 seconds, 5 seconds, 8 seconds, etc. The adjustment operation can be an operation performed by a user of the first user terminal on the first user terminal, for example, the user of the first user terminal can tilt the first user terminal to perform the adjustment operation.

[0068] Within a preset time period, an adjustment operation is received for the first user terminal, and the gravity sensor in the first user terminal senses the tilt state of the first user terminal to obtain the tilt direction and tilt angle of the first user terminal, and adjusts the display position of the image to be matched and the game interface and / or the game scene screen in the first graphical user interface according to parameters such as the tilt direction and tilt angle to control the overlap of the image to be matched with the game interface and / or the game scene screen.

[0069] According to some exemplary embodiments of the present disclosure, the image to be matched includes at least one of the following: a first target screen that is the same as the game screen displayed by the second user terminal; a second target screen that is the same as the game interface displayed by the second user terminal; and a third target screen that is the same as the game scene screen displayed by the second user terminal. The first target screen may be the same target screen as the game screen displayed by the second user terminal, and the first target screen may include a game interface and a game scene screen. The second target screen may be the same target screen as the game interface displayed by the second user terminal, and the second target screen may include operation controls such as joystick controls and skill controls. The third target screen may be the same target screen as the game scene screen displayed by the second user terminal, and the third target screen may include a screen related to the game content, such as a game scene and a virtual character.

[0070] According to different types of images to be matched, the user can pre-configure in the system which image is to be adjusted in the display position of the first graphical user interface by the adjustment operation, so as to perform the target operation through the adjustment operation. For example, when receiving the adjustment operation for the first user terminal, it can be set to adjust the display position of the image to be displayed in the first graphical user interface, it can also be set to adjust the display position of the game interface in the first graphical user interface, and it can also be set to adjust the display position of the game scene screen in the first graphical user interface.

[0071] For example, when the image to be matched is a game interface, the arrangement of the game interface (i.e., the operation controls) in the second user terminal can be determined according to the received screen data, and the image to be matched is displayed in the first graphical user interface according to the arrangement of the operation controls. Figure 3 , Figure 3The first interface diagram of the first user terminal according to some exemplary embodiments of the present disclosure is schematically shown. The arrangement of the game interface in the second user terminal is obtained. The game interface in the second user terminal may include 311, control 312, and control 313. According to the corresponding arrangement, an image to be matched may be generated in the first graphical user interface. The image to be matched includes control 321, control 322, and control 323. By receiving an adjustment operation for the first user terminal; adjusting and controlling the display position of the image to be matched and the game interface and / or the game scene screen in the first graphical user interface, so as to control the image to be matched to overlap with the game interface and / or the game scene screen.

[0072] It is easily understood by those skilled in the art that when the image to be matched is a game screen or a game scene screen, the user can use corresponding adjustment operations to adjust the display position of the image to be matched in the first graphical user interface to control the image to be matched to overlap with the game interface and / or game scene screen.

[0073] According to another exemplary embodiment of the present disclosure, a touch operation on the first graphical user interface is received to adjust the display position of the image to be matched and the game interface and / or the game scene screen on the first graphical user interface; the image to be matched is controlled to overlap with the game interface and / or the game scene screen within a preset time period. The touch operation can be a touch operation performed by a user of the first user terminal on the first graphical user interface, and the touch operation can include a drag operation, a click operation, a press operation, etc.

[0074] Taking the image to be matched as a game interface as an example, when the image to be matched is displayed in the first graphical user interface, since the first user terminal has received the screen data corresponding to the game screen displayed by the second user terminal and displayed at least part of the screen in the first graphical user interface, the user can adjust the display position of the operation control in the game interface in the first graphical user interface through touch operation. Figure 4 , Figure 4 The second interface diagram of the first user terminal according to some exemplary embodiments of the present disclosure is schematically shown. Figure 4 In the example, the game interface of the second user terminal may include controls 411, 412, and 413, the image to be matched may include controls 421, 422, and 423, and the first operation controls are randomly distributed in the first user interface. The user of the first user terminal may adjust the display position of the operation controls in the first graphical user interface through touch operation.

[0075] Similarly, when the image to be matched is a game screen or a game scene screen, the user can use corresponding adjustment operations to adjust the display position of the image to be matched in the first graphical user interface to control the image to be matched to overlap with the game interface and / or game scene screen.

[0076] In addition, during the device handover operation, a first operation progress control may be generated at a first preset position of the first graphical user interface; operation progress data corresponding to the target operation is obtained, and the status data displayed in the first operation progress control is updated in real time according to the operation progress data. The first preset position may be a position displayed in the first graphical user interface and used to display the operation progress control. For example, the first preset position may be any page position such as the top, bottom, left, or right of the page of the first user interface. The first operation progress control may be a page control displayed in the first user interface for displaying the completion progress of the target operation. The operation progress data may be data indicating the current completion progress of the target operation. The status data may be the operation progress data displayed in the operation progress control. For example, the status data may be displayed in the form of a percentage, 0% indicating that the target operation has not started, any value from 1% to 99% indicating that the target operation is in progress, and 100% indicating that the target operation is completed.

[0077] After the first operation control is generated in the first user interface, a first operation progress control may be generated at a first preset position of the first user interface, and the status data displayed in the first operation progress control may be updated in real time according to the current progress of the control handover preparation operation. Figure 3 and Figure 4 , Figure 3 The first operation progress control 330 in the display shows the current state of the target operation performed by the user of the first user terminal, "preparing for 3 seconds", indicating that the timing of the target operation performed by the user of the first user terminal has lasted for 3 seconds; Figure 4 The first operation progress control 430 in the display shows the current status “Ready 5 seconds” of the target operation performed by the first user.

[0078] When the user of the first user terminal performs a target operation, the operation progress status can be displayed on the second user terminal accordingly. Figure 5 , Figure 5 The interface diagram of the second user terminal according to some exemplary embodiments of the present disclosure is schematically shown. When the user performs a target operation through the first user terminal, the operation feedback information sent by the first user terminal can be received, and the second operation progress control 510 can be displayed at the second preset position. For example, the status displayed in the second operation progress control 510 is "the other party is preparing". At this time, the second user terminal is still the current control terminal of the target game, and the target game can be controlled through controls 311, 312, and 313.

[0079] In step S240, the control terminal of the target game is switched from the second user terminal to the first user terminal, and the operation for the target game is controlled and executed through the control instruction triggered by the first user terminal.

[0080] In some exemplary embodiments of the present disclosure, the control instruction may be a control instruction generated according to an operation performed by a user of the first user terminal on the first user terminal. When it is determined that the first user terminal passes the operation test, the control terminal of the target game may be switched from the second user terminal to the first user terminal, so that the user of the first user terminal continues to perform the control operation of the target game through the first user terminal instead of the user of the second user terminal.

[0081] If the overlapping area is not detected to be greater than or equal to the overlapping area threshold within the preset time, it can be considered that the first user terminal has failed the operation test, and the image to be matched is hidden in the first user interface, and the second user terminal remains the control terminal of the target game, and continues to control the target game through the second user terminal.

[0082] It should be noted that the terms "first", "second", etc. used in the present disclosure are only for distinguishing different user terminals, different operation progress controls, different display styles, etc., and should not impose any limitations on the present disclosure.

[0083] In summary, the interactive control method disclosed in the present invention displays a first graphical user interface through a first user terminal, displays at least part of the game screen displayed by a second user terminal in the first graphical user interface, and the second user terminal is the current control terminal of the target game; displays an operation test guide through the first graphical user interface to guide the user of the first user terminal to perform an operation test based on at least part of the screen; in response to receiving a target operation corresponding to the operation test guide, determines that the first user terminal passes the operation test; switches the control terminal of the target game from the second user terminal to the first user terminal, and controls the execution of the operation for the target game through the control instruction triggered by the first user terminal. On the one hand, displaying at least part of the game screen displayed by the second user terminal in the first graphical user interface can ensure that the two user terminals perform device handover control operations based on at least part of the screen, so that the device handover operation can be performed anytime and anywhere. On the other hand, by displaying the operation test guide in the first graphical user interface to guide the user to perform the operation test, the device handover control operation is simple and easy to implement. On the other hand, when it is determined that the first user terminal passes the operation test, the control terminal of the target game is switched, which can increase the interaction between users of different user terminals and improve the user experience. On the other hand, by adjusting the display position of the image to be matched and the game interface and game scene screen so that the image to be matched overlaps with them for operation testing, the fun of the user in the operation test can be improved.

[0084] It should be noted that, although the steps of the method of the present invention are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0085] In addition, in this exemplary embodiment, an interactive control device is also provided. Figure 6 The interactive control device 600 may include: a screen display module 610, a test instruction module 620, a test operation module 630 and a switching module 640.

[0086] Specifically, the screen display module 610 is used to display the first graphical user interface through the first user terminal, and display at least a portion of the game screen displayed by the second user terminal in the first graphical user interface, and the second user terminal is the current control terminal of the target game; the test guidance module 620 is used to display the operation test guidance through the first graphical user interface to guide the user of the first user terminal to perform an operation test based on at least a portion of the screen; the test operation module 630 is used to determine that the first user terminal passes the operation test in response to receiving a target operation corresponding to the operation test guidance; the switching module 640 is used to switch the control terminal of the target game from the second user terminal to the first user terminal, and control the execution of operations for the target game through the control instructions triggered by the first user terminal.

[0087] When performing handover control, the interactive control device 600 displays at least part of the game screen displayed by the second user terminal on the first graphical user interface, so that the two user terminals can perform device handover control operations anytime and anywhere based on at least part of the screen; and, by displaying operation test instructions on the first graphical user interface to guide users to perform operation tests, the device handover control operation is simple and easy to implement; when it is determined that the first user terminal has passed the operation test, the control terminal of the target game is switched, which can increase the interaction between users of different user terminals and improve the user experience.

[0088] In some exemplary embodiments of the present disclosure, the screen display module includes a screen display unit for receiving screen data corresponding to a game screen displayed by a second user terminal, wherein the game screen includes a game interface and a game scene screen, and the screen data includes at least one of the following data: game interface data corresponding to the game interface, and game scene screen data corresponding to the game scene screen; and the game interface and / or game scene screen corresponding to the screen data are displayed on the first graphical user interface.

[0089] In some exemplary embodiments of the present disclosure, the test guidance module includes a test guidance unit, which is used to provide an image to be matched through a first graphical user interface, and the image to be matched is displayed in an overlay manner with a game interface and / or a game scene screen; the control operation received by the first user terminal determines the display position of at least one of the image to be matched, the game interface, and the game scene screen in the first graphical user interface.

[0090] In some exemplary embodiments of the present disclosure, the test operation module includes a test operation unit for receiving a target operation of controlling the image to be matched to overlap with the game interface and / or the game scene screen; in response to the image to be matched overlapping with the game interface and / or the game scene screen, determining that the first user terminal has passed the operation test.

[0091] In some exemplary embodiments of the present disclosure, the test operation unit includes a first operation subunit, which is used to receive an adjustment operation for a first user terminal within a preset time period; and control the image to be matched to overlap with the game interface and / or the game scene screen through the gravity sensor of the first user terminal.

[0092] In some exemplary embodiments of the present disclosure, the test operation unit also includes a second operation sub-unit, which is used to receive touch operations on the first graphical user interface to adjust the display position of the image to be matched and the game interface and / or the game scene screen in the first graphical user interface; and control the image to be matched to overlap with the game interface and / or the game scene screen within a preset time period.

[0093] The specific details of the virtual modules of the above-mentioned interactive control devices have been described in detail in the corresponding interactive control methods, so they will not be repeated here.

[0094] It should be noted that although several modules or units of the interactive control device are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0095] In addition, in an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0096] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as systems, methods or program products. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: complete hardware embodiments, complete software embodiments (including firmware, microcode, etc.), or embodiments combining hardware and software aspects, which may be collectively referred to herein as "circuits", "modules" or "systems".

[0097] Reference below Figure 7 An electronic device 700 according to such an embodiment of the present invention is described. Figure 7 The electronic device 700 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0098] like Figure 7 As shown, the electronic device 700 is in the form of a general computing device. The components of the electronic device 700 may include, but are not limited to: the at least one processing unit 710, the at least one storage unit 720, a bus 730 connecting different system components (including the storage unit 720 and the processing unit 710), and a display unit 740.

[0099] The storage unit stores program codes, which can be executed by the processing unit 710, so that the processing unit 710 executes the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification.

[0100] The storage unit 720 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 721 and / or a cache memory unit 722 , and may further include a read-only memory unit (ROM) 723 .

[0101] The storage unit 720 may include a program / utility 724 having a set (at least one) of program modules 725, such program modules 725 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0102] Bus 730 may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0103] The electronic device 700 may also communicate with one or more external devices 770 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 700, and / or communicate with any device that enables the electronic device 700 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 750. Furthermore, the electronic device 700 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) via a network adapter 760. As shown, the network adapter 760 communicates with other modules of the electronic device 700 via a bus 730. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0104] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the embodiment of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiment of the present disclosure.

[0105] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible embodiments, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to perform the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.

[0106] refer to Figure 8 As shown, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0107] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0108] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0109] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0110] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0111] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0112] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

[0113] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An interactive control method, characterized in that: include: Displaying a first graphical user interface through a first user terminal, displaying at least a portion of a game screen displayed by a second user terminal in the first graphical user interface, wherein the second user terminal is a current control terminal of the target game; Displaying an operation test guide through the first graphical user interface to guide a user of the first user terminal to perform an operation test based on at least a portion of the screen; In response to receiving a target operation corresponding to the operation test guide, determining that the first user terminal passes the operation test; Switching the control terminal of the target game from the second user terminal to the first user terminal, and controlling the execution of operations for the target game through control instructions triggered by the first user terminal; The displaying of the operation test guide through the first graphical user interface to guide the user of the first user terminal to perform the operation test based on the at least part of the screen includes: providing an image to be matched through the first graphical user interface, wherein the image to be matched is displayed in a superimposed manner with a game interface and / or a game scene screen, wherein a display position of at least one of the image to be matched, the game interface, and the game scene screen in the first graphical user interface is determined by a control operation received by the first user terminal; The image to be matched includes at least one of the following: a first target screen that is identical to at least a portion of the game screen displayed on the second user terminal; a second target screen that is identical to at least a portion of the game interface displayed on the second user terminal; A third target screen that is identical to at least a portion of the game scene screen displayed by the second user terminal.

2. The interactive control method according to claim 1, characterized in that: The displaying, in the first graphical user interface, at least a portion of the game screen displayed by the second user terminal includes: Receiving screen data corresponding to a game screen displayed by the second user terminal, wherein the game screen includes a game interface and a game scene screen, and the screen data includes at least one of the following data: game interface data corresponding to the game interface, and game scene screen data corresponding to the game scene screen; The game interface and / or the game scene screen corresponding to the screen data is displayed on the first graphical user interface.

3. The interactive control method according to claim 2, characterized in that: In response to receiving the target operation corresponding to the operation test guide, determining that the first user terminal passes the operation test includes: Receiving a target operation of controlling the image to be matched to overlap with the game interface and / or game scene screen; In response to the image to be matched overlapping with the game interface and / or the game scene screen, it is determined that the first user terminal passes the operation test.

4. The interactive control method according to claim 3, characterized in that: The receiving a target operation of controlling the image to be matched to overlap with the game interface and / or the game scene screen includes: receiving an adjustment operation for the first user terminal within a preset time period; The image to be matched is controlled to overlap with the game interface and / or game scene screen through the gravity sensor of the first user terminal.

5. The interactive control method according to claim 3, characterized in that: The receiving of the target operation of controlling the image to be matched to overlap with the game interface and / or the game scene screen also includes: Receiving a touch operation on the first graphical user interface to adjust the display position of the to-be-matched image and the game interface and / or the game scene screen on the first graphical user interface; The image to be matched is controlled to overlap with the game interface and / or the game scene screen within a preset time period.

6. An interactive control device, characterized in that: include: A screen display module, configured to display a first graphical user interface through a first user terminal, and display at least a portion of a game screen displayed by a second user terminal in the first graphical user interface, wherein the second user terminal is a current control terminal of the target game; A test guide module, configured to display an operation test guide through the first graphical user interface to guide a user of the first user terminal to perform an operation test based on at least part of the screen; a test operation module, configured to determine that the first user terminal passes the operation test in response to receiving a target operation corresponding to the operation test guide; A switching module, used to switch the control terminal of the target game from the second user terminal to the first user terminal, and control the execution of operations for the target game through control instructions triggered by the first user terminal; The test guidance module is also used to provide an image to be matched through the first graphical user interface, and the image to be matched is displayed in an overlay manner with the game interface and / or the game scene screen, wherein the control operation received by the first user terminal determines the display position of at least one of the image to be matched, the game interface and the game scene screen in the first graphical user interface; the image to be matched includes at least one of the following: a first target screen that is identical to at least part of the game screen displayed by the second user terminal; a second target screen that is identical to at least part of the game interface displayed by the second user terminal; a third target screen that is identical to at least part of the game scene screen displayed by the second user terminal.

7. An electronic device, characterized in that: include: processor; as well as A memory having computer-readable instructions stored thereon, wherein the computer-readable instructions, when executed by the processor, implement the interactive control method according to any one of claims 1 to 5.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the interactive control method according to any one of claims 1 to 5 is implemented.

Images