Virtual handle editing method and device, terminal, storage medium and program product

Abstract

The embodiment of the invention discloses a virtual handle editing method and device, a terminal, a storage medium and a program product, and relates to the field of human-computer interaction. Comprising the steps that a virtual handle editing interface is displayed, the virtual handle editing interface comprises at least one handle editing area, the handle editing areas are used for editing target virtual handles, and different handle editing areas correspond to different target virtual handles; in response to a key editing operation in the handle editing area, displaying a target virtual key indicated by the key editing operation in the handle editing area; in response to the editing application operation, the edited target virtual handle is applied to the control equipment, so that the control equipment is controlled through the target virtual handle, different target virtual handles are applied to different control equipment, and the edited target virtual handle comprises virtual keys in the corresponding handle editing area. By adopting the method provided by the embodiment of the invention, the physical limitation of an entity handle is avoided, and the degree of freedom of virtual handle key setting is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of human-computer interaction, and in particular to a virtual handle editing method, device, terminal, storage medium and program product. Background Art

[0002] In the game scene, there may be situations where some players are unable to independently complete the operation of the virtual character.

[0003] To enable two or more players to simultaneously control the same virtual character, related technologies use detachable game controller hardware. A host device is connected to two or more separate game controllers, allowing different players to control the same virtual character by operating different separate game controllers, thereby enhancing player collaboration and engagement.

[0004] However, the use of detachable game controller hardware is subject to the limitations of hardware entities. The number of detachable controllers is limited and the hardware cost is high. At the same time, each detached controller needs to be connected to the host device separately, resulting in a poor user experience. Summary of the Invention

[0005] The present invention provides a method, device, terminal, storage medium, and program product for editing a virtual handle. The technical solution is as follows:

[0006] In one aspect, an embodiment of the present application provides a method for editing a virtual handle, the method comprising:

[0007] Displaying a virtual handle editing interface, wherein the virtual handle editing interface includes at least one handle editing area, wherein the handle editing area is used to edit a target virtual handle, and different handle editing areas correspond to different target virtual handles;

[0008] In response to a key editing operation in the handle editing area, displaying a target virtual key indicated by the key editing operation in the handle editing area;

[0009] In response to the editing application operation, the edited target virtual handle is applied to the control device so that the control device is controlled by the target virtual handle, wherein different target virtual handles are applied to different control devices, and the edited target virtual handle includes virtual buttons within the corresponding handle editing area.

[0010] On the other hand, an embodiment of the present application provides a virtual handle editing device, the device comprising:

[0011] An interface display module is used to display a virtual handle editing interface, wherein the virtual handle editing interface includes at least one handle editing area, wherein the handle editing area is used to edit a target virtual handle, and different handle editing areas correspond to different target virtual handles;

[0012] a button editing module, configured to respond to a button editing operation in the handle editing area and display a target virtual button indicated by the button editing operation in the handle editing area;

[0013] A handle application module is used to apply the edited target virtual handle to the control device in response to the editing application operation, so that the control device is controlled by the target virtual handle, wherein different target virtual handles are applied to different control devices, and the edited target virtual handle includes virtual buttons in the corresponding handle editing area.

[0014] On the other hand, an embodiment of the present application provides a terminal, which includes a processor and a memory, wherein the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the method described in the above aspect.

[0015] On the other hand, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores at least one instruction, and the instruction is loaded and executed by a processor to implement the method described in the above aspects.

[0016] In another aspect, an embodiment of the present application provides a computer program product, comprising computer instructions stored in a computer-readable storage medium. A processor of a terminal reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the terminal to perform the methods provided in various optional implementations of the above aspects.

[0017] In an embodiment of the present application, the target virtual handle corresponding to the handle editing area can be edited through the handle editing area in the virtual handle editing interface; through the key editing operation, the virtual keys contained in the target virtual key can be freely combined without being constrained by physical hardware, and a variety of virtual key combinations can be generated, thereby improving the freedom of handle editing; at the same time, different handle editing areas correspond to different target virtual handles. After completing the handle editing, the different target virtual handles are applied to different control devices respectively, and joint control can be achieved through different control devices, thereby improving the sense of collaboration and participation of different users, broadening the usage scenarios of the handle, and enriching the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0019] Figure 1 It is a schematic diagram of the separation of the game controller hardware in the related art;

[0020] Figure 2 is a schematic diagram of using a split sub-handle through a physical handle element in the related art;

[0021] Figure 3 is a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application;

[0022] Figure 4 is a flowchart of a virtual handle editing method provided by an exemplary embodiment of the present application;

[0023] Figure 5 is a schematic diagram of a virtual handle editing interface provided by an exemplary embodiment of the present application;

[0024] Figure 6 is a schematic diagram of a virtual handle editing interface after completing a drag operation on all virtual keys, provided by an exemplary embodiment of the present application;

[0025] Figure 7 is a schematic diagram of an editing query interface, a configuration entry interface, and a virtual handle editing interface provided by an exemplary embodiment of the present application;

[0026] Figure 8 is a schematic diagram of displaying a configuration error prompt provided by an exemplary embodiment of the present application;

[0027] Figure 9 is a schematic diagram of a single handle editing area included in each split area when the first number is equal to the second number, provided by an exemplary embodiment of the present application;

[0028] Figure 10 is a schematic diagram of an exemplary embodiment of the present application, in which at least one split region includes at least two handle editing regions when the first number is greater than the second number;

[0029] Figure 11 is a schematic diagram showing a first editing error prompt provided by an exemplary embodiment of the present application;

[0030] Figure 12This is a schematic diagram of an exemplary embodiment of the present application providing an area adjustment operation for a handle editing area;

[0031] Figure 13 is a schematic diagram showing a second editing error prompt provided by an exemplary embodiment of the present application;

[0032] Figure 14 is a schematic diagram showing a third editing error prompt provided by an exemplary embodiment of the present application;

[0033] Figure 15 is a schematic diagram showing a fourth editing error prompt provided by an exemplary embodiment of the present application;

[0034] Figure 16 is a schematic diagram of a vehicle computer displaying a graphic code in response to an editing application operation provided by an exemplary embodiment of the present application;

[0035] Figure 17 is a schematic diagram of a control device displaying a target virtual handle based on handle information obtained by parsing a graphic code, provided by an exemplary embodiment of the present application;

[0036] Figure 18 is a flowchart of a virtual handle editing method provided by another exemplary embodiment of the present application;

[0037] Figure 19 This is a structural block diagram of a virtual handle editing device provided by an exemplary embodiment of the present application;

[0038] Figure 20 It is a schematic diagram of the structure of a terminal provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0039] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0040] In related technologies, detachable game controller hardware is often used to enable two or more players to simultaneously control the same virtual character. A host device is connected to two or more separate game controller hardware components, allowing different players to control the same virtual character by operating different separate game controller hardware components.

[0041] See also Figure 1 , Figure 1 This is a schematic diagram of the disassembly of the game controller hardware in the related art.

[0042] like Figure 1As shown, before the game controller hardware is split, the sub-controller 110 and the sub-controller 120 in the game controller hardware are connected through the underlying hardware connection area 130; after the split, the sub-controller 110 and the sub-controller 120 are independent of each other and can be operated separately by two players to control the virtual characters in the same game.

[0043] See also Figure 2 , Figure 2 This is a schematic diagram of using split sub-handles through physical handle elements in the related art.

[0044] like Figure 2 As shown, the physical handle element 210 corresponding to the split sub-handle 110 and the physical handle element 220 corresponding to the sub-handle 120 both need to be connected to the gaming device before they can be used.

[0045] It can be seen that the use of related technology solutions to split the handle has many limitations. First, the split sub-handles are not devices that support independent use. They need to connect the physical handle components through a USB (Universal Serial Bus) interface, or require the game device itself to provide NFC (Near Field Communication) capabilities. Secondly, the way the handle is split is subject to the limitations of physical hardware, the degree of freedom of splitting is low, and the number of handles that can be connected to each game device is also limited.

[0046] Therefore, the embodiment of the present application provides a virtual handle editing method, which can avoid the limitations of physical hardware and has a high degree of freedom in setting virtual buttons in the virtual handle.

[0047] See also Figure 3 , Figure 3 FIG. 3 is a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application, wherein the implementation environment includes a virtual handle editing device 310 , a control device 320 , and a server 330 .

[0048] The virtual handle editing device 310 is used to execute the virtual handle editing method. In some embodiments, the virtual handle editing device 310 is a car computer, that is, a vehicle-mounted terminal installed in the vehicle, which is used to realize information communication between people and vehicles, and between vehicles and the outside world. The car computer can also be called a driving computer. The car computer can run different applications to provide different services. For example, the car computer can run a cloud game application, and the co-pilot and the passengers in the back row of the vehicle can play games on the cloud game screen displayed by the car computer. The embodiment of the present application is explained by taking the virtual handle editing device 310 as an example of a car computer. However, the virtual handle editing device 310 can also be implemented as other types of devices, such as smart phones, tablet computers, desktop computers, wearable devices, electronic game consoles, etc., and this application does not limit this.

[0049] In some embodiments, a virtual handle editing interface is displayed in the virtual handle editing device 310 for editing the virtual handle. For example, the virtual buttons included in the target virtual handle can be determined in the virtual handle editing interface.

[0050] After completing the editing of the target virtual handle, the virtual handle editing device 310 can apply the handle information to the control device 320, where the handle information can include the handle identifier corresponding to the target virtual handle and the key information of the virtual keys contained in the target virtual handle. In some embodiments, the virtual handle editing device 310 can display a graphic code containing the handle information, and after the control device 320 successfully scans the code, the target virtual handle and virtual keys are displayed in the interface of the control device 320. In other embodiments, the virtual handle editing device 310 can also send the handle information to the control device 320 via Bluetooth connection, SMS link, wireless network or mobile data, etc., and the embodiments of the present application do not impose any restrictions on this.

[0051] The control device 320 is used to control the virtual handle editing device 310 through the target virtual handle. The control device 320 can be a smartphone, a tablet computer, a desktop computer, a wearable device, etc. The embodiment of the present application is described by taking the control device as a smartphone as an example, but does not constitute any limitation on the specific type of the control device 320. In some embodiments, there are one or more control devices 320. For example, multiple passengers on the car computer control different target virtual handles through their respective different smartphones to achieve common control of the cloud gaming application in the car computer. For example, different smartphones of different passengers can be used to control the same virtual object in the cloud gaming application, or different virtual objects.

[0052] In some embodiments, in a cloud application scenario, the virtual handle editing device 310 may send handle information and the mapping relationship between the virtual handle and the virtual object to the server 330. The control device 320 may upload a control event to the server 330, so that the server 330 processes the control event of the control device 320, generates a video stream corresponding to the cloud application, and returns the video stream to the virtual handle editing device 310, thereby enabling the control device 320 to control the virtual handle editing device 310 through the target virtual handle.

[0053] Server 330 may be a backend server for a cloud application. Server 330 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0054] It should be noted that the above embodiment only describes the general architecture of the implementation environment. The system may also include more or fewer components, or combine certain components. For example, the implementation environment may include one or more control devices 320, and this embodiment does not limit this.

[0055] See also Figure 4 , Figure 4 Flowchart of a method for editing a virtual handle provided by an exemplary embodiment of the present application. The method comprises the following steps:

[0056] Step 401 : Display a virtual handle editing interface. The virtual handle editing interface includes at least one handle editing area. The handle editing area is used to edit a target virtual handle, and different handle editing areas correspond to different target virtual handles.

[0057] The target virtual handle is a virtual handle obtained after editing in the handle editing area. The target virtual handle includes at least one virtual button.

[0058] For example only, the target virtual handle may include four directional movement keys of "up, down, left, and right"; or, the target virtual handle may include "jump" and "crouch" keys; or, the target virtual handle may include an "attack" key.

[0059] In some embodiments, a target virtual handle may include all or part of virtual buttons for controlling the control object.

[0060] In some embodiments, the handle editing area corresponds to the target virtual handle in a one-to-one manner. For example, if there are five handle editing areas displayed in the virtual handle editing interface, there will be five target virtual handles after editing is completed.

[0061] The target virtual handle can be edited in various possible ways through the handle editing area.

[0062] In a possible implementation, a drop-down menu bar may be displayed in the handle editing area, and the user may select a virtual button included in the target virtual handle by clicking on each optional virtual button provided in the drop-down menu bar.

[0063] In another possible implementation, icons of various optional virtual keys are displayed outside the handle editing area. The user can drag the virtual key icon to move the icon to the handle editing area corresponding to the target virtual handle to determine the virtual keys contained in the target virtual handle.

[0064] It should be noted that the above implementation method is only an example. Those skilled in the art can set the method of editing the target virtual handle through the handle editing area according to actual needs. For example, in the car computer, the user can also determine the virtual buttons in the handle editing area through voice input to realize the editing of the target virtual handle. The embodiment of this application does not limit this.

[0065] In a cloud gaming application scenario, the edited target virtual handle can be applied to a control device to control virtual objects in the cloud gaming application. It should be noted that the virtual handle editing method provided in the embodiment of the present application can also be applied to other cloud application scenarios or local application scenarios, and the embodiment of the present application does not limit this.

[0066] Step 402: In response to a key editing operation in the handle editing area, a target virtual key indicated by the key editing operation is displayed in the handle editing area.

[0067] The button editing operation is used to determine the virtual buttons contained in the target virtual controller corresponding to the controller editing area.

[0068] In different editing modes, the button editing operation can take different forms. For example, when editing in the handle editing area by displaying a drop-down menu bar, the button editing operation is to click on a virtual button in the drop-down menu bar; for another example, when editing by dragging a virtual button icon to the handle editing area, the button editing operation is to drag the virtual button icon.

[0069] The button editing operation can be a one-time operation or multiple operations. For example, the user can drag all virtual buttons contained in the target virtual controller into the controller editing area at once; or the user can drag different virtual buttons into the controller editing area one by one.

[0070] After completing the button editing operation in the handle editing area, the key combination consisting of one or more target virtual keys displayed in the handle editing area is the virtual key combination contained in the target virtual handle. For example, if the user drags the icons corresponding to the four directional movement keys "up, down, left, and right" into the handle editing area four times and confirms the completion of the editing, the target virtual handle corresponding to the handle editing area will contain the four directional movement keys.

[0071] In some embodiments, when two target virtual controllers corresponding to two controller editing areas are used to control different virtual characters, the virtual buttons within the different controller editing areas may be displayed in different colors to more intuitively indicate that different controller editing areas correspond to different virtual characters. For example, the virtual button for controlling virtual character A in controller editing area 1 may be displayed with a yellow icon, while the virtual button for controlling virtual character B in controller editing area 2 may be displayed with a green icon. This intuitively indicates the control object of the virtual button, preventing users from making incorrect button editing operations, thereby improving controller editing efficiency.

[0072] Step 403: In response to the editing application operation, the edited target virtual handle is applied to the control device so that the control device is controlled by the target virtual handle, wherein different target virtual handles are applied to different control devices, and the edited target virtual handle includes virtual buttons in the corresponding handle editing area.

[0073] The edit and apply operation is used to apply the edited target virtual handle to the control device.

[0074] Optionally, the editing application operation is a click operation on the editing completion control after the user completes the handle editing; or, the editing application operation can also be a shortcut key operation, a special gesture operation, etc., which is not limited.

[0075] The edited target virtual handle includes the virtual keys in the corresponding handle editing area. In some embodiments, the virtual keys in the handle editing area may be the target virtual keys indicated by the key editing operation in step 402, or may be a virtual key combination including the target virtual key and other virtual keys.

[0076] In one possible implementation, in response to an application editing operation, the vehicle computer may display a graphic code containing handle information, where the handle information includes the handle identifier corresponding to the edited target virtual handle and the key information of the virtual keys contained in the target virtual handle. After the control device successfully scans the code, the control device interface displays the target virtual handle including the virtual keys based on the handle information parsed from the graphic code.

[0077] In another possible implementation, in response to the editing application operation, the vehicle computer may establish a Bluetooth connection with the control device and transmit the handle information to the control device via Bluetooth transmission.

[0078] In another possible implementation, in response to the editing application operation, the vehicle computer can also send handle information to the control device via a wireless network or mobile data. The embodiment of the present application does not limit the specific method of applying the edited target virtual handle to the control device.

[0079] In some embodiments, different target virtual controllers corresponding to different controller editing areas are applied to different control devices. For example, after editing five target virtual controllers through five controller editing areas, the car computer applies the five target virtual controllers to five different smartphones. For example, three of the target virtual controllers are used to control virtual character A in the car computer's cloud gaming application, and the remaining two target virtual controllers are used to control virtual character B in the car computer's cloud gaming application.

[0080] To sum up, through the handle editing area in the virtual handle editing interface, you can edit the target virtual handle corresponding to the handle editing area; through the key editing operation, you can freely combine the virtual keys contained in the target virtual key, without being constrained by physical hardware, and can produce a variety of virtual key combinations, which improves the freedom of handle editing; at the same time, different handle editing areas correspond to different target virtual handles. After completing the handle editing, different target virtual handles are applied to different control devices respectively, and joint control can be achieved through different control devices, thereby improving the sense of collaboration and participation of different users, broadening the usage scenarios of the handle, and enriching the user experience.

[0081] In order to edit the virtual buttons in the target virtual handle through the handle editing area, in one possible implementation, the virtual handle editing interface also includes the original virtual handle. The user can move the virtual buttons in the original virtual handle to the handle editing area by dragging to edit the target virtual handle.

[0082] The original virtual handle includes various virtual buttons for controlling the same control object.

[0083] In some embodiments, through the virtual handle editing interface, the user can "split" the original virtual handle into two or more target virtual handles, and the two or more target virtual handles "split" from the same original virtual handle can be applied to the smartphones corresponding to different users respectively, so that different users can jointly control the same control object through their respective target virtual handles.

[0084] See also Figure 5, Figure 5 This is a schematic diagram of a virtual handle editing interface provided by an exemplary embodiment of the present application.

[0085] For example, in a cloud gaming application, the original virtual controller 510 displayed in the virtual controller editing interface is used to control the virtual object "Zhang San" in the cloud gaming application, and the original virtual controller 520 is used to control the virtual object "Li Si" in the cloud gaming application. The original virtual controller 510 contains all the virtual buttons for controlling the virtual object "Zhang San", and the original virtual controller 520 contains all the virtual buttons for controlling the virtual object "Li Si".

[0086] The virtual handle editing interface also displays 6 handle editing areas. After editing is completed, the three target virtual handles corresponding to the handle editing areas 511, 512 and 513 are all virtual handles used to control the virtual object "Zhang San"; the three target virtual handles corresponding to the handle editing areas 521, 522 and 523 are all virtual handles used to control the virtual object "Li Si".

[0087] In some embodiments, in response to a drag operation on a target virtual key in the original virtual handle, the target virtual key is displayed in a handle editing area located at an end point corresponding to the drag operation.

[0088] For example Figure 5 In the example, the user drags the target virtual button 531 - 1 (left joystick) in the original virtual handle 520 , and the dragging end point is located in the handle editing area 522 . Therefore, the vehicle computer displays the target virtual button 531 - 2 in the handle editing area 522 .

[0089] In a possible implementation, after the target virtual key is displayed in the handle editing area, the vehicle computer may hide the target virtual key in the original virtual handle to highlight that the target virtual key has been assigned to the target virtual handle.

[0090] In another possible implementation, after the target virtual key is displayed in the handle editing area located at the dragging end point corresponding to the dragging operation, the vehicle computer sets the target virtual key in the original virtual handle to an uneditable state, wherein the target virtual key in the uneditable state does not support editing.

[0091] For example, after the user drags the target virtual key 531-1 to the handle editing area 522, the vehicle computer sets the target virtual key 531-1 in the original virtual handle 520 to be uneditable, and the user cannot perform the drag operation on the target virtual key 531-1 in the original virtual handle 520 again.

[0092] Optionally, for non-editable virtual keys, the vehicle computer may display them in a form different from that of editable virtual keys, for example, a semi-transparent display mode.

[0093] In some embodiments, in response to a removal operation on a target virtual key in the handle editing area, the vehicle computer resets the target virtual key in the original virtual handle to an editable state, wherein the target virtual key in the editable state supports editing.

[0094] Optionally, the removal operation is an operation triggered by clicking a removal control, or the removal operation is an operation of dragging the target virtual button from the handle editing area back to the original virtual handle.

[0095] For example, when the user removes the target virtual key 531 - 2 in the handle editing area 522 , the vehicle computer sets the target virtual key 531 - 1 in the original virtual handle 520 to an editable state again.

[0096] In this embodiment, the virtual keys contained in the target virtual handle corresponding to the handle editing area can be edited through the key editing operation; when the target virtual key is already displayed in the handle editing area, the target virtual key in the original virtual handle is set to an uneditable state to avoid the same virtual key being repeatedly assigned to different virtual handles; when the target virtual key in the handle editing area is removed, the target virtual key in the original virtual handle is reset to an editable state to avoid missing virtual keys during editing.

[0097] See also Figure 6 , Figure 6 This is a schematic diagram of a virtual handle editing interface after completing the drag operation on all virtual keys, provided by an exemplary embodiment of the present application.

[0098] like Figure 6 As shown, after the user completes the drag operation on the virtual key, the handle editing areas 511, 512 and 513 contain some virtual keys in the original virtual handle 510; the handle editing areas 521, 522 and 523 contain some virtual keys in the original virtual handle 520.

[0099] The target virtual controllers corresponding to different controller editing areas will be applied to different control devices. For example, the target virtual controller corresponding to controller editing area 521 contains four virtual buttons and will be applied to user A's smartphone; while the target virtual controller corresponding to controller editing area 512 contains only one virtual button and will be applied to user B's smartphone.

[0100] Before displaying the virtual handle editing interface, the vehicle computer can display the editing query interface and the configuration input interface. The editing query interface is used to inquire the user whether to enter the virtual handle editing interface, and the configuration input interface is used to enter the parameters required during the handle editing process.

[0101] See also Figure 7 , Figure 7 It is a schematic diagram of an editing query interface, a configuration entry interface, and a virtual handle editing interface provided by an exemplary embodiment of the present application.

[0102] like Figure 7 As shown, when the cloud game application is started, the car computer displays an editing inquiry interface 710, asking the user whether to use the virtual handle editing technology. If the user does not edit the handle, the car computer can directly display the cloud game screen and receive the user's control operation through the physical handle; when the user confirms to use the handle editing technology, the configuration entry interface 720 is displayed.

[0103] In some embodiments, the configuration entry interface is used to configure a first number of control devices and a second number of control objects.

[0104] In the scenario of cloud gaming applications, the first number of control devices is the number of players participating in the game, for example, the user input is 6; the second number of control objects is the number of characters in the game, for example, the user input is 2.

[0105] Since the control object requires at least one control device to control it, input prompt information is also displayed in the configuration entry interface. For example, in the cloud gaming application scenario, the vehicle computer displays the input prompt information "Multiple people control the same character, the number of game players ≥ the number of characters" in the configuration entry interface to prompt the user to enter valid parameters.

[0106] In some embodiments, when the first number is greater than or equal to the second number, a virtual handle editing interface including the second number of original virtual handles and the first number of handle editing areas is displayed, wherein different control objects correspond to different original virtual handles.

[0107] For example, if the user enters a first number of 6 and a second number of 2, and since the first number is greater than or equal to the second number, the vehicle computer displays a virtual controller editing interface 730. This interface contains two original virtual controllers, which are used to control different virtual objects in the cloud gaming application. Furthermore, the interface also displays six controller editing areas, allowing the user to edit six target virtual controllers using the buttons within the controller editing areas. These six target virtual controllers are then applied to the smartphones corresponding to the six game players.

[0108] In one possible implementation, the vehicle computer may determine the number of handle editing areas corresponding to each original virtual handle based on the ratio of the first number to the second number. For example, if the ratio is 3, then each original virtual handle corresponds to 3 handle editing areas. If the ratio of the first number to the second number is not an integer, the vehicle computer may round the ratio to the nearest integer to ensure that the number of handle editing areas corresponding to different original virtual handles is as close as possible. This ensures that the number of people controlling each virtual object is similar, thereby improving game fairness and increasing player participation and collaboration.

[0109] In another possible implementation, the vehicle computer may also prompt the user to enter the number of target virtual handles corresponding to different control objects in the configuration entry interface, and display the handle editing area corresponding to each original virtual handle according to the number. For example, the vehicle computer may further display "Please enter the number of players to control the first virtual object" and "Enter the number of players to control the second virtual object" in the configuration entry interface. Assuming that the user enters 3 and 3 respectively, the vehicle computer will display three handle editing areas below the two original virtual handles in the virtual handle editing interface 630.

[0110] In some embodiments, when the first number of control devices is less than the second number of control objects, the vehicle computer displays a configuration error prompt to prompt the user that the parameters entered are invalid.

[0111] See also Figure 8 , Figure 8 This is a schematic diagram of a display configuration error prompt provided by an exemplary embodiment of the present application.

[0112] like Figure 8 As shown, when the number of people participating in the game (i.e., the first number of control devices) entered by the user in the configuration entry interface 810 is 3, and the number of game characters (i.e., the second number of control objects) is 4, since the first number is less than the second number, the vehicle computer displays a configuration error prompt message 811 in the virtual handle editing interface 810 to prompt the user that the parameters entered are invalid and asks the user to re-enter the parameters that meet the requirements.

[0113] In this embodiment, by configuring the entry interface, the user can determine the first number of control devices and the second number of control objects. On the premise that the first number is greater than or equal to the second number, any number of original virtual handles can be edited according to the actual needs of the user, and the original virtual handles can be split into any number of target virtual handles. Therefore, it is not subject to physical hardware limitations and has a high degree of freedom in handle editing.

[0114] By using the virtual handle editing method provided in the embodiment of the present application, it is possible for one player to control a control object alone, or for multiple players to control the same control object together.

[0115] In some embodiments, the virtual handle editing interface includes a split area corresponding to each original virtual handle, wherein the split area is used to carry the handle editing area corresponding to the original virtual handle.

[0116] When the first number is equal to the second number, each split area contains a single handle editing area, wherein the virtual buttons in the handle editing area belong to the original virtual handle corresponding to the split area to which the handle editing area belongs.

[0117] That is, when the number of control objects is consistent with the number of control devices, the player corresponding to each control device controls one control object separately.

[0118] See also Figure 9 , Figure 9 This is a schematic diagram of an exemplary embodiment of the present application providing a single handle editing area within each split area when the first number is equal to the second number.

[0119] like Figure 9 As shown, when the first number of control devices and the second number of control objects are both 3, three original virtual handles 911, 912, and 913 are displayed in the virtual handle editing interface 910, where each original virtual handle corresponds to a split area, namely split areas 921, 922, and 923. Since the first number is equal to the second number, each split area contains only a single handle editing area.

[0120] After completing the handle editing, the handle editing area within the split area 921 corresponds to the target virtual handle 1 controlled by user A, and the target virtual handle 1 is used to control the virtual object 1 in the cloud game application; the handle editing area within the split area 922 corresponds to the target virtual handle 2 controlled by user B, and the target virtual handle 2 is used to control the virtual object 2; the handle editing area within the split area 923 corresponds to the target virtual handle 3 controlled by user C, and the target virtual handle 3 is used to control the virtual object 3.

[0121] When the first number is greater than the second number, there is at least one split area that contains at least two handle editing areas, wherein the virtual keys in the handle editing area belong to the original virtual handle corresponding to the split area to which the handle editing area belongs.

[0122] That is, when the first number of control devices is greater than the second number of control objects, there are at least two players who jointly control one control object.

[0123] See also Figure 10 , Figure 10 This is a schematic diagram of an exemplary embodiment of the present application, in which at least one split area includes at least two handle editing areas when the first number is greater than the second number.

[0124] like Figure 10 As shown, the virtual handle editing interface 1010 displays a split area 1021 corresponding to the original virtual handle 1011 and a split area 1022 corresponding to the original virtual handle 1012 .

[0125] The two split areas contain a total of four handle editing areas. The target virtual handles corresponding to different handle editing areas will be applied to different control devices, that is, the first number of control devices is 4. The virtual handle editing interface 1010 displays original virtual handles 1011 and 1012. Different original virtual handles correspond to different control objects, that is, the second number of control objects is 2.

[0126] Therefore, when the first number is greater than the second number, there is at least one split area that contains at least two handle editing areas, that is, the split area 1021 contains 3 handle editing areas.

[0127] After completing the handle editing, the three handle editing areas within the split area 1021 correspond to the target virtual handle 1 controlled by user A, the target virtual handle 2 controlled by user B, and the target virtual handle 3 controlled by user C, wherein the above three target virtual handles are used to jointly control the virtual object 1 in the cloud game application; the one handle editing area within the split area 1022 corresponds to the target virtual handle 4 controlled by user D, and the target virtual handle 4 is used to individually control the virtual object 2 in the cloud game application.

[0128] During the handle editing process, the virtual keys in the original virtual handle can only be dragged to the split area corresponding to the original virtual handle, but not to the split areas corresponding to other original virtual handles. Therefore, the error of including virtual keys used to control different control objects in the same target virtual handle can be avoided.

[0129] In some embodiments, in response to a drag operation on a target virtual key in the original virtual handle, the target virtual key is displayed in the handle editing area if the handle editing area at the dragging end point belongs to the split area corresponding to the original virtual handle.

[0130] In order to intuitively and clearly show the correspondence between the original virtual handle and the split area, in some embodiments, the virtual handle editing interface can display the corresponding split area in the area below the original virtual handle, or display the corresponding split area and the original virtual handle in the same color.

[0131] In some embodiments, when the handle editing area at the dragging end point belongs to the split area corresponding to other original virtual handles, a first editing error prompt is displayed.

[0132] The first editing error prompt is used to prompt the user that the virtual key has been dragged to an incorrect split area.

[0133] Optionally, the first editing error prompt may be in the form of a prompt card, prompt text, prompt special effects, etc., and there is no limitation to this.

[0134] See also Figure 11 , Figure 11 This is a schematic diagram showing a first editing error prompt provided by an exemplary embodiment of the present application.

[0135] like Figure 11 As shown, the virtual handle editing interface includes an original virtual handle 1111 and a corresponding split area 1121 , as well as an original virtual handle 1112 and a corresponding split area 1122 .

[0136] When the user performs a drag operation on the virtual button 1131 in the original virtual handle 1112 and drags the virtual button 1131 to the handle editing area in the split area 1121, since the handle editing area at the dragging end point belongs to the split area 1121 corresponding to the other original virtual handle 1111, the vehicle computer displays the first editing error prompt 1140 to prompt the user that the virtual button 1131 does not support dragging to this split area 1121.

[0137] In this embodiment, when the handle editing area at the end point of dragging belongs to the split area corresponding to other original virtual handles, the first editing error prompt is displayed. This can avoid the user from dragging virtual buttons in different original virtual handles to the same handle editing area and causing errors, thereby improving the accuracy of virtual handle editing.

[0138] After the user enters the first number of control devices and the second number of control objects in the configuration entry interface, when editing the handle in the virtual handle editing interface, the number of players can be temporarily adjusted, or the control relationship between different players and control objects can be adjusted, or the number of control objects can be temporarily changed, etc.

[0139] In one possible implementation, the user can return to the configuration entry interface, re-enter the parameters related to the handle editing, and edit them in the updated virtual handle editing interface.

[0140] To improve editing efficiency, in another possible implementation, the user can also make adjustments directly in the current virtual handle editing interface.

[0141] In some embodiments, in response to a region adjustment operation on a handle editing region within a split region, the split region to which the handle editing region belongs is adjusted.

[0142] In one possible implementation, for the first handle editing area within the first split area, when the first handle editing area does not include virtual buttons, in response to a moving operation of moving the first handle editing area to the second split area, the vehicle computer stops displaying the first handle editing area within the first split area, and adds the first handle editing area to be displayed in the second split area.

[0143] Before performing the move operation, the first handle editing area is used to edit the virtual keys contained in the first original virtual handle corresponding to the first split area; after performing the move operation, the first handle editing area is used to edit the virtual keys contained in the second original virtual handle corresponding to the second split area.

[0144] See also Figure 12 , Figure 12 This is a schematic diagram of an exemplary embodiment of the present application providing an area adjustment operation on a handle editing area.

[0145] like Figure 12 As shown, the virtual handle editing interface 1210 displays a first split area 1221 corresponding to the original virtual handle 1211 and a second split area 1222 corresponding to the original virtual handle 1212 .

[0146] The handle editing area 1232 in the first split area 1221 does not include virtual buttons. When the user moves the handle editing area 1232 to the second split area 1222, the vehicle computer stops displaying the handle editing area 1232 in the first split area 1221, and adds a handle editing area 1232 to the second split area 1222.

[0147] The handle editing area 1232 displayed in the second split area 1222 is used to edit the virtual buttons in the original virtual handle 1212 .

[0148] In another possible implementation, for the first handle editing area in the first split area, when the first handle editing area includes virtual keys, in response to the moving operation of moving the first handle editing area to the second split area, the vehicle computer can first remove the existing virtual keys in the first handle editing area. When all the virtual keys in the first handle editing area have been removed, the vehicle computer stops displaying the first handle editing area in the first split area, and adds the first handle editing area to be displayed in the second split area.

[0149] For example, when the user moves the handle editing area 1231 to the second split area 1222 , the vehicle computer removes the virtual keys contained in the handle editing area 1231 and then moves the handle editing area 1231 to the second split area 1222 .

[0150] In another possible implementation, for the first handle editing area in the first split area, when the first handle editing area includes virtual keys, in response to the moving operation of moving the first handle editing area to the second split area, the vehicle computer may first prompt the user to transfer the existing virtual keys in the first handle editing area to other handle editing areas in the first split area. When all the virtual keys in the first handle editing area have been transferred, the vehicle computer stops displaying the first handle editing area in the first split area, and adds the first handle editing area to the second split area.

[0151] For example, when the user moves the handle editing area 1233 to the second split area 1222, the vehicle computer prompts the user to first transfer the virtual buttons contained in the handle editing area 1233 to the handle editing area 1231 or 1233, and then move the handle editing area 1231 to the second split area 1222.

[0152] In some other possible implementations, the area adjustment operation may have other forms besides the movement operation of moving the handle editing area from the first split area to the second split area.

[0153] For example, a user can set the number of handle editing areas within a split area. The vehicle computer displays the target number of handle editing areas indicated by the setting operation within the split area. Simultaneously, the vehicle computer adjusts the number of handle editing areas in other split areas based on the target number and the first number of control devices.

[0154] Optionally, the quantity setting operation may be performed through a quantity setting button, a shortcut key, or other methods.

[0155] For example, when the user sets the number of handle editing areas within the first split area 1221 to 4, the vehicle computer displays four handle editing areas within the first split area 1221. At the same time, since one handle editing area has been added to the first split area 1221 compared to the original, to ensure that the first number of control settings remains unchanged (still 6), the vehicle computer can remove one handle editing area from the second split area 1222. For example, the vehicle computer can remove the blank handle editing area in the second split area 1222 that does not contain a virtual button.

[0156] In this embodiment, in response to the area adjustment operation of the handle editing area within the split area, the split area to which the handle editing area belongs is adjusted. The number of handle editing areas in the split area and the correspondence between the split area and the handle editing area can be flexibly adjusted, thereby improving the efficiency of virtual handle editing.

[0157] The virtual handle editing interface can be used to split an original virtual handle into one or more target virtual handles, or to split two or more original virtual handles into two or more target virtual handles.

[0158] In some embodiments, the virtual handle editing interface includes at least two original virtual handles. Therefore, when the user drags a virtual button in the original virtual handle to the handle editing area, it is necessary to determine whether the virtual button can be dragged to the current handle editing area.

[0159] In some embodiments, in response to a key editing operation in the handle editing area, if the target virtual key indicated by the key editing operation belongs to the same original virtual handle as the existing virtual key in the handle editing area, the target virtual key is displayed in the handle editing area.

[0160] Optionally, the vehicle computer may set an original handle identifier for each original virtual handle, and the virtual buttons included in the original virtual handle also have an original handle identifier corresponding to the original virtual handle.

[0161] Optionally, the original handle identifier is a MAC (Media Access Control address) address of the original virtual handle.

[0162] For example only, if the original handle identifier of the original virtual handle A is MAC address a, then the original handle identifier corresponding to the virtual button contained in the original virtual handle A is also MAC address a. When the user drags the virtual button contained in the original virtual handle A to the handle editing area, if the original handle identifier corresponding to an existing virtual button in the handle editing area is also MAC address a, the vehicle computer will display the virtual button and other existing virtual buttons in the handle editing area.

[0163] In some embodiments, when the target virtual key and the existing virtual keys in the handle editing area belong to different original virtual handles, a second editing error prompt is displayed.

[0164] The second editing error prompt is used to prompt the user to drag the virtual key to the wrong handle editing area.

[0165] See also Figure 13 , Figure 13 This is a schematic diagram showing a second editing error prompt provided by an exemplary embodiment of the present application.

[0166] like Figure 13 As shown, the virtual handle editing interface displays original virtual handle 1311 and original handle 1312. The original handle identifier corresponding to original virtual handle 1311 is MAC address a, and the original handle identifier corresponding to original handle 1312 is MAC address b. The existing virtual buttons in handle editing area 1321 are the two joysticks in original virtual handle 1311, and the corresponding original handle identifiers are MAC address a. The original handle identifier corresponding to virtual button 1331 in original virtual button 1312 is MAC address b.

[0167] When the user performs a drag operation on the virtual key 1331 in the original virtual key 1312, and the drag terminal of the drag operation is the handle editing area 1321, since the existing virtual key in the handle editing area 1321 is different from the original handle identifier corresponding to the virtual key 1331, the vehicle computer displays a second editing error prompt 1340 to prompt the user that the drag operation cannot be successfully executed.

[0168] In a possible scenario, the original virtual controller may include at least two virtual buttons with the same button function. For example, the original virtual controller may include two shoulder buttons both used for aiming.

[0169] In order to improve the accuracy of handle editing and avoid virtual keys with the same function being assigned to different handle editing areas, resulting in the virtual keys with the same function being used by two or more players, in some embodiments, in response to a key editing operation in the handle editing area, the vehicle computer displays the target virtual key in the handle editing area when the target virtual key indicated by the key editing operation corresponds to a different key function from the existing virtual keys in other handle editing areas.

[0170] Optionally, the vehicle computer may determine the function identifiers corresponding to the virtual buttons in the original virtual handle, wherein virtual buttons with the same button functions correspond to the same function identifiers.

[0171] When the target virtual key indicated by the key editing operation is different from the function identifiers corresponding to the existing virtual keys in other handle editing areas, the target virtual key is displayed in the handle editing area.

[0172] In some embodiments, when the target virtual key indicated by the key editing operation corresponds to the same key function as the existing virtual keys in other handle editing areas, the vehicle computer displays a third editing error prompt.

[0173] Among them, the third editing error prompt is used to prompt the user that there are virtual keys with the same key function in other handle editing areas.

[0174] See also Figure 14 , Figure 14 This is a schematic diagram showing a third editing error prompt provided by an exemplary embodiment of the present application.

[0175] like Figure 14 As shown, the handle editing area 1414 displayed in the virtual handle editing interface includes a right shoulder button 1415 with an aiming function.

[0176] When the user drags the virtual button 1412 contained in the original virtual handle 1411 to the handle editing area 1413, since the virtual button 1412 is a left shoulder button with an aiming function, its button function is consistent with the button function of the virtual button 1415 in other handle editing areas 1414. Therefore, the vehicle computer displays a third editing error prompt 1416 to remind the user that there are virtual buttons with the same button functions in other handle editing areas.

[0177] To improve the editing efficiency of the virtual handle, the car computer can provide users with recommended virtual handle splitting plans. Users can use quick editing operations to obtain the splitting plan with one click and directly adopt the splitting plan, or edit and adjust the virtual buttons based on the splitting plan to reduce the operation steps and improve editing efficiency.

[0178] In some embodiments, in response to the quick edit operation, the vehicle computer groups the virtual keys contained in the original virtual handle based on the number of regions in the handle editing area corresponding to the original virtual handle to obtain a key combination, and displays the virtual keys in the key combination in the handle editing area. The number of key combinations is consistent with the number of regions.

[0179] Optionally, the quick editing operation may be a triggering operation of a quick editing button in the virtual handle editing interface, or a shortcut key operation or a special gesture operation, etc., and there is no restriction on this.

[0180] For example only, if the number of handle editing areas corresponding to the first original virtual handle is 4, the vehicle computer will divide the virtual keys contained in the first original virtual handle into 4 key combinations, and display the virtual keys in the 4 virtual key combinations in the 4 handle editing areas respectively.

[0181] In one possible implementation, the vehicle computer may group the virtual keys based on the number of areas in the handle editing area and the number of virtual keys in the original virtual handle, so that the number of virtual keys contained in different key combinations is closest.

[0182] In another possible implementation, the vehicle computer can group the virtual keys contained in the original virtual handle based on the number of areas in the handle editing area and the function type of the virtual keys in the original virtual handle to obtain a key combination, wherein virtual keys of the same function type are divided into the same key combination.

[0183] Among them, the vehicle computer can determine the function type identifiers corresponding to different virtual buttons, and classify the virtual buttons with the same function type identifiers into the same button combination.

[0184] For example only, the function types corresponding to the four directional movement keys "up, down, left, and right" are all "movement functions", the function types corresponding to the left shoulder key and the right shoulder key are all "aiming functions", the function types corresponding to the left joystick and the right joystick are all "attack functions", and so on.

[0185] By grouping virtual keys of the same functional type into the same key combination, the target virtual handle corresponding to the key combination can be used to control the same type of function of the controlled object. In a scenario where two or more players control the same controlled object, division of labor and cooperation between different players can be achieved, thereby improving the players' operating efficiency.

[0186] After the user completes editing the handle, the edited target virtual handle can be applied to the control device.

[0187] In some embodiments, in response to an editing application operation, when at least one handle editing area does not include a virtual button, the vehicle computer displays a fourth editing error prompt.

[0188] The edit and apply operation is used to apply the edited virtual handle to the control device.

[0189] Optionally, the editing application operation may be a triggering operation on an editing completion button, a sharing operation on a handle editing area, a shortcut key or a special gesture operation, etc., and there is no restriction on this.

[0190] See also Figure 15 , Figure 15 This is a schematic diagram showing a fourth editing error prompt provided by an exemplary embodiment of the present application.

[0191] Among them, the fourth editing error prompt is used to prompt the user that the button editing operation in the handle editing area has not been completed.

[0192] like Figure 15 As shown, when the user triggers the editing completion button 1512, since the handle editing area 1511 does not contain a virtual key, the terminal displays a fourth editing error prompt in the handle editing area 1511 to prompt the user that the editing of the handle editing area 1511 has not been completed yet.

[0193] After the user successfully completes the button editing operation in each handle editing area, the vehicle computer can apply the target virtual handle corresponding to each handle editing area to each control device.

[0194] In some embodiments, in response to an editing application operation, when each handle editing area includes a virtual button, the vehicle computer applies the edited target virtual handle to the control device.

[0195] In one possible implementation, in response to an editing application operation, the vehicle computer displays a graphic code containing handle information, so that after the control device obtains the graphic code by scanning, it displays the target virtual handle based on the handle information parsed from the graphic code.

[0196] The handle information includes the handle identifier of the target virtual handle and the key information of the virtual keys included in the target virtual handle.

[0197] Optionally, the graphic code includes an information container such as a graphic code, a barcode, etc. that carries information through a graphic identifier.

[0198] See also Figure 16 , Figure 16 This is a schematic diagram of a vehicle computer displaying a graphic code in response to an editing application operation provided by an exemplary embodiment of the present application.

[0199] like Figure 16 As shown, when the user completes the key editing operation in each handle editing area, when the user triggers the editing completion button 1611, the vehicle computer displays the graphic code corresponding to each handle editing area.

[0200] The graphic code carries the handle identifier of the target virtual handle corresponding to the handle editing area, and the key information of the virtual keys contained in the target virtual handle.

[0201] For example, the graphic code 1631 (QR code 1) carries the handle identifier of the target virtual handle corresponding to the handle editing area 1621, as well as the button information of the virtual buttons contained in the target virtual handle, namely the left shoulder button, right shoulder button, left joystick and right joystick.

[0202] After the control device obtains the graphic code by scanning, it displays the target virtual controller based on the controller information obtained from the graphic code.

[0203] See also Figure 17 , Figure 17 This is a schematic diagram of a control device displaying a target virtual handle based on handle information obtained by parsing a graphic code, provided by an exemplary embodiment of the present application.

[0204] like Figure 17 As shown, when 6 control devices (smartphones) scan Figure 16 After the 6 graphic codes are displayed on the CRRC computer, each control device displays the corresponding target virtual handle based on the handle information parsed from the graphic code.

[0205] For example, after the smartphone 1711 scans the graphic code 1631 displayed on the vehicle computer, the target virtual controller corresponding to the controller editing area 1621 is displayed based on the controller information carried in the graphic code 1631. The target virtual controller includes the left shoulder button, right shoulder button, left joystick, and right joystick contained in the controller editing area 1621. The controller information carried in the graphic code 1631 includes the controller identifier of the target virtual controller corresponding to the controller editing area 1621 and the key information of the virtual keys contained in the target virtual controller.

[0206] In the cloud application scenario, the target virtual handle is used to control the virtual objects in the cloud application. The user of the smartphone 1711 clicks the ready control 1712 to control the virtual objects in the cloud application in the vehicle computer through the target virtual handle displayed on the smartphone 1711.

[0207] Therefore, in order to determine which virtual object in the cloud application is controlled by the target virtual handle, in some embodiments, the vehicle computer reports the handle information and the mapping relationship between the target virtual handle and the virtual object to the cloud application server, so that when the cloud application server receives the control event reported by the control device, it determines the virtual object controlled by the control event based on the mapping relationship, wherein the control event includes the handle identifier of the target virtual handle.

[0208] The mapping relationship between the target virtual handle and the virtual object can be determined by the vehicle computer based on the mapping relationship between the original virtual handle and the virtual object. Figure 16 For the handle editing area 1621 in the image, the virtual button in the corresponding target virtual handle belongs to the first original virtual handle. Therefore, the target virtual handle corresponding to the handle editing area 1621 is used to control the virtual object "Zhang San" corresponding to the first original virtual handle.

[0209] After the vehicle computer sends the handle information (including the handle identifier of the target virtual handle corresponding to each handle editing area and the key information of the virtual keys contained in each target virtual handle) and the mapping relationship between each target virtual handle and the virtual object to the cloud application server, when the control device 1711 uploads the control event containing the handle identifier to the cloud application server, the cloud application server can determine that the virtual object controlled by the control event is "Zhang San" based on the handle identifier. The handle identifier is the handle identifier of the target virtual handle corresponding to the handle editing area 1621.

[0210] Optionally, the handle information also includes an instance token of the cloud application instance, and the control event includes the instance token, which is used to verify the legitimacy of the control event.

[0211] Among them, the instance token is also called "token". When the control device parses the handle information from the graphic code, the control device can obtain the token contained in the handle information, and include the token in the handle identifier when uploading the control event to the cloud application server, and include the handle identifier in the control event. When the cloud application server receives the control event, it performs a legitimacy check on the token. If the legitimacy check passes, the virtual object controlled by the control event is determined based on the handle identifier.

[0212] It should be noted that, in order to determine which virtual object in the cloud application is controlled by the target virtual handle, those skilled in the art may also implement it in any other possible manner, for example, in at least one of the following manners.

[0213] (1) In one possible implementation, the handle information of the target virtual handle may further include a virtual object identifier, wherein the virtual object identifier is used to represent the virtual object that the target virtual handle is used to control. The vehicle computer transmits the handle information including the virtual object identifier to the cloud application server, and the control device uploads the handle information including the virtual object identifier to the cloud application server along with a control event. The cloud application server determines the virtual object controlled by the control event based on the virtual object identifier.

[0214] (2) In one possible implementation, after obtaining the handle information from the graphic code and displaying the target virtual handle according to the handle information, the control device may first send a control event containing a handle identifier to the vehicle computer, and the vehicle computer determines the corresponding virtual object based on the handle identifier. The vehicle computer sends the virtual object identifier and the handle information corresponding to the virtual object to the cloud application server, and the control device sends the control event containing the handle information to the cloud application server. The cloud application server then determines that the virtual object controlled by the control event is the virtual object corresponding to the virtual object identifier based on the information sent by the vehicle computer (virtual object identifier and handle information) and the information sent by the control device (control event containing handle control information).

[0215] It should be noted that in addition to applying the edited target virtual handle to the control device through graphic code, those skilled in the art can also implement it in any other possible way. For example, the edited target virtual handle can be applied to the control device through at least one of the following ways.

[0216] (1) Through Bluetooth connection. After the user completes the button editing operation in each handle editing area in the vehicle computer, in response to the editing application operation, a Bluetooth connection is established between the vehicle computer and the control device, and the handle information corresponding to each handle editing area is sent to each control device through the Bluetooth connection, so that the control device displays the corresponding target virtual handle based on the handle information.

[0217] (2) Through SMS link. After the user completes the key editing operation in each handle editing area in the vehicle computer, the vehicle computer displays the number input area. After the user enters the number corresponding to the control device in the number input area, the vehicle computer sends the number and handle information to the SMS service. The SMS service sends a text message containing a link to the control device, wherein the link carries the handle information. After receiving the text message, the control device displays the target virtual handle based on the handle information contained in the text message link.

[0218] In addition, those skilled in the art may also use wireless network technologies such as WiFi (Wireless Fidelity) or mobile data to apply the edited target virtual handle to the control device. Such solutions of applying the target virtual handle to the control device are within the scope of protection of this application.

[0219] See also Figure 18 , Figure 18 FIG. 1 is a flowchart of a method for editing a virtual handle provided by another exemplary embodiment of the present application. The method includes the following steps.

[0220] Step 1801, the vehicle computer starts.

[0221] Step 1802: The cloud application is started and logged in through the account.

[0222] In step 1803, the vehicle computer displays an editing inquiry interface, asking the user whether to use the virtual handle editing technology.

[0223] In response to the cancel operation, step 1804 is executed to control the virtual object in the cloud application through the physical handle.

[0224] In response to the confirmation operation, step 1805 is executed, and the vehicle computer displays the configuration entry interface.

[0225] Step 1806: The user enters a first quantity of control devices and a second quantity of control objects in the configuration entry interface.

[0226] In step 1807, the vehicle computer displays a pop-up window introducing the functions of the virtual buttons.

[0227] Optionally, to introduce the functions of the virtual buttons in the original virtual handle, before editing the handle, the vehicle computer can display the functions of the virtual buttons in the original virtual handle in a pop-up window using animated videos to inform the user of the function of each virtual button.

[0228] Step 1808: The vehicle computer displays a virtual handle editing interface, and the user performs button editing operations in the handle editing area.

[0229] Optionally, the user can edit the target virtual handle by dragging the virtual buttons contained in the original virtual handle in the virtual handle editing interface to the handle editing area.

[0230] Step 1809: If the key editing operation does not meet the requirements, an error prompt message is displayed; if it meets the requirements, a handle editing area containing the target virtual key is displayed.

[0231] Optionally, regarding the requirements that key editing operations need to meet, and the editing error prompts displayed when the requirements are not met, please refer to the first editing error prompt, the second editing error prompt, and the third editing error prompt in the previous embodiments, which will not be repeated here.

[0232] Step 1810: In response to the editing application operation, the vehicle computer determines whether each handle editing area contains virtual buttons.

[0233] In response to no, step 1811 is executed to display the corresponding editing error prompt (ie, the fourth editing error prompt). For more details about the fourth editing error prompt, please refer to the previous embodiment and will not be repeated here.

[0234] In response, step 1812 is executed, the vehicle computer displays a graphic code containing the handle information, and sends the mapping relationship between the handle information, the target virtual handle and the virtual object to the cloud application server.

[0235] Step 1813: After the control device scans the code successfully, the target virtual handle is displayed on the control device.

[0236] In step 1814, the user clicks the ready control, and the control device notifies the cloud application server that it is ready.

[0237] Step 1815: The cloud application server decodes the compressed video stream and pushes the video stream to the vehicle computer.

[0238] Optionally, upon receiving a ready notification from each control device, the cloud application server pushes the video stream to the vehicle computer.

[0239] In step 1816 , the user operates the target virtual handle on the control device, and the control device sends the operation event including the handle information and the token to the cloud application server.

[0240] In step 1817, after the cloud application server successfully verifies the token, it updates the virtual object based on the operation event and sends the new video stream after encoding and compression to the vehicle computer in real time.

[0241] In step 1818, the vehicle computer receives the video stream, decodes and renders it to display the real-time cloud application video.

[0242] Step 1819, the process ends.

[0243] See also Figure 19 , Figure 19 This is a block diagram of a virtual handle editing device provided by an exemplary embodiment of the present application. The device includes:

[0244] The interface display module 1901 is used to display a virtual handle editing interface, wherein the virtual handle editing interface includes at least one handle editing area, wherein the handle editing area is used to edit a target virtual handle, and different handle editing areas correspond to different target virtual handles;

[0245] A button editing module 1902 is configured to respond to a button editing operation in the handle editing area and display a target virtual button indicated by the button editing operation in the handle editing area;

[0246] The handle application module 1903 is used to apply the edited target virtual handle to the control device in response to the editing application operation, so that the control device is controlled by the target virtual handle, wherein different target virtual handles are applied to different control devices, and the edited target virtual handle includes virtual buttons in the corresponding handle editing area.

[0247] Optionally, the virtual handle editing interface further includes an original virtual handle, and the original virtual handle includes virtual buttons; the button editing module 1902 is used to:

[0248] In response to a drag operation on the target virtual key in the original virtual handle, the target virtual key is displayed in the handle editing area located at an end point corresponding to the drag operation.

[0249] Optionally, after the target virtual key is displayed in the handle editing area located at the dragging end point corresponding to the dragging operation, the key editing module 1902 is configured to:

[0250] The target virtual key in the original virtual handle is set to an uneditable state, wherein the target virtual key does not support editing in the uneditable state.

[0251] Optionally, the key editing module 1902 is used to:

[0252] In response to a removal operation on the target virtual key in the handle editing area, the target virtual key in the original virtual handle is set to an editable state, wherein the target virtual key supports editing in the editable state.

[0253] Optionally, the interface display module 1901 is used to:

[0254] Displaying a configuration entry interface, wherein the configuration entry interface is used to configure a first number of control devices and a second number of control objects;

[0255] When the first number is greater than or equal to the second number, displaying the virtual handle editing interface including the second number of original virtual handles and the first number of handle editing areas, wherein different control objects correspond to different original virtual handles;

[0256] When the first number is smaller than the second number, a configuration error prompt is displayed.

[0257] Optionally, each original virtual handle in the virtual handle editing interface corresponds to its own split area;

[0258] When the first number is equal to the second number, each split area contains a single handle editing area;

[0259] In the case where the first number is greater than the second number, there is at least one split area containing at least two handle editing areas;

[0260] The virtual buttons in the handle editing area belong to the original virtual handle corresponding to the split area to which the handle editing area belongs.

[0261] Optionally, the key editing module 1902 is used to:

[0262] In response to a drag operation on the target virtual key in the original virtual handle, if the handle editing area at the dragging end point belongs to the split area corresponding to the original virtual handle, displaying the target virtual key in the handle editing area;

[0263] In the case that the handle editing area located at the dragging end point belongs to the split area corresponding to other original virtual handles, a first editing error prompt is displayed.

[0264] Optionally, the key editing module 1902 is used to:

[0265] In response to an area adjustment operation on the handle editing area within the split area, the split area to which the handle editing area belongs is adjusted.

[0266] Optionally, the virtual handle editing interface includes at least two original virtual handles; the button editing module 1902 is used to:

[0267] In response to the key editing operation in the handle editing area, if the target virtual key indicated by the key editing operation and an existing virtual key in the handle editing area belong to the same original virtual handle, displaying the target virtual key in the handle editing area;

[0268] In a case where the target virtual key and the existing virtual keys in the handle editing area belong to different original virtual handles, a second editing error prompt is displayed.

[0269] Optionally, the original virtual handle includes at least two virtual keys with the same key function; the key editing module 1902 is configured to:

[0270] In response to the key editing operation in the handle editing area, if the target virtual key indicated by the key editing operation corresponds to a different key function than other existing virtual keys in the handle editing area, displaying the target virtual key in the handle editing area;

[0271] When the target virtual key indicated by the key editing operation corresponds to the same key function as an existing virtual key in another handle editing area, a third editing error prompt is displayed.

[0272] Optionally, the key editing module 1902 is used to:

[0273] In response to a quick edit operation, grouping virtual keys included in the original virtual handle based on the number of regions of the handle editing area corresponding to the original virtual handle to obtain key combinations, where the number of the key combinations is consistent with the number of regions;

[0274] The virtual keys in the key combination are displayed in the handle editing area.

[0275] Optionally, the key editing module 1902 is used to:

[0276] Based on the number of areas in the handle editing area and the function types of the virtual keys in the original virtual handle, the virtual keys contained in the original virtual handle are grouped to obtain the key combination, wherein virtual keys of the same function type are divided into the same key combination.

[0277] Optionally, the handle application module 1903 is used to:

[0278] In response to the editing and applying operation, if each handle editing area includes a virtual button, applying the edited target virtual handle to the control device;

[0279] When there is at least one handle editing area that does not contain a virtual key, a fourth editing error prompt is displayed.

[0280] Optionally, the handle application module 1903 is used to:

[0281] In response to the editing application operation, a graphic code containing handle information is displayed, so that after the control device obtains the graphic code by scanning, the target virtual handle is displayed based on the handle information parsed from the graphic code, wherein the handle information includes the handle identifier of the target virtual handle and the key information of the virtual keys included in the target virtual handle; or

[0282] In response to the editing application operation, the handle information is transmitted to the control device, so that the control device displays the target virtual handle based on the handle information.

[0283] Optionally, the method is used in a cloud application scenario, and the target virtual handle is used to control a virtual object in the cloud application; the handle application module 1903 is used to:

[0284] Report the handle information and the mapping relationship between the target virtual handle and the virtual object to the cloud application server, so that when the cloud application server receives the control event reported by the control device, it can determine the virtual object controlled by the control event based on the mapping relationship, and the control event includes the handle identifier.

[0285] Optionally, the handle information further includes an instance token of a cloud application instance, and the control event includes the instance token, which is used to verify the legitimacy of the control event.

[0286] See also Figure 20 , Figure 20 It is a schematic diagram of the structure of a terminal provided by an exemplary embodiment of the present application.

[0287] The terminal can be implemented as the virtual handle editing device (e.g., a car computer) in the above embodiments, or as the control device (e.g., a smartphone) in the above embodiments. The present application does not impose any restrictions on the specific types of the virtual handle editing device and the control device, and the virtual handle editing device and the control device can also be a tablet computer, a laptop computer, a smartphone, or other types of terminals.

[0288] Specifically, the terminal 2000 includes a central processing unit (CPU) 2001, a system memory 2004 including a random access memory 2002 and a read-only memory 2003, and a system bus 2005 connecting the system memory 2004 and the CPU 2001. The terminal 2000 also includes a basic input / output system (I / O system) 2006 for facilitating information transmission between various components within the computer, and a mass storage device 2007 for storing an operating system 2013, application programs 2014, and other program modules 2015.

[0289] The basic input / output system 2006 includes a display 2008 for displaying information and an input device 2009 such as a mouse and a keyboard for user input. The display 2008 and the input device 2009 are both connected to the central processing unit 2001 via an input / output controller 2010 connected to the system bus 2005. The basic input / output system 2006 may also include an input / output controller 2010 for receiving and processing input from a plurality of other devices such as a keyboard, a mouse, or an electronic stylus. Similarly, the input / output controller 2010 also provides output to a display screen, a printer, or other types of output devices.

[0290] The mass storage device 2007 is connected to the central processing unit 2001 via a mass storage controller (not shown) connected to the system bus 2005. The mass storage device 2007 and its associated computer-readable medium provide non-volatile storage for the terminal 2000. In other words, the mass storage device 2007 may include a computer-readable medium (not shown) such as a hard disk or drive.

[0291] Without loss of generality, the computer-readable medium may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Computer storage media include random access memory (RAM), read-only memory (ROM), flash memory or other solid-state storage technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic tape cassettes, magnetic tapes, disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that the computer storage media are not limited to the above-mentioned ones. The above-mentioned system memory 2004 and mass storage device 2007 can be collectively referred to as memory.

[0292] The memory stores one or more programs, and the one or more programs are configured to be executed by one or more central processing units 2001. The one or more programs contain instructions for implementing the above-mentioned methods. The central processing unit 2001 executes the one or more programs to implement the methods provided by the above-mentioned various method embodiments.

[0293] According to various embodiments of the present application, the terminal 2000 can also be connected to a remote computer on a network via a network such as the Internet. That is, the terminal 2000 can be connected to the network 2012 via the network interface unit 2011 connected to the system bus 2005, or the network interface unit 2011 can be used to connect to other types of networks or remote computer systems (not shown).

[0294] The memory also includes one or more programs, which are stored in the memory and include steps executed by the terminal in the method provided in the embodiment of the present application.

[0295] The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium stores at least one instruction, and the at least one instruction is loaded and executed by a processor to implement the method described in the above embodiment. Optionally, the computer-readable storage medium may include: ROM, RAM, solid-state drives (SSDs), or optical disks. Among them, RAM may include resistance random access memory (ReRAM) and dynamic random access memory (DRAM).

[0296] The present application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various optional implementations of the above aspects.

[0297] The above description is merely an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A virtual handle editing method, characterized in that: The method comprises: Displaying a virtual handle editing interface, wherein the virtual handle editing interface includes at least one handle editing area, wherein the handle editing area is used to edit a target virtual handle, and different handle editing areas correspond to different target virtual handles; In response to a key editing operation in the handle editing area, displaying a target virtual key indicated by the key editing operation in the handle editing area; In response to the editing application operation, the edited target virtual handle is applied to the control device so that the control device is controlled by the target virtual handle, wherein different target virtual handles are applied to different control devices, and the edited target virtual handle includes virtual buttons within the corresponding handle editing area.

2. The method according to claim 1, characterized in that The virtual handle editing interface also includes an original virtual handle, and the original virtual handle includes virtual buttons; In response to the key editing operation in the handle editing area, displaying the target virtual key indicated by the key editing operation in the handle editing area includes: In response to a drag operation on the target virtual key in the original virtual handle, the target virtual key is displayed in the handle editing area located at an end point corresponding to the drag operation.

3. The method according to claim 2, characterized in that After displaying the target virtual key in the handle editing area located at the dragging end point corresponding to the drag operation, the method further includes: The target virtual key in the original virtual handle is set to an uneditable state, wherein the target virtual key does not support editing in the uneditable state.

4. The method according to claim 3, characterized in that The method further comprises: In response to a removal operation on the target virtual key in the handle editing area, the target virtual key in the original virtual handle is set to an editable state, wherein the target virtual key supports editing in the editable state.

5. The method according to claim 2, characterized in that Before displaying the virtual handle editing interface, the method further includes: Displaying a configuration entry interface, wherein the configuration entry interface is used to configure a first number of control devices and a second number of control objects; The display of the virtual handle editing interface includes: When the first number is greater than or equal to the second number, displaying the virtual handle editing interface including the second number of original virtual handles and the first number of handle editing areas, wherein different control objects correspond to different original virtual handles; The method further comprises: When the first number is smaller than the second number, a configuration error prompt is displayed.

6. The method according to claim 5, characterized in that The virtual handle editing interface includes the split areas corresponding to the original virtual handles; When the first number is equal to the second number, each split area contains a single handle editing area; In the case where the first number is greater than the second number, there is at least one split area containing at least two handle editing areas; The virtual buttons in the handle editing area belong to the original virtual handle corresponding to the split area to which the handle editing area belongs.

7. The method according to claim 6, characterized in that In response to the drag operation on the target virtual key in the original virtual handle, displaying the target virtual key in the handle editing area located at the dragging end point corresponding to the drag operation includes: In response to a drag operation on the target virtual key in the original virtual handle, if the handle editing area at the dragging end point belongs to the split area corresponding to the original virtual handle, displaying the target virtual key in the handle editing area; The method further comprises: In the case that the handle editing area located at the dragging end point belongs to the split area corresponding to other original virtual handles, a first editing error prompt is displayed.

8. The method according to claim 6, characterized in that The method further comprises: In response to an area adjustment operation on the handle editing area within the split area, the split area to which the handle editing area belongs is adjusted.

9. The method according to claim 2, characterized in that The virtual handle editing interface includes at least two original virtual handles; In response to the key editing operation in the handle editing area, displaying the target virtual key indicated by the key editing operation in the handle editing area includes: In response to the key editing operation in the handle editing area, if the target virtual key indicated by the key editing operation and an existing virtual key in the handle editing area belong to the same original virtual handle, displaying the target virtual key in the handle editing area; The method further comprises: In a case where the target virtual key and the existing virtual keys in the handle editing area belong to different original virtual handles, a second editing error prompt is displayed.

10. The method according to claim 2, characterized in that The original virtual handle includes at least two virtual buttons with the same button function; In response to the key editing operation in the handle editing area, displaying the target virtual key indicated by the key editing operation in the handle editing area includes: In response to the key editing operation in the handle editing area, if the target virtual key indicated by the key editing operation corresponds to a different key function than other existing virtual keys in the handle editing area, displaying the target virtual key in the handle editing area; The method further comprises: When the target virtual key indicated by the key editing operation corresponds to the same key function as an existing virtual key in another handle editing area, a third editing error prompt is displayed.

11. The method according to claim 2, characterized in that The method further comprises: In response to a quick edit operation, grouping virtual keys included in the original virtual handle based on the number of regions of the handle editing area corresponding to the original virtual handle to obtain key combinations, where the number of the key combinations is consistent with the number of regions; The virtual keys in the key combination are displayed in the handle editing area.

12. The method according to claim 11, characterized in that The grouping of virtual keys included in the original virtual handle based on the number of areas of the handle editing area corresponding to the original virtual handle to obtain a key combination includes: Based on the number of areas in the handle editing area and the function types of the virtual keys in the original virtual handle, the virtual keys contained in the original virtual handle are grouped to obtain the key combination, wherein virtual keys of the same function type are divided into the same key combination.

13. The method according to any one of claims 1 to 12, characterized in that: In response to the editing application operation, applying the edited target virtual handle to the control device includes: In response to the editing and applying operation, if each handle editing area includes a virtual button, applying the edited target virtual handle to the control device; The method further comprises: When there is at least one handle editing area that does not contain a virtual key, a fourth editing error prompt is displayed.

14. The method according to any one of claims 1 to 12, characterized in that: In response to the editing application operation, applying the edited target virtual handle to the control device includes: In response to the editing application operation, a graphic code containing handle information is displayed, so that after the control device obtains the graphic code by scanning, the target virtual handle is displayed based on the handle information parsed from the graphic code, wherein the handle information includes the handle identifier of the target virtual handle and the key information of the virtual keys included in the target virtual handle; or In response to the editing application operation, the handle information is transmitted to the control device, so that the control device displays the target virtual handle based on the handle information.

15. The method according to claim 14, characterized in that The method is used in cloud application scenarios, and the target virtual handle is used to control virtual objects in cloud applications; The method further comprises: Report the handle information and the mapping relationship between the target virtual handle and the virtual object to the cloud application server, so that when the cloud application server receives the control event reported by the control device, it can determine the virtual object controlled by the control event based on the mapping relationship, and the control event includes the handle identifier.

16. The method according to claim 15, characterized in that The handle information also includes an instance token of a cloud application instance, and the control event includes the instance token, which is used to verify the legitimacy of the control event.

17. A virtual handle editing device, characterized in that: The device comprises: An interface display module is used to display a virtual handle editing interface, wherein the virtual handle editing interface includes at least one handle editing area, wherein the handle editing area is used to edit a target virtual handle, and different handle editing areas correspond to different target virtual handles; a button editing module, configured to respond to a button editing operation in the handle editing area and display a target virtual button indicated by the button editing operation in the handle editing area; A handle application module is used to apply the edited target virtual handle to the control device in response to the editing application operation, so that the control device is controlled by the target virtual handle, wherein different target virtual handles are applied to different control devices, and the edited target virtual handle includes virtual buttons in the corresponding handle editing area.

18. A terminal, characterized in that: The terminal includes a processor and a memory; the memory stores at least one instruction, and the at least one instruction is used to be executed by the processor to implement the virtual handle editing method according to any one of claims 1 to 16.

19. A computer-readable storage medium, characterized in that The computer-readable storage medium stores at least one instruction, which is loaded and executed by a processor to implement the virtual handle editing method according to any one of claims 1 to 16.

20. A computer program product, characterized in that The computer program product includes computer instructions, which are stored in a computer-readable storage medium; the processor of the terminal reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the terminal executes the virtual handle editing method as described in any one of claims 1 to 16.

Images