Input control method and device, electronic equipment, storage medium and program product

Abstract

The embodiment of the invention provides an input control method and device, electronic equipment, a storage medium and a program product, which are at least applied to the field of cloud technology, and the method comprises the following steps: setting a display state of at least one virtual input key of a virtual input device; in response to a running operation for the virtual scene application, displaying a virtual scene video of the virtual scene, and displaying the first type of virtual input keys on the virtual scene video in an overlapping manner according to a display state set corresponding to the first type of virtual input keys; the first type of virtual input keys are keys capable of operating and controlling the running process of the virtual scene application; and in response to a control operation for any one of the first type of virtual input keys, performing operation control on the virtual scene application according to an operation function corresponding to the first type of virtual input keys to obtain an updated video after the virtual scene video is updated, and displaying the updated video. According to the invention, the input control quality can be improved in a resource intensive manner.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of the Internet, and relate to but are not limited to an input control method, device, electronic device, storage medium and program product. Background Art

[0002] Cloud gaming refers to a gaming mode in which the server renders the game screen and the client only displays it. In related technologies, a user can connect an external keyboard to the client, and then use the keyboard mapping function provided by an application to map the key values ​​of the external keyboard to other key values, so that the key values ​​of the external keyboard can be mapped according to the user's own habits, such as mapping the Z key to the A key, and mapping the B key to the A key, etc.

[0003] However, the key mapping method of the external keyboard in the related art only supports the key mapping of the external physical keyboard, and after replacing the new keyboard, it is necessary to re-map it; and for different games, the designated external keyboard needs to be connected to use the mapped keyboard; at the same time, for the case of running cloud games on mobile devices, when there is no external keyboard, it is impossible to meet the keyboard needs of users. It can be seen that the keyboard mapping method in the related art only supports the use of fixed external keyboards for fixed players in fixed games. Obviously, when any of the factors such as the external keyboard, game type and player changes, the key mapping of the external keyboard needs to be re-mapped. Obviously, this will cause a large waste of resources (including computing resources and communication resources of the background server) for the input control process of the external input device.

[0004] In summary, there is no effective solution in the relevant technology on how to expand in-depth and efficient keyboard mapping methods in the input control process in a resource-intensive manner to improve the quality of input control. Summary of the invention

[0005] The embodiments of the present application provide an input control method, device, electronic device, storage medium and program product, which can be applied at least in the field of cloud technology or the field of games, and can achieve in-depth and efficient keyboard mapping in the input control process in a resource-intensive manner, thereby improving the quality of input control.

[0006] The technical solution of the embodiment of the present application is implemented as follows:

[0007] An embodiment of the present application provides an input control method, including: in response to a setting operation for a virtual input device, setting a display state of at least one virtual input button of the virtual input device; in response to a running operation for a virtual scene application, displaying a virtual scene video of the virtual scene, and superimposing and displaying a first type of virtual input button in the virtual input device on the virtual scene video according to the display state set corresponding to the first type of virtual input button; wherein the first type of virtual input button is a button capable of operating and controlling the running process of the virtual scene application; in response to a control operation for any one of the first type of virtual input buttons, operating and controlling the virtual scene application according to the operation function corresponding to the first type of virtual input button, obtaining an updated video after updating the virtual scene video, and displaying the updated video.

[0008] An embodiment of the present application provides an input control device, including: a setting module, configured to set a display state of at least one virtual input button of the virtual input device in response to a setting operation for the virtual input device; a display module, configured to display a virtual scene video of the virtual scene in response to a running operation for a virtual scene application, and superimpose and display a first type of virtual input button in the virtual input device on the virtual scene video according to the display state set corresponding to the first type of virtual input button; wherein the first type of virtual input button is a button capable of operating and controlling the running process of the virtual scene application; an operation control module, configured to operate and control the virtual scene application according to the operation function corresponding to any one of the first type of virtual input buttons in response to a control operation for any one of the first type of virtual input buttons, obtain an updated video after updating the virtual scene video, and display the updated video.

[0009] In some embodiments, the setting operation includes at least one of a display position setting operation, a display size setting operation, a display color setting operation, and a display illustration setting operation for at least one target virtual input button on the virtual input device; the display state includes at least one of the following: display position, display size, display color, and display illustration; the setting module is further configured to: in response to a setting operation for the at least one target virtual input button, set at least one of the display position, display size, display color, and display illustration of the target virtual input button.

[0010] In some embodiments, the setting module is further configured to: in response to a setting operation for the at least one target virtual input button, determine the type of the display illustration of the target virtual input button, the display position of the display illustration, the display duration of the display illustration, and the display frequency of the display illustration; and set the display illustration of the target virtual input button based on the type of the display illustration, the display position of the display illustration, the display duration of the display illustration, and the display frequency of the display illustration.

[0011] In some embodiments, the setting operation further includes a display addition and deletion setting operation; the virtual input device includes a virtual keyboard, a virtual mouse, and a virtual gamepad; the setting module is further configured to: in response to a display addition and deletion setting operation for the virtual input device, add or delete at least one of the virtual keyboard, the virtual mouse, and the virtual gamepad, or add or delete at least one virtual input button of the virtual keyboard, the virtual mouse, and the virtual gamepad.

[0012] In some embodiments, the device further includes: a key-value mapping module, configured to obtain the display position, display size, display color, and display illustration of each virtual input button on the virtual input device; encapsulate the display position, display size, display color, and display illustration of each virtual input button into encapsulated data in a specific data format; obtain the key identifier of each virtual input button; perform data mapping on the key identifier of each virtual input button and the encapsulated data to obtain a key-value pair; and a sending module, configured to send the key-value pair corresponding to each virtual input button to a server, and store the key-value pair of each virtual input button on the virtual input device through the server.

[0013] In some embodiments, the device further includes: a first type of virtual input button determination module, configured to determine the application running parameters of the virtual scene application in at least one running mode; based on the application running parameters, determine the buttons that can operate and control the running process of the virtual scene application in each running mode; and determine the buttons in each running mode as the first type of virtual input buttons.

[0014] In some embodiments, the display module is further configured to: in response to a running operation for the virtual scene application in a target running mode, display a target virtual scene video of the virtual scene in the target running mode, and superimpose and display at least one first type of virtual input button corresponding to the target running mode in the virtual input device on the target virtual scene video according to the display state set corresponding to the first type of virtual input button.

[0015] In some embodiments, the device further includes: a key hiding module, configured to hide a second type of virtual input key in the virtual input device from the virtual scene video when superimposing a first type of virtual input key in the virtual input device on the virtual scene video according to a display state set corresponding to the first type of virtual input key; wherein, the second type of virtual input key is a key that cannot operate and control the running process of the virtual scene application.

[0016] In some embodiments, the device further includes: a list display module, configured to display a list of published virtual input devices on the current interface of the virtual scene application before performing the setting operation on the virtual input device; in response to a selection operation on any one of the published virtual input devices in the list of published virtual input devices, display the selected published virtual input device; the setting module is further configured to: in response to a setting operation on the selected published virtual input device, set the display state of at least one virtual input key of the published virtual input device.

[0017] In some embodiments, the list display module is further configured to: in response to a scoring operation of a plurality of evaluation terminals on each of the published virtual input devices, determine the comprehensive score of each of the published virtual input devices; determine a plurality of published virtual input devices in the list of published virtual input devices based on the comprehensive score; and sequentially display each of the plurality of published virtual input devices in the list of published virtual input devices in descending order of the comprehensive score.

[0018] In some embodiments, the device further includes: a reward module, configured to, after determining a plurality of published virtual input devices in the list of published virtual input devices, in response to any one of the plurality of published virtual input devices in the list of published virtual input devices being a published virtual input device set by a target terminal, generate a reward policy for the target terminal, and display reward information corresponding to the reward policy on the current interface of the target terminal.

[0019] In some embodiments, the list display module is further configured to: before receiving a running operation for the virtual scene application, display a list of published virtual input devices on the current interface of the virtual scene application; in response to a selection operation on any one of the published virtual input devices in the list of published virtual input devices, display the selected published virtual input device; the display module is further configured to: in response to a running operation for the virtual scene application, display a virtual scene video of the virtual scene, and superimpose, on the virtual scene video, a first type of virtual input keys in the selected published virtual input device according to a configured display state of the first type of virtual input keys in the published virtual input device.

[0020] In some embodiments, the device further includes: a preview module, configured to, when displaying a list of published virtual input devices on the current interface of the virtual scene application, in response to a preview operation on at least one of the published virtual input devices in the list of published virtual input devices, display the at least one published virtual input device on the current interface.

[0021] An embodiment of the present application provides an electronic device, including: a memory for storing executable instructions; a processor for implementing the above input control method when executing the executable instructions stored in the memory.

[0022] An embodiment of the present application provides a computer program product, which includes executable instructions stored in a computer-readable storage medium; wherein, when a processor of an electronic device reads the executable instructions from the computer-readable storage medium and executes the executable instructions, the above input control method is implemented.

[0023] An embodiment of the present application provides a computer-readable storage medium storing executable instructions for causing a processor to implement the above input control method when executing the executable instructions.

[0024] The embodiments of the present application have the following beneficial effects:

[0025] When performing input control for virtual scene applications, on the one hand, the display state of at least one virtual input button of the virtual input device is set, so that when displaying the virtual scene video of the virtual scene, the first type of virtual input buttons in the virtual input device can be superimposed and displayed on the virtual scene video according to the display state set corresponding to the first type of virtual input buttons; among them, the first type of virtual input buttons are buttons that can operate and control the running process of the virtual scene application. In this way, users can have a portable keyboard and mouse set without connecting an external input device, and users can customize the display state of the virtual input device, so as to create their favorite keyboard and mouse controls. In addition, during the running process of the virtual scene application, non-essential buttons can be automatically hidden according to the needs of the current virtual scene application, and the operation effect of the virtual input buttons of the user can be improved in real time. It can be seen that the input control method of the embodiment of the present application can realize an in-depth and efficient keyboard mapping method in the input control process in a resource-intensive manner and promote the input control quality without re-mapping the key values of the external keyboard when any at least one of the external keyboard, game type, and player changes. On the other hand, when the embodiment of the present application receives a click operation on any first type of virtual input button, it can operate and control the virtual scene application according to the operation function corresponding to the first type of virtual input button, and obtain an updated video after updating the virtual scene video. In this way, it can be ensured that the displayed first type of virtual input buttons can achieve the same input function as the external input buttons, so as to ensure the accurate and effective operation of the virtual scene application and improve the user's game playing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 is an optional architecture diagram of the input control system provided by the embodiment of the present application;

[0027] Figure 2 is a schematic structural diagram of the electronic device provided by the embodiment of the present application;

[0028] Figure 3 is an optional flowchart of the input control method provided by the embodiment of the present application;

[0029] Figure 4 is another optional flowchart of the input control method provided by the embodiment of the present application;

[0030] Figure 5 is a schematic implementation flowchart of the terminal sending the display state of each virtual input button to the server provided by the embodiment of the present application;

[0031] Figure 6 is a schematic implementation flowchart of determining the first type of virtual input buttons provided by the embodiment of the present application;

[0032] Figure 7 is another optional flowchart of the input control method provided by the embodiments of the present application;

[0033] Figure 8 is a schematic diagram of the implementation process of the terminal for displaying the list of published virtual input devices provided by the embodiments of the present application;

[0034] Figure 9 is a keyboard setting interface diagram of the input control method provided by the embodiments of the present application;

[0035] Figure 10 is a display interface diagram of the virtual input keys of the input control method provided by the embodiments of the present application;

[0036] Figure 11 is a schematic diagram of the cloud game interface provided by the embodiments of the present application;

[0037] Figure 12 is a schematic diagram of the game keyboard leaderboard and score provided by the embodiments of the present application;

[0038] Figure 13 is a schematic diagram of the technical-side implementation process of the input control method provided by the embodiments of the present application. Detailed implementation manners

[0039] In order to make the objectives, technical solutions, and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be construed as limitations on the present application. All other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of the present application.

[0040] In the following description, reference is made to "some embodiments", which describe a subset of all possible embodiments. However, it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments and can be combined with each other without conflict. Unless otherwise defined, all technical and scientific terms used in the embodiments of the present application have the same meaning as commonly understood by those skilled in the technical field to which the embodiments of the present application belong. The terms used in the embodiments of the present application are only for the purpose of describing the embodiments of the present application and are not intended to limit the present application.

[0041] In the embodiments of the present application, the term "module" or "unit" refers to a computer program with a predetermined function or a part of a computer program, which works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as a processing circuit or a memory), or a combination thereof. Similarly, one processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of the overall module or unit that includes the function of the module or unit.

[0042] Before describing the input control method provided by the embodiments of the present application, the professional terms involved in the embodiments of the present application are first described:

[0043] (1) Responsive to, which is used to represent the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more of the executed operations can be real-time or can have a set delay; without special instructions, there is no limit on the execution order of the multiple executed operations.

[0044] (2) Cloud game: It is a game mode based on cloud computing. In the operation mode of cloud games, all games are run on the server side, and the rendered game screens are compressed and transmitted to users through the network. On the client side, the user's game device does not require any high-end processors and graphics cards, and only basic video decompression capabilities are needed. Cloud game technology enables lightweight devices (thin clients) with relatively limited graphics processing and data computing capabilities to run high-quality games. In the cloud game scenario, the game does not run on the player's game terminal, but on the cloud server, and the cloud server renders the game scene into a video and audio stream, which is transmitted to the player's game terminal through the network. The player's game terminal does not need to have powerful graphics computing and data processing capabilities, and only needs to have basic streaming media playback capabilities and the ability to obtain the player's input instructions and send them to the cloud server.

[0045] (3) Cloud game virtual keyboard and mouse: It refers to a combined keyboard and mouse control of a keyboard, mouse, and gamepad displayed on a mobile device, which can directly click the buttons corresponding to the virtual combined keyboard control to achieve the same effect as clicking a physical keyboard key or a physical mouse. The virtual keyboard and mouse style is updated according to the user's custom design and training to adapt to a more convenient operation method.

[0046] In the input control method provided by the embodiments of the present application, cloud game users can preset their favorite keyboard and mouse styles, gamepads, and display states of each control on the cloud game terminal application in advance. The background records the mapping relationship between the key values and display states of each key, and then, according to different game requirements, simplifies and updates the keys and icons of the displayed virtual input device. One set of virtual input devices is applicable to all games and various mobile terminals (Android, IOS, Web). At the same time, when playing games, users can update their keyboard and mouse styles and positions at any time according to their physical sensations and usage experiences, and then publish the updated virtual input device to the cloud game platform for other users to choose and use. Other users are also allowed to perform secondary creation and update and publish of the keyboard and mouse. After being trained by multiple people, finally, the platform generates a ranking list of virtual input devices of various different types with the highest satisfaction for all users to independently choose and use.

[0047] Specifically, in the input control method provided by the embodiments of the present application, first, in response to a setting operation for the virtual input device, set the display state of at least one virtual input key of the virtual input device; then, in response to a running operation for the virtual scene application, display the virtual scene video of the virtual scene, and superimpose and display the first type of virtual input keys in the virtual input device on the virtual scene video according to the display state set corresponding to the first type of virtual input keys; wherein, the first type of virtual input keys are keys that can operate and control the running process of the virtual scene application; finally, in response to a control operation for any one of the first type of virtual input keys, operate and control the virtual scene application according to the operation function corresponding to the first type of virtual input key, obtain an updated video after updating the virtual scene video, and display the updated video. In this way, users can have a portable keyboard and mouse set without connecting an external input device, and users can customize the display state of the virtual input device, thereby creating their favorite keyboard and mouse controls. In addition, during the running process of the virtual scene application, non-essential keys can be automatically hidden according to the needs of the current virtual scene application, and the operation effect of the virtual input keys of the user can be improved in real time. It can be seen that the input control method of the embodiments of the present application can achieve a resource-intensive way to expand and deepen the keyboard mapping method in the input control process and promote the input control quality without re-performing the key value mapping of the external keyboard when any at least one of the factors of the external keyboard, game type, and player changes.

[0048] Here, the exemplary application of the input control device according to the embodiments of the present application will be described first. The input control device is an electronic device for implementing the input control method. In one implementation, the input control device (i.e., the electronic device) provided by the embodiments of the present application can be implemented as a terminal or a server. In one implementation, the device provided by the embodiments of the present application can be implemented as any terminal with game video display function and game application running function, such as a laptop computer, a tablet computer, a desktop computer, a mobile phone, a portable music player, a personal digital assistant, a dedicated messaging device, a portable game device, a smart robot, a smart home appliance, and a smart vehicle device; in another implementation, the input control device provided by the embodiments of the present application can also be implemented as a server, where the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery network (CDN, Content Delivery Network), and big data and artificial intelligence platforms. The terminal and the server can be directly or indirectly connected through wired or wireless communication methods, which are not limited in the embodiments of the present application. Next, the exemplary application when the input control device is implemented as a terminal will be described.

[0049] See Figure 1 , Figure 1 is an optional architecture diagram of the input control system provided by the embodiments of the present application. To implement the input control of the virtual scene application, that is, to set a virtual input device for the virtual scene application and implement the key value mapping of the input device, an input control platform can be provided. The input control platform can be a functional module in the virtual scene application (any game application) or another control application independent of the virtual scene application. When the input control platform is independent of the virtual scene application, the input control platform has an open data interface, and through this data interface, data transmission with the virtual scene application can be achieved, so as to implement the input control method of the embodiments of the present application, that is, the virtual scene application can use the virtual input device set by the embodiments of the present application by calling this data interface.

[0050] In the input control system 10 of the embodiments of the present application, at least a terminal 100, a network 200, and a server 300 are included. An input control platform and a virtual scene application are deployed on the terminal 100, where the server 300 may be the server of the input control platform and the virtual scene application. The terminal 100 may constitute the input control device of the embodiments of the present application, that is, the input control method of the embodiments of the present application is implemented through the terminal 100. The terminal 100 is connected to the server 300 through the network 200. The network 200 may be a wide area network or a local area network, or a combination of the two. Refer to Figure 1 , when performing input control on the virtual scene application on the terminal 100, the user may perform a setting operation on the virtual input device through the terminal 100 on the input control platform. The terminal 100 responds to the setting operation on the virtual input device and sets the display state of at least one virtual input button of the virtual input device; then, the user may perform an operation to run the virtual scene application through the terminal 100 on the client of the virtual scene application. The terminal 100 responds to the operation to run the virtual scene application, sends an application running request of the virtual scene application to the server through the network 200, thereby obtaining the virtual scene video (i.e., game video) of the virtual scene from the server, displaying the virtual scene video of the virtual scene, and superimposing and displaying the first type of virtual input buttons in the virtual input device on the virtual scene video according to the display state; wherein, the first type of virtual input buttons are buttons that can operate and control the running process of the virtual scene application; during the process of displaying the first type of virtual input buttons, the terminal 100 may receive a control operation of the user on any one of the first type of virtual input buttons. The terminal 100 responds to the control operation on any one of the first type of virtual input buttons and operates and controls the virtual scene application according to the operation function corresponding to the first type of virtual input button, obtains an updated video after updating the virtual scene video, and displays the updated video.

[0051] The input control method provided by the embodiments of the present application may also be implemented based on a cloud platform and through cloud technology. For example, the above-mentioned server 300 may be a cloud server. The virtual scene application is run through the cloud server to generate the virtual scene video of the virtual scene, or alternatively, the virtual scene video may also be updated through the cloud server to obtain an updated video.

[0052] In some embodiments, a cloud storage may also be provided, and the display state of the virtual input keys, the virtual input device obtained after setting, etc. can be stored in the cloud storage. In this way, when receiving an operation for running a virtual scenario application, the display state of the virtual input keys can be directly obtained from the cloud storage, and the first type of virtual input keys in the virtual input device can be superimposed and displayed on the virtual scenario video according to the display state, so as to quickly display the first type of virtual input keys, improve the refresh display efficiency of the virtual scenario video of the virtual scenario application, and further improve the usage experience of the virtual scenario application.

[0053] It should be noted here that cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and networks within a wide area network or a local area network to achieve data computing, storage, processing, and sharing. Cloud technology is the general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model, which can form a resource pool and be used on demand, flexibly and conveniently. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture-based websites, and more portal websites. With the high development and application of the Internet industry, in the future, each item may have its own identification mark and needs to be transmitted to the background system for logical processing. Data at different levels will be processed separately, and various industry data requires a powerful system background support, which can be achieved through cloud computing.

[0054] Figure 2 is a schematic structural diagram of an electronic device provided by an embodiment of the present application. Figure 2 The illustrated electronic device may be an input control device, and the input control device includes: at least one processor 310, a memory 350, at least one network interface 320, and a user interface 330. Each component in the input control device is coupled together through a bus system 340. It can be understood that the bus system 340 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 340 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clear illustration, in Figure 2 all kinds of buses are labeled as the bus system 340.

[0055] The processor 310 may be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or any conventional processor, etc.

[0056] The user interface 330 includes one or more output devices 331 that enable the presentation of media content, and one or more input devices 332.

[0057] The memory 350 can be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid state memory, hard disk drives, optical disk drives, etc. The memory 350 optionally includes one or more storage devices that are physically remote from the processor 310. The memory 350 includes volatile memory or non-volatile memory, and may also include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), and the volatile memory can be random access memory (RAM). The memory 350 described in the embodiments of the present application is intended to include any suitable type of memory. In some embodiments, the memory 350 is capable of storing data to support various operations, examples of which include programs, modules, and data structures, or subsets or supersets thereof, which will be described exemplarily below.

[0058] The operating system 351 includes system programs for processing various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks; a network communication module 352 for reaching other computing devices via one or more (wired or wireless) network interfaces 320. Exemplary network interfaces 320 include: Bluetooth, Wireless Fidelity (WiFi), and Universal Serial Bus (USB), etc.; an input processing module 353 for detecting and translating one or more user inputs or interactions from one of the one or more input devices 332.

[0059] In some embodiments, the device provided by the embodiments of the present application can be implemented in software. Figure 2 An input control device 354 stored in the memory 350 is shown. The input control device 354 can be an input control device in an electronic device, and it can be software in the form of a program, a plug-in, etc., including the following software modules: a setting module 3541, a display module 3542, and an operation control module 3543. These modules are logical, and thus can be combined arbitrarily or further split according to the functions to be implemented. The functions of each module will be described below.

[0060] In some embodiments, the device provided in the embodiments of the present application can be implemented in a hardware manner. As an example, the device provided in the embodiments of the present application can be a processor in the form of a hardware decoding processor, which is programmed to execute the input control method provided in the embodiments of the present application. For example, a processor in the form of a hardware decoding processor can employ one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.

[0061] The input control method provided in each embodiment of the present application can be executed by an electronic device. Among them, the electronic device can be a server or a terminal, that is, the input control method in each embodiment of the present application can be executed by the server, or can be executed by the terminal, or can also be executed through the interaction between the server and the terminal.

[0062] Figure 3 is an optional flowchart of the input control method provided in the embodiments of the present application. The following will be described in conjunction with Figure 3 the steps shown. As Figure 3 shown, taking the execution entity of the input control method as a server as an example for description, the method includes the following steps S101 to step S103:

[0063] Step S101, in response to a setting operation for the virtual input device, set the display state of at least one virtual input key of the virtual input device.

[0064] In the embodiments of the present application, an input control application can be provided. The input control application is used to provide the function of user-defined setting of the virtual input device, and the user can customize his own virtual input device through the input control application.

[0065] The virtual input device refers to an input device that, after mapping the key values of the physical input device, is displayed on the current interface of the display device and can be operated and can achieve the same information input function as the physical keyboard. The virtual input device includes a virtual keyboard, a virtual mouse, and a virtual handle.

[0066] In the embodiments of the present application, a user may input a setting operation for any one or more virtual input buttons in the virtual input device. The setting operation includes, but is not limited to, a display position setting operation, a display size setting operation, a display color setting operation, and a display illustration setting operation.

[0067] After the user performs a setting operation on the virtual input device through the terminal, the terminal responds to the setting operation and sets the display state of the virtual input button corresponding to the setting operation on the virtual input device. In the embodiments of the present application, setting the display state of the virtual input button may be setting such as updating or adding the display state of the virtual input button.

[0068] Step S102, in response to a running operation for the virtual scene application, display the virtual scene video of the virtual scene, and superimpose and display the first type of virtual input buttons in the virtual input device on the virtual scene video according to the set display state corresponding to the first type of virtual input buttons.

[0069] Here, the first type of virtual input buttons are buttons that can operate and control the running process of the virtual scene application. In the embodiments of the present application, superimposing and displaying the first type of virtual input buttons on the virtual scene video means superimposing and displaying the button icons of the first type of virtual input buttons on the virtual scene video.

[0070] In the embodiments of the present application, the user may perform a running operation on the client of the virtual scene application. The running operation is used to operate and run the virtual scene application. During the running of the virtual scene application, the virtual scene application runs on the server side, and the server renders the virtual scene video during the running of the virtual scene application. After the rendering is completed, the virtual scene video is compressed and transmitted to the terminal through the network. That is to say, for the virtual scene application, the virtual scene application runs on the server, and only the picture of the virtual scene video is displayed on the terminal, which is equivalent to watching a video. Therefore, if the virtual input buttons are not drawn on the picture, the virtual scene application is actually inoperable because this is just a video stream. So in the embodiments of the present application, the first type of virtual input buttons are superimposed and displayed on the virtual scene video according to the display state, that is to say, the virtual input device is displayed on the terminal. Then when the user clicks on the virtual input button, the client of the virtual scene application sends the key value of the button to the server, and the server then updates the operation of the virtual scene application, and the user experience will be the same as running the virtual scene application on the terminal. In some embodiments, the virtual scene application may be a game application, such as a cloud game application.

[0071] In the embodiments of the present application, the number of the first type of virtual input keys is less than or equal to the number of all virtual input keys in the virtual input device. The first type of virtual input keys are the keys that can operate and control the running process of the virtual scene application. That is to say, the first type of virtual input keys are the keys related to running the virtual scene application, and through these keys, the running process of the virtual scene application can be operated and controlled.

[0072] Step S103: In response to a control operation on any one of the first type of virtual input keys, operate and control the virtual scene application according to the operation function corresponding to the first type of virtual input key, obtain an updated video after updating the virtual scene video, and display the updated video.

[0073] In the embodiments of the present application, the control operation may be any one of interactive operations such as a click operation, a double-click operation, a drag operation, etc. In the embodiments of the present application, the click operation is taken as an example for illustration. After the first type of virtual input keys are superimposed and displayed on the virtual scene video, the user can perform a click operation on the displayed first type of virtual input keys, so as to realize the operation and control of the virtual scene application. During the operation and control of the virtual scene application, the server of the virtual scene application can simultaneously respond to the user's click operation, perform real-time update on the virtual scene video, obtain an updated video, and send the updated video to the terminal to display the updated video on the terminal.

[0074] The input control method provided by the embodiments of the present application, when performing input control for virtual scene applications, on the one hand, sets the display states of at least one virtual input button of the virtual input device, so that when displaying the virtual scene video of the virtual scene, the first type of virtual input buttons in the virtual input device can be superimposed on the virtual scene video according to the display states set corresponding to the first type of virtual input buttons; wherein, the first type of virtual input buttons are buttons that can operate and control the running process of the virtual scene application. In this way, the user can have a mouse and keyboard set that can be carried around without connecting an external input device, and the user can customize the display states of the virtual input device, so as to create the mouse and keyboard controls that they like. In addition, during the running process of the virtual scene application, non-essential buttons can be automatically hidden according to the needs of the current virtual scene application, and the operation effect of the virtual input buttons of the user can be improved in real time. It can be seen that the input control method of the embodiments of the present application can achieve a keyboard mapping method that is in-depth and efficient in the input control process in a resource-intensive manner and promote the input control quality without re-performing key value mapping of the external keyboard when any at least one of the factors of the external keyboard, game type, and player changes. On the other hand, when the embodiments of the present application receive a click operation on any first type of virtual input button, they can operate and control the virtual scene application according to the operation function corresponding to the first type of virtual input button, and obtain an updated video after updating the virtual scene video. In this way, it can be ensured that the displayed first type of virtual input buttons can achieve the same input functions as the external input buttons, so as to ensure the accurate and effective operation of the virtual scene application and improve the user's game playing experience.

[0075] The following is an example of the application scenarios of the input control method provided by the embodiments of the present application. The embodiments of the present application can be applied to at least any one of the following exemplary scenarios:

[0076] Scenario 1: The input control system includes at least a terminal and a server. To achieve input control for virtual scene applications, a virtual input device is set for the virtual scene applications to implement key value mapping of the input device. An input control platform can be provided. This input control platform can be a functional module in a virtual scene application (any game application), that is, there is an input control functional module in the game application, and the server constitutes the background server of the game application. Users can run the game application and start this input control functional module in the game application, and input setting operations for the virtual input device. The terminal responds to the setting operations for the virtual input device and sets the display state of at least one virtual input button of the virtual input device. Then, the user can also start the game module in the game application to run the game function. The terminal can respond to the running operations for the game function in the game application, send a game running request to the server. The server responds to the game running request, generates and renders the game screen, and obtains a game video. After the server obtains the game video, it sends the game video to the terminal. The terminal displays the game video of this game on the current interface, and superimposes and displays the first type of virtual input buttons in the virtual input device on the game video according to the set display state; among them, the first type of virtual input buttons are buttons that can operate and control the running process of the game application, that is, buttons that can operate and control this game. After that, during the running of the game, the user can operate on the first type of virtual input buttons displayed on the current interface. The terminal responds to the click operation on any first type of virtual input button, determines the operation function corresponding to this first type of virtual input button, and sends the corresponding operation request to the server. After receiving the operation request, the server responds to the operation request, updates the game video to obtain an updated video of the game, and sends the updated video to the terminal, and displays the updated video on the current interface of the terminal. This process repeats until the operation and running of the entire game are completed.

[0077] Scenario 2: The input control system includes at least a terminal and a server. To achieve input control for game applications, a virtual input device is set for the game applications to implement key value mapping of the input device. An input control platform can be provided. This input control platform can be another control application independent of the game application. For example, it can be an input control application, and the server constitutes the background server of the input control application. This input control application has an open data interface (such as an API interface). Through this data interface, data transmission with the game application can be achieved, so as to implement the input control method of the embodiments of the present application, that is, the game application can use the virtual input device set in the embodiments of the present application by calling this data interface.

[0078] When a user needs to set up a virtual input device, they can run the input control application and enter the setup operations for the virtual input device at the client side of the input control application. In response to the setup operations for the virtual input device, the terminal sets the display states of at least one virtual input button of the virtual input device. After obtaining the display state of each virtual input button, the terminal can send the display state of each virtual input button to the server, and the server stores the display states of each virtual input button in the virtual input device. Then, the user can also start the game application. The terminal can send a game running request to the game server in response to the operation of running the game function in the game application. The game server generates and renders a game screen in response to the game running request to obtain a game video. After obtaining the game video, the game server sends the game video to the terminal. The terminal displays the game video of the game on the current interface, and calls the data interface to obtain the display states of each virtual input button in the virtual input device, and superimposes and displays the first type of virtual input buttons in the virtual input device on the game video according to the set display states; where the first type of virtual input buttons are buttons that can operate and control the running process of the game application, that is, buttons that can operate and control the game. After that, during the running of the game, the user can operate on the first type of virtual input buttons displayed on the current interface. The terminal determines the operation function corresponding to the first type of virtual input button in response to the click operation on any first type of virtual input button, and sends the corresponding operation request to the game server. After receiving the operation request, the game server updates the game video in response to the operation request to obtain an updated video of the game, and sends the updated video to the terminal, and displays the updated video on the current interface of the terminal, and so on in a loop until the operation and running of the entire game are completed.

[0079] Next, taking the above Scenario 2 as an example, the input control method of the embodiments of the present application will be described. Figure 4 It is another optional flowchart of the input control method provided by the embodiments of the present application, as Figure 4 shown, the method includes the following steps S201 to step S213:

[0080] Step S201, the terminal runs the input control application and receives the setup operations for the virtual input device through the client of the input control application.

[0081] A virtual input device refers to an input device that can be operated and can achieve the same information input function as a physical keyboard after mapping the key values of a physical input device and displayed on the current interface of a display device. The virtual input device includes a virtual keyboard, a virtual mouse, and a virtual joystick. The virtual keyboard refers to a virtual input device after mapping the key values of each key in an external physical keyboard. The virtual mouse refers to a virtual input device after mapping the key values of the left and right mouse buttons, the mouse scroll wheel, and other buttons in an external physical mouse. The virtual joystick refers to a virtual input device after mapping the key values of the buttons in an external gamepad.

[0082] It should be noted here that the key values in the key value mapping refer to the values of each button on the physical keyboard, mouse, and joystick. For example, the A key on the physical keyboard is actually represented by a number. That is to say, the identification information of the A key can actually be a specific number; each button is actually a number and is fixed. When a user clicks a button, it is actually clicking on a number. Both the client and the server can know which button the user has clicked through this number. When performing key value mapping, the key values of each button on the physical keyboard, mouse, and joystick are mapped to the key values of the buttons on the virtual input device. In this way, when the user clicks any button on the virtual input device, it is actually clicking on a number on the virtual input device. Both the client and the server can know which virtual button on the virtual input device the user has clicked through this number, and then according to the mapping key during the key value mapping between the physical button and the virtual button, it is possible to query which physical button the user wants to click, so that the server can make corresponding response actions based on this physical button.

[0083] Step S202, the terminal responds to a setting operation for the virtual input device and sets the display state of at least one virtual input button of the virtual input device.

[0084] In some embodiments, the setting operation includes at least one of a display position setting operation, a display size setting operation, a display color setting operation, and a display illustration setting operation for at least one target virtual input button on the virtual input device; the display state includes at least one of the following: display position, display size, display color, and display illustration. In the embodiments of the present application, the terminal can respond to the setting operation for at least one target virtual input button and set at least one of the display position, display size, display color, and display illustration of the target virtual input button.

[0085] Since the setting operations include, but are not limited to: display position setting operation, display size setting operation, display color setting operation, and display matching picture setting operation. Among them, the display position setting operation is used to request setting the display position of the corresponding virtual input button. For example, adjusting the display position of the virtual input button, swapping the display positions of the virtual input button and other virtual input buttons, moving the virtual input button upward, downward, leftward, or rightward by a preset distance, etc.; the display size setting operation is used to request setting the display size of the corresponding virtual input button. For example, adjusting the current display size of the virtual input button, enlarging or reducing the virtual input button; the display color setting operation is used to request setting the display color of the corresponding virtual input button. For example, adjusting the display color of the virtual input button to various different colors such as white, black, red, etc.; the display matching picture setting operation is used to request setting the display matching picture of the corresponding virtual input button. The display matching picture refers to an image displayed above or around the virtual input button. For example, it can be any type and field of image that is pre-generated or pre-imported. The display matching picture can be in the form of a picture or a moving picture. The display matching pictures here include, but are not limited to: the background picture inside the button, the pictures around the button, the moving pictures synchronously displayed with the button, etc.

[0086] In some embodiments, a picture library can be provided, in which multiple different types and styles of pictures are stored. Among them, the pictures include pictures and moving pictures. When the user performs the display matching picture setting operation, the corresponding picture can be selected from the picture library, so as to add the picture selected by the user to the virtual input button when setting the display state of the virtual input button.

[0087] The display matching picture setting operation can be a selection operation for different types of display matching pictures. By performing the display matching picture setting operation, at least one picture of the same or different types can be selected from the picture library, that is, after the terminal responds to the display matching picture setting operation, the type of the display matching picture of the target virtual input button can be determined.

[0088] The display matching picture setting operation can also be a setting operation for the display position of the display matching picture. By performing the display matching picture setting operation, the display position of the display matching picture can be set. For example, the display matching picture can be displayed inside or around the target virtual input button, or it can also be set to be overlapped and displayed above or below the target virtual input button.

[0089] The display picture setting operation can also be an operation for setting the display duration of the display picture. By performing the display picture setting operation, the display duration of the display picture can be set. For example, a setting interface for the display picture can be provided. On the setting interface, the user can input the display duration of each display picture, or the user can also select the display duration of the display picture by dragging the time bar. The display duration of the display picture can be set to any duration. In the embodiments of the present application, when the configured virtual input device is displayed on the current interface of the terminal, each target virtual input button's display picture can be displayed according to this display duration; if the display duration of any display picture is greater than the display duration of the virtual input device, then when controlling the virtual input device to hide, control this display picture to be hidden synchronously, that is, when the virtual input device is not displayed, the display picture also disappears synchronously; if the display duration of any display picture is less than the display duration of the virtual input device, then when the display duration of this display picture is reached, control this display picture to be hidden and disappear; if the display duration of any display picture is equal to the display duration of the virtual input device, then when controlling the virtual input device to hide, control this display picture to be hidden simultaneously.

[0090] The display picture setting operation can also be an operation for setting the display frequency of the display picture. By performing the display picture setting operation, the display frequency of the display picture can be set. For example, the display frequency of any display picture can be set to be displayed for 5 seconds every 15 seconds. In this way, during the display process of the virtual input device, according to this display frequency, the hiding and displaying of the display picture can be controlled, and the hiding and displaying are performed cyclically, so as to achieve the diversity of the display effect of the target virtual input button and improve the user experience.

[0091] In the embodiments of the present application, the user can input a setting operation for any one or more virtual input buttons in the virtual input device. Correspondingly, the terminal responds to the setting operation for any one or more virtual input buttons in the virtual input device and sets the display states of one or more virtual input buttons of the virtual input device. The setting operation input by the user can be a setting operation for at least one virtual input button in any one virtual input device among the virtual keyboard, virtual mouse, and virtual gamepad, or can also be a setting operation for at least one virtual input button in multiple virtual input devices among the virtual keyboard, virtual mouse, and virtual gamepad.

[0092] For example, setting operations for keys A, B, and K in a virtual keyboard can be input. Among them, the setting operations are used to set the display position of key A, the display color of key B, and the display size of key K. The terminal can respond to this setting operation for the virtual input device and set the display position of key A, the display color of key B, and the display size of key K in the virtual keyboard. Another example is that setting operations for key L in the virtual keyboard and the scroll ball in the virtual mouse can be input. Among them, the setting operations are used to set the display color of key L and the display position of the scroll ball of the virtual mouse. The terminal can respond to this setting operation for the virtual input device and set the display color of key L and the display position of the scroll ball of the virtual mouse.

[0093] In other embodiments, the terminal can also respond to a setting operation for the virtual input device, generate a setting request, and send the setting request to the server to set the display state of at least one virtual input key of the virtual input device through the server. That is, the server responds to the setting request and sets the display state of at least one virtual input key of the virtual input device. In the implementation process, the setting operation includes at least one of a display position setting operation, a display size setting operation, a display color setting operation, and a display illustration setting operation for at least one target virtual input key on the virtual input device; correspondingly, the setting request includes at least one of a display position setting request, a display size setting request, a display color setting request, and a display illustration setting request for at least one target virtual input key on the virtual input device. The server can perform corresponding settings in response to at least one of these setting requests to obtain the display state of at least one virtual input key of the virtual input device. After obtaining the display state of at least one virtual input key of the virtual input device, the server can send the display state of at least one virtual input key of the virtual input device to the terminal or store the display state of at least one virtual input key of the virtual input device.

[0094] In some embodiments, the setting operation can also include a display addition and deletion setting operation; the virtual input device can include a virtual keyboard, a virtual mouse, and a virtual handle. The terminal can respond to the display addition and deletion setting operation for the virtual input device and add or delete at least one of the virtual keyboard, the virtual mouse, and the virtual handle, or add or delete at least one virtual input key of the virtual keyboard, the virtual mouse, and the virtual handle.

[0095] In other embodiments, the terminal may also generate a setting request in response to a setting operation for the virtual input device, and send the setting request to the server. During the implementation process, the setting operation may further include a display addition and deletion setting operation; correspondingly, the setting request also includes a display addition and deletion setting request for at least one target virtual input key on the virtual input device. The server may perform corresponding settings in response to the display addition and deletion setting request, so as to add or delete at least one of the virtual keyboard, virtual mouse, and virtual gamepad, or add or delete at least one virtual input key of the virtual keyboard, virtual mouse, and virtual gamepad, that is, perform addition and deletion settings for any at least one virtual input device and addition and deletion settings for at least one virtual input key. After the server performs addition and deletion settings for any at least one virtual input device and addition and deletion settings for at least one virtual input key, the server may send the virtual input device after the addition and deletion settings to the terminal, or store the virtual input device.

[0096] For example, the setting operation input by the user may be to delete the virtual gamepad and the "shift" key on the virtual keyboard. Then, the "shift" key on the virtual gamepad and the virtual keyboard can be deleted, and the display state of the virtual input key after deletion is determined as the final display state of the virtual input key.

[0097] It should be noted that since the number of keys on the virtual input device is large, and the number of virtual input keys requested to be set by the setting operation is generally less than the total number of keys on the virtual input device. That is to say, there may be a situation where not all virtual input keys are customized. Therefore, there will be some virtual input keys that are not set. For these virtual input keys, the display state of these virtual input keys can be determined as the default display state of these virtual input keys. That is to say, the system has a default display state for each virtual input key in the virtual input device. When setting the virtual input device, for the keys that the user does not request to update the settings, these virtual input keys are displayed in the default display state.

[0098] In some embodiments, the display state of each virtual input key of the virtual input device may also be initialized in advance. In this way, when no virtual input key is customized, the virtual input key can be displayed according to the initialized display state.

[0099] Step S203, after the terminal obtains the display state of each virtual input key, the terminal sends the display state of each virtual input key to the server.

[0100] In some embodiments, referring to Figure 5 , Figure 5It shows that in step S203, the terminal sends the display status of each virtual input key to the server, which can be implemented through the following steps S2031 to S2035:

[0101] Step S2031, obtain the display position, display size, display color, and display illustration of each virtual input key on the virtual input device.

[0102] In the embodiments of the present application, after the terminal responds to the user's setting operation, the display position, display size, display color, and display illustration of each virtual input key on the virtual input device can be obtained.

[0103] Step S2032, encapsulate the display position, display size, display color, and display illustration of each virtual input key into encapsulated data in a specific data format.

[0104] In some embodiments, the encapsulated data can be data in a json data format. The display position, display size, display color, and display illustration of each virtual input key can be encapsulated into a json data format. For multiple virtual input keys in the same virtual input device, there can be multiple json data format data, that is, each virtual input key corresponds to a json data format data.

[0105] In the embodiments of the present application, by encapsulating the various display states of each virtual input key, the encapsulated data obtained can include the relevant information of all the display states of the virtual input key, so that the complete display state of the virtual input key can be recorded through the encapsulated data. In this way, after the encapsulated data is obtained later, the complete display state of the virtual input key can be determined by parsing the data, and the virtual input key can be accurately displayed.

[0106] Step S2033, obtain the key identifier of each virtual input key.

[0107] Here, the key identifier is the identification information used to uniquely identify the virtual input key. The key identifier can be the key value of the key. The key value here refers to the value of each key on the physical input device (such as a physical keyboard). For example, for the A key, it actually corresponds to a number, and each key actually corresponds to a fixed number. When the user clicks a key, it is actually clicking to select a number. Both the client and the server can know which key the user clicks through this number. Of course, the key identifier can also be the name of the key, the function of the key, or the type of the key. The embodiments of the present application do not make any limitations.

[0108] Step S2034: Map the key identifier and the encapsulation data of each virtual input button to obtain a pair of key-value pairs.

[0109] Here, data mapping means taking the key identifier of the virtual input button as the key and the encapsulation data of the virtual input button as the value to form a pair of key-value pairs. For all the virtual input buttons in the virtual input device, since each virtual input button corresponds to an encapsulation data (for the virtual input buttons that have not received the user's setting operation, the encapsulation data can be the encapsulation data corresponding to the default display state), therefore, multiple key-value pairs can be formed, and the number of key-value pairs is the same as the number of virtual input buttons in the virtual input device.

[0110] In the embodiment of the present application, based on the key identifier and the encapsulation data of the virtual input button for data mapping, the obtained key-value pairs are the accurately mapped data. In this way, as long as the key identifier of the virtual input button is known, the encapsulation data of the virtual input button can be queried based on the key-value pairs obtained after data mapping, and the display state of the virtual input button can be parsed through the encapsulation data, so as to realize the accurate display of the virtual input button according to the user's settings.

[0111] Step S2035: Send the key-value pair corresponding to each virtual input button to the server.

[0112] Step S204: The server stores the display state of each virtual input button on the virtual input device.

[0113] In the embodiment of the present application, the server stores the display state of each virtual input button on the virtual input device by storing the key-value pairs of each virtual input button on the virtual input device.

[0114] The embodiment of the present application provides the following two storage methods:

[0115] Storage method 1: Multiple data storage units can be set in the memory of the server. Each data storage unit is used to store the data of a virtual input device, that is, the data of the same virtual input device is stored in the same data storage unit. The device identifier of the virtual input device can be obtained and set as the storage unit identifier of the corresponding data storage unit. In this way, by querying through the device identifier of the virtual input device, it can be determined in which data storage unit the data of the virtual input buttons in the virtual input device is stored. When storing, in a data storage unit, the key-value pairs of each virtual input button of the corresponding virtual input device can be stored.

[0116] In this way, due to the division of storage units in the memory, the relevant information of a virtual input device is independently stored in each data storage unit. Thus, based on the device identifier of the virtual input device, the corresponding data storage unit can be queried, and the encapsulated data of the virtual input button to be queried can be quickly queried based on the key-value pair in the data storage unit, thereby improving the efficiency of data query. When using the set virtual input device stored in the memory, the virtual input device can be quickly queried, so as to realize the quick display of the virtual input device. In addition, since all the relevant information of the virtual input buttons of the virtual input device is stored in the same data storage unit, all the data can be obtained from this one data storage unit to complete the display of the virtual input device, further improving the display efficiency of the virtual input device.

[0117] Storage method 2: Two types of data storage units can be set in the memory of the server. The first type of data storage unit is a public data storage unit, in which the encapsulated data corresponding to the default display state of each virtual input button in the virtual input device is stored. That is to say, the default display state of each virtual input button can be stored in the public data storage unit in advance. The second type of data storage unit is a privatized data storage unit. The number of privatized data storage units is multiple, and each privatized data storage unit stores part or all of the data of a virtual input device. That is to say, part or all of the data of the same virtual input device is stored in the same privatized data storage unit. In specific implementation, the key-value pairs corresponding to the display states of the virtual input buttons set by the user can be stored in the corresponding privatized data storage unit, and for the key-value pairs corresponding to the display states of the virtual input buttons not set by the user, there is no need to store them, and correspondingly, there is no need to send this part of the key-value pairs to the terminal. During use, all the set key-value pairs of the virtual input buttons can be obtained from the privatized data storage unit corresponding to the virtual input device, and for other virtual input buttons not set, they can be directly obtained from the public data storage unit.

[0118] Thus, since only the key-value pairs corresponding to the display states of the virtual input buttons set by the user need to be stored in the private data storage unit, without having to send the key-value pairs of all the virtual input buttons of the virtual input device to the server for storage, and usually the number of virtual input buttons set by the user may be relatively small or most are less than the total number of all virtual input buttons, therefore, the data transmission volume can be greatly reduced, thereby saving data transmission resources, improving data transmission efficiency, and achieving fast storage of the key-value pairs of the virtual input buttons. And, since the key-value pairs of some virtual input buttons are stored in the public data storage unit, it is possible to avoid duplicate storage of the data of the virtual input buttons not set by the user, thus greatly saving data storage resources.

[0119] Step S205, the terminal receives the running operation for the virtual scene application and generates an application running request in response to the running operation.

[0120] In the embodiments of the present application, the virtual scene application may be a game application, and the application running request may be a game running request. In the implementation process, the game application may be a cloud game application.

[0121] Step S206, the terminal sends the application running request to the application server of the virtual scene application.

[0122] Step S207, the application server generates and renders a virtual scene video of the virtual scene in response to the application running request.

[0123] Here, the application server may be a cloud game server. During the running process of the cloud game application, the cloud game server will render the game screen of the cloud game to obtain the game video of the cloud game.

[0124] Step S208, the application server sends the virtual scene video of the virtual scene to the terminal.

[0125] Here, the cloud game server may compress the generated game video after rendering to obtain a compressed video, and send the compressed video to the terminal through the network.

[0126] Step S209, the terminal displays the virtual scene video on the client of the virtual scene application.

[0127] Step S210, the terminal calls the open data interface of the input control application through the client of the virtual scene application, and obtains the display state of each virtual input button of the virtual input device from the server of the input control application through this data interface.

[0128] Here, since the input control application and the virtual scenario application (i.e., cloud game application) are two different applications, the input control application is used to implement the setting of the virtual input device, while the virtual scenario application is used to use the virtual input device set through the input control application. Therefore, a data interface capable of data interaction is required. In the embodiments of the present application, the input control application may have an open data interface. Any virtual scenario application can call this data interface and obtain the display state of each virtual input button of the virtual input device from the server of the input control application through this data interface under the condition of obtaining authorization.

[0129] In the embodiments of the present application, when obtaining the display state of each virtual input button of the virtual input device, a virtual input device acquisition request may be sent to the server of the virtual input application. The virtual input device acquisition request carries the device identifier of the virtual input device. The server of the input control application obtains the key-value pairs of each virtual input button of the corresponding virtual input device from the memory based on this device identifier, and extracts the display state of the virtual input button from the key-value pairs.

[0130] Step S211, the terminal superimposes and displays the first type of virtual input buttons in the virtual input device on the virtual scenario video according to the display state, and automatically hides the second type of virtual input buttons in the virtual input device from the virtual scenario video.

[0131] Here, the first type of virtual input buttons are the buttons that can operate and control the running process of the virtual scenario application; the second type of virtual input buttons are the buttons that cannot operate and control the running process of the virtual scenario application. For example, for a certain game P1, during the running of the game, the player only needs to operate the four buttons "A", "B", "C", and "D" on the keyboard to complete the running of the game. That is to say, the player can play the game normally by operating the four buttons "A", "B", "C", and "D". Therefore, for this game P1, the first type of virtual input buttons are the virtual input buttons corresponding to the four buttons "A", "B", "C", and "D" in the virtual input device; correspondingly, the second type of virtual input buttons are all the other buttons on the keyboard except the four buttons "A", "B", "C", and "D".

[0132] When displaying a virtual input device, the first type of virtual input buttons in the virtual input device can be superimposed on the virtual scene video according to the display states set corresponding to the first type of virtual input buttons, and the second type of virtual input buttons in the virtual input device can be automatically hidden from the virtual scene video. For the hiding of the second type of virtual input buttons, the transparency of each second type of virtual input button can be adjusted to be greater than a preset transparency threshold. On the current game interface, when the transparency of the second type of virtual input buttons is greater than the preset transparency threshold, from the user's sensory perspective, the second type of virtual input buttons cannot be seen. Based on this, the second type of virtual input buttons in the virtual input device are automatically hidden from the virtual scene video.

[0133] In the embodiments of the present application, by superimposing the first type of virtual input buttons in the virtual input device on the virtual scene video according to the display states set corresponding to the first type of virtual input buttons, and automatically hiding the second type of virtual input buttons in the virtual input device from the virtual scene video, on the one hand, the number of virtual input buttons displayed on the current interface will be greatly reduced, thus ensuring the simplicity of the current interface and avoiding the interference of unnecessary virtual input buttons to players when playing games; on the other hand, the necessary first type of virtual input buttons are displayed on the current interface, thus ensuring the normal operation of the players' games.

[0134] In some embodiments, the first type of virtual input buttons can be determined first, and then when obtaining the display states of the virtual input buttons of the virtual input device, only the display states of the first type of virtual input buttons can be obtained. That is to say, a virtual input device acquisition request can be sent to the server of the virtual input application. The virtual input device acquisition request carries the device identifier of the virtual input device and the button identifier of the first type of virtual input buttons. The server of the input control application obtains the key-value pairs of the first type of virtual input buttons in the corresponding virtual input device from the memory based on the device identifier and the button identifier of the first type of virtual input buttons, and extracts the display states of the first type of virtual input buttons from the key-value pairs.

[0135] The embodiments of the present application further provide a method for determining the first type of virtual input buttons. The method for determining the first type of virtual input buttons can be executed by the server or by the terminal. When the terminal executes the method for determining the first type of virtual input buttons, the method for determining the first type of virtual input buttons can be specifically implemented by the client of the input control application or by the client of the virtual scene application. Figure 6 It is a schematic diagram of the implementation process for determining the first type of virtual input buttons provided by the embodiments of the present application. As Figure 6 shown, it includes the following steps S301 to step S303:

[0136] Step S301: Determine the application running parameters of the virtual scene application in at least one running mode.

[0137] Here, the running mode refers to different running scenarios during the running process of the virtual scene application. For example, for a game application, it can be different map modes, track modes, room modes, level modes, etc. The virtual scene application has different application running parameters in different running modes.

[0138] Step S302: Based on the application running parameters, determine the keys that can operate and control the running process of the virtual scene application in each running mode.

[0139] In different running modes, the types of keys that can operate and control the running process of the virtual scene application are different. For example, in different map modes, such as in the city map mode, there are different rooms, elevators, and floors in the city map. Therefore, there can be keys for corresponding operation controls such as entering and exiting rooms, entering and exiting elevators, operating elevators, going up and down floors, etc.; in the grassland map mode, there can be keys for corresponding operation controls such as getting on and off the vehicle and driving the vehicle.

[0140] Step S303: Determine the keys in each running mode as the first type of virtual input keys.

[0141] In the embodiment of the present application, after determining the first type of virtual input keys, the terminal can, in response to the running operation of the virtual scene application in the target running mode, display the target virtual scene video of the virtual scene in the target running mode, and superimpose and display at least one first type of virtual input key corresponding to the target running mode in the virtual input device on the target virtual scene video according to the display state set corresponding to the first type of virtual input key.

[0142] Step S212: The terminal receives a click operation on any first type of virtual input key.

[0143] Step S213: The terminal, in response to the click operation, operates and controls the virtual scene application according to the operation function corresponding to the first type of virtual input key, obtains an updated video after updating the virtual scene video, and displays the updated video.

[0144] In the embodiments of the present application, after the first type of virtual input keys are superimposed and displayed on the virtual scene video, the user can perform a click operation on the displayed first type of virtual input keys, thereby realizing the operation control of the virtual scene application. During the operation control of the virtual scene application, the server of the virtual scene application can simultaneously respond to the user's click operation, perform real-time update on the virtual scene video to obtain an updated video, and send the updated video to the terminal for display on the terminal.

[0145] For the input control method of the embodiments of the present application, the user sets the display state of at least one virtual input key of the virtual input device through a setting operation for the virtual input device. That is to say, the user can preset their favorite keyboard and mouse styles, gamepad, and the positions of each control in advance. The background records the mapping relationship between the key values and positions of each virtual input key, and then simplifies and updates the keys according to the keys and icons to be displayed for different game requirements. One set of keyboard is applicable to all games and various mobile terminals. In some embodiments, when any at least one of the factors of an external keyboard, game type, and player changes, if the input control method provided by the embodiments of the present application is not used to perform the mapping of the key values and positions of the keys, then in order to ensure the normal use of the external keyboard, the matching of the external keyboard with different game types, and the keyboard and mouse style of the external keyboard can be the user's favorite keyboard and mouse style, it may be necessary to re-perform the key value mapping of the external keyboard. That is to say, when any at least one of the factors of an external keyboard, game type, and player changes, the key value mapping of the external keyboard needs to be re-performed.

[0146] However, for the input control method provided by the embodiments of the present application, the user can have a portable keyboard and mouse set without connecting an external input device, and the user can customize the display state of the virtual input device, thereby creating their favorite keyboard and mouse controls. In addition, during the operation of the virtual scene application, non-essential keys can be automatically hidden according to the needs of the current virtual scene application, and the operation effect of the user's virtual input keys can be improved in real time. It can be seen that the input control method of the embodiments of the present application can, when any at least one of the factors of an external keyboard, game type, and player changes, not require re-performing the key value mapping of the external keyboard, thereby being able to realize an in-depth and efficient keyboard mapping method in the input control process in a resource-intensive manner, and promoting the input control quality.

[0147] In some embodiments, after each terminal sets up a virtual input device, the set virtual input device can be published, thus forming a large number of published virtual input devices. Before running a virtual scene application, a user can directly select a virtual input device from the list of published virtual input devices. That is to say, before receiving a running operation for the virtual scene application, a list of published virtual input devices can be displayed on the current interface of the virtual scene application. Moreover, the user inputs a selection operation for any one of the published virtual input devices in the list of published virtual input devices through the client of the virtual scene application. In response to the selection operation for any one of the published virtual input devices in the list of published virtual input devices, the terminal displays the selected published virtual input device. In this way, when the terminal, in response to a running operation for the virtual scene application, displays a virtual scene video of the virtual scene and superimposes and displays the first type of virtual input keys in the virtual input device on the virtual scene video, it can be in response to the running operation for the virtual scene application, display the virtual scene video of the virtual scene, and superimpose and display the first type of virtual input keys in the selected published virtual input device on the virtual scene video according to the configured display state of the first type of virtual input keys in the published virtual input device.

[0148] In some embodiments, after each terminal sets up a virtual input device, the set virtual input device can be published, thus forming a large number of published virtual input devices. Before performing a setting operation on the virtual input device, a user can select a virtual input device from the list of published virtual input devices for setting. That is to say, the user can perform secondary creation on the virtual input devices published by other users and achieve secondary setting of the virtual input devices published by other users. Figure 7 is another optional flowchart of the input control method provided by the embodiments of the present application. As Figure 7 shown, the method includes the following steps S401 to step S417:

[0149] Step S401, the terminal displays a list of published virtual input devices on the current interface of the virtual scene application.

[0150] In some embodiments, referring to Figure 8 , Figure 8 shows that the terminal displays a list of published virtual input devices in step S401, which can be implemented through the following steps S4011 to step S4013:

[0151] Step S4011, in response to the scoring operations of multiple evaluation terminals on each published virtual input device, determine the comprehensive score of each published virtual input device.

[0152] In the embodiments of the present application, for a published virtual input device, each user in the virtual scene application can use, re-create, and rate the published virtual input device. A user can perform a rating operation on the published virtual input device through a terminal. The server of the virtual scene application determines the comprehensive rating of each published virtual input device in response to the rating operations of multiple evaluation terminals on each published virtual input device.

[0153] Step S4012: Determine multiple published virtual input devices in the list of published virtual input devices based on the comprehensive rating.

[0154] Here, after determining the comprehensive rating of each published virtual input device, the published virtual input device with a comprehensive rating greater than the rating threshold can be determined as the published virtual input device in the list of published virtual input devices. Alternatively, sort the multiple published virtual input devices in descending order of the comprehensive rating to form a sequence of published virtual input devices, and select the first N published virtual input devices in the sequence of published virtual input devices as the published virtual input devices in the list of published virtual input devices.

[0155] In some embodiments, after determining multiple published virtual input devices in the list of published virtual input devices, the users who set these published virtual input devices can also be rewarded. In the implementation process, in response to any one of the multiple published virtual input devices being the published virtual input device set by the target terminal, a reward policy for the target terminal is generated, and the reward information corresponding to the reward policy is displayed on the current interface of the target terminal. At the same time, the reward information corresponding to the reward policy is updated to the account of the target terminal.

[0156] Step S4013: Display each of the multiple published virtual input devices in the list of published virtual input devices in descending order of the comprehensive rating.

[0157] Step S402: The terminal receives a preview operation on at least one published virtual input device in the list of published virtual input devices.

[0158] Step S403: The terminal displays at least one published virtual input device on the current interface in response to the preview operation on at least one published virtual input device in the list of published virtual input devices.

[0159] In the embodiments of the present application, in the displayed list of published virtual input devices, a preview button for each published virtual input device may also be displayed. The preview button is an operable button. Clicking the preview button will perform a preview operation, and at this time, the corresponding published virtual input device can be displayed on the current interface. When displaying the previewed published virtual input device, all virtual input buttons in the published virtual input device may be displayed on the current interface, and all virtual input buttons are displayed according to the set display state.

[0160] Step S404, the terminal responds to a selection operation for any one of the published virtual input devices in the list of published virtual input devices, and displays the selected published virtual input device.

[0161] Step S405, the terminal receives a setting operation for the selected published virtual input device.

[0162] Step S406, the terminal responds to the setting operation for the selected published virtual input device, and sets the display state of at least one virtual input button of the published virtual input device.

[0163] Step S407, after obtaining the display state of each virtual input button, the terminal sends the display state of each virtual input button to the server.

[0164] Step S408, the server stores the display state of each virtual input button on the virtual input device.

[0165] Step S409, the terminal receives a running operation for the virtual scene application, and generates an application running request in response to the running operation.

[0166] The virtual scene application may be a game application, and the application running request may be a game running request.

[0167] Step S410, the terminal sends the application running request to the application server of the virtual scene application.

[0168] Step S411, the application server generates and renders a virtual scene video of the virtual scene in response to the application running request.

[0169] Step S412, the application server sends the virtual scene video of the virtual scene to the terminal.

[0170] Step S413, the terminal displays the virtual scene video on the client of the virtual scene application.

[0171] Step S414: The terminal calls the open data interface of the input control application through the client of the virtual scene application, and obtains the display status of each virtual input button of the virtual input device from the server of the input control application through this data interface.

[0172] Step S415: The terminal superimposes and displays the first type of virtual input buttons in the virtual input device on the virtual scene video according to the display status, and automatically hides the second type of virtual input buttons in the virtual input device from the virtual scene video.

[0173] Step S416: The terminal receives a click operation on any of the first type of virtual input buttons.

[0174] Step S417: In response to the click operation, the terminal operates and controls the virtual scene application according to the operation function corresponding to the first type of virtual input button, obtains an updated video after updating the virtual scene video, and displays the updated video.

[0175] It should be noted that the implementation processes of steps S405 to S417 are the same as those of steps S201 to S213. For the specific implementation processes of each step in steps S405 to S417, please refer to the specific implementation processes of each step in the above steps S201 to S213, and the embodiments of the present application will not be elaborated herein.

[0176] In the input control method provided by the embodiments of the present application, users can update their virtual input devices in real time and publish them. After multiple users have trained and created multiple times, the best user experience can be achieved. For users, the user experience is greatly improved, and there is an additional chance to obtain rewards from the cloud game platform. For the cloud game platform, without more costs, it can improve the user activity. For both parties, a win-win effect is achieved.

[0177] Next, an exemplary application of the embodiments of the present application in a practical application scenario will be described.

[0178] An input control method is proposed in an embodiment of the present application, which is applied to the field of cloud games. Cloud game users can preset their favorite keyboard and mouse styles, gamepads, and the positions of various controls in a cloud game terminal application (i.e., a virtual scene application). The background records the mapping of the key values and positions of each key, and then simplifies and updates the keys according to the keys and icons to be displayed for different game needs. One set of keyboard is applicable to all games and various mobile terminals. At the same time, when playing games, users can update their keyboard and mouse styles and positions at any time according to the body feeling and usage experience, and then publish them to the cloud game platform for other users to choose and use. Other users are also allowed to perform secondary creation and update and publish of the keyboard and mouse. After multiple people's training, finally, the platform generates various types of keyboards with the highest satisfaction rankings for all users to independently choose and use.

[0179] The input control method in the embodiment of the present application first breaks through the limitations of the physical keyboard and realizes virtual keyboard and mouse controls. Users can have a keyboard and mouse set (i.e., a virtual input device) that they can carry with them without connecting an external keyboard. Secondly, users can customize the positions and styles of the keyboard and mouse, including the colors, arrangements, sizes, etc. of the keys, and create their favorite keyboard and mouse controls. At the same time, they can update according to the usage experience during the game to achieve the best usage experience. In addition, during the game process, the platform will automatically hide non-essential key values according to the needs of the current game, and improve the operation effect of the user's keyboard and mouse in real time. Finally, users can independently publish their own keyboards, and other users can join in the secondary creation of the keyboard and mouse. After multiple people's multiple trainings, the best keyboard and mouse usage rankings are obtained, thereby enhancing the game playing experience and competitiveness of the platform.

[0180] The implementation process of the input control method on the product side in the embodiment of the present application will be described below.

[0181] Figure 9 It is a keyboard setting interface diagram of the input control method provided in the embodiment of the present application. Users can click the "Settings" button on the home page to enter the settings page of the virtual keyboard. Here, users can customize the styles of the keyboard, gamepad, mouse, etc. keys, and edit the virtual keyboard and mouse (i.e., the virtual input device) with the best feel for their own use. After that, they can click the "Finish" button and the "Publish" button to edit and publish.

[0182] Figure 10 It is a display interface diagram of the virtual input keys of the input control method provided in the embodiment of the present application. Users can drag the keys randomly. For example, drag the Z key to the lower right corner and the V key to the right; the keys can be enlarged or reduced randomly, or new icons can be added to represent the mouse scroll. Figure 11 It is a schematic diagram of the cloud game interface in the embodiment of the present application. When users play cloud games, the cloud game server will automatically hide non-essential buttons according to the current scene to reduce the occlusion of the game screen by the keys. Figure 12It is a schematic diagram of the game keyboard leaderboard and score display provided by an embodiment of the present application. Through the "Use" button on the left leaderboard, users can use the virtual keyboard and mouse released by other users as their own keyboard and mouse and perform secondary creation. The right leaderboard will be updated daily according to the scores given by users to different virtual keyboards and mice. The user with the highest score will receive the game time rewarded by the platform.

[0183] In some embodiments, on the game keyboard leaderboard and score display interface, there may also be a preview button for each virtual keyboard and mouse. By clicking the preview button of any virtual keyboard and mouse, a pop-up window will appear, and the customized virtual keyboard and mouse template will be displayed on the pop-up window.

[0184] Next, the detailed implementation process on the technical side of the input control method provided by the embodiments of the present application will be described.

[0185] Figure 13 It is a schematic diagram of the implementation process on the technical side of the input control method provided by the embodiments of the present application. As Figure 13 shown, the method includes the following steps S501 to step S512:

[0186] Step S501, after the user starts the cloud game client, enter the settings interface, click the custom virtual keyboard and mouse button, and independently perform virtual keyboard and mouse settings to create their own exclusive virtual keyboard and mouse.

[0187] Step S502, the client renders the style of the keyboard according to the user's click, zoom and other events.

[0188] In the embodiments of the present application, users can independently perform operations such as zooming, dragging, color matching, and icon matching of the keys on the settings interface to design the keyboard and mouse controls that are most satisfactory to themselves and have the best user experience. The client reads the user's gestures and operations and renders the style of the user's virtual keyboard and mouse in real time.

[0189] Step S503, after the user clicks the "Finish" button, the client reads all the elements such as the position, size, color value, icon, etc. of the controls on the current virtual keyboard and mouse page, and encapsulates these elements into a json data data (i.e., encapsulated data), and sends it to the server in the form of key value -> json data (i.e., key value pair).

[0190] Here, the key value refers to the value of each key on the physical keyboard. For example, the A key can actually be a number. Each key is actually a key value and is fixed. When the user clicks a key, it is actually clicking a key value. Both the client and the server can determine which key the user clicks through this number. In some embodiments, the virtual keyboard and mouse can also be saved, and a name setting entry can be provided for the user to set a unique name for the virtual keyboard and mouse to distinguish multiple virtual keyboards and mice.

[0191] In step S504, after the server receives it, the json data is stored in the database with the user's userId as the key value.

[0192] In step S505, when the user plays the cloud game, they can choose whether to use their own virtual keyboard and mouse. If so, the client draws the user's exclusive virtual keyboard and mouse on the game interface according to the data of the virtual keyboard and mouse.

[0193] Here, the server also tells the client the current game scene, and which buttons are non-essential (i.e., the second type of virtual input buttons). After the client receives it, it automatically hides the non-essential buttons to reduce the occlusion of the game interface by the buttons.

[0194] In step S506, after the user exits the game, they can enter the settings page again according to their usage experience to update their virtual keyboard and mouse style.

[0195] In step S507, after the client clicks the "Finish" button, it synchronizes the virtual keyboard and mouse data again and updates it to the server. This process can be carried out multiple times.

[0196] In step S508, when the user selects the "Publish" button, the client notifies the server of this event, and the server synchronously publishes the virtual keyboard and mouse data to the "Shared Keyboard and Mouse List".

[0197] In step S509, all clients will pull the shared virtual keyboard and mouse list, and the user can choose which one to use according to their preferences. After the user uses it, they can rate the virtual keyboard and mouse.

[0198] In step S510, the client sends the rating data to the server, which is statistically analyzed by the server to obtain a virtual keyboard and mouse rating leaderboard, and the virtual keyboard and mouse rating leaderboard is pushed to each client for display.

[0199] In step S511, the user can choose to use a virtual keyboard and mouse on a certain leaderboard, perform secondary editing and publishing, and update the virtual keyboard and mouse list in real time. Finally, the server updates the leaderboard according to the ratings of the virtual keyboard and mouse list to obtain the most satisfactory keyboard and mouse.

[0200] In step S512, the server reads and updates the user list of the virtual keyboard and mouse with the highest satisfaction, and rewards the users in this user list with the cloud game time of the platform, thereby promoting the competitive psychology of the users and improving the activity of the users.

[0201] In the embodiments of the present application, any user on the cloud game platform can freely select a virtual keyboard and mouse on the "shared virtual keyboard and mouse list" for use. At the same time, on the settings interface, the virtual keyboard and mouse can be updated and published again. After the publication, the virtual keyboard and mouse will be displayed again on the "shared virtual keyboard and mouse list" with a new name set by the user, and can be used and created by other users for N times. At the same time, the server regularly counts the rating data on all virtual keyboard and mouse lists every day, summarizes a virtual keyboard and mouse ranking list, pushes the ranking list data to the client, which is displayed by the client and provided for users to select and use. And the user ID list of the user with the highest-ranked virtual keyboard and mouse is read, and the game time of some platforms is rewarded for this list, so as to stimulate the creative psychology and competitive mentality of users, and further improve the user activity of cloud games. Users can create multiple virtual keyboards and mice for publication, for other users to re-create and publish, and enter the ranking list. The platform gives reasonable rewards according to the rating data.

[0202] In the embodiments of the present application, through a custom virtual keyboard and mouse control (i.e., virtual input keys), users can make independent designs according to their own preferences during the game. At the same time, combined with the scene analysis ability of the game platform, the number of keys of the virtual keyboard and mouse is updated to achieve a better user experience. Furthermore, users can update their virtual keyboards and mice in real time and publish them. After multiple users have trained and created them multiple times, the best user experience can be achieved. For users, the user experience is greatly improved, and there is an additional chance to obtain platform rewards; for the cloud game platform, without more costs, it can improve user activity; for both users and the cloud game platform, a win-win effect is achieved.

[0203] It can be understood that in the embodiments of the present application, for content related to user information, such as the user ID of the user, the cloud game operation data of the user, etc., if it involves data related to user information or enterprise information, when the embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, or these information need to be blurred to eliminate the corresponding relationship between this information and the user; and the collection and processing of relevant data should strictly comply with the requirements of relevant national laws and regulations during actual application, obtain the informed consent or separate consent of the personal information subject, and carry out subsequent data use and processing behaviors within the scope authorized by laws and regulations and the personal information subject.

[0204] The following continues to describe the exemplary structure in which the input control device 354 provided in the embodiments of the present application is implemented as a software module. In some embodiments, such as Figure 2As shown, the input control device 354 includes: a setting module 3541, configured to set a display state of at least one virtual input button of the virtual input device in response to a setting operation for the virtual input device; a display module 3542, configured to display a virtual scene video of the virtual scene in response to a running operation for the virtual scene application, and superimpose and display the first type of virtual input buttons in the virtual input device on the virtual scene video according to the display state set corresponding to the first type of virtual input buttons; wherein, the first type of virtual input buttons are buttons capable of operating and controlling the running process of the virtual scene application; an operation control module 3543, configured to, in response to a control operation for any one of the first type of virtual input buttons, perform operation control on the virtual scene application according to the operation function corresponding to the first type of virtual input button, obtain an updated video after updating the virtual scene video, and display the updated video.

[0205] In some embodiments, the setting operation includes at least one of a display position setting operation, a display size setting operation, a display color setting operation, and a display illustration setting operation for at least one target virtual input button on the virtual input device; the display state includes at least one of the following: display position, display size, display color, and display illustration; the setting module is further configured to: in response to the setting operation for the at least one target virtual input button, set at least one of the display position, display size, display color, and display illustration of the target virtual input button.

[0206] In some embodiments, the setting module is further configured to: in response to the setting operation for at least one target virtual input button, determine a type of the display illustration of the target virtual input button, a display position of the display illustration, a display duration of the display illustration, and a display frequency of the display illustration; and set the display illustration of the target virtual input button based on the type of the display illustration, the display position of the display illustration, the display duration of the display illustration, and the display frequency of the display illustration.

[0207] In some embodiments, the setting operation further includes a display addition and deletion setting operation; the virtual input device includes a virtual keyboard, a virtual mouse, and a virtual handle; the setting module is further configured to: in response to the display addition and deletion setting operation for the virtual input device, add or delete at least one of the virtual keyboard, the virtual mouse, and the virtual handle, or add or delete at least one virtual input button of the virtual keyboard, the virtual mouse, and the virtual handle.

[0208] In some embodiments, the device further includes: a key-value mapping module, configured to obtain the display position, display size, display color, and display illustration of each virtual input button on the virtual input device; encapsulate the display position, display size, display color, and display illustration of each virtual input button into encapsulated data in a specific data format; obtain the key identifier of each virtual input button; perform data mapping on the key identifier of each virtual input button and the encapsulated data to obtain a pair of key-value pairs; a sending module, configured to send the key-value pair corresponding to each virtual input button to a server, and store the key-value pairs of each virtual input button on the virtual input device through the server.

[0209] In some embodiments, the device further includes: a first type of virtual input button determination module, configured to determine the application running parameters of the virtual scene application in at least one running mode; based on the application running parameters, determine the buttons that can operate and control the running process of the virtual scene application in each running mode; and determine the buttons in each running mode as the first type of virtual input buttons.

[0210] In some embodiments, the display module is further configured to: in response to a running operation on the virtual scene application in a target running mode, display a target virtual scene video of the virtual scene in the target running mode, and superimpose and display at least one first type of virtual input button corresponding to the target running mode in the virtual input device on the target virtual scene video according to the display state set corresponding to the first type of virtual input button.

[0211] In some embodiments, the device further includes: a button hiding module, configured to hide the second type of virtual input buttons in the virtual input device from the virtual scene video when superimposing and displaying the first type of virtual input buttons in the virtual input device on the virtual scene video according to the display state set corresponding to the first type of virtual input buttons; wherein the second type of virtual input buttons are buttons that cannot operate and control the running process of the virtual scene application.

[0212] In some embodiments, the device further includes: a list display module, configured to display a list of published virtual input devices on the current interface of the virtual scene application before performing the setting operation on the virtual input device; in response to a selection operation on any published virtual input device in the list of published virtual input devices, display the selected published virtual input device; the setting module is further configured to: in response to a setting operation on the selected published virtual input device, set the display state of at least one virtual input button of the published virtual input device.

[0213] In some embodiments, the list display module is further configured to: in response to rating operations of multiple evaluation terminals on each of the published virtual input devices, determine a comprehensive rating for each of the published virtual input devices; based on the comprehensive ratings, determine multiple published virtual input devices in the list of published virtual input devices; and sequentially display each of the multiple published virtual input devices in the list of published virtual input devices in descending order of the comprehensive ratings.

[0214] In some embodiments, the device further includes: a reward module, configured to, after determining multiple published virtual input devices in the list of published virtual input devices, in response to any one of the multiple published virtual input devices in the list of published virtual input devices being a published virtual input device set by a target terminal, generate a reward policy for the target terminal, and display reward information corresponding to the reward policy on the current interface of the target terminal.

[0215] In some embodiments, the list display module is further configured to: before receiving a running operation for a virtual scene application, display a list of published virtual input devices on the current interface of the virtual scene application; in response to a selection operation on any one of the published virtual input devices in the list of published virtual input devices, display the selected published virtual input device; the display module is further configured to: in response to a running operation for the virtual scene application, display a virtual scene video of the virtual scene, and superimpose and display first-type virtual input keys in the selected published virtual input device on the virtual scene video according to the configured display states of the first-type virtual input keys in the published virtual input device.

[0216] In some embodiments, the device further includes: a preview module, configured to, when displaying a list of published virtual input devices on the current interface of the virtual scene application, in response to a preview operation on at least one of the published virtual input devices in the list of published virtual input devices, display the at least one published virtual input device on the current interface.

[0217] It should be noted that the description of the device in the embodiments of the present application is similar to the description of the above method embodiments and has similar beneficial effects to the method embodiments, so details are not repeated here. For technical details not disclosed in the embodiments of the present device, please refer to the description of the method embodiments of the present application for understanding.

[0218] An embodiment of the present application provides a computer program product, which includes executable instructions. The executable instructions are a type of computer instructions, and the executable instructions are stored in a computer-readable storage medium. When the processor of an electronic device reads the executable instructions from the computer-readable storage medium and the processor executes the executable instructions, the electronic device is caused to execute the method described above in the embodiment of the present application.

[0219] An embodiment of the present application provides a storage medium storing executable instructions, where the executable instructions are stored. When the executable instructions are executed by a processor, the processor is caused to execute the method provided in the embodiment of the present application. For example, as Figure 3 shown in the method. In some embodiments, the storage medium may be a computer-readable storage medium. For example, a ferroelectric memory (FRAM, Ferromagnetic Random Access Memory), a read-only memory (ROM, Read Only Memory), a programmable read-only memory (PROM, Programmable Read Only Memory), an erasable programmable read-only memory (EPROM, Erasable Programmable Read Only Memory), an electrically erasable programmable read-only memory (EEPROM, Electrically Erasable Programmable Read Only Memory), a flash memory, a magnetic surface memory, an optical disc, or a compact disk-read only memory (CD-ROM, Compact Disk-Read Only Memory), etc.; or it may be various devices including one or any combination of the above memories.

[0220] In some embodiments, the executable instructions may be in the form of a program, software, a software module, a script, or code, and may be written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including being deployed as an independent program or being deployed as a module, a component, a subroutine, or other units suitable for use in a computing environment.

[0221] As an example, the executable instructions may or may not correspond to files in a file system, and may be stored as part of a file that holds other programs or data. For example, they may be stored in one or more scripts in a Hyper Text Markup Language (HTML) document, stored in a single file dedicated to the program under discussion, or stored in multiple cooperating files (e.g., files that store one or more modules, subroutines, or portions of code). As an example, the executable instructions may be deployed to execute on one electronic device, or on multiple electronic devices located at one location, or on multiple electronic devices distributed across multiple locations and interconnected by a communication network.

[0222] As described above, the above are only embodiments of the present application and are not intended to limit the protection scope of the present application. Any modifications, equivalent replacements, and improvements made within the spirit and scope of the present application are all included in the protection scope of the present application.

Claims

1. An input control method, characterized in that, The method includes: In response to a setting operation for a virtual input device, setting a display state of at least one virtual input button of the virtual input device; In response to a running operation for a virtual scene application, displaying a virtual scene video of the virtual scene, and superimposing and displaying a first type of virtual input buttons in the virtual input device on the virtual scene video according to the display state set corresponding to the first type of virtual input buttons; wherein, the first type of virtual input buttons are buttons capable of operating and controlling the running process of the virtual scene application; In response to a control operation for any one of the first type of virtual input buttons, operating and controlling the virtual scene application according to the operation function corresponding to the first type of virtual input button, obtaining an updated video after updating the virtual scene video, and displaying the updated video.

2. The method according to claim 1, wherein The setting operation includes at least one of a display position setting operation, a display size setting operation, a display color setting operation, and a display illustration setting operation for at least one target virtual input button on the virtual input device; the display state includes at least one of the following: display position, display size, display color, and display illustration; The step of, in response to a setting operation for a virtual input device, setting a display state of at least one virtual input button of the virtual input device includes: In response to a setting operation for the at least one target virtual input button, setting at least one of a display position, a display size, a display color, and a display illustration of the target virtual input button.

3. The method according to claim 2, wherein The step of, in response to a setting operation for the at least one target virtual input button, setting a display illustration of the target virtual input button includes: In response to a setting operation for the at least one target virtual input button, determining a type of the display illustration of the target virtual input button, a display position of the display illustration, a display duration of the display illustration, and a display frequency of the display illustration; Based on the type of the display illustration, the display position of the display illustration, the display duration of the display illustration, and the display frequency of the display illustration, setting the display illustration of the target virtual input button.

4. The method according to claim 2, characterized in that, The setting operation further includes a display addition and deletion setting operation; the virtual input device includes a virtual keyboard, a virtual mouse, and a virtual handle; The step of, in response to a setting operation for a virtual input device, setting a display state of at least one virtual input button of the virtual input device further includes: In response to a display addition and deletion setting operation for the virtual input device, adding or deleting at least one of the virtual keyboard, the virtual mouse, and the virtual handle, or adding or deleting at least one virtual input button of the virtual keyboard, the virtual mouse, and the virtual handle.

5. The method according to claim 2, characterized in that, The method further includes: Obtaining a display position, a display size, a display color, and a display illustration of each virtual input button on the virtual input device; Encapsulating the display position, the display size, the display color, and the display illustration of each virtual input button into encapsulated data in a specific data format; Obtaining a button identifier of each virtual input button; Perform data mapping on the key identifier of each virtual input button and the encapsulated data to obtain a pair of key-value pairs; Send the key-value pair corresponding to each virtual input button to the server, and store the key-value pairs of each virtual input button on the virtual input device through the server.

6. The method according to claim 1, wherein The method further includes: Determine the application running parameters of the virtual scene application in at least one running mode; Based on the application running parameters, determine the buttons that can operate and control the running process of the virtual scene application in each running mode; Determine the buttons in each running mode as the first type of virtual input buttons.

7. The method according to claim 6, characterized in that The responding to the running operation for the virtual scene application, displaying the virtual scene video of the virtual scene, and superimposing and displaying the first type of virtual input buttons in the virtual input device on the virtual scene video according to the display state set corresponding to the first type of virtual input buttons includes: In response to the running operation for the virtual scene application in the target running mode, display the target virtual scene video of the virtual scene in the target running mode, and superimpose and display at least one first type of virtual input button corresponding to the target running mode in the virtual input device on the target virtual scene video according to the display state set corresponding to the first type of virtual input buttons.

8. The method according to claim 1, wherein When superimposing and displaying the first type of virtual input buttons in the virtual input device on the virtual scene video according to the display state set corresponding to the first type of virtual input buttons, the method further includes: Hide the second type of virtual input buttons in the virtual input device from the virtual scene video; Wherein, the second type of virtual input buttons are buttons that cannot operate and control the running process of the virtual scene application.

9. The method according to claim 1, wherein The method further includes: Before performing the setting operation on the virtual input device, display the list of published virtual input devices on the current interface of the virtual scene application; In response to the selection operation for any published virtual input device in the list of published virtual input devices, display the selected published virtual input device; The responding to the setting operation for the virtual input device, setting the display state of at least one virtual input button of the virtual input device includes: In response to the setting operation for the selected published virtual input device, set the display state of at least one virtual input button of the published virtual input device.

10. The method according to claim 9, wherein The displaying the list of published virtual input devices on the current interface of the virtual scene application includes: In response to the scoring operations of multiple evaluation terminals on each published virtual input device, determine the comprehensive score of each published virtual input device; Based on the comprehensive scores, determine the multiple published virtual input devices in the list of published virtual input devices; In the order from high to low of the comprehensive scores, sequentially display each published virtual input device in the multiple published virtual input devices in the list of published virtual input devices.

11. The method according to claim 10, wherein The method further includes: After determining multiple published virtual input devices in the published virtual input device list, in response to any one of the multiple published virtual input devices in the published virtual input device list being a published virtual input device set by a target terminal, generate a reward policy for the target terminal, and display reward information corresponding to the reward policy on the current interface of the target terminal.

12. The method according to any one of claims 1 to 11, characterized in that The method further includes: Before receiving a running operation for a virtual scene application, display a list of published virtual input devices on the current interface of the virtual scene application; In response to a selection operation for any one of the published virtual input devices in the published virtual input device list, display the selected published virtual input device; The responding to a running operation for a virtual scene application, displaying a virtual scene video of the virtual scene, and superimposing and displaying a first type of virtual input button in the virtual input device on the virtual scene video according to a display state set corresponding to the first type of virtual input button includes: In response to a running operation for the virtual scene application, display the virtual scene video of the virtual scene, and superimpose and display the first type of virtual input button in the selected published virtual input device on the virtual scene video according to a configured display state of the first type of virtual input button in the published virtual input device.

13. The method according to claim 12, characterized in that, The method further includes: When displaying a list of published virtual input devices on the current interface of the virtual scene application, in response to a preview operation for at least one published virtual input device in the published virtual input device list, display the at least one published virtual input device on the current interface.

14. An input control device, characterized in that, The device includes: A setting module, configured to set a display state of at least one virtual input button of the virtual input device in response to a setting operation for the virtual input device; A display module, configured to display a virtual scene video of a virtual scene in response to a running operation for a virtual scene application, and superimpose and display a first type of virtual input button in the virtual input device on the virtual scene video according to a display state set corresponding to the first type of virtual input button; wherein the first type of virtual input button is a button capable of operating and controlling the running process of the virtual scene application; An operation control module, configured to, in response to a control operation for any one of the first type of virtual input buttons, operate and control the virtual scene application according to an operation function corresponding to the first type of virtual input button, obtain an updated video after updating the virtual scene video, and display the updated video.

15. An electronic device, characterized in that, Includes: A memory, configured to store executable instructions; A processor, configured to implement the input control method according to any one of claims 1 to 13 when executing the executable instructions stored in the memory.

16. A computer-readable storage medium, characterized in that, Stored with executable instructions, configured to cause the processor to implement the input control method according to any one of claims 1 to 13 when executing the executable instructions.

17. A computer program product, the computer program product comprising executable instructions stored in a computer-readable storage medium; When a processor of an electronic device reads the executable instructions from the computer-readable storage medium and executes the executable instructions, the input control method according to any one of claims 1 to 13 is implemented.

Images