Cross-end interaction processing and display method
By deploying a virtual machine to run the mobile operating system on the desktop terminal, and using external input devices to convert interactive signals to simulate touch screen interaction, the problem of high development costs is solved and a natural and efficient interactive experience of cross-end operations is achieved.
Patent Information
- Application Number
- CN202411195179.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-28
- Publication Date
- 2024-12-03
AI Technical Summary
The prior art requires the development of applications for desktop and mobile operating systems separately, resulting in high development costs and high workload.
By deploying a virtual machine on the desktop terminal, running the mobile operating system, and using external input devices to obtain interactive operation signals, converting them into touch signals, simulating the interactive operation of mobile applications on the touch screen terminal, and achieving cross-end interactive processing and display.
It reduces development costs, improves interactive experience, and realizes cross-end operation of the same application on different terminals, retains a good visual experience while achieving natural and efficient information interaction through touch.
Smart Images

Figure CN119065559A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a cross-end interaction processing method, a cross-end interaction display method, an apparatus, a computer device, a computer-readable storage medium, and a computer program product. Background Art
[0002] With the rapid development of computer technology, computers using desktop operating systems and touch-screen terminals using mobile operating systems have emerged.
[0003] In traditional technology, for the same product, two sets of applications are usually developed, one for the desktop operating system and the other for the mobile operating system, to match the usage requirements of different devices. This undoubtedly increases the workload of developers and has the problem of high development costs. Summary of the invention
[0004] Based on this, it is necessary to provide a cross-end interaction processing method, cross-end interaction display method, device, computer equipment, computer-readable storage medium and computer program product that can reduce development costs in response to the above-mentioned technical problems.
[0005] In a first aspect, the present application provides a cross-end interaction processing method, the method comprising:
[0006] In response to an application triggering operation initiated by a desktop operating system of a first terminal, a triggered mobile application is run on a virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile operating system; and the first terminal includes an external input device;
[0007] In response to an interactive operation triggered by the external input device, acquiring an operation signal of the interactive operation;
[0008] According to the interactive mapping relationship between the first terminal and the second terminal, the operation signal is converted into a touch signal for the application page of the mobile application; the second terminal is a touch screen terminal;
[0009] The touch operation represented by the touch signal is applied to the application page to simulate the touch screen interaction of the mobile application on the second terminal.
[0010] In a second aspect, the present application also provides a cross-end interactive display method, the method comprising:
[0011] On a desktop client of an application distribution platform, displaying application identifiers of respective mobile applications distributed by the application distribution platform; the desktop client runs on a desktop operating system of a first terminal; the first terminal includes an external input device;
[0012] In response to a trigger operation for a target identifier in each of the application identifiers, an application page of a mobile application represented by the target identifier is displayed; the mobile application runs on a virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile terminal operating system;
[0013] In response to an interactive operation triggered on the external input device, an updated application page is displayed; the updated application page is obtained by converting the operation signal of the interactive operation into a touch signal for the application page according to the interactive mapping relationship between the first terminal and the second terminal, and updating the application page in response to the touch signal; the second terminal is a touch screen terminal.
[0014] In a third aspect, the present application further provides a cross-end interaction processing device, the device comprising:
[0015] A virtual operation module, configured to respond to an application triggering operation initiated by a desktop operating system of a first terminal and to run a triggered mobile application on a virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile operating system; and the first terminal includes an external input device;
[0016] An operation signal acquisition module, configured to acquire an operation signal of the interactive operation in response to the interactive operation triggered by the external input device;
[0017] a signal conversion module, configured to convert the operation signal into a touch signal for an application page of the mobile application according to an interactive mapping relationship between the first terminal and a second terminal; the second terminal being a touch screen terminal;
[0018] A touch screen interaction simulation module is used to apply the touch operation represented by the touch signal to the application page to simulate the touch screen interaction of the mobile application on the second terminal.
[0019] In a fourth aspect, the present application further provides a cross-end interactive display device, the device comprising:
[0020] An application identification display module, used for displaying the application identification of each of the plurality of mobile applications distributed by the application distribution platform on a desktop client of the application distribution platform; the desktop client runs on a desktop operating system of a first terminal; the first terminal includes an external input device;
[0021] an application page display module, configured to display an application page of a mobile application represented by a target identifier in response to a trigger operation on a target identifier in each of the application identifiers; the mobile application runs on a virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile terminal operating system;
[0022] An update interface display module is used to display an updated application page in response to an interactive operation triggered on the external input device; the updated application page is obtained by converting the operation signal of the interactive operation into a touch signal for the application page according to the interactive mapping relationship between the first terminal and the second terminal, and updating the application page in response to the touch signal; the second terminal is a touch screen terminal.
[0023] In a fifth aspect, the present application further provides a computer device, wherein the computer device comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.
[0024] In a sixth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of the above method when executed by a processor.
[0025] In a seventh aspect, the present application further provides a computer program product, wherein the computer program product comprises a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.
[0026] The above cross-terminal interaction processing method, device, computer equipment, computer-readable storage medium and computer program product respond to the application triggering operation initiated by the desktop operating system of the first terminal, and run the triggered mobile application on the virtual machine deployed on the first terminal. Since the operating system of the virtual machine is a mobile operating system, it is equivalent to supporting the running of applications adapted to the mobile operating system on the first terminal, so that a set of applications can be adapted to two types of terminal devices, thereby reducing the workload of developers and reducing development costs. In response to the interactive operation triggered by the external input device, the operation signal of the interactive operation is obtained; according to the interactive mapping relationship between the first terminal and the second terminal, the operation signal is converted into a touch signal for the application page of the mobile application; the touch operation represented by the touch signal is applied to the application page to simulate the touch screen interaction of the mobile application on the second terminal. Since the second terminal is a touch screen terminal, it is equivalent to mapping the interactive operation of the external input device under the first terminal to the touch operation for the touch screen terminal, thereby realizing cross-terminal operation for the same application, and being able to achieve information interaction more naturally and efficiently through touch while retaining the good visual experience of the first terminal, which is conducive to improving the interactive experience of the first terminal. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] Figure 1 It is an application environment diagram of a cross-end interaction processing method and a cross-end interaction display method in one embodiment;
[0028] Figure 2A schematic diagram of a client page of a desktop client in one embodiment;
[0029] Figure 3 This is a schematic diagram of an application page of a mobile application A in an embodiment;
[0030] Figure 4 Schematic diagram of a process flow of a cross-end interaction processing method in one embodiment;
[0031] Figure 5 A schematic diagram of an update process of an interactive mapping file in one embodiment;
[0032] Figure 6 A schematic diagram showing how the display position of a same functional control changes with page size in one embodiment;
[0033] Figure 7 It is a flowchart of a cross-end interaction processing method in another embodiment;
[0034] Figure 8 1 is a flow chart of a cross-terminal interactive display method in one embodiment;
[0035] Fig. 9 A schematic diagram of the mapping relationship between keyboard keys and function controls in one embodiment;
[0036] Fig.10 A schematic diagram of a generation process of an interactive mapping file in one embodiment;
[0037] Fig.11 A schematic diagram of module logic generated and executed for an interactive map in one embodiment;
[0038] Fig.12 A logical diagram of an interactive mapping execution process in one embodiment;
[0039] Fig.13 A schematic diagram of a process of converting an interactive operation based on an external input device into a touch operation in one embodiment;
[0040] Fig.14 is a structural block diagram of a cross-end interaction processing device in one embodiment;
[0041] Fig.15 is a structural block diagram of a cross-end interactive display device in an embodiment;
[0042] Fig.16 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0043] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0044] The cross-end interaction processing method and the cross-end interaction display method provided in the embodiments of the present application can be applied to Figure 1 In the application environment shown. Among them, the first terminal 102 communicates with the server 104 through a network. The communication network can be a wired network or a wireless network. Therefore, the first terminal 102 and the server 104 can be directly or indirectly connected through wired or wireless communication. For example, the first terminal 102 can be indirectly connected to the server 104 through a wireless access point, or the first terminal 102 is directly connected to the server 104 through the Internet, and this application does not limit this.
[0045] Among them, the first terminal 102 is a terminal that includes an external input device and applies a desktop operating system. The first terminal 102 can be, but is not limited to, various desktop computers, laptops, and IoT host computers that include external input devices in various scenarios such as intelligent manufacturing, remote monitoring, operation and maintenance management, medical care, education, and conference systems. The second terminal 106 is a touch-screen terminal that applies a mobile terminal operating system, and users can interact by touching the screen without using a mouse and keyboard light external input device. The second terminal 106 can specifically be a smart phone, a tablet computer, an IoT device, and a portable wearable device. The IoT device can be a smart speaker, a smart TV, a smart air conditioner, a smart car-mounted device, and a device with a touch screen function in various scenarios such as intelligent manufacturing, remote monitoring, operation and maintenance management, medical care, education, and conference systems. The portable wearable device can be a smart watch, a smart bracelet, a head-mounted device, etc. For example, in a smart manufacturing scenario, the first terminal 102 and the second terminal 106 may be terminals held by managers, who can perform production management and scheduling by interacting with the first terminal 102 or the second terminal 106. For another example, in a conference system, the first terminal 102 and the second terminal 106 may be terminals held by participants, who can participate in the meeting and communicate with other participants by interacting with the first terminal 102 or the second terminal 106.
[0046] It can be understood that the essence of the present application is to simulate the touch screen interaction of the second terminal 106 by the first terminal 102. During the entire interaction process, the second terminal 106 does not need to participate. Therefore, the application environment may not involve the second terminal 106, that is, the second terminal 106 does not need to be started during the implementation of the present application solution. Figure 1The second terminal 106 shown in the figure is only to illustrate that the mobile application pages of the first terminal 102 and the second terminal 106 in this application are similar. This application is to simulate the touch interaction of the mobile application on the second terminal 106 through the first terminal 102, thereby realizing the cross-terminal interactive application.
[0047] Further, the server 104 can be used to store the interactive mapping relationship between the first terminal 102 and the second terminal 106, and can also provide service support for the operation of the mobile application. Optionally, the mobile application can be a multiplayer battle application, and the user can interact with the server 104 through the first terminal 102, thereby cooperating with other terminals to achieve multiplayer battle; optionally, the mobile application can be a social application, and the user can interact with the server 104 through the first terminal 102, so as to socialize with other terminal users; optionally, the mobile application can be a video browsing application, and the user can interact with the server 104 through the first terminal 102 to browse the video information submitted to the server 104 by other terminal users. It should be noted that, in some embodiments, the interactive mapping relationship between the first terminal 102 and the second terminal 106 can also be stored in the first terminal 102, or in a data storage system. The data storage system can store data that the server 104 needs to process. The data storage system can be set up separately, integrated on the server 104, or placed on the cloud or other servers.
[0048] Among them, server 104 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), as well as big data and artificial intelligence platforms.
[0049] It should be noted that the cross-terminal interaction processing method and the cross-terminal interaction display method in the embodiment of the present application can be executed by the first terminal 102 alone. Figure 1As shown, the first terminal 102 includes a main device 1021 and an external input device 1022, wherein the main device 1021 is installed with a desktop operating system and a virtual machine that applies a mobile operating system is deployed. Desktop operating systems mainly include Windows, Mac OS, Linux and their derivative versions, etc. These operating systems are mainly used for desktop computers, laptops, IoT host computers, etc., providing user interfaces and a series of applications to meet daily computing needs. The mobile operating system, also known as the mobile terminal operating system, is developed on the basis of an embedded operating system. It provides a unified interface and a friendly interactive interface for users to use mobile terminals, and also provides a platform for the expansion of mobile terminal functions and the installation and operation of third-party software. The mobile operating systems mainly include Android, iOS, HarmonyOS, etc. The external input device 1022 may include a mouse, a keyboard, a touchpad, etc.
[0050] Specifically, during the cross-terminal interaction processing, the first terminal 102: responds to an application trigger operation initiated based on the desktop operating system, and runs the triggered mobile application on the virtual machine deployed in the first terminal 102; then, responds to the interaction operation triggered based on the external input device, obtains the operation signal of the interaction operation; according to the interaction mapping relationship between the first terminal and the second terminal, converts the operation signal into a touch signal for the application page of the mobile application; and applies the touch operation represented by the touch signal to the application page to simulate the touch screen interaction of the mobile application on the second terminal.
[0051] Furthermore, in the process of cross-end interaction processing, such as Figure 2 As shown, the first terminal 102 can display the application identifiers of the multiple mobile applications distributed by the application distribution platform on the client page 201 of the desktop client of the application distribution platform. Figure 2 Then, in response to the trigger operation for the target identifier in each application identifier, the application page of the mobile application represented by the target identifier is displayed. The target identifier can be, for example, Figure 2 The application identifier A in the first terminal 102 is a desktop client running on the desktop operating system; the mobile application runs on the virtual machine deployed on the first terminal 102; the operating system of the virtual machine is a mobile operating system. Figure 3 As shown, the application page 301 of the mobile application can be displayed on the upper layer of the client page 201. It can be understood that in other embodiments, the application page 301 and the client page 201 can also be displayed side by side, which is not limited here.
[0052] After the mobile application is running, the first terminal 102 can display an updated application page in response to an interactive operation triggered on an external input device. The updated application page is obtained by converting the operation signal of the interactive operation into a touch signal for the application page 301 according to the interactive mapping relationship between the first terminal 102 and the second terminal, and updating the application page 301 in response to the touch signal.
[0053] In one embodiment, Figure 4 As shown, a cross-end interaction processing method is provided, which can be executed by a computer device, and the computer device can be Figure 1 The first terminal shown comprises the following steps:
[0054] Step S402: In response to an application triggering operation initiated by a desktop operating system of the first terminal, a triggered mobile application is run on a virtual machine deployed on the first terminal.
[0055] Among them, the first terminal includes an external input device. The external input device can be used as a physical medium for the user to interact with the first terminal, and can specifically include at least one of a keyboard, a mouse, and a touchpad. A desktop operating system is installed on the first terminal, and when the first terminal is powered on, the desktop operating system runs. That is, when the first terminal is in an on state, the desktop operating system always remains in operation. Mobile application refers to an application suitable for a mobile operating system. Specifically, in order to meet the operating conditions of the mobile application, the first terminal can deploy a virtual machine whose operating system is a mobile operating system, so that the virtual machine can be used as a running container to run the mobile application. Further, the mobile application can be a stand-alone application that can run on the first terminal without server support; it can also be a cloud application whose at least part of the running logic is managed by the server and needs to be accessed through the Internet, such as cloud games or cloud videos, etc. Among them, cloud games are game applications that use powerful cloud services deployed in data centers to render game screens.
[0056] Specifically, when the first terminal is started, the application identifier of the mobile application can be displayed in the interactive interface provided by the desktop operating system. The user can initiate an application trigger operation for the mobile application by interacting with the first terminal. Thus, the first terminal can respond to the application trigger operation and use the virtual machine deployed by the first terminal as the running container to run the triggered mobile application.
[0057] There is no unique way to initiate an application trigger operation. Optionally, the user can use a mouse or touchpad to control the cursor to click the application logo of the mobile application, or select the application logo of the mobile application through the keyboard to initiate an application trigger operation for the mobile application represented by the application logo. The method of clicking the application logo can be single-click or double-click, etc.; the method of selecting the application logo can be, for example, first controlling the cursor to move to the application logo through the "direction keys", and then selecting the application logo through the "enter key".
[0058] In a specific embodiment, a desktop client of an application distribution platform can be installed on the first terminal. The application distribution platform is an aggregation platform for providing application listing, updating and downloading. Developers can upload the applications they develop to the application distribution platform so that users can discover and use these applications. The desktop client refers to a client that is adapted to the desktop operating system and can run on the desktop operating system. The mobile client, which is opposite to the desktop client, refers to a client that is adapted to the mobile operating system and can run on the mobile operating system. It can be understood that the mobile application in this application refers to the application carried by the mobile client.
[0059] Specifically, when the user triggers the desktop client of the application distribution platform, the first terminal can display the client page of the desktop client. Figure 2 As shown, the client page 201 displays the application identifiers of multiple mobile applications distributed by the application distribution platform. Thus, the user can initiate an application trigger operation for any mobile application by interacting with the first terminal. Figure 2 In the example, the user can trigger the application A represented by the application identifier A by clicking the start control 2011 of the application identifier A. The start control 2011 can be marked with words such as "open" or "start" to guide the user to perform the operation.
[0060] Furthermore, the virtual machine can be deployed in advance or in real time when the mobile application is triggered.
[0061] In a specific embodiment, the first terminal can respond to the application triggering operation initiated based on the desktop operating system, determine the application category to which the triggered application belongs, and if the application category to which the triggered application belongs is a mobile application, deploy a virtual machine as a running container, and run the triggered mobile application on the virtual machine. The operating system of the virtual machine is a mobile operating system.
[0062] In a specific embodiment, the first terminal may pre-deploy a virtual machine whose operating system is a mobile operating system. During operation, the first terminal may respond to an application triggering operation initiated based on the desktop operating system, determine the application category to which the triggered application belongs, and run the triggered mobile application on the virtual machine if the application category to which the triggered application belongs is a mobile application.
[0063] Step S404: in response to the interactive operation triggered by the external input device, an operation signal of the interactive operation is obtained.
[0064] Among them, the interactive operation is a hardware operation performed with an external input device as a physical medium. The interactive operation, for example, may include a pressing operation on a key in the keyboard; it may also include a moving operation on the mouse, and a pressing or scrolling operation on the mouse button. The operation signal refers to the signal received by the operating system when an interactive operation occurs. It can be understood that by parsing the operation signal, the first terminal can determine the triggered component in the external input device and the triggering method of the component. Taking the case where the external input device is a keyboard as an example, when the user presses different keys, the first terminal can obtain different operation signals; for the same key, the operation signals obtained by the first terminal are also different in the two cases of long pressing and single pressing.
[0065] Specifically, when the mobile application is running, the user can initiate an interactive operation for the mobile application through an external input device, so that the first terminal can obtain the operation signal of the interactive operation. The way in which the first terminal obtains the operation signal can be active acquisition or passive reception. Optionally, the first terminal can monitor the device signal of the external input device through the communication component with the external input device. When the user operates the external input device, the device signal will change accordingly, so that the first terminal can obtain the operation signal of the external input device by analyzing the change of the device signal. Optionally, when the user operates the external input device, the external input device can send an operation signal to the first terminal, so that the first terminal can receive the operation signal of the interactive operation.
[0066] Step S406: converting the operation signal into a touch signal for the application page of the mobile application according to the interactive mapping relationship between the first terminal and the second terminal.
[0067] Among them, the second terminal is a touch screen terminal. The interactive mapping relationship between the first terminal and the second terminal is used to characterize the mapping relationship between the interactive operation initiated for the first terminal and the touch operation initiated for the second terminal. Optionally, the interactive mapping relationship can be expressed as a mapping relationship between keyboard keys and functions. For example, the key position "W" maps the function "move up", the key position "A" maps the function "move left", the key position "S" maps the function "move down", and the key position "D" maps the function "move forward"; for example, the key position "Enter" (i.e. the Enter key mentioned above) maps the function "confirm" or "start", and the key position "Esc" maps the function "return". Optionally, the interactive mapping relationship can be expressed as a mapping relationship between keyboard keys and page positions in a mobile application page. For example, the key position "M" maps the lower right corner of the page, and the key position "Z" maps the lower left corner of the page. Optionally, the interactive mapping relationship can be expressed as a mapping relationship between keyboard keys and page paths in a mobile application page. For example, the page path mapped by the key position "↑" is "from bottom to top", and the page path mapped by the key position "↓" is "from top to bottom".
[0068] Specifically, the first terminal can obtain the interactive mapping relationship between itself and the second terminal, and according to the interactive mapping relationship, convert the operation signal corresponding to the external input device into a touch signal for the application page of the mobile application, so as to simulate the touch operation of the second terminal through the first terminal.
[0069] Optionally, the first terminal may obtain an interactive mapping file configured for the terminal type to which the first terminal belongs and the terminal type to which the second terminal belongs from a server or a cloud, and further determine the interactive mapping relationship carried by the interactive mapping file. The terminal type to which the first terminal belongs refers to a PC (personal computer) terminal that applies a desktop operating system; the terminal type to which the second terminal belongs refers to a touch-screen terminal that applies a mobile operating system.
[0070] Optionally, the first terminal can determine the interactive mapping relationship between itself and the second terminal in response to the user operation. Exemplarily, the desktop client of the application distribution platform can provide an entry for mapping settings, so that the user can trigger the configuration operation for the interactive mapping relationship through the entry. During the configuration process of the interactive mapping relationship, the user can set shortcut keys to map the interactive actions of the second terminal. For example, the "W", "A", "S", and "D" keys can be mapped to the respective direction keys in different directions, and the "Enter" key can be mapped to the "Confirm" or "Start" button of the application page in the second terminal. It can be understood that when the mapping relationship configuration is completed, the first terminal can save the interactive mapping relationship to an interactive mapping file, and upload the interactive mapping file to a server or cloud for other users to download and use.
[0071] It should be noted that the number of triggered mobile applications is not unique, for example, it can be one or more. In the case where the number of triggered mobile applications is multiple, the first terminal can determine the foreground application from each mobile application in response to the user's operation, and convert the operation signal into a touch signal for the application page of the foreground application according to the interactive mapping relationship between the first terminal and the second terminal. Exemplarily, the user can trigger the application page switching function through the "Tab" key and the direction keys, and select the target page from each application page by switching, so that the first terminal can determine the mobile application corresponding to the target page as the foreground application, and determine the mobile applications corresponding to other pages as background applications.
[0072] Step S408: applying the touch operation represented by the touch signal to the application page to simulate the touch screen interaction of the mobile application on the second terminal.
[0073] Specifically, the first terminal can determine the touch operation represented by the touch signal based on the mobile terminal operating system. Then, the touch operation is applied to the application page of the mobile application to simulate the touch screen interaction of the mobile application in the second terminal. It can be understood that after the touch operation is applied to the application page of the mobile application, the application program of the mobile application can respond to the touch operation and update the application page. Optionally, the first terminal can transmit the touch signal to the mobile application through a virtual machine, so that the mobile application responds to the touch operation represented by the touch signal and updates the application page. It should be noted that when the number of triggered mobile applications is multiple, the first terminal specifically updates the application page of the foreground application based on the touch signal.
[0074] In a specific implementation, the first terminal can click and interact with the screen canvas on the virtual machine container, transparently transmit it to the screen canvas of the mobile application being executed, and obtain a response from the mobile application to update the application screen.
[0075] In the above cross-terminal interaction processing method, in response to the application triggering operation initiated by the desktop operating system of the first terminal, the triggered mobile application is run on the virtual machine deployed on the first terminal. Since the operating system of the virtual machine is a mobile operating system, it is equivalent to supporting the running of applications adapted to the mobile operating system on the first terminal, so that a set of applications can be adapted to two types of terminals, thereby reducing the workload of developers and reducing development costs. In response to the interactive operation triggered by the external input device, the operation signal of the interactive operation is obtained; according to the interactive mapping relationship between the first terminal and the second terminal, the operation signal is converted into a touch signal for the application page of the mobile application; the touch operation represented by the touch signal is applied to the application page to simulate the touch screen interaction of the mobile application on the second terminal. Since the second terminal is a touch screen terminal, it is equivalent to mapping the interactive operation of the external input device under the first terminal to the touch operation for the touch screen terminal, thereby realizing cross-terminal operation for the same application, and being able to retain the good visual experience of the first terminal while realizing information interaction more naturally and efficiently through touch, which is conducive to improving the interactive experience of the first terminal.
[0076] In one embodiment, in response to an application triggering operation initiated by a desktop operating system based on a first terminal, a triggered mobile application is run on a virtual machine deployed on the first terminal, including: in response to the application triggering operation initiated by the desktop operating system based on the first terminal, determining the application category to which the triggered application belongs; when the application category to which the triggered application belongs is a mobile application, deploying a virtual machine as a running container on the first terminal; and running the triggered mobile application on the virtual machine.
[0077] The application category may be a mobile application or a desktop application. A desktop application refers to an application program carried by a desktop client that is compatible with a desktop operating system.
[0078] Specifically, the user can initiate an application triggering operation based on the desktop operating system of the first terminal. The first terminal can determine the application category to which the triggered application belongs in response to the application triggering operation. When the application category to which the triggered application belongs is a desktop application, the desktop application is run under the desktop operating system. When the application category to which the triggered application belongs is a mobile application, a virtual machine is deployed on the first terminal as a running container, and the triggered mobile application is run on the virtual machine. Furthermore, the virtual machine can be specifically deployed based on virtualization technology. Among them, the desktop operating system serves as the host operating system (Host Operating System, Host OS), and the mobile operating system serves as the guest operating system (Guest Operating System, Guest OS).
[0079] For example, Figure 2 As shown, when the desktop application corresponding to the application distribution platform is triggered, the first terminal can run the desktop application in the desktop operating system and display the client page of the application distribution platform. Figure 3 As shown, in the case where mobile application A is triggered, it is necessary to create a virtual machine of a mobile operating system as a running container, and run mobile application A on the virtual machine.
[0080] In the above embodiment, when the application category to which the triggered application belongs is a mobile application, a virtual machine serving as a running container is deployed on the first terminal, and the triggered mobile application is run on the virtual machine. This is equivalent to deploying the virtual machine only when the mobile application needs to be run, which can ensure the utilization rate of the deployed virtual machine and thereby improve the utilization rate of the computing resources of the first terminal.
[0081] The following is an introduction to the process of determining the interactive mapping relationship.
[0082] In one embodiment, the cross-terminal interaction processing method also includes: in response to a mapping recording operation for the first terminal, determining a page mapping position from a display interface of the first terminal, and determining a target key from multiple input keys of an external input device; based on the correspondence between multiple groups of target keys and page mapping positions, determining an interaction mapping relationship between the first terminal and the second terminal.
[0083] Specifically, the desktop mapping system can provide an entry for mapping settings, so that the user can trigger the configuration operation for the interactive mapping relationship through the entry. In this embodiment, the configuration process will be recorded in a recording manner, so the configuration operation for the interactive mapping relationship can also be called a mapping recording operation. During the mapping recording process, the first terminal can determine the page mapping position from the mobile application page displayed on the display interface in response to the user operation, and determine the target button from the multiple input buttons of the external input device. Exemplarily, the user can trigger a specified operation for the page mapping position so that the first terminal can record the specified page mapping position through screen recording; by triggering an interactive operation for the target button, the first terminal can determine the triggered target button through the operation information of the interactive operation. It should be noted that the order of specifying the page mapping position and triggering the target button is not unique. For example, the page mapping position can be specified first and then the target button can be triggered, or the target button can be triggered first and then the page mapping position can be specified, which is not limited here.
[0084] Furthermore, the specific method of specifying the page mapping position is not unique. In a specific embodiment, the first terminal can display a mobile application page, so that the user can trigger the specified operation for the page mapping position in the mobile application page through the mouse. Among them, the mobile application page can refer to a general page of multiple mobile applications, or it can refer to the application page of a specific mobile application. Specifically, the first terminal can select mobile applications with similar page layouts from various mobile applications according to the page layouts of the application pages of each installed mobile application, and uniformly configure the interactive mapping relationship; it can also extract the common layout according to the page layouts of the application pages of each installed mobile application, and generate a mobile application page showing the common layout, and then perform the specified operation of the page mapping position based on the mobile application page, thereby realizing the setting of the general mapping relationship for different mobile applications. Exemplarily, for the "lower right corner" of the application page of a social mobile application, a "my" control is usually deployed. The first terminal can use the lower right corner of the page as the page mapping position, and the button "M" as the target button to obtain a set of corresponding relationships between the target button and the page mapping position. During the application process, when the user presses the button "M", the "my" control will be triggered to enter the personal information setting page.
[0085] In a specific embodiment, the first terminal can display a variety of touch screen interactive functions supported by the mobile application, so that the user can select a target function from each touch screen interactive function. In this case, the first terminal can determine the location of the control corresponding to the target function in the mobile application page as the specified page mapping location. It can be understood that mobile applications belonging to the same application type usually support similar interactive functions. For example, game applications support up, down, left, and right movement operation functions; social applications support likes, favorites, and other functions; video applications support pause, double-speed playback, and other functions. By determining the page mapping location through function, it is also possible to set a general mapping relationship for different mobile applications.
[0086] In the case of obtaining the correspondence between multiple groups of target buttons and page mapping positions, the first terminal can determine the interactive mapping relationship including each group of correspondence, and the interactive mapping relationship is the interactive mapping relationship between the first terminal and the second terminal. Exemplarily, the interactive mapping relationship may include multiple groups of interactive mapping key-value pairs, each group of interactive mapping key-value pairs records the correspondence between a target button and a page mapping position, and the interactive mapping key-value pair {key:value}, for example, may be {keyboard operation, mobile terminal coordinates}. Among them, "keyboard operation" is used to record the target button, and "mobile terminal coordinates" are used to record the page mapping position of the mobile application page.
[0087] In a specific implementation, after the interaction mapping relationship is configured, the user can test and adjust the interaction mapping relationship until a comfortable operation method is found.
[0088] In the above embodiment, based on the correspondence between multiple groups of target buttons and page mapping positions, the interactive mapping relationship between the first terminal and the second terminal is determined, which can support general mapping relationship settings and help reduce development costs.
[0089] In a specific embodiment, in response to a mapping recording operation for a first terminal, a page mapping position is determined from a display interface of the first terminal, and a triggered target key is determined from multiple input keys of an external input device, including: in response to a mapping position confirmation operation for the first terminal, a page mapping position is determined from a display interface of the first terminal; in response to a key operation triggered based on an external input device, a triggered target key is determined from multiple input keys of the external input device.
[0090] Specifically, the user can first click any position in the mobile application page with the mouse to trigger the mapping position confirmation operation for the first terminal, so that the first terminal can respond to the mapping position confirmation operation and determine the clicked page mapping position from the mobile application interface displayed on the display interface. The user can also perform a key operation on an external input device, so that the first terminal can respond to the key operation and determine the triggered target key from multiple input keys of the external input device through the operation information of the key operation.
[0091] In a specific implementation, such as Figure 5 As shown, the first terminal can Figure 2 The client identification (application identification, AppID) of the desktop client creates an interaction mapping file that records the interaction mapping relationship. The file name can be customized and includes {AppID, update version, author, [{key1:value1},{key2:value2},...]}. This file is used as the interaction mapping file of the entire mobile application. During the configuration of the interaction mapping relationship, the first terminal can create a corresponding interaction mapping key-value pair for each interaction, and can also update or delete the created interaction mapping key-value pair.
[0092] Specifically, the first terminal can capture the click instruction, record the coordinate position of the user's mouse instruction and the mouse click, that is, the page mapping position, and fill it into the interactive mapping key-value pair as the mobile terminal coordinate (value). At the same time, the corresponding target button is determined according to the page mapping position, and filled into the interactive mapping key-value pair as a keyboard operation (key), thereby completing the mapping entry of a set of key-value pairs. Among them, the target button can be entered through keyboard operation. In some implementations, the target button can also be entered by voice, such as entering the voice "key W" to indicate that the target button is "W". When the entry is completed, the file update is triggered, and the file is exported or persisted for subsequent application. In the above process, the interactive mapping relationship is recorded based on the AppID corresponding to the application distribution platform. Therefore, the obtained interactive mapping file can be applied to multiple mobile applications distributed by the application distribution platform.
[0093] In the above embodiment, the page mapping position is first determined, and then the target button corresponding to the page mapping position is set. The operation is simple and the working efficiency of the interactive mapping recording process can be improved.
[0094] In a specific embodiment, determining a page mapping position from a display interface of a first terminal includes: determining a target function from a plurality of touch screen interaction functions supported by a second terminal; and determining a position of a target control corresponding to the target function in a mobile application page as a page mapping position of a target button corresponding to the second terminal.
[0095] In actual applications, the touch screen interaction functions supported by different mobile applications of the same application type are similar. That is to say, the multiple touch screen interaction functions supported by the second terminal may include functions such as moving, shooting, and selecting menus in game applications; they may also include functions such as liking and collecting in social applications; they may also include functions such as switching, pausing, and speed playback in video applications. For different mobile applications, the positions of the controls corresponding to the same touch screen interaction function in the mobile application page may be different. For example, the positions of the direction controls of different game applications in the application page may be different, and the positions of the like controls of different social applications in the application page may be different. Based on this, the first terminal can determine the target function from the multiple touch screen interaction functions supported by the second terminal, and determine the position of the target control corresponding to the target function in the mobile application page as the page mapping position of the target button corresponding to the second terminal.
[0096] In a specific implementation, the interactive mapping key-value pair may include a "target button" and a "target function". Specifically, the first terminal may, on the one hand, determine the triggered target button by capturing the interactive operation of the external input device, and fill it into the interactive mapping key-value pair as a key. On the other hand, the first terminal may, in response to the user operation, fill the target function specified by the user as the touch screen interactive function mapped to the target button, and fill it into the interactive mapping key-value pair as a value, thereby completing the mapping entry of a set of key-value pairs. During the application process, when the first terminal receives the interactive operation triggered by the target button, it may determine the target function mapped to the target button based on the key-value pair, and further search for the target control corresponding to the target function in the currently running application page, and determine the location of the target control in the mobile application page as the page mapping position of the target button corresponding to the second terminal.
[0097] In this embodiment, the page mapping position is determined based on the touch screen interaction function, which can implement a universal mapping setting for the same touch screen interaction function in multiple mobile applications, and is conducive to improving the work efficiency of the interactive mapping relationship determination process.
[0098] In one embodiment, the cross-terminal interaction processing method further includes: obtaining an interaction mapping file configured for the first terminal and the second terminal and having passed review; and determining the corresponding relationship carried by the interaction mapping file as the interaction mapping relationship between the first terminal and the second terminal.
[0099] In practical applications, after completing the configuration of the interactive mapping relationship, the interactive mapping relationship can be saved in the form of a key-value pair in an interactive mapping file, and the interactive mapping file can be uploaded to a server or cloud for use by other terminals. Furthermore, the server or cloud can review the interactive mapping file and, if the review is passed, open the interactive mapping file to other terminals.
[0100] Specifically, for the first terminal, an interactive mapping file configured for the first terminal and the second terminal and having passed the review can be obtained from the open platform, and the corresponding relationship carried by the interactive mapping file can be determined as the interactive mapping relationship between the first terminal and the second terminal. Figure 2The interactive mapping file developed under the desktop client of the application distribution platform can be reviewed by the server of the application distribution platform. The review focus may include the correctness of the file information, the rationality of the interactive mapping relationship, whether there are security risks, etc. Among them, the file information may include version number, developer information, etc. If the review determines that the interactive mapping file meets the requirements, the review is passed, and the interactive mapping file can be recognized and applied by the desktop client of the application distribution platform. Optionally, the first terminal can use the interactive mapping relationship in the interactive mapping file by default when the mobile application distributed by the application distribution platform is running; optionally, the first terminal can also respond to the file download operation, and when the interactive mapping file is loaded from the server or cloud to the local, the interactive mapping relationship carried in the application mapping file is applied.
[0101] In the above embodiment, by obtaining the reviewed interactive mapping file, the interactive mapping relationship between the first terminal and the second terminal is determined, so that the user can enjoy an efficient cross-terminal interactive experience without manually setting the mapping relationship. In addition, this open platform mechanism facilitates the interaction between developers and users, providing users with more customized application experiences.
[0102] In a specific embodiment, obtaining an interactive mapping file configured for the first terminal and the second terminal and having passed the review includes: obtaining multiple candidate mapping files configured for the first terminal and the second terminal and having passed the review; and determining, from each candidate mapping file, an interactive mapping file that matches the application type of the mobile application.
[0103] Among them, the application type of the mobile application can be determined according to the purpose and function of the application. The application type may include, for example, social, information, games, shopping, finance, and video. Specifically, since the touch screen interaction functions supported by different mobile applications of the same type are usually similar, the layout of the application page is also similar, therefore, the interactive mapping relationship can be configured for multiple different mobile applications of the same type. In other words, for the first terminal and the second terminal, there may be multiple candidate mapping files carrying different interactive mapping relationships.
[0104] Based on this, the first terminal can determine the application type of the currently triggered mobile application on the one hand, and on the other hand, can obtain the candidate mapping files configured for the first terminal and the second terminal and have passed the review. Then, the first terminal determines the interactive mapping file that matches the application type of the mobile application from each candidate mapping file.
[0105] In this embodiment, determining an interaction mapping file that matches the application type of the mobile application from multiple candidate mapping files configured for the first terminal and the second terminal can ensure the compatibility of the interaction mapping relationship carried by the interaction mapping file with the mobile application, thereby ensuring smooth cross-terminal interaction.
[0106] In one embodiment, according to the interactive mapping relationship between the first terminal and the second terminal, the operation signal is converted into a touch signal for the application page of the mobile application, including: parsing the operation signal, determining the operation key corresponding to the operation signal from an external input device; based on the interactive mapping relationship between the first terminal and the second terminal, determining the page mapping position of the application page of the mobile application corresponding to the operation key; converting the operation signal into a touch signal for the page mapping position.
[0107] Specifically, in the case of triggering a key operation, the first terminal can obtain the corresponding operation signal, and then determine the triggered operation key by parsing the operation signal. Taking the case where the external input device number is a keyboard as an example, there are several wires connected under each key of the keyboard, and switches connected to these wires are arranged under the key. When the key is pressed, some of these switches are closed and some are opened. If the closed one is 1 and the open one is 0, then each time a key is triggered, it will correspond to a unique binary code, which is the operation signal. Then, the first terminal can determine the triggered operation key based on the operation signal and the correspondence between the operation signal and the operation key.
[0108] After determining the triggered operation button, the first terminal determines the page mapping position of the application page of the mobile application corresponding to the operation button according to the interactive mapping relationship between itself and the second terminal, and converts the operation signal into a touch signal for the page mapping position.
[0109] In the above embodiment, after determining the operation button based on the operation signal, the operation signal is converted into a touch signal of the page mapping position mapped by the operation button according to the interactive mapping relationship, so that the touch screen operation of the second terminal can be simulated on the first terminal, which is beneficial to improving the interactive experience of the first terminal.
[0110] In a specific embodiment, based on the interactive mapping relationship between the first terminal and the second terminal, determining the page mapping position of the operation button corresponding to the application page of the mobile application includes: determining the theoretical page size of the second terminal and the initial mapping position of the operation button corresponding to the theoretical page size during the configuration of the interactive mapping relationship according to the interactive mapping relationship between the first terminal and the second terminal; based on the theoretical page size and the actual page size of the mobile application in the virtual machine window display area, correcting the initial mapping position to obtain the page mapping position of the application page of the mobile application corresponding to the operation button.
[0111] It can be understood that if the page mapping position is determined based on the touch screen interaction function during the configuration of the interactive mapping relationship, the first terminal can determine the target function of the operation button mapping according to the interactive mapping relationship between the first terminal and the second terminal, and further determine the position of the target control corresponding to the target function in the application page of the mobile application as the page mapping position of the operation button corresponding to the application page of the mobile application. If the page mapping position is specified by the mouse during the configuration of the interactive mapping relationship, there may be a difference between the page size when the interactive mapping relationship is configured and the page size when the interactive mapping relationship is applied. For example, Figure 6 As shown, due to the different page sizes of the application page 601 when the interactive mapping relationship is configured and the application page 602 when the interactive mapping relationship is applied, the shooting control is offset from the initial mapping position 6011 to the page mapping position 6021. In this case, the first terminal needs to make corrections based on the initial mapping position determined according to the interactive mapping relationship to obtain the page mapping position of the application page of the mobile application corresponding to the operation button.
[0112] Specifically, the first terminal can determine the theoretical page size of the second terminal and the initial mapping position of the operation button corresponding to the theoretical page size during the configuration of the interactive mapping relationship according to the interactive mapping relationship between the first terminal and the second terminal. Then, the actual page size of the mobile application in the current virtual machine window display area is determined, and then the initial mapping position is corrected according to the difference between the theoretical page size and the actual page size to obtain the page mapping position of the operation button corresponding to the application page of the mobile application.
[0113] In a specific implementation, for each initial mapping position in the interactive mapping relationship, a correction method that matches the initial mapping position can be determined based on the constraint condition that the initial mapping position changes with the page size, and based on the theoretical page size and the actual page size of the mobile application in the virtual machine window display area, the initial mapping position is corrected according to the correction method to obtain the page mapping position of the application page of the mobile application corresponding to the operation button.
[0114] The change constraint condition may be, for example, that the position changes in proportion to the page size, or that the distance between the position and the edge of the page remains unchanged.
[0115] In the case where the position changes proportionally with the page size, the matching correction method can be to correct it according to the proportional relationship between the page sizes. Specifically, the first terminal can correct the initial mapping position according to the proportional relationship between the theoretical page size and the actual page size. Exemplarily, the theoretical page size is width L1 and height H1, the actual page size is width L2 and height H2, and the initial mapping position is (X1, Y1). Then the page mapping position after correction can be (X2, Y2), where X2=(L2 / L1)*X1, Y2=(H2 / H1)*Y1.
[0116] When the distance between the position and the edge of the page remains unchanged, the matching correction method can be to correct it according to the set distance. Specifically, the first terminal can determine the set distance between the initial mapping position and the edge of the page based on the initial mapping position and the theoretical page size, and then determine the page mapping position corresponding to the initial mapping position based on the set distance and the actual page size. Exemplarily, the theoretical page size is width L1 and height H1, the actual page size is width L2 and height H2, the initial mapping position is (X1, Y1), and the set distance between the initial mapping position and the right page edge is △L, and the set distance between the initial mapping position and the lower page edge is △H, then: △L= L1-X1; △H= H1-Y1. The page mapping position obtained after correcting the initial mapping position (X1, Y1) can be (X2, Y2), where X2= L2-△L; Y2= H2-△H.
[0117] In the above embodiment, based on the difference between the theoretical page size and the actual page size, the initial mapping position is corrected to determine the page mapping position of the operation button corresponding to the application page of the mobile application, which can ensure that the button operation can be accurately converted into a screen touch event of the second terminal, thereby improving the convenience and interactivity of the interaction.
[0118] In one embodiment, the cross-end interactive mapping method further includes: parsing the operation signal to determine the operation parameters for the operation button. In the case of this embodiment, converting the operation signal into a touch signal for the page mapping position includes: based on the touch parameters corresponding to the operation parameters, converting the operation signal into a touch signal for the page mapping position.
[0119] The operation parameter includes any one of the operation times or the operation duration. The touch parameter corresponds to the operation parameter. For example, if the operation parameter includes the operation times, the touch parameter also includes the touch times; if the operation parameter includes the operation duration, the touch parameter also includes the touch duration.
[0120] As mentioned above, the operation signals corresponding to different buttons are different. Furthermore, for the same button, the corresponding operation signals will also be different when the operation methods are different. For example, the duration of the operation signal is different in the two cases of long press operation and single click operation; for another example, compared with the single click operation, there is a signal interruption in the operation signal of the double click operation. Based on this, the first terminal can determine the triggered operation button and the operation parameters for the operation button by parsing the operation signal. Then, based on the touch parameters corresponding to the operation parameters, the operation signal is converted into a touch signal for the page mapping position. Exemplarily, a double-click operation triggered by an external input device will be converted into a touch signal corresponding to two consecutive touches; a long press operation triggered by an external input device will be converted into a touch signal corresponding to a long touch. Among them, the touch duration is the same as the press duration; the number of touches is the same as the number of presses.
[0121] In the above embodiment, by analyzing the operation signal, determining the operation parameters for the operation button, and converting the operation signal into a touch signal for the page mapping position based on the touch parameters corresponding to the operation parameters, rich touch screen interaction simulation can be achieved, which is conducive to further improving the convenience and interactivity of cross-end interaction processing.
[0122] In one embodiment, Figure 7 As shown, a cross-end interaction processing method is provided, which can be executed by a computer device, and the computer device can be Figure 1 In the first terminal shown in the embodiment, the method includes the following steps:
[0123] Step S701, in response to an application triggering operation initiated by a desktop operating system of a first terminal, determining an application category to which a triggered application belongs;
[0124] Wherein, the first terminal includes an external input device;
[0125] Step S702: When the application category to which the triggered application belongs is a mobile application, a virtual machine as a running container is deployed on the first terminal, and the triggered mobile application is run on the virtual machine;
[0126] The operating system of the virtual machine is a mobile terminal operating system;
[0127] Step S703, obtaining a plurality of candidate mapping files configured for the first terminal and the second terminal and having passed review;
[0128] Step S704, determining an interactive mapping file that matches the application type of the mobile application from among the candidate mapping files;
[0129] Step S705, determining the corresponding relationship carried by the interaction mapping file as the interaction mapping relationship between the first terminal and the second terminal;
[0130] Step S706, in response to the interactive operation triggered by the external input device, obtaining an operation signal of the interactive operation;
[0131] Step S707, analyzing the operation signal, and determining the operation key corresponding to the operation signal and the operation parameter for the operation key from the external input device;
[0132] Step S708, determining the theoretical page size of the second terminal and the initial mapping position of the operation button corresponding to the theoretical page size in the configuration process of the interactive mapping relationship according to the interactive mapping relationship between the first terminal and the second terminal;
[0133] Step S709, based on the theoretical page size and the actual page size of the mobile application in the virtual machine window display area, correct the initial mapping position to obtain the page mapping position of the operation button corresponding to the application page of the mobile application;
[0134] Step S710, converting the operation signal into a touch signal for the page mapping position based on the touch parameter corresponding to the operation parameter;
[0135] Step S711: applying the touch operation represented by the touch signal to the application page to simulate the touch screen interaction of the mobile application on the second terminal.
[0136] The above cross-terminal interaction processing method can support running applications adapted to the mobile terminal operating system on the first terminal, so that a set of applications can be adapted to two types of terminals, thereby reducing the workload of developers and reducing development costs. In addition, since the second terminal is a touch-screen terminal, it is equivalent to mapping the interactive operations of the external input device under the first terminal to the touch operations for the touch-screen terminal, thereby realizing cross-terminal operations for the same application, while retaining the good visual experience of the first terminal, and realizing information interaction more naturally and efficiently through touch, which is conducive to improving the interactive experience of the first terminal.
[0137] In one embodiment, Figure 8 As shown, the present application also provides a cross-terminal interactive display method, which is applied to a first terminal including an external input device, and the method includes:
[0138] Step S802: Displaying application identifiers of respective mobile applications distributed by the application distribution platform on the desktop client of the application distribution platform.
[0139] The desktop client runs on the desktop operating system of the first terminal. Figure 2As shown, the first terminal can respond to the triggering operation on the desktop client of the application distribution platform, run the desktop client, and display the application identifiers of the multiple mobile applications distributed by the application distribution platform on the client page 201 of the desktop client. Figure 2 Application identifier A, application identifier B, and application identifier C, etc.
[0140] Step S804: in response to a triggering operation on a target identifier in each application identifier, an application page of the mobile application represented by the target identifier is displayed.
[0141] The mobile application runs on a virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile terminal operating system. Specifically, the user can select and trigger a target identifier from various application identifiers through an external input device. The first terminal can respond to the trigger operation for the target identifier and display the application page of the mobile application represented by the target identifier. Exemplary, the target identifier can be, for example, Figure 2 In the case where the application identifier A is triggered, such as Figure 3 As shown, the first terminal can display the application page 301 of the mobile application represented by the application identifier A. Further, the application page 301 can be displayed on the upper layer of the client page 201, can be displayed side by side with the client page 201, or can be displayed in full screen, which is not limited here.
[0142] Step S806: In response to the interactive operation triggered on the external input device, display the updated application page.
[0143] The updated application page is obtained by converting the operation signal of the interactive operation into a touch signal for the application page according to the interactive mapping relationship between the first terminal and the second terminal, and updating the application page in response to the touch signal; the second terminal is a touch screen terminal. Specifically, after the mobile application is running, the first terminal can respond to the interactive operation triggered on the external input device, map the interactive operation into a touch screen operation for the application page, and update the application page based on the touch screen operation according to the interactive mode of the second terminal.
[0144] The above cross-terminal interactive display method displays the application identifiers of the multiple mobile applications distributed by the application distribution platform on the desktop client of the application distribution platform, and displays the application page of the mobile application represented by the target identifier in response to the trigger operation of the target identifier in each application identifier. Since the mobile application runs on the virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile terminal operating system, which is equivalent to supporting the running of applications adapted to the mobile terminal operating system on the first terminal, so that a set of applications can be adapted to two types of terminals, thereby reducing the workload of developers and reducing development costs. In response to the interactive operation triggered on the external input device, an updated application page is displayed, wherein the updated application page is obtained by converting the operation signal of the interactive operation into a touch signal for the application page according to the interactive mapping relationship between the first terminal and the second terminal, and updating the application page in response to the touch signal. Since the second terminal is a touch screen terminal, it is equivalent to mapping the interactive operation of the external input device under the first terminal to the touch operation for the touch screen terminal, thereby realizing cross-terminal operation for the same application, and being able to retain the good visual experience of the first terminal while realizing information interaction more naturally and efficiently through touch, which is conducive to improving the interactive experience of the first terminal.
[0145] In one embodiment, an application scenario is also provided, in which the cross-end interaction processing method and the cross-end interaction display method of the present application are applied. The application scenario may be, for example, a game scenario, and the mobile application may be a mobile game application. Specifically, the first terminal may respond to an application trigger operation initiated based on a desktop operating system, and run the triggered mobile game application on a virtual machine deployed in the first terminal; then, in response to an interactive operation triggered based on an external input device, obtain an operation signal of the interactive operation; according to the interactive mapping relationship between the first terminal and the second terminal, convert the operation signal into a touch signal for an application page of the mobile game application; and apply the touch operation represented by the touch signal to the application page to simulate the touch screen interaction of the mobile game application on the second terminal. Thus, the game interaction experience of a touch screen terminal can be enjoyed on the non-touch screen first terminal. Exemplary, such as Fig. 9 As shown, the key position "W" maps to the function control "move up", the key position "A" maps to the function control "move left", the key position "S" maps to the function control "move down", and the key position "D" maps to the function control "move forward". When the user triggers a pressing operation on a certain key position, the pressing operation will be converted into a touch operation on the corresponding function control, so that the mobile game application can respond to the touch operation according to the processing logic adapted to the second terminal.
[0146] In one embodiment, an application scenario is also provided, in which the cross-terminal interaction processing method and the cross-terminal interaction display method of the present application are applied. The application scenario may be, for example, a video browsing scenario, and the mobile application may be a mobile video application. Specifically, the first terminal may respond to an application trigger operation initiated based on a desktop operating system, and run the triggered mobile video application on a virtual machine deployed in the first terminal; then, in response to an interactive operation triggered based on an external input device, obtain an operation signal of the interactive operation; according to the interactive mapping relationship between the first terminal and the second terminal, convert the operation signal into a touch signal for an application page of the mobile video application; apply the touch operation represented by the touch signal to the application page to simulate the touch screen interaction of the mobile video application in the second terminal. Thus, the game interaction experience of the touch screen terminal can be enjoyed in the non-touch screen first terminal. Exemplarily, when the user triggers a press operation on the key position "↑", the press operation will be converted into a touch operation of sliding up on the application page, so that the mobile video application can respond to the touch operation according to the processing logic adapted to the second terminal to switch the video.
[0147] The following uses the case where a mobile application is triggered from a desktop client of an application distribution platform as an example to introduce the present application solution in detail.
[0148] In one embodiment, the simulator sets operation shortcut keys at corresponding positions to provide quick interaction mapping settings for each application APP distributed by the application distribution platform. Thus, users can open the application APP adapted for the mobile terminal through the desktop client of the application distribution platform, and realize cross-terminal interaction by mapping the desktop terminal operation to the touch operation of the mobile terminal.
[0149] In one embodiment, Fig.10 As shown, the user can start the desktop client of the application distribution platform on the first terminal (such as a personal computer, i.e., a PC). Figure 2 As shown, the client page of the desktop client can display multiple application identifiers, each of which represents a corresponding mobile application. Thus, users can select and open the mobile applications they want to run on the desktop. Furthermore, the desktop client can provide an interactive mapping recording option to guide users to record interactive mapping relationships. The interactive mapping recording option can be found, for example, through a special menu or in the detailed page information. Then, the user can select a preset mapping mode, which is usually optimized for common application types (such as games, social networking, entertainment, etc.); or select a custom mapping mode to suit personal habits or special application needs.
[0150] During the mapping setting process, users can set shortcut keys to map the interactive actions of the mobile terminal. For example, users can map the "WASD" keys to the "up, left, down, right" arrow keys of the mobile terminal, or map the "Enter" key to the "Confirm" or "Start" button. The entire process can be done by first clicking the corresponding screen coordinates (i.e., clicking the interaction) and then setting the input keyboard key positions. After the settings are completed, the user needs to save the mapping settings and test whether the shortcut keys can be correctly mapped to the operations of the mobile terminal. During the test process, the user can adjust the mapping settings until the most comfortable operation method is found. Once the mapping settings are completed and the test passes, the user can use the external input device (such as the keyboard) on the desktop for interactive operations. The keyboard mapping ensures that the user's input can be accurately executed on the mobile application running on the virtual machine. After completing multiple rounds of shortcut key settings, the interactive mapping recording operation can be ended to generate an interactive mapping file that records the interactive mapping relationship.
[0151] Through the above steps, users can use the desktop keyboard to map mobile terminal operations in the desktop client on the PC side, realizing convenient and efficient cross-terminal application control. This universal cross-terminal interactive mapping technology provides users with a flexible and convenient cross-terminal application control method, improving the user experience.
[0152] Furthermore, the cross-end interactive mapping setting function provided by the desktop client allows users to map the key operations on the external keyboard to the touch operations on the mobile terminal, that is, the user can use it himself. Submit the interactive mapping file to the server of the application development platform. If the file passes the review, other users can be allowed to use it on the desktop client of the application distribution platform. This open platform mechanism helps to promote interaction between developers and users and provide users with more customized application experience.
[0153] In a specific embodiment, Fig.11 As shown, the desktop client of the application distribution platform may include an interactive mapping generation module and an interactive mapping execution module. Among them, the "interactive mapping execution module" finds and loads the "interactive mapping file" used by the application through the client identifier (i.e., AppID) of the desktop client, and also performs trigger actions and execution actions on the desktop client, converting keyboard actions into touch operations at various positions. The "interactive mapping generation module" can record interactive mapping through the desktop client, and combine the coordinate operation collection and keyboard mapping settings in the application to generate an "interactive mapping file" corresponding to the AppID of the desktop client. This "interactive mapping file" can be run locally on the desktop client, or uploaded to the server or cloud corresponding to the desktop client.
[0154] In a specific embodiment, the function of the "interactive mapping execution module" is to execute hardware instructions (i.e., operation signals triggered by external input devices such as keyboards) and convert them into screen coordinate click commands (i.e., touch signals) executable by the mobile application running in the mobile application execution container through the "interactive mapping file". Fig.12 As shown, the desktop client of the application distribution platform runs on the desktop operating system, while the mobile application needs to run on the mobile operating system environment. Therefore, in order to run the mobile application, the desktop client (Host) running on the desktop operating system (Host OS) needs to create a virtual machine using the mobile operating system (Guest OS) as a running container for the mobile application, and run the mobile application on the virtual machine and perform interactive operations. In other words, the mobile client (Guest) uses the virtual machine as a container to run and interact. Among them, the interactive operation can be clicked on the screen canvas on the virtual machine container and transparently transmitted to the screen canvas of the mobile application being executed.
[0155] Specifically, if Fig.12 and 13 As shown, when the keyboard is triggered, a keyboard command signal matching the triggered key position will be generated, that is, Fig.12 The first terminal can search for an "interactive mapping file" adapted to the desktop client from the registered mapping files according to the client identifier of the desktop client, that is, Fig.12 Then, the interactive mapping key-value pair is further found from the "interactive mapping file", and the initial mapping position corresponding to the hardware instruction is determined according to the interactive mapping key-value pair, that is, Fig.12 Interaction mapping in .
[0156] Furthermore, after determining the initial mapping position, the initial mapping position can be further corrected. Window calculation is required during the correction process. Specifically, the first terminal can obtain the width and height of the canvas of the virtual machine window display area, trigger the update of the window width and height of the currently running mobile application each time the window size changes, and cache the current latest window canvas size (width and height), which is the actual page size. Finally, the first terminal can correct the initial mapping position according to the theoretical page size of the mobile terminal during the mutual mapping relationship configuration process and the current latest window canvas size, and proportionally convert the click interaction coordinates suitable for the current window canvas, that is, the page mapping position. The page mapping position can be transparently transmitted to the corresponding mobile application through the virtual machine container and get a response. In the above process, it can ensure that the keyboard input can be accurately converted into a screen click event on the mobile terminal, thereby improving the convenience and interactivity of the user experience.
[0157] This application provides users with a solution for cross-end interaction processing in which a mobile application is executed on a desktop device and responds to desktop interactions, allowing users to use different interactive control applications between different devices. This application solution has at least the following advantages:
[0158] Cross-end interactive action mapping: This application provides a cross-end interactive mapping method, which can map the keyboard and mouse operations on the desktop to interactive actions on the mobile terminal, thereby providing a more natural and efficient desktop interactive experience.
[0159] Universal mapping method: Unlike the traditional method that requires customized development for each application, this application adopts a universal mapping method that can be widely used in different types of mobile applications, which helps to reduce development costs.
[0160] Improve user experience: Through the interactive mapping technology of this application, users can enjoy an operating experience similar to that of a touch-screen terminal on the desktop without having to adapt to the unnatural interaction method brought by the simulator.
[0161] Reduce development costs: Developers can use the mapping device of the present application to reduce the workload of developing interaction logic for different platforms separately, thereby reducing development costs and time.
[0162] Compatibility and scalability: The mapping device of the present application is designed with compatibility and scalability in mind, and can adapt to different types of mobile applications and constantly updated desktop operating systems.
[0163] In summary, this application fills the shortcomings of existing simulator technology in desktop interactive experience through innovative interactive mapping technology, provides users with a more comfortable and efficient operation method, and also provides developers with a more convenient cross-platform application development solution.
[0164] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0165] Based on the same inventive concept, the embodiment of the present application also provides a cross-end interaction processing device for implementing the cross-end interaction processing method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more cross-end interaction processing device embodiments provided below can refer to the above limitations on the cross-end interaction processing method, which will not be repeated here.
[0166] In one embodiment, Fig.14 As shown, a cross-terminal interaction processing device is provided. The device includes: a virtual operation module 1401, an operation signal acquisition module 1402, a signal conversion module 1403 and a touch screen interaction simulation module 1404, wherein:
[0167] The virtual operation module 1401 is used to respond to the application triggering operation initiated by the desktop operating system of the first terminal, and to run the triggered mobile application on the virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile operating system; wherein the first terminal includes an external input device;
[0168] An operation signal acquisition module 1402 is used to acquire an operation signal of an interactive operation in response to an interactive operation triggered by an external input device;
[0169] The signal conversion module 1403 is used to convert the operation signal into a touch signal for the application page of the mobile application according to the interactive mapping relationship between the first terminal and the second terminal; the second terminal is a touch screen terminal;
[0170] The touch screen interaction simulation module 1404 is used to apply the touch operation represented by the touch signal to the application page to simulate the touch screen interaction of the mobile application on the second terminal.
[0171] In one embodiment, the cross-terminal interaction processing device also includes: a mapping recording module, which is used to determine the page mapping position from the display interface of the first terminal in response to the mapping recording operation for the first terminal, and determine the target key from multiple input keys of the external input device; an interaction mapping relationship determination module, which is used to determine the interaction mapping relationship between the first terminal and the second terminal based on the correspondence between multiple groups of target keys and page mapping positions.
[0172] In one embodiment, the mapping recording module is specifically used to: in response to a mapping position confirmation operation for the first terminal, determine the page mapping position from the display interface of the first terminal; in response to a key operation triggered by an external input device, determine the triggered target key from multiple input keys of the external input device.
[0173] In one embodiment, the interactive mapping relationship determination module is specifically used to: determine the target function from multiple touch screen interactive functions supported by the second terminal; determine the position of the target control corresponding to the target function in the mobile application page as the page mapping position of the target button corresponding to the second terminal.
[0174] In one embodiment, the cross-terminal interaction processing device also includes: a file acquisition module, used to: obtain an interaction mapping file configured for the first terminal and the second terminal and that has passed the review; an interaction mapping relationship determination module, used to determine the corresponding relationship carried by the interaction mapping file as the interaction mapping relationship between the first terminal and the second terminal.
[0175] In one embodiment, the file acquisition module is specifically used to: acquire multiple candidate mapping files configured for the first terminal and the second terminal and that have passed review; and determine an interactive mapping file that matches the application type of the mobile application from each candidate mapping file.
[0176] In one embodiment, the signal conversion module 1403 includes: a parsing unit, used to parse the operation signal and determine the operation key corresponding to the operation signal from an external input device; a mapping position determination unit, used to determine the page mapping position of the application page of the mobile application corresponding to the operation key based on the interactive mapping relationship between the first terminal and the second terminal; a signal conversion unit, used to convert the operation signal into a touch signal for the page mapping position.
[0177] In one embodiment, the mapping position determination unit is specifically used to: determine the theoretical page size of the second terminal and the initial mapping position of the operation key corresponding to the theoretical page size during the configuration of the interactive mapping relationship according to the interactive mapping relationship between the first terminal and the second terminal; based on the theoretical page size and the actual page size of the mobile application in the virtual machine window display area, correct the initial mapping position to obtain the page mapping position of the operation key corresponding to the application page of the mobile application.
[0178] In one embodiment, the analysis unit is further used to analyze the operation signal and determine the operation parameters for the operation key. In this embodiment, the signal conversion unit is specifically used to convert the operation signal into a touch signal for the page mapping position based on the touch parameters corresponding to the operation parameters.
[0179] In one embodiment, the virtual operation module 1401 is specifically used to: determine the application category to which the triggered application belongs in response to an application triggering operation initiated by the desktop operating system based on the first terminal; when the application category to which the triggered application belongs is a mobile application, deploy a virtual machine as a running container on the first terminal; and run the triggered mobile application on the virtual machine.
[0180] Each module in the above-mentioned cross-end interaction processing device can be implemented in whole or in part by software, hardware and a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.
[0181] Based on the same inventive concept, the embodiment of the present application also provides a cross-end interactive display device for implementing the cross-end interactive display method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more cross-end interactive display device embodiments provided below can refer to the above limitations on the cross-end interactive display method, which will not be repeated here.
[0182] In one embodiment, Fig.15 As shown, a cross-terminal interactive display device is provided, the device comprising: an application identification display module 1501, an application page display module 1502 and an update interface display module 1503, wherein:
[0183] The application identification display module 1501 is used to display the application identification of each of the multiple mobile applications distributed by the application distribution platform on the desktop client of the application distribution platform; the desktop client runs on the desktop operating system of the first terminal; the first terminal includes an external input device;
[0184] The application page display module 1502 is used to display the application page of the mobile application represented by the target identifier in response to the trigger operation for the target identifier in each application identifier; the mobile application runs on the virtual machine deployed on the first terminal; the operating system of the virtual machine is the mobile terminal operating system;
[0185] The update interface display module 1503 is used to display an updated application page in response to an interactive operation triggered on an external input device; the updated application page is obtained by converting the operation signal of the interactive operation into a touch signal for the application page according to the interactive mapping relationship between the first terminal and the second terminal, and updating the application page in response to the touch signal; the second terminal is a touch screen terminal.
[0186] Each module in the above cross-end interactive display device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module above.
[0187] In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as follows: Fig.16As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and the external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a cross-end interactive processing method and a cross-end interactive display method are implemented. The display unit of the computer device is used to form a visually visible image, and can be a display screen, a projection device or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covered on the display screen, or a button, trackball or touchpad set on the computer device casing, or an external keyboard, touchpad or mouse, etc.
[0188] Those skilled in the art will understand that Fig.16 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0189] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps of the above method embodiment when executing the computer program.
[0190] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above method embodiment are implemented.
[0191] In one embodiment, a computer program product is provided, comprising a computer program, which implements the steps of the above method embodiment when executed by a processor.
[0192] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards in the relevant regions and areas. In addition, the subject can choose not to authorize the subject information and related data, or refuse or conveniently refuse to push information, etc.
[0193] In this application, when collecting and processing relevant data during the instance application, the requirements of the laws and regulations of the relevant regions should be strictly followed to obtain the informed consent or separate consent of the personal information subject, and subsequent data use and processing should be carried out within the scope of authorization of the laws and regulations and the personal information subject.
[0194] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0195] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0196] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A cross-end interaction processing method, characterized in that: The method comprises: In response to an application triggering operation initiated by a desktop operating system of a first terminal, a triggered mobile application is run on a virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile operating system; and the first terminal includes an external input device; In response to an interactive operation triggered by the external input device, acquiring an operation signal of the interactive operation; According to the interactive mapping relationship between the first terminal and the second terminal, the operation signal is converted into a touch signal for the application page of the mobile application; the second terminal is a touch screen terminal; The touch operation represented by the touch signal is applied to the application page to simulate the touch screen interaction of the mobile application on the second terminal.
2. The method according to claim 1, characterized in that The method further comprises: In response to a mapping recording operation for the first terminal, determining a page mapping position from a display interface of the first terminal, and determining a target key from a plurality of input keys of the external input device; Based on the correspondence between the multiple groups of target buttons and page mapping positions, an interactive mapping relationship between the first terminal and the second terminal is determined.
3. The method according to claim 2, characterized in that In response to the mapping recording operation for the first terminal, determining a page mapping position from a display interface of the first terminal, and determining a triggered target key from a plurality of input keys of the external input device, comprises: In response to a mapping position confirmation operation for the first terminal, determining a page mapping position from a display interface of the first terminal; In response to a key operation triggered by the external input device, a triggered target key is determined from a plurality of input keys of the external input device.
4. The method according to claim 2, characterized in that: The determining a page mapping position from a display interface of the first terminal includes: Determining a target function from a plurality of touch screen interaction functions supported by the second terminal; The position of the target control corresponding to the target function in the mobile application page is determined as the page mapping position of the target button corresponding to the second terminal.
5. The method according to claim 1, characterized in that The method further comprises: Acquire an interactive mapping file configured for the first terminal and the second terminal and having passed review; The corresponding relationship carried by the interaction mapping file is determined as the interaction mapping relationship between the first terminal and the second terminal.
6. The method according to claim 5, characterized in that The obtaining of the interaction mapping file configured for the first terminal and the second terminal and having passed the review includes: Acquire multiple candidate mapping files that are configured for the first terminal and the second terminal and have passed review; An interaction mapping file matching the application type of the mobile application is determined from the candidate mapping files.
7. The method according to claim 1, characterized in that The converting the operation signal into a touch signal for the application page of the mobile application according to the interactive mapping relationship between the first terminal and the second terminal includes: Analyzing the operation signal, and determining the operation key corresponding to the operation signal from the external input device; Determining, based on an interactive mapping relationship between the first terminal and the second terminal, a page mapping position of the operation button corresponding to the application page of the mobile application; The operation signal is converted into a touch signal for the page mapping position.
8. The method according to claim 7, characterized in that The determining, based on the interactive mapping relationship between the first terminal and the second terminal, a page mapping position of the operation button corresponding to the application page of the mobile application includes: According to the interactive mapping relationship between the first terminal and the second terminal, determining a theoretical page size of the second terminal in a configuration process of the interactive mapping relationship and an initial mapping position of the operation button corresponding to the theoretical page size; Based on the theoretical page size and the actual page size of the mobile application in the virtual machine window display area, the initial mapping position is corrected to obtain the page mapping position of the operation button corresponding to the application page of the mobile application.
9. The method according to claim 7, characterized in that: The method further comprises: Analyze the operation signal to determine the operation parameters for the operation button; The converting the operation signal into a touch signal for the page mapping position includes: The operation signal is converted into a touch signal for the page mapping position based on a touch parameter corresponding to the operation parameter.
10. The method according to any one of claims 1 to 9, characterized in that The step of responding to the application triggering operation initiated by the desktop operating system of the first terminal and running the triggered mobile application on the virtual machine deployed by the first terminal includes: In response to an application triggering operation initiated by a desktop operating system of the first terminal, determining an application category to which the triggered application belongs; In a case where the application category to which the triggered application belongs is a mobile application, deploying a virtual machine as a running container on the first terminal; The triggered mobile application is run on the virtual machine.
11. A cross-terminal interactive display method, characterized in that: The method comprises: On a desktop client of an application distribution platform, displaying application identifiers of respective mobile applications distributed by the application distribution platform; the desktop client runs on a desktop operating system of a first terminal; the first terminal includes an external input device; In response to a trigger operation for a target identifier in each of the application identifiers, an application page of a mobile application represented by the target identifier is displayed; the mobile application runs on a virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile terminal operating system; In response to an interactive operation triggered on the external input device, an updated application page is displayed; the updated application page is obtained by converting the operation signal of the interactive operation into a touch signal for the application page according to the interactive mapping relationship between the first terminal and the second terminal, and updating the application page in response to the touch signal; the second terminal is a touch screen terminal.
12. A cross-end interaction processing device, characterized in that: The device comprises: A virtual operation module, configured to respond to an application triggering operation initiated by a desktop operating system of a first terminal and to run a triggered mobile application on a virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile operating system; and the first terminal includes an external input device; An operation signal acquisition module, configured to acquire an operation signal of the interactive operation in response to the interactive operation triggered by the external input device; a signal conversion module, configured to convert the operation signal into a touch signal for an application page of the mobile application according to an interactive mapping relationship between the first terminal and a second terminal; the second terminal being a touch screen terminal; A touch screen interaction simulation module is used to apply the touch operation represented by the touch signal to the application page to simulate the touch screen interaction of the mobile application on the second terminal.
13. A cross-terminal interactive display device, characterized in that: The device comprises: An application identification display module, used for displaying the application identification of each of the plurality of mobile applications distributed by the application distribution platform on a desktop client of the application distribution platform; the desktop client runs on a desktop operating system of a first terminal; the first terminal includes an external input device; an application page display module, configured to display an application page of a mobile application represented by a target identifier in response to a trigger operation on a target identifier in each of the application identifiers; the mobile application runs on a virtual machine deployed on the first terminal; the operating system of the virtual machine is a mobile terminal operating system; An update interface display module is used to display an updated application page in response to an interactive operation triggered on the external input device; the updated application page is obtained by converting the operation signal of the interactive operation into a touch signal for the application page according to the interactive mapping relationship between the first terminal and the second terminal, and updating the application page in response to the touch signal; the second terminal is a touch screen terminal.
14. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 11 are implemented.
15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.
16. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 11 are implemented.
