Information processing method and device based on simulator, electronic equipment, computer readable storage medium and computer program product

Abstract

The invention provides an information processing method and device based on a simulator, electronic equipment, a computer readable storage medium and a computer program product. The method comprises the steps of displaying an operation interface of the simulator; in response to an information viewing operation, first information and a virtual control are displayed in the operation interface, and the virtual control is used for executing a corresponding target operation; and in response to a trigger operation for the virtual control, updating the first information into second information in the operation interface. Through the information processing method and device, the information processing efficiency in a simulator scene can be effectively improved, and then the user experience is improved.

Description

Technical Field

[0001] This application relates to the field of Internet technologies, and in particular, to an information processing method, apparatus, electronic device, computer-readable storage medium, and computer program product based on a simulator. Background Art

[0002] A simulator is a tool that emulates the operating system (such as the Android system) of one type of terminal device (such as a computer) on another type of terminal device (such as a mobile phone), enabling applications adapted to the other type of terminal device to run on the present type of terminal device. For example, assuming that social application A is only adapted to the Android system, if one needs to use social application A on a computer, one needs to open the simulator in the computer and run social application A in the simulator. However, when a user needs to view wide-format content in the simulator, the user needs to hold down the mouse and drag to complete it, which not only increases the operation steps but also may reduce the accuracy of the mouse, thereby reducing the information processing efficiency and the user experience. Summary of the Invention

[0003] Embodiments of this application provide an information processing method, apparatus, electronic device, computer-readable storage medium, and computer program product based on a simulator, which can effectively improve the information processing efficiency in the simulator scenario and thereby enhance the user experience.

[0004] The technical solution of the embodiments of this application is implemented as follows:

[0005] Embodiments of this application provide an information processing method based on a simulator, including:

[0006] Display the operation interface of the simulator;

[0007] In response to an information viewing operation, display first information and virtual controls in the operation interface, where the virtual controls are used to perform corresponding target operations;

[0008] In response to a trigger operation on the virtual controls, update the first information to second information in the operation interface.

[0009] Embodiments of this application provide an information processing apparatus based on a simulator, including:

[0010] A display module, configured to display the operation interface of the simulator;

[0011] The display module is further configured to, in response to an information viewing operation, display first information and virtual controls in the operation interface, where the virtual controls are used to perform corresponding target operations;

[0012] An update module, configured to update the first information to second information in the operation interface in response to a trigger operation on the virtual control.

[0013] An embodiment of the present application provides an electronic device, including:

[0014] A memory, configured to store computer-executable instructions;

[0015] A processor, configured to implement the information processing method based on a simulator provided by an embodiment of the present application when executing the computer-executable instructions stored in the memory.

[0016] An embodiment of the present application provides a computer-readable storage medium, storing computer-executable instructions, configured to implement the information processing method based on a simulator provided by an embodiment of the present application when being executed by a processor.

[0017] An embodiment of the present application provides a computer program product, including a computer program or computer-executable instructions, configured to implement the information processing method based on a simulator provided by an embodiment of the present application when being executed by a processor.

[0018] The embodiments of the present application have the following beneficial effects:

[0019] By adding a virtual control to the operation interface of the simulator, wherein when the virtual control is triggered, a corresponding target operation can be executed in the operation interface. Thus, the user only needs to trigger the virtual control to automatically execute the corresponding target operation in the operation interface, thereby effectively reducing the operation steps that the user needs to perform manually, greatly improving the information processing efficiency in the simulator scenario, and further enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 is a schematic architecture diagram of an information processing system 100 based on a simulator provided by an embodiment of the present application;

[0021] Figure 2 is a schematic structural diagram of an electronic device 500 provided by an embodiment of the present application;

[0022] Figure 3 is a first flowchart of an information processing method based on a simulator provided by an embodiment of the present application;

[0023] Figure 4 is a second flowchart of an information processing method based on a simulator provided by an embodiment of the present application;

[0024] Figure 5 is a third flowchart of an information processing method based on a simulator provided by an embodiment of the present application;

[0025] Figure 6AIt is the first application scenario schematic diagram of the information processing method based on the simulator provided by the embodiments of the present application;

[0026] Figure 6B It is the second application scenario schematic diagram of the information processing method based on the simulator provided by the embodiments of the present application;

[0027] Figure 6C It is the third application scenario schematic diagram of the information processing method based on the simulator provided by the embodiments of the present application;

[0028] Figure 7 It is the fourth process schematic diagram of the information processing method based on the simulator provided by the embodiments of the present application;

[0029] Figure 8 It is the fifth process schematic diagram of the information processing method based on the simulator provided by the embodiments of the present application. Detailed implementation manners

[0030] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be construed as limiting the present application. All other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of the present application.

[0031] In the following description, "some embodiments" are involved, which describe a subset of all possible embodiments. However, it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0032] It can be understood that in the embodiments of the present application, when related data such as user information is involved, when the embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards.

[0033] In the following description, the terms "first / second / ..." involved are only used to distinguish similar objects, and do not represent a specific order for the objects. It can be understood that "first / second / ..." can be interchanged with a specific order or sequence when allowed, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0034] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the technical field to which the present application belongs. The terms used herein are only for the purpose of describing the embodiments of the present application and are not intended to limit the present application.

[0035] Before further elaborating on the embodiments of the present application, the nouns and terms involved in the embodiments of the present application are described. The nouns and terms involved in the embodiments of the present application are applicable to the following explanations.

[0036] 1) Responsive to: Used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more executed operations can be real-time or have a set delay; without special instructions, there is no restriction on the execution order of multiple executed operations.

[0037] 2) Emulator: A software tool (i.e., application program) used to imitate another computer system or device. Its main purpose is to run software or games that can only run on a specific platform on different hardware or operating systems. The emulator creates a virtual environment by replicating the instruction set, hardware architecture, and peripheral interfaces of the target system, enabling source code or binary files to be executed on the host system while maintaining compatibility with the original environment.

[0038] 3) Virtual control: Refers to a control used to simulate the corresponding target operations of a target object (such as a user) in an operation interface. That is, when the virtual control is triggered, the corresponding target operations can be automatically executed in the operation interface. For example, the virtual control can include controls for performing sliding operations, zooming operations, and moving operations, etc. That is to say, the effect of the user triggering the virtual control is the same as the effect of manually performing the corresponding target operations in the operation interface.

[0039] The embodiments of the present application provide an information processing method, device, electronic device, computer-readable storage medium, and computer program product based on an emulator, which can effectively improve the information processing efficiency in the emulator scenario, thereby enhancing the user experience. The electronic device provided by the embodiments of the present application is described below. The electronic device provided by the embodiments of the present application can be implemented as a terminal device, or can be implemented as a server, or can also be jointly implemented by a server and a terminal device.

[0040] Exemplarily, referring to Figure 1 , Figure 1 is a schematic diagram of the architecture of the information processing system 100 based on an emulator provided by the embodiments of the present application. To implement an application that supports improving the information processing efficiency in the emulator scenario, such as Figure 1As shown in the figure, the simulator-based information processing system 100 includes: a server 200, a network 300, and a terminal device 400. Among them, the server 200 can be the background server of the application 410 running on the terminal device 400. The network 300 can be a local area network or a wide area network, or a combination of the two. The terminal device 400 is a terminal device associated with the user. An application 410 is running on the terminal device 400. The application 410 can be various types of simulators, such as a mobile phone simulator (i.e., an application for simulating the operating system running on a mobile phone) and a computer simulator (i.e., an application for simulating the operating system running on a computer), etc.

[0041] In some embodiments, taking the terminal device 400 as a computer and the application 410 as a mobile phone simulator as an example (i.e., the scenario where the user experiences mobile phone applications on a computer), when a click operation on the mobile phone simulator running on the computer is received, the mobile phone simulator can be run on the computer. For example, the operation interface of the operating system (such as the Android system) simulated by the mobile phone simulator can be displayed on the computer. Then, when the mobile phone simulator receives an information viewing operation triggered by the user in the operation interface, the first information and virtual controls can be displayed in the operation interface. When the virtual control is triggered, corresponding operations can be automatically executed in the operation interface. Subsequently, when the mobile phone simulator receives a trigger operation on the virtual control by the user, corresponding operations (such as page turning operations, zooming operations, moving operations, etc.) can be automatically executed in the operation interface. Finally, the mobile phone simulator can update the first information to the second information in the operation interface in response to this operation. For example, when the operation is a sliding operation, the first information can be updated to the second information based on the sliding operation in the operation interface; when the operation is a zooming operation, the first information can be zoomed, and the zoomed first information can be displayed in the operation interface. In this way, the operation steps that the user needs to manually execute can be effectively reduced, the information processing efficiency in the simulator scenario can be greatly improved, and thus the user experience can be enhanced.

[0042] It should be noted that Figure 1The server 200 therein may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. The terminal device 400 may be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, a vehicle-mounted terminal, etc., but is not limited thereto. The terminal device 400 and the server 200 may be directly or indirectly connected through wired or wireless communication means, which is not limited in the embodiments of the present application.

[0043] In some other embodiments, the terminal device may also implement the information processing method based on the emulator provided in the embodiments of the present application by running various computer-executable instructions or computer programs. For example, the computer-executable instructions may be commands at the microprogram level, machine instructions, or software instructions. The computer program may be a native program or a software module in the operating system; it may be a local (Native) application (APPlication, APP), that is, a program that needs to be installed in the operating system to run, such as a mobile phone emulator; or it may be a small program that can be embedded in any APP, that is, a program that only needs to be downloaded to the browser environment to run. In short, the above computer-executable instructions may be instructions in any form, and the above computer programs may be application programs, modules, or plugins in any form.

[0044] Next, the structure of the electronic device provided in the embodiments of the present application will be further described. Taking the electronic device as the terminal device as an example, refer to Figure 2 , Figure 2 which is a schematic structural diagram of the electronic device 500 provided in the embodiments of the present application. Figure 2 The electronic device 500 shown includes: at least one processor 510, a memory 550, at least one network interface 520, and a user interface 530. Each component in the electronic device 500 is coupled together through a bus system 540. It can be understood that the bus system 540 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clear illustration, in Figure 2 all kinds of buses are labeled as the bus system 540.

[0045] The processor 510 may be an integrated circuit chip with the ability to process signals, such as a general - purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general - purpose processor may be a microprocessor or any conventional processor, etc.

[0046] The user interface 530 includes one or more output devices 531 that enable the presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 530 also includes one or more input devices 532, including user - interface components that facilitate user input, such as a keyboard, a mouse, a microphone, a touch - screen display, a camera, other input buttons, and controls.

[0047] The memory 550 may be removable, non - removable, or a combination thereof. Exemplary hardware devices include solid - state memory, hard disk drives, optical disk drives, etc. The memory 550 optionally includes one or more storage devices that are physically remote from the processor 510.

[0048] The memory 550 includes volatile memory or non - volatile memory, and may also include both volatile and non - volatile memory. The non - volatile memory may be a read - only memory (ROM), and the volatile memory may be a random - access memory (RAM). The memory 550 described in the embodiments of the present application is intended to include any suitable type of memory.

[0049] In some embodiments, the memory 550 is capable of storing data to support various operations. Examples of such data include programs, modules, and data structures, or subsets or supersets thereof, which are described below by way of example.

[0050] The operating system 551, including system programs for processing various basic system services and performing hardware - related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware - based tasks;

[0051] The network communication module 552 is used to reach other computing devices via one or more (wired or wireless) network interfaces 520. Exemplary network interfaces 520 include: Bluetooth, Wi - Fi (Wireless Fidelity), and USB (Universal Serial Bus), etc.;

[0052] A presentation module 553 for enabling presentation of information (e.g., a user interface for operating peripheral devices and displaying content and information) via one or more output devices 531 associated with the user interface 530 (e.g., a display screen, a speaker, etc.);

[0053] An input processing module 554 for detecting one or more user inputs or interactions from one of one or more input devices 532 and translating the detected inputs or interactions.

[0054] In some embodiments, the device provided by the embodiments of the present application may be implemented in software. Figure 2 Shown is an emulator-based information processing device 555 stored in the memory 550, which may be software in the form of programs and plugins, etc., including the following software modules: a display module 5551, an update module 5552, a scaling module 5553, a rotation module 5554, a movement module 5555, a format conversion module 5556, a splitting module 5557, a compression module 5558, a position detection module 5559, an acquisition module 55510, a creation module 55511, and an addition module 55512. These modules are logical, so they can be combined arbitrarily or further split according to the functions implemented. It should be noted that Figure 2 For the convenience of expression, all the above modules are shown at once, but it should not be considered that the emulator-based information processing device 555 excludes embodiments that may only include the display module 5551 and the update module 5552. The functions of each module will be described below.

[0055] The following specifically describes the emulator-based information processing method provided by the embodiments of the present application.

[0056] It should be noted that the emulator-based information processing method provided by the embodiments of the present application may be implemented independently by a terminal device, or may be implemented independently by a server, or may also be implemented jointly by a server and a terminal device. The following takes the implementation of the emulator-based information processing method provided by the embodiments of the present application by a terminal device alone as an example for description.

[0057] Exemplarily, refer to Figure 3 Figure 3 which is a first process schematic diagram of the emulator-based information processing method provided by the embodiments of the present application, and will be described in combination with the steps shown in Figure 3

[0058] In step 101, display the operation interface of the emulator.

[0059] ​​Here, the emulator can be used to simulate and run a certain type of operating system on the host computer, and the operating system simulated and run by the emulator and the operating system running on the host computer of the emulator can be the same or different. For example, assume that both the operating system simulated and run by the emulator and the operating system running on the host computer are the Android system (i.e., the Android system, which is an open-source operating system based on the Linux kernel and is mainly used for mobile devices and other embedded devices. It provides a rich application framework that allows developers to build various types of applications and games). The only difference between the two is the version (for example, assume that the user wants to experience the mobile applications in an older version of the Android system on a mobile phone with a newer version of the Android system), or it can also be that the emulator simulates and runs the Android system while the host computer runs the Windows system (for example, assume that the user wants to experience the mobile applications of the Android system on a Windows computer). The embodiments of the present application do not make specific limitations on this.

[0060] In some embodiments, an emulator can be running on the host computer. When a click operation on the emulator by the user is received, the emulator can be started in the host computer, and the operation interface of the operating system simulated and run by the emulator (such as the Android system, for example) can be displayed on the host computer.

[0061] For example, taking the host computer as a computer running the Windows operating system and the emulator as a mobile phone emulator, when the user wants to experience mobile applications on the computer, it is necessary to first install the mobile phone emulator on the computer. After the mobile phone emulator is installed, an icon of the mobile phone emulator will be displayed on the desktop of the computer. When a click operation on the icon of the mobile phone emulator by the user is received, the mobile phone emulator can be started on the computer, and the operation interface of the Android system simulated and run by the mobile phone emulator can be displayed on the screen of the computer. For example, a window can be displayed on the screen of the computer, and the operation interface of the Android system simulated and run by the mobile phone emulator can be displayed in the window; or, the operation interface of the Android system simulated and run by the mobile phone emulator can also be displayed full-screen on the computer. The embodiments of the present application do not make specific limitations on this.

[0062] It should be noted that the mobile phone emulator can include the main end of the mobile phone emulator (i.e., the Host end of the mobile phone emulator) and the guest end of the mobile phone emulator (i.e., the Guest end of the mobile phone emulator). Among them, the Host end of the mobile phone emulator refers to the emulator software itself running on the computer, as well as the supporting hardware abstraction layer, operating system, and user interface components. The Host end is responsible for creating and managing the virtual mobile phone environment (i.e., the Guest end), and providing a series of tools and interfaces so that users can interact with the virtual mobile phone. The Guest end of the mobile phone emulator refers to the virtual mobile phone environment created by the emulator software on the computer. In this environment, mobile applications can be installed and run, and users can perform various operations and experiences, just like using a real mobile phone. For example, the Guest end can be an Android system implemented based on the vbox virtualization solution, and its manifestation form can be a virtual disk image (VDI, Virtual Disk Image) file, which complies with the VDI file format specification. The Host end loads this VDI file to load and run this VDI file, so that the operation interface of the Android system simulated by the mobile phone emulator can be displayed on the computer screen.

[0063] In step 102, in response to the information viewing operation, the first information and virtual controls are displayed in the operation interface.

[0064] Here, the information viewing operation can be a single-step operation or a multi-step operation. For example, the information viewing operation can be an open operation for a certain document or picture displayed in the emulator, or a click operation on the icon of a certain application running in the emulator, as well as a click operation on a certain article (such as a post) or item (such as a book) displayed on the page of the application. The embodiments of the present application do not make specific limitations on this.

[0065] In some embodiments, the above-mentioned display of the first information and virtual controls in the operation interface can be achieved in the following way: display the first information and at least one virtual control in the operation interface, where different virtual controls can be used to perform different target operations.

[0066] Exemplarily, taking the emulator as a mobile phone emulator as an example, when receiving an information viewing operation triggered by a user in the operation interface of an operating system (such as the Android system) simulated and run by the mobile phone emulator (such as a click operation on the icon of a certain application running in the Android system), in addition to being able to display the first information (such as the information displayed on the page of a certain application) in the operation interface of the Android system simulated and run by the mobile phone emulator, multiple virtual controls for performing different operations can also be displayed in the operation interface. For example, 4 virtual controls can be displayed in the operation interface, which are assumed to be virtual control 1, virtual control 2, virtual control 3, and virtual control 4 respectively. Among them, virtual control 1 can be used to perform a sliding operation, virtual control 2 can be used to perform a zoom operation, virtual control 3 can be used to perform a moving operation, and virtual control 4 can be used to perform a compression operation. In this way, by adding multiple virtual controls for performing different operations in the operation interface, the user only needs to trigger the corresponding virtual control to automatically perform the corresponding operation in the operation interface, thereby greatly reducing the operation steps that the user needs to perform manually and improving the information processing efficiency.

[0067] It should be noted that the display styles of different virtual controls can be different. For example, in order to facilitate the user to intuitively understand the functions of each virtual control, corresponding prompt texts can be displayed on each virtual control. For example, for the virtual control used to perform the zoom-in operation, the text "Zoom in" can be displayed on this virtual control; for the virtual control used to perform the zoom-out operation, the text "Zoom out" can be displayed on this virtual control.

[0068] In some other embodiments, refer to Figure 4 , Figure 4 is the second process schematic diagram of the information processing method based on the emulator provided by the embodiments of the present application. As Figure 4 shown, Figure 3 the step 102 shown can be implemented by Figure 4 the step 1021 and step 1022 shown, and will be described in combination with Figure 4 the steps shown.

[0069] In step 1021, in response to the information viewing operation, the first information is displayed in the operation interface.

[0070] In some embodiments, an application icon of the first application running in the operating system can also be displayed in the operation interface. Then, step 1021 can be implemented in the following manner: in response to the triggering operation on the application icon of the first application, the first page of the first application is displayed in the operation interface, where the first page includes the first information.

[0071] Exemplarily, taking the emulator as a mobile phone emulator as an example, after running the mobile phone emulator on the host computer of the mobile phone emulator (such as a computer), the user can install a mobile application (such as a mobile social application only adapted to the Android system) in the operating system (such as the Android system) simulated by the mobile phone emulator. After the installation of the mobile social application is completed, the icon of the installed mobile social application can be displayed on the desktop of the Android system. Subsequently, when a click operation on the icon is received from the user, the mobile social application can be launched in the Android system simulated by the mobile phone emulator. For example, the first page of the mobile social application can be displayed in the operation interface of the Android system simulated by the mobile phone emulator, and the first information can be displayed on the first page. Among them, the first page can be the home page of the mobile social application, and the type of the first information can include pictures, texts, etc. The embodiments of the present application do not make specific limitations on this.

[0072] In step 1022, in response to meeting the control display condition, a virtual control is displayed in the operation interface.

[0073] In some embodiments, following the above example, step 1022 can be implemented in the following manner: Detect the position of the operation pointer (such as a mouse pointer) in the operating system running on the host computer of the emulator; When it is detected that the operation pointer contacts a sliding component (such as a horizontal sliding component, that is, a component capable of horizontal sliding, for example, multiple pictures can be displayed on the horizontal sliding component, and the user can switch pictures by horizontal sliding) on the first page, a virtual control can be displayed in the operation interface, where the virtual control can be used to perform a sliding operation or a page turning operation.

[0074] Exemplarily, continuing with the mobile phone emulator as an example, after starting a selected mobile social application in the operating system (such as the Android system) simulated by the mobile phone emulator, in addition to being able to display the home page (i.e., the first page) of the mobile social application in the operation interface of the Android system simulated by the mobile phone emulator, it is also possible to detect the position of the mouse pointer in the operating system (such as the Windows operating system) running on the host computer of the mobile phone emulator (such as a computer). That is to say, the mobile phone emulator can detect the position of the mouse pointer in real time to dynamically display or hide virtual controls according to the movement of the mouse pointer. For example, when it is detected that the mouse pointer moves to the horizontal sliding component included in the home page of the mobile social application, it indicates that the user currently has a need for horizontal sliding, and virtual controls for simulating horizontal sliding operations can be displayed in the operation interface of the Android system simulated by the mobile phone emulator. For example, a virtual control can be displayed on each of the left and right sides of the operation interface. Among them, the virtual control displayed on the left side of the operation interface can be used to simulate a leftward sliding operation, and the virtual control displayed on the right side of the operation interface is used to simulate a rightward sliding operation. That is to say, the user can achieve a leftward slide by clicking the virtual control on the left, or the user can also achieve a rightward slide by clicking the virtual control on the right. In addition, when it is detected that the mouse pointer leaves the horizontal sliding component, the virtual control can be hidden in the operation interface. In this way, the operation steps required by the user when performing a horizontal sliding action can be effectively simplified, making the interface interaction more fluent and intuitive.

[0075] It should be noted that the control display condition can be not only that the mouse pointer touches the horizontal sliding component, but also that the display duration of the first information is greater than or equal to the duration threshold (such as 5 seconds). For example, when it is detected that the display duration of the first information is greater than or equal to 5 seconds, virtual controls can be displayed in the operation interface; or, it can also be that a click operation of the user on a specific button displayed in the operation interface is received. For example, a specific button for displaying or hiding virtual controls can be displayed in the operation interface. When a click operation of the user on this button is received, virtual controls can be displayed in the operation interface; when a click operation of the user on this button is received again, the virtual controls can be hidden in the operation interface. The embodiments of the present application do not specifically limit the control display condition.

[0076] In some other embodiments, continuing from the above, before displaying the virtual control in the operation interface, the following processing may also be performed: Obtain the application window corresponding to the first page (i.e., Activity, where Activity is one of the basic components of an application running in the Android system. It represents a single screen of a user interface. An application running in the Android system is usually composed of multiple Activities, each Activity providing different functions or interfaces respectively, and Activity is also responsible for managing the interaction between the user and the application), and obtain the top-level view (i.e., DecorView, where DecorView is the top-level view of the application window in the Android system. It contains all the contents in the application window, such as the title bar, status bar, and the actual content part of the user interface. Usually, DecorView includes a LinearLayout, where the LinearLayout may include a ViewGroup for placing the main interface content of the application) object of the application window; create a virtual control and add the virtual control to the top-level view object.

[0077] For example, taking the emulator as a mobile phone emulator, before displaying the virtual control in the operation interface of the operating system (such as the Android system) simulated by the mobile phone emulator, the Activity of the page where the virtual control is located can be obtained first, then the DecorView object of the Activity can be obtained. Subsequently, a custom view (i.e., View, where View is the base class of all user interface components in the Android system. It represents a basic element on the screen, such as buttons, text boxes, images, etc. View is responsible for drawing the content and responding to user interactions, and all user interface components are derived from View) can be created, and the created custom view can be used as the virtual control. Finally, the virtual control can be added to the DecorView object, so as to achieve the effect of displaying the virtual control in the operation interface.

[0078] In step 103, in response to the trigger operation on the virtual control, in the operation interface, update the first information to the second information.

[0079] Here, the virtual control can be used to perform corresponding target operations (that is, when the virtual control is triggered, corresponding target operations can be automatically performed in the operation interface). Among them, the target operation can be a single operation, such as including a sliding operation, a zooming operation, a moving operation, a compression operation, etc. Of course, the target operation can also include multiple sub-operations, that is, the target operation can be obtained by combining multiple sub-operations. The embodiments of the present application do not make specific limitations on this. That is to say, the virtual control can be used to simulate the target operation manually performed by the target object (such as the user) in the operation interface, that is, the effect of the user clicking the virtual control is the same as the effect of manually performing the corresponding target operation.

[0080] In some embodiments, when the number of virtual controls is multiple, step 103 can be implemented in the following manner: in response to a trigger operation on the first virtual control among the multiple virtual controls, in the operation interface, update the first information to the second information based on the first target operation (that is, the target operation that the triggered first virtual control is used to perform).

[0081] Exemplarily, taking the emulator as a mobile phone emulator for example, assume that in the operation interface of the operating system (such as the Android system) simulated and run by the mobile phone emulator, there are multiple virtual controls displayed (such as 4 virtual controls). Assume they are virtual control 1, virtual control 2, virtual control 3, and virtual control 4 respectively. Among them, virtual control 1 located on the left side of the operation interface (for example, the style of virtual control 1 can be an arrow pointing to the left) can be used to perform a leftward sliding operation. Virtual control 2 located on the right side of the operation interface (for example, the style of virtual control 2 can be an arrow pointing to the right) can be used to perform a rightward sliding operation. Virtual control 3 located in the upper left corner of the operation interface (for example, the text "Zoom in" can be displayed on virtual control 3 to prompt the user that virtual control 3 is used to perform a zoom-in operation) can be used to perform a zoom-in operation. Virtual control 4 located in the upper right corner of the operation interface (for example, the text "Zoom out" can be displayed on virtual control 4 to prompt the user that virtual control 4 is used to perform a zoom-out operation) can be used to perform a zoom-out operation. When the user wants to browse the information (such as picture 2) located on the left side of the first information (such as picture 1), the user can click virtual control 1 located on the left side of the operation interface. For example, when receiving the click operation of the user on virtual control 1 (such as the user controls the mouse pointer to move to the position where virtual control 1 is located and clicks the left mouse button), a leftward sliding operation can be performed in the operation interface. That is to say, the effect of the user clicking virtual control 1 is the same as the effect of the user holding down the left mouse button and dragging the mouse to the left. Or, when the user wants to browse picture 3 located on the right side of picture 1, the user can click virtual control 2 located on the right side of the operation interface. For example, when receiving the click operation of the user on virtual control 2, a rightward sliding operation can be performed in the operation interface. That is to say, the effect of the user clicking virtual control 1 is the same as the effect of the user holding down the left mouse button and dragging the mouse to the right. Or, when the user wants to zoom in on the first information (such as picture 1), the user can click virtual control 3 located in the upper left corner of the operation interface. For example, when receiving the click operation of the user on virtual control 3, a zoom-in operation on picture 1 can be performed in the operation interface. That is to say, the effect of the user clicking virtual control 3 is the same as the effect of the user holding down the "Ctrl" key on the keyboard and scrolling up the mouse wheel; when the user wants to zoom out picture 1, the user can click virtual control 4 located in the upper right corner of the operation interface. For example, when receiving the click operation of the user on virtual control 4, a zoom-out operation can be performed in the operation interface. That is to say, the effect of the user clicking virtual control 4 is the same as the effect of the user holding down the "Ctrl" key on the keyboard and scrolling down the mouse wheel. Thus, by adding virtual controls for performing corresponding operations in the operation interface, the user only needs to trigger the virtual control and the corresponding operation will be performed in the operation interface, greatly reducing the operation steps that the user needs to perform, and thus effectively improving the information processing efficiency and the user experience in the emulator scenario.In some other embodiments, continuing from the above, different virtual controls can be used to perform paging operations in different directions. Then, the above-mentioned updating of the first information to the second information based on the first target operation in the operation interface in response to a triggering operation on the first virtual control among multiple virtual controls can be achieved in the following manner: In response to a triggering operation on the first virtual control among multiple virtual controls, perform a paging operation in the first direction (such as backward) in the operation interface to update the first information to the second information (i.e., the information behind the first information).

[0082] Exemplarily, taking two virtual controls as an example of multiple virtual controls, assume they are virtual control 1 located on the left side of the operation interface and virtual control 2 located on the right side of the operation interface. Among them, virtual control 1 can be used to perform a leftward paging operation, and virtual control 2 can be used to perform a rightward paging operation. That is to say, the effect of the user clicking on virtual control 1 is the same as the effect of the user holding down the left mouse button and dragging the mouse to the left, and the effect of the user clicking on virtual control 2 is the same as the effect of the user holding down the left mouse button and dragging the mouse to the right. For example, when it is detected that the mouse pointer moves to the picture area, virtual control 1 and virtual control 2 can be displayed in the operation interface. In this way, the user can click on virtual control 1 and virtual control 2 to achieve the function of switching pictures left and right; or, taking the example of the user experiencing a mobile reading application in the operating system simulated by a mobile phone emulator, the user can click on virtual control 1 and virtual control 2 to achieve the function of paging left and right.

[0083] In some embodiments, the above-mentioned target operation can further include multiple sub-operations, and the multiple sub-operations are set with an execution order. Then, the above-mentioned step 103 can also be achieved in the following manner: In response to a triggering operation on the virtual control, sequentially execute multiple sub-operations in the operation interface according to the execution order to update the first information to the second information.

[0084] Exemplarily, taking the complex operation obtained by combining multiple sub-operations with the above-mentioned target operation as an example, when a trigger operation on the virtual control is received from the user (for example, the user moves the mouse pointer to the position where the virtual control is located and clicks the left mouse button), multiple sub-operations can be sequentially executed in the operation interface according to a preset execution order. For example, assuming that the above complex operation includes 4 sub-operations, namely sub-operation 1, sub-operation 2, sub-operation 3, and sub-operation 4, and assuming that the preset execution order for these 4 sub-operations is: sub-operation 1, sub-operation 3, sub-operation 2, sub-operation 4, then when a trigger operation on the virtual control is received from the user, sub-operation 1 (such as a move operation) can be first executed in the operation interface, followed by sub-operation 3 (such as a shrink operation), then sub-operation 2 (such as a rotation operation), and finally sub-operation 4 (such as a zoom operation), so that the first information can be updated to the second information. That is to say, the embodiments of the present application can not only simulate a single operation through the virtual control, but also simulate a complex operation obtained by combining multiple sub-operations through the virtual control. In this way, the steps for the user to perform complex operations can be further reduced, thereby greatly improving the information processing efficiency and the user experience.

[0085] In some embodiments, when the above-mentioned target operation is a sliding operation, the above step 103 can also be implemented in the following manner: in response to a trigger operation on the virtual control, in the operation interface, update the first information to the second information based on the sliding operation.

[0086] Exemplarily, the following method can be used to update the first information to the second information in the operation interface based on the sliding operation: slide the information flow in the operation interface according to the sliding parameters of the sliding operation (such as the sliding amplitude) to update the first information displayed in the operation interface to the second information, where the sliding parameters (such as the sliding amplitude) can be determined based on the trigger parameters for the virtual control (such as the pressing duration). For example, the pressing duration of the user on the virtual control can be obtained, and the mapping table created in advance can be queried based on the pressing duration to obtain the sliding amplitude corresponding to the pressing duration. The mapping table can include the mapping relationship between different pressing durations and different sliding amplitudes.

[0087] For example, taking the emulator as a mobile phone emulator, in the operation interface of the operating system (such as the Android system) simulated and run by the mobile phone emulator, virtual controls for simulating swipe operations can be displayed. For example, taking the host computer of the mobile phone emulator as a Windows computer (i.e., a computer running the Windows operating system) as an example, when it is detected that the mouse pointer touches the picture area on the page, a virtual control 1 for performing a left swipe can be displayed on the left side of the operation interface, and a virtual control 2 for performing a right swipe can be displayed on the right side of the operation interface. When a click operation on the virtual control 2 located on the right side of the operation interface is received (for example, the user controls the mouse pointer to move to the position where the virtual control 2 is located and clicks the left mouse button), a right swipe operation can be performed in the operation interface (i.e., simulating the process of the user holding down the left mouse button and dragging the mouse to the right). Then, the mobile phone emulator can, in response to the right swipe operation, update the first information (such as picture 1) displayed in the operation interface to the second information (such as picture 2). In this way, the user only needs to click the corresponding virtual control to achieve the same effect as holding down the left mouse button and dragging it in the corresponding direction, effectively reducing the steps that the user needs to manually perform during the horizontal swipe process, and thus effectively improving the user experience.

[0088] It should be noted that when a pressing operation on the virtual control 2 located on the right side of the operation interface is received (for example, the user controls the mouse pointer to move to the position where the virtual control 2 is located and holds down the left mouse button), the duration of the user pressing the virtual control 2 can be obtained (for example, the duration from when the user holds down the left mouse button to when the user releases it), and based on this duration, a pre-created mapping table can be queried to obtain the swipe amplitude corresponding to this duration. Among them, there can be a positive correlation between the swipe amplitude and the duration, that is, the longer the duration of the user pressing the virtual control, the greater the corresponding swipe amplitude. Then, the mobile phone emulator can swipe the information flow displayed in the operation interface to the right according to this swipe amplitude, so as to update the information displayed in the operation interface. In this way, the user can achieve a large-scale swipe by pressing the virtual control, further improving the user experience.

[0089] In some other embodiments, when the above target operation is a zoom operation, the second information can be the first information after being zoomed. Then, the above step 103 can also be implemented in the following manner: in response to a trigger operation on the virtual control, zoom the first information and display the zoomed first information in the operation interface.

[0090] Exemplarily, the above-mentioned scaling of the first information and displaying the scaled first information in the operation interface can be achieved in the following manner: Scale the first information according to the set scaling ratio and display the scaled first information in the operation interface, where the scaling ratio can be determined based on the triggering parameter (such as the pressing duration) for the virtual control. For example, the pressing duration of the user for the virtual control can be obtained first, and then the pre-created mapping table can be queried based on this pressing duration to obtain the scaling ratio corresponding to this pressing duration. The mapping table can include the mapping relationship between different pressing durations and different compression ratios.

[0091] For example, taking the emulator as a mobile phone emulator, in the operation interface of the operating system (such as the Android system) simulated and run by the mobile phone emulator, virtual controls for performing scaling operations can be displayed. For example, taking the host computer of the mobile phone emulator as a Windows computer, when it is detected that the mouse pointer touches the picture (i.e., the first information) on the page, virtual controls for performing scaling operations can be displayed in the operation interface. For example, a virtual control 1 for performing a zoom-out operation can be displayed in the upper left corner of the operation interface, and a virtual control 2 for performing a zoom-in operation can be displayed in the upper right corner of the operation interface. When the user wants to zoom in on the picture, the virtual control 2 displayed in the operation interface can be clicked. For example, when a click operation of the user on the virtual control 2 located in the upper right corner of the operation interface is received (such as the user controls the mouse pointer to move to the position where the virtual control 2 is located and clicks the left mouse button), a zoom-in operation on the picture can be performed in the operation interface (i.e., simulating the process of the user holding down the "Ctrl" key on the keyboard and scrolling up the mouse wheel). Finally, the magnified picture can be displayed in the operation interface. In this way, the user only needs to click the corresponding virtual control in the operation interface to achieve the zoom-in process of the picture. Compared with the solution provided by the related technology, the steps that the user needs to execute are greatly simplified, thereby effectively improving the user experience.

[0092] It should be noted that each time the user clicks on the virtual control 2, the image can be enlarged by a set multiple (for example, one time). That is to say, the user can enlarge the image to the corresponding multiple by clicking on the virtual control 2 multiple times. In addition, if the operation triggered by the user for the virtual control 2 is a pressing operation (for example, the user controls the mouse pointer to move to the position where the virtual control 2 is located and holds down the left mouse button), the pressing duration of the user for the virtual control 2 can be obtained first (that is, the duration from when the user holds down the left mouse button to when the user releases it). Then, the pre-created mapping table can be queried based on this pressing duration to obtain the magnification ratio corresponding to this pressing duration. Among them, the magnification ratio and the pressing duration can be positively correlated, that is, the longer the user presses the virtual control 2, the larger the corresponding magnification ratio. Finally, the image can be enlarged according to the magnification ratio, and the enlarged image can be displayed in the operation interface. In this way, the user can realize the enlargement processing of the image displayed in the operation interface only by pressing the corresponding virtual control, and the magnification ratio of the image corresponds to the pressing duration of the user for the virtual control, which can further improve the user experience in the mobile phone emulator scenario.

[0093] In some embodiments, when the above-mentioned target operation is a rotation operation, the second information can be the first information after rotation. Then, the above step 103 can also be implemented in the following way: in response to the trigger operation for the virtual control, rotate the first information and display the rotated first information in the operation interface.

[0094] For example, the above rotation of the first information and display of the rotated first information in the operation interface can be implemented in the following way: rotate the first information by a set angle and display the rotated first information in the operation interface, where the angle can be determined based on the trigger parameter (such as the pressing duration) for the virtual control. For example, the pressing duration of the user for the virtual control can be obtained first, and then the pre-created mapping table can be queried based on this pressing duration to obtain the rotation angle corresponding to this pressing duration. Among them, the mapping table can include the mapping relationship between different pressing durations and different rotation angles.

[0095] For example, taking the simulator as a mobile phone simulator, in the operation interface of the operating system (such as the Android system) simulated and run by the mobile phone simulator, virtual controls for performing rotation operations can be displayed. For example, taking the host computer of the mobile phone simulator as a Windows computer, when it is detected that the mouse pointer touches the picture (i.e., the first information) displayed on the page, virtual controls for performing rotation operations can be displayed in the operation interface. For example, virtual controls for performing rotation operations can be displayed in the upper right corner of the operation interface. When a click operation of the user on this virtual control is received (for example, the user controls the mouse pointer to move to the position where the virtual control is located and clicks the left mouse button), a rotation operation can be performed in the operation interface (for example, simulating the process that the user controls the mouse pointer to move to the area where the picture is located, holds down the left mouse button, and drags the mouse). Then, the mobile phone simulator can respond to the rotation operation and rotate the picture (for example, rotate the picture 90 degrees clockwise), so that the rotated picture can be displayed in the operation interface. That is to say, every time the user clicks the virtual control, the picture can be rotated 90 degrees clockwise. In this way, the user can realize the rotation processing of the picture only by clicking the virtual control in the operation interface, greatly reducing the steps that the user needs to execute when rotating the picture and effectively improving the rotation efficiency and the user experience.

[0096] It should be noted that if the operation triggered by the user on the virtual control is a pressing operation (for example, the user controls the mouse pointer to move to the position where the virtual control is located and holds down the left mouse button), the pressing duration of the user on this virtual control can be obtained first (for example, the duration from when the user holds down the left mouse button to when the user releases the button). Then, a pre-created mapping table can be queried based on this pressing duration to obtain the rotation angle corresponding to this pressing duration. Among them, there can be a positive correlation between the rotation angle and the pressing duration, that is, the longer the user presses the virtual control, the larger the rotation angle. Finally, the picture can be controlled to rotate clockwise according to this rotation angle, so that the rotated picture can be displayed in the operation interface. In this way, the user can realize the rotation processing of the picture only by pressing the corresponding virtual control in the operation interface, and the rotation angle of the picture is related to the pressing duration of the user on the virtual control, that is, the user can determine the rotation angle of the picture by controlling the pressing duration of the virtual control, so as to realize the precise rotation of the picture and further improve the user experience in the scenario of the mobile phone simulator.

[0097] In some other embodiments, when the above-mentioned target operation is a moving operation, the second information can be the first information after being moved. Then, the above step 103 can also be implemented in the following manner: in response to the triggering operation on the virtual control, move the first information from the first area where the operation interface is located to the second area.

[0098] Exemplarily, the above-mentioned moving of the first information from the first area where the operation interface is located to the second area can be achieved in the following manner: Control the movement of the first information in the operation interface according to the movement parameters of the movement operation (such as including movement speed, movement distance, etc.) to move the first information from the first area of the operation interface to the second area. Among them, the movement parameters can be determined based on the triggering parameters for the virtual control (such as the pressing duration). For example, the pressing duration of the user for the virtual control can be obtained first, and then the pre-created mapping table can be queried based on this pressing duration to obtain the movement distance corresponding to this pressing duration. The mapping table can include the mapping relationship between different pressing durations and different movement distances.

[0099] For example, taking the emulator as a mobile phone emulator, in the operation interface of the operating system (such as the Android system) simulated and run by the mobile phone emulator, virtual controls for performing movement operations can be displayed. For example, taking the host computer of the mobile phone emulator as a Windows computer, when it is detected that the mouse pointer touches the picture (i.e., the first information) on the page, virtual controls for performing movement operations can be displayed in the operation interface. For example, a virtual control 1 for performing leftward movement can be displayed on the left side of the operation interface, a virtual control 2 for performing rightward movement can be displayed on the right side of the operation interface, a virtual control 3 for performing upward movement can be displayed at the top of the operation interface, and a virtual control 4 for performing downward movement can be displayed at the bottom of the operation interface. Assuming that the picture is currently located in the upper left corner of the operation interface, when the user wants to move the picture to the lower right corner of the operation interface, the virtual control 4 displayed in the operation interface can be clicked first to move the picture from the upper left corner of the operation interface to the lower left corner of the operation interface, and then the virtual control 2 displayed in the operation interface can be clicked to move the picture from the lower left corner of the operation interface to the lower right corner of the operation interface. Or, the user can also first click the virtual control 2 displayed in the operation interface to move the picture from the upper left corner of the operation interface to the upper right corner of the operation interface, and then click the virtual control 4 displayed in the operation interface to move the picture from the upper right corner of the operation interface to the lower right corner of the operation interface. Taking the user's clicking of the virtual control 4 displayed in the operation interface as an example, when the click operation of the user for the virtual control 4 is received, a downward movement operation can be performed in the operation interface (i.e., simulating the process of the user controlling the mouse pointer to move to the area where the picture is located and holding down the left mouse button and dragging the mouse downward). Then, the mobile phone emulator can respond to the downward movement operation and control the picture to move from the upper left corner of the operation interface to the lower left corner of the operation interface.

[0100] It should be noted that each time the user clicks on the virtual control 4, the picture can be controlled to move downward by a set distance (for example, 1 centimeter). That is to say, when the user hopes to move the picture downward by 4 centimeters, the virtual control 4 needs to be clicked four times. In addition, when the picture moves to the lower edge of the operation interface, it will no longer move downward. For example, when the lower edge of the picture touches the lower edge of the operation interface, the picture will stop moving downward, so as to ensure that the picture can be completely displayed in the operation interface. In addition, if the operation triggered by the user for the virtual control 4 is a pressing operation (for example, the user controls the mouse pointer to move to the position where the virtual control 4 is located and holds down the left mouse button), the pressing duration of the user for the virtual control 4 can be obtained first (that is, the duration from when the user holds down the left mouse button to when the user releases it). Then, the mapping table created in advance can be queried based on this pressing duration to obtain the moving distance corresponding to this pressing duration. Among them, the moving distance and the pressing duration can be positively correlated, that is, the longer the user presses the virtual control 4, the greater the corresponding moving distance. In this way, the user can accurately control the moving distance of the picture by controlling the pressing duration of the virtual control, thereby further improving the user experience.

[0101] In some embodiments, when the above-mentioned target operation is a format conversion operation, the second information can be the first information after format conversion. Then, the above step 103 can also be implemented in the following manner: in response to the trigger operation for the virtual control, perform format conversion on the first information and display the first information after format conversion in the operation interface.

[0102] For example, taking the emulator as a mobile phone emulator, a virtual control for performing format conversion operations can be displayed in the operation interface of the operating system (such as the Android system) simulated and run by the mobile phone emulator. For example, taking the host computer of the mobile phone emulator as a Windows computer, when it is detected that the mouse pointer touches the picture in the first format (i.e., the first information) displayed on the page, a virtual control for performing format conversion can be displayed in the operation interface. When receiving the click operation of the user on this virtual control (for example, the user controls the mouse pointer to move to the position where this virtual control is located and clicks the left mouse button), a format conversion operation can be performed in the operation interface (for example, simulating that the user controls the mouse pointer to move to the area where the picture is located and clicks the right mouse button, and selects the operation in the second format in the pop-up menu). Then, the mobile phone emulator can respond to the format conversion operation, convert the picture from the first format to the second format, and display the picture in the second format in the operation interface. In this way, the user only needs to click the virtual control displayed in the operation interface to complete the format conversion process for the picture, greatly reducing the steps that the user needs to manually execute during the format conversion process, thereby effectively improving the user experience.

[0103] Exemplarily, taking the simulator as a mobile phone simulator for example, in the operation interface of the operating system (such as the Android system) simulated and run by the mobile phone simulator, virtual controls for performing format conversion operations can be displayed. For example, taking the host computer of the mobile phone simulator as a Windows computer for example, when it is detected that the mouse pointer touches a document (i.e., the first information) in the first format (such as the Word format) displayed in the operation interface, virtual controls for performing format conversion can be displayed in the operation interface. When a click operation on the virtual control is received from the user (for example, the user controls the mouse pointer to move to the position where the virtual control is located and clicks the left mouse button), a format conversion operation can be performed in the operation interface (for example, simulating the process that the user controls the mouse pointer to move to the position where the document is located and clicks the right mouse button, and selecting the new format to be saved as in the pop-up menu). Then, the mobile phone simulator can respond to the format conversion operation and convert the document from the first format to the second format (such as the PDF format). In this way, the user only needs to click the virtual control displayed in the operation interface to achieve the process of performing format conversion on the document, greatly reducing the steps that the user needs to manually execute during the document format conversion process, thereby effectively improving the document format conversion efficiency and the user experience.

[0104] In some other embodiments, when the above-mentioned target operation is a splitting operation, the second information may be a plurality of sub-information obtained by splitting the first information. Then, the above-mentioned step 103 can also be implemented in the following manner: in response to a trigger operation on the virtual control, split the first information and display the plurality of sub-information obtained by splitting the first information in the operation interface.

[0105] Exemplarily, taking the simulator as a mobile phone simulator for example, in the operation interface of the operating system (such as the Android system) simulated and run by the mobile phone simulator, virtual controls for performing splitting operations can be displayed. For example, taking the host computer of the mobile phone simulator as a Windows computer for example, when it is detected that the mouse pointer touches a picture (i.e., the first information) displayed on the page, virtual controls for performing splitting operations can be displayed in the operation interface. When a click operation on the virtual control is received from the user (for example, the user controls the mouse pointer to move to the position where the virtual control is located and clicks the left mouse button), a splitting operation can be performed in the operation interface (for example, simulating the process that the user splits the picture through specific keys on the mouse and keyboard). Then, the mobile phone simulator can respond to the splitting operation, split the picture into a plurality of sub-pictures, and display the plurality of sub-pictures obtained by splitting in the operation interface. In this way, the user only needs to click the virtual control displayed in the operation interface to achieve the process of splitting the picture, greatly reducing the steps that the user needs to execute when splitting the picture, and effectively improving the picture splitting efficiency and the user experience.

[0106] In some embodiments, when the above-mentioned target operation is a compression operation, the second information may be a compressed package obtained by compressing the first information. Then, the above-mentioned step 103 may also be implemented in the following manner: in response to a trigger operation on the virtual control, compress the first information, and display the compressed package obtained by compressing the first information in the operation interface.

[0107] For example, taking the emulator as a mobile phone emulator, in the operation interface of the operating system (such as the Android system) simulated and run by the mobile phone emulator, virtual controls for performing compression operations can be displayed. For example, taking the host computer of the mobile phone emulator as a Windows computer, when it is detected that the mouse pointer touches a picture (i.e., the first information) on the page, virtual controls for performing compression operations can be displayed in the operation interface. When a click operation of the user on the virtual control is received (for example, the user controls the mouse pointer to move to the position where the virtual control is located and clicks the left mouse button), the compression operation can be automatically executed in the operation interface (for example, simulating the process that the user controls the mouse pointer to move to the area where the picture is located and clicks the right mouse button, and selecting the compression option in the pop-up menu). Then, the mobile phone emulator can respond to the compression operation, compress the picture displayed on the page, and display the compressed package obtained by compressing the page in the operation interface. In this way, the user only needs to click the virtual control displayed in the operation interface to complete the compression process of the picture, greatly reducing the steps that the user needs to execute during the process of compressing the picture, and thus effectively improving the user experience.

[0108] In some other embodiments, refer to Figure 5 , Figure 5 which is the third process schematic diagram of the information processing method based on the emulator provided by the embodiments of the present application. As shown in Figure 5 , after performing the step 103 shown in Figure 3 , the step 104 shown in Figure 5 may also be executed, and will be described in combination with the steps shown in Figure 5 .

[0109] In step 104, in response to meeting the control cancellation condition, cancel the display of the virtual control in the operation interface.

[0110] In some embodiments, the above-mentioned first information may be displayed on the first page of the first application running in the emulator. Then, the above-mentioned step 104 may be implemented in the following manner: detect the position of the operation pointer in the operating system running on the host computer of the emulator; in response to the operation pointer (such as the mouse pointer) leaving the sliding component included in the first page, cancel the display of the virtual control in the operation interface.

[0111] Exemplarily, taking the mobile phone emulator as an example, a first application (such as a certain mobile social application) can run in the operating system (such as the Android system) simulated by the mobile phone emulator. Among them, the above-mentioned first information can be displayed on the page of the mobile social application. Taking the host computer of the mobile phone emulator as a Windows computer as an example, when it is detected that the mouse pointer touches the horizontal sliding component included in the page (the first information, such as a picture, is displayed on the horizontal sliding component), virtual controls can be displayed in the operation interface; when it is detected that the mouse pointer leaves the horizontal sliding component, it indicates that the user has no intention of operating the picture displayed on the horizontal sliding component at this time, and then the virtual controls can be hidden in the operation interface. In this way, the interaction process can be made more intuitive and convenient.

[0112] It should be noted that the condition for canceling the control can be not only that the mouse pointer leaves the horizontal sliding component in the page, but also that a click operation of the user on a specific button displayed in the operation interface is received. For example, a specific button for controlling the display and hiding of the virtual control can be displayed in the operation interface. When the virtual control is displayed in the operation interface, if a click operation of the user on the specific button is received, the virtual control can be hidden in the operation interface. The embodiments of the present application do not specifically limit the condition for canceling the control.

[0113] The information processing method based on the emulator provided by the embodiments of the present application adds virtual controls to the operation interface of the operating system simulated by the emulator. Among them, when the virtual control is triggered, corresponding operations can be automatically executed in the operation interface. In this way, the user only needs to trigger the virtual control to automatically execute the corresponding operations in the operation interface, thereby effectively reducing the operation steps that the user needs to perform manually, greatly improving the information processing efficiency in the emulator scenario, and further enhancing the user experience.

[0114] Next, taking the scenario of running a mobile phone emulator on a computer as an example, the exemplary application of the embodiments of the present application in an actual application scenario will be described.

[0115] In order to experience mobile applications on a computer (such as a Windows computer), the user first needs to install a mobile phone emulator on the computer, and then can install the corresponding mobile application in the operating system (such as the Android system) simulated by the mobile phone emulator, so as to experience mobile applications on the computer. When experiencing mobile applications, in order to achieve horizontal sliding, the user usually needs to hold down the left mouse button and drag to complete, which not only increases the operation steps, but also may reduce the accuracy of the mouse. Especially when dealing with large-size displays or complex design software, this inconvenience is particularly prominent.

[0116] In view of this, an information processing method based on a simulator is provided in an embodiment of the present application. By detecting in real time the position of the mouse pointer in the operation interface of the operating system simulated by the mobile phone simulator, virtual buttons can be dynamically displayed or hidden according to the movement of the mouse pointer. For example, when it is detected that the mouse pointer moves to a horizontal sliding component included in the page displayed in the operation interface, virtual buttons (such as virtual button 1 located on the left side of the operation interface and virtual button 2 located on the right side of the operation interface) will be automatically displayed on the operation interface. The user can click on virtual button 1 on the left to achieve leftward sliding of the content, or can also click on virtual button 2 on the right to achieve rightward sliding of the content. In addition, when it is detected that the mouse pointer leaves the horizontal sliding component, the virtual buttons can be hidden in the operation interface (that is, these virtual buttons will automatically disappear). In this way, the horizontal sliding operation of the user is effectively simplified, making the interaction process more intuitive and smooth.

[0117] The information processing method based on the simulator provided in the embodiment of the present application will be specifically described below.

[0118] In some embodiments, taking the picture browsing scenario as an example, refer to Figure 6A , Figure 6A which is a schematic diagram of the first application scenario of the information processing method based on the simulator provided in the embodiment of the present application. As Figure 6A shown, in the operation interface 601 of the mobile phone simulator, a page of a certain social application program is displayed. When it is detected that the user controls the mouse pointer to move to the picture area including multiple pictures in the page, two virtual buttons, left and right (that is, Figure 6A the virtual button 602 located on the left side of the operation interface 601 and the virtual button 603 located on the right side of the operation interface 601 shown in

[0119] In other embodiments, taking the novel reading scenario as an example, refer to Figure 6B , Figure 6B which is a schematic diagram of the second application scenario of the information processing method based on the simulator provided in the embodiment of the present application. As Figure 6BAs shown, when a user experiences a mobile reading application on a computer through a mobile phone emulator (for example, reads a novel provided by the mobile reading application on the computer) (for example, it is detected that the user clicks on a certain novel reading application running in the mobile phone emulator and clicks on the cover of a certain novel displayed on the home page of the application), the content of the novel can be displayed in the operation interface 606 of the mobile phone emulator, and two virtual buttons, namely Figure 6B the virtual button 607 located on the left side of the operation interface and the virtual button 608 located on the right side of the operation interface shown in

[0120] are automatically added. In this way, the user can click on the virtual buttons on the left and right sides with the mouse to implement the function of turning pages left and right. For example, when it is detected that the user clicks on the left virtual button 607 with the mouse, the function of turning pages to the left can be implemented; when it is detected that the user clicks on the right virtual button 608 with the mouse, the function of turning pages to the right can be implemented. Figure 6C , Figure 6C is a schematic diagram of the third application scenario of the information processing method based on the emulator provided by the embodiments of the present application. As Figure 6C shown, a page of a certain application opened by the user (such as the home page of the application) is displayed in the operation interface 609 of the mobile phone emulator. When it is detected that the user controls the mouse pointer to touch the horizontal sliding area (such as a horizontal sliding list) in this page, two virtual buttons, namely Figure 6C the virtual button 610 located on the left side of the operation interface 609 and the virtual button 611 located on the right side of the operation interface 609 shown in

[0121] are automatically added to the operation interface 609. In this way, the user can click on the virtual buttons on the left and right sides with the mouse to implement the function of horizontal sliding of the list on the left and right.

[0122] It should be noted that when it is detected that the mouse pointer moves out of the horizontal sliding area of the picture, the virtual buttons on the left and right sides will automatically disappear from the operation interface, so as not to affect other functions. Figure 7 Next, the information processing method based on the emulator provided by the embodiments of the present application will be specifically described in combination with

[0123] Specifically, referring to Figure 7 , Figure 7 is the fourth flow schematic diagram of the information processing method based on the emulator provided by the embodiments of the present application, and will be described in combination with the steps shown in Figure 7 .

[0124] In step 201, the user starts a mobile application in the mobile phone emulator Host.

[0125] Here, a mobile application refers to an application that runs in a virtual mobile environment (such as the Android system) created on the Host side of the mobile emulator.

[0126] In step 202, the Host side of the mobile emulator requests application whitelist configuration information from the background server.

[0127] In some embodiments, after starting a mobile application on the Host side of the mobile emulator, the Host side of the mobile emulator can pull the application whitelist configuration information corresponding to the mobile application from the background server, where the application whitelist configuration information may include the pages where the mobile application is to display virtual buttons and the corresponding components.

[0128] In step 203, the background server returns the application whitelist configuration information to the Host side of the mobile emulator.

[0129] In step 204, the Host side of the mobile emulator sends a start request to the Guest side of the mobile emulator.

[0130] In step 205, the Guest side of the mobile emulator reads the application whitelist configuration information and determines whether the mouse pointer is on a horizontal sliding component. If so, step 206 is executed; if not, step 206 is also executed.

[0131] In step 206, the Guest side of the mobile emulator notifies the Host side of the mobile emulator to display the virtual button.

[0132] In step 207, the Guest side of the mobile emulator notifies the Host side of the mobile emulator to hide the virtual button.

[0133] In some embodiments, after receiving the start request sent by the Host side of the mobile emulator, the Guest side of the mobile emulator can first read the application whitelist configuration information from the start request, display the page corresponding to the mobile application based on the read application whitelist configuration information, and detect the position of the mouse pointer. When it detects that the mouse pointer moves to a component that needs to be horizontally scrolled, the Guest side of the mobile emulator can notify the Host side of the mobile emulator to display the virtual button (for example, add virtual buttons on the left and right sides of the operation interface). In this way, the user can click the virtual button with the mouse to achieve left - right switching. When it detects that the mouse pointer leaves the horizontal sliding component, the Guest side of the mobile emulator can notify the Host side of the mobile emulator to hide the virtual button, that is, the virtual button will automatically disappear, thus not affecting other functions.

[0134] Next, the event passing process of the mobile emulator will be further described.

[0135] In some embodiments, the complete link of event delivery in a mobile phone emulator may include five steps: event formation, event acquisition, event reading, event distribution, and event consumption. Among them, event formation means that the mobile phone emulator simulates touching the screen through Virtual Input and writes the corresponding event to the corresponding device node; event acquisition means that the event management module (i.e., the EventHub module) collects touch panel (TP) reporting events of the underlying hardware device. For example, it can open the input device in the " / dev / input" directory and register it in the detection queue of epoll (which is an improved poll for handling a large number of file descriptors in the Linux kernel and is an enhanced version of the multiplexed read-write interface in Linux. It can significantly improve the utilization rate of the system's central processing unit when there are only a small number of active connections among a large number of concurrent connections). Once there is a readable input event on the corresponding device, it can immediately be packaged into an event and reported to InputReader. InputReader is a key component in the Android system, mainly responsible for obtaining input events from the EventHub module and processing and distributing these events; event reading means that after InputReader obtains an event, it can confirm what type of event of what device it is through the device identifier (such as DeviceId) and the corresponding InputMapper (which is a component in the Android system used to process raw input events. It is mainly responsible for processing the raw input events so that the system can further use these events), and perform the first data result encapsulation on it, and put the encapsulated result into the mInboundQueue of InputDispatcher (which is a key component in the Android system responsible for handling input event distribution. When InputReader reads an input event, it will wake up the InputDispatcher thread to perform event distribution). The mInboundQueue is a key component in the Android system used to store the input events received from InputReader. Its main function is to buffer the input events to ensure the order and reliability of the input events) and wait to be distributed and processed;Event distribution means that the InputDispatcher takes an event from the head of the mInboundQueue, searches for the focused window, and confirms whether the connection of the InputChannel (which is the communication bridge between the InputDispatcher and the application and is used to handle input events) is valid. Among them, the registration of the InputChannel can be executed when the window is created in the warehouse management system. After everything is ready, the current event can be put into the outBoundQueue (which refers to the queue used to store packets to be sent in network communication. The role of this queue is to temporarily store packets until they can be sent out), and then the event is sent to the application process. At the same time, the current event can also be transferred from the outBoundQueue to the waiting queue (i.e., the waitQueue. Among them, the waitQueue is a mechanism in the Linux kernel for managing waiting resources, mainly used for synchronizing access to system resources, asynchronous event notification, and cross-process communication, etc.). It should be noted that attention should be paid to the problem of Application Not Response (ANR) here. Specifically, if the next input event arrives and it is found that the current waitQueue is not empty and the head event distribution exceeds 500 ms, then the ANR timing starts. If it exceeds 5S, a command corresponding to the ANR will be generated, and the ANR process will be executed when the command is triggered next time; Event consumption means that the process of the mobile application obtains the event and matches the specific implementation class of the InputStage (which is a stage processing mechanism for handling input events in the Android system. In the process of handling input events, the InputStage can divide the input events into multiple stages for processing, each stage corresponds to a Stage, and each Stage is responsible for processing different parts of the input events) to be responsible for consuming the event. Among them, the transmission order of the input events in the mobile application is: application window (Activity) → top-level view (DecorView) → view set (ViewGroup) → view (View).;

[0136] Next, continue to combine Figure 8 to illustrate the process of detecting the mouse wheel event on the mobile emulator.

[0137] For example, refer to Figure 8 , Figure 8 which is the fifth process schematic diagram of the information processing method based on the emulator provided by the embodiment of the present application, and will be described in combination with Figure 8 the steps shown.

[0138] In step 301, the user starts the mobile application in the Host side of the mobile emulator.

[0139] In step 302, the Host side of the mobile phone emulator transmits the position of the mouse pointer to the Guest side of the mobile phone emulator transparently.

[0140] In some embodiments, when the user starts a mobile application on the Host side of the mobile phone emulator, the Host side of the mobile phone emulator can transmit the position of the mouse pointer to the Guest side of the mobile phone emulator transparently.

[0141] It should be noted that in a traditional mobile touch screen, when the firmware of the screen scans the current change at a certain frequency, it starts to calculate the touch position and upload it. Among them, the reporting point information can be finally written into the relevant device nodes after being processed by the TP driver. In the technical solution provided in the embodiments of the present application, the Host of the mobile phone emulator can simulate the touch screen through VirtualInput and write the corresponding events into the corresponding device nodes. Among them, VirtualInput usually refers to a function used to represent or simulate input devices in programming. It allows developers to simulate real input operations during software development without actual physical devices. For example, in an emulator or simulation environment, VirtualInput can provide virtual input devices, enabling users to operate in a virtual environment without the need for actual hardware support.

[0142] In step 303, the Guest side of the mobile phone emulator determines whether the current view needs to display virtual buttons in the dispatchHoverEvent method of the view set. If virtual buttons need to be displayed, it detects mouse events.

[0143] In some embodiments, after the Guest side of the mobile phone emulator receives the position of the mouse pointer transmitted transparently by the Host side of the mobile phone emulator, it can determine whether the current view (i.e., View) needs to display virtual buttons in the dispatchHoverEvent method of the view set (ViewGroup, which is an important method in Android development and is mainly used to handle hover events on the touch screen. Among them, the hover event refers to the operation that the user places a finger on the screen but does not slide or click). For example, when it detects a sliding operation or a click operation triggered by the user on the screen, it can be determined that the user has a need to slide, that is, virtual buttons need to be displayed in the current view. At this time, the Guest of the mobile phone emulator can detect mouse events.

[0144] In step 304, when the Guest side of the mobile phone emulator detects a MotionEvent.Action_HOVER_ENTER event, it notifies the Host side of the mobile phone emulator to display virtual buttons.

[0145] In some embodiments, when the Guest side of the mobile phone emulator detects a MotionEvent.Action_HOVER_ENTER event, it indicates that the mouse pointer touches the horizontal sliding component in the page, that is, the user has a need for horizontal sliding at this time. Then the Guest side of the mobile phone emulator can notify the Host side of the mobile phone emulator to display a virtual button. In this way, the user can click the virtual button with the mouse to achieve left - right sliding. That is to say, the technical solution provided by the embodiments of the present application involves two - level dimensions of the configuration page and components. When a mobile application displays a specified page, if it detects that the mouse pointer touches a specified component (such as a horizontal sliding component) in the page, the Host side of the mobile phone emulator can automatically add a virtual button.

[0146] The following continues to describe the process of displaying the virtual button.

[0147] In some embodiments, it is possible to first obtain the Activity of the page where the virtual button is located, then obtain the DecorView object of the Activity, then create a custom View, layout the style of the virtual button on the custom View, and finally add the created virtual button to the DecorView object, so as to achieve the purpose of displaying the virtual button in the operation interface.

[0148] In step 305, when the Guest side of the mobile phone emulator detects a MotionEvent.Action_HOVER_EXIT event, it notifies the Host side of the mobile phone emulator to hide the virtual button.

[0149] In some embodiments, when the Guest side of the mobile phone emulator detects a MotionEvent.Action_HOVER_EXIT event, it indicates that the mouse pointer has left the horizontal sliding component (i.e., the component in the page that can perform horizontal sliding), that is, the user has no need for sliding at this time. Then the Guest side of the mobile phone emulator can notify the Host side of the mobile phone emulator to hide the virtual button, and at this time the user can normally use other functions.

[0150] In summary, the information processing method based on the emulator provided by the embodiments of the present application has the following beneficial effects:

[0151] For the scenario of using a mobile phone emulator on a computer to experience a mobile application, the technical solution provided by the embodiments of the present application provides the user with the ability to achieve horizontal sliding by clicking the mouse, making the user's operation more comfortable and efficient. Especially in the reading scenario, it simplifies the user's horizontal sliding operation, makes the interaction process more intuitive and smooth, and thus effectively improves the user's experience.

[0152] Next, the exemplary structure of the simulator-based information processing device 555 provided in the embodiments of the present application implemented as software modules will be further described. In some embodiments, as Figure 2 shown, the software modules stored in the simulator-based information processing device 555 in the memory 550 may include: a display module 5551 and an update module 5552.

[0153] The display module 5551 is used to display the operation interface of the simulator; the display module 5551 is also used to, in response to an information viewing operation, display first information and virtual controls in the operation interface, where the virtual controls are used to perform corresponding target operations; the update module 5552 is used to, in response to a trigger operation on the virtual control, update the first information to second information in the operation interface.

[0154] In some embodiments, the display module 5551 is also used to display first information and at least one virtual control in the operation interface, where different virtual controls are used to perform different target operations; the update module 5552 is also used to, in response to a trigger operation on a first virtual control among the at least one virtual control, update the first information to second information in the operation interface based on a first target operation.

[0155] In some embodiments, different virtual controls are used to perform paging operations in different directions; the update module 5552 is also used to, in response to a trigger operation on a first virtual control among the at least one virtual control, perform a paging operation in a first direction in the operation interface to update the first information to second information.

[0156] In some embodiments, the above-mentioned target operation includes multiple sub-operations, and the multiple sub-operations are set with an execution order; the update module 5552 is also used to, in response to a trigger operation on the virtual control, sequentially execute the multiple sub-operations in the operation interface according to the execution order to update the first information to second information.

[0157] In some embodiments, when the above-mentioned target operation is a sliding operation, the update module 5552 is also used to, in response to a trigger operation on the virtual control, update the first information to second information in the operation interface based on the sliding operation.

[0158] In some embodiments, the update module 5552 is also used to slide the information flow in the operation interface according to the sliding parameters of the sliding operation to update the first information displayed in the operation interface to second information, where the sliding parameters are determined based on the trigger parameters for the virtual control.

[0159] In some embodiments, when the above-mentioned target operation is a zoom operation, the second information is the first information after being zoomed. The information processing device 555 based on the simulator further includes a zoom module 5553, configured to zoom the first information in response to a trigger operation on a virtual control; and a display module 5551, further configured to display the first information after being zoomed in the operation interface.

[0160] In some embodiments, the zoom module 5553 is further configured to zoom the first information according to a set zoom ratio, where the zoom ratio is determined based on a trigger parameter for the virtual control; and the display module 5551 is further configured to display the first information after being zoomed in the operation interface.

[0161] In some embodiments, when the above-mentioned target operation is a rotation operation, the second information is the first information after being rotated. The information processing device 555 based on the simulator further includes a rotation module 5554, configured to rotate the first information in response to a trigger operation on a virtual control; and a display module 5551, further configured to display the first information after being rotated in the operation interface.

[0162] In some embodiments, the rotation module 5554 is further configured to rotate the first information by a set angle, where the angle is determined based on a trigger parameter for the virtual control; and the display module 5551 is further configured to display the first information after being rotated in the operation interface.

[0163] In some embodiments, when the above-mentioned target operation is a movement operation, the second information is the first information after being moved; the information processing device 555 based on the simulator further includes a movement module 5555, configured to move the first information from a first area where the operation interface is located to a second area in response to a trigger operation on a virtual control.

[0164] In some embodiments, the movement module 5555 is further configured to control the movement of the first information in the operation interface according to the movement parameters of the movement operation, so as to move the first information from the first area to the second area of the operation interface, where the movement parameters are determined based on the trigger parameters for the virtual control.

[0165] In some embodiments, when the above-mentioned target operation is a format conversion operation, the second information is the first information after being format-converted; the information processing device 555 based on the simulator further includes a format conversion module 5556, configured to perform format conversion on the first information in response to a trigger operation on a virtual control; and the display module 5551 is further configured to display the first information after being format-converted in the operation interface.

[0166] In some embodiments, when the above-mentioned target operation is a splitting operation, the second information is a plurality of sub-information obtained by splitting the first information; the information processing device 555 based on the simulator further includes a splitting module 5557, configured to split the first information in response to the splitting operation; and a display module 5551, further configured to display, in the operation interface, the plurality of sub-information obtained by splitting the first information.

[0167] In some embodiments, when the above-mentioned target operation is a compression operation, the second information is a compressed package obtained by compressing the first information; the information processing device 555 based on the simulator further includes a compression module 5558, configured to compress the first information in response to a trigger operation on a virtual control; and a display module 5551, further configured to display, in the operation interface, the compressed package obtained by compressing the first information.

[0168] In some embodiments, the display module 5551 is further configured to display the first information in the operation interface in response to an information viewing operation; and display a virtual control in the operation interface in response to meeting the control display condition.

[0169] In some embodiments, the operation interface includes an application icon of a first application running in the simulator; the display module 5551 is further configured to display, in the operation interface, a first page of the first application in response to a trigger operation on the application icon of the first application, where the first page includes the first information.

[0170] In some embodiments, the information processing device 555 based on the simulator further includes a position detection module 5559, configured to detect the position of an operation pointer in the operating system running on the host computer of the simulator; the display module 5551 is further configured to display a virtual control in the operation interface when it is detected that the operation pointer contacts a sliding component in the first page, where the virtual control is used to perform a sliding operation or a page turning operation.

[0171] In some embodiments, the information processing device 555 based on the simulator further includes an acquisition module 55510, a creation module 55511, and an addition module 55512. Among them, before the display module 5551 displays the virtual control in the operation interface, the acquisition module 55510 is configured to acquire the application window corresponding to the first page and acquire the top-level view object of the application window; the creation module 55511 is configured to create a virtual control; and the addition module 55512 is configured to add the virtual control to the top-level view object.

[0172] In some embodiments, after the virtual control is displayed in the operation interface, the display module 5551 is further configured to cancel the display of the virtual control in the operation interface in response to meeting the control cancellation condition.

[0173] In some embodiments, the first information is displayed in the first page of the first application running in the emulator; the position detection module 5559 is further configured to detect the position of the operation pointer in the operating system running on the host computer of the emulator; the display module 5551 is further configured to cancel the display of the virtual control in the operation interface in response to the operation pointer leaving the sliding component included in the first page.

[0174] It should be noted that the description of the device in the embodiments of the present application is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments, so details will not be repeated. For the technical details not described in the information processing device based on the emulator provided in the embodiments of the present application, they can be understood according to Figure 3 、 Figure 4 、or Figure 5 the description of any of the accompanying drawings.

[0175] The embodiments of the present application provide a computer program product, which includes a computer program or computer executable instructions, and the computer program or computer executable instructions are stored in a computer-readable storage medium. The processor of the electronic device reads the computer executable instructions from the computer-readable storage medium, and the processor executes the computer executable instructions, so that the electronic device executes the information processing method based on the emulator described above in the embodiments of the present application.

[0176] The embodiments of the present application provide a computer-readable storage medium storing computer executable instructions, where the computer executable instructions are stored, and when the computer executable instructions are executed by a processor, the processor will be caused to execute the information processing method based on the emulator provided in the embodiments of the present application. For example, as Figure 3 、 Figure 4 、or Figure 5 shown in the information processing method based on the emulator.

[0177] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disc, or CD-ROM; it may also be various devices including one or any combination of the above memories.

[0178] In some embodiments, the executable instructions may be in the form of a program, software, software module, script, or code, and may be written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including being deployed as an independent program or being deployed as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0179] As an example, the executable instructions can be deployed to execute on one electronic device, or on multiple electronic devices located at one location, or on multiple electronic devices distributed at multiple locations and interconnected by a communication network.

[0180] As described above, the above are only embodiments of the present application and are not used to limit the protection scope of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and scope of the present application are all included in the protection scope of the present application.

Claims

1. An information processing method based on a simulator, characterized in that: The method comprises: Display the simulator's operating interface; In response to the information viewing operation, displaying first information and a virtual control in the operation interface, wherein the virtual control is used to perform a corresponding target operation; In response to a triggering operation on the virtual control, in the operation interface, the first information is updated to second information.

2. The method according to claim 1, characterized in that The displaying of the first information and the virtual control in the operation interface includes: Displaying first information and at least one virtual control in the operation interface, wherein different virtual controls are used to perform different target operations; In response to the triggering operation on the virtual control, in the operation interface, updating the first information to second information includes: In response to a trigger operation on a first virtual control among the at least one virtual control, in the operation interface, the first information is updated to second information based on a first target operation.

3. The method according to claim 2, characterized in that Different virtual controls are used to perform page turning operations in different directions; In response to the triggering operation on the first virtual control among the at least one virtual control, in the operation interface, updating the first information to the second information based on the first target operation includes: In response to a trigger operation on a first virtual control among the at least one virtual control, a page turning operation in a first direction is performed in the operation interface to update the first information to second information.

4. The method according to claim 1, characterized in that: The target operation includes a plurality of sub-operations, and the plurality of sub-operations are set with an execution order; In response to the triggering operation on the virtual control, in the operation interface, updating the first information to second information includes: In response to a trigger operation on the virtual control, the multiple sub-operations are sequentially executed in the operation interface according to the execution order to update the first information to second information.

5. The method according to claim 1, characterized in that When the target operation is a sliding operation, in response to the triggering operation on the virtual control, updating the first information to second information in the operation interface includes: In response to a trigger operation on the virtual control, in the operation interface, the first information is updated to second information based on the sliding operation.

6. The method according to claim 5, characterized in that The updating the first information to second information based on the sliding operation includes: The information flow in the operation interface is slid according to the sliding parameters of the sliding operation to update the first information displayed in the operation interface to the second information, wherein the sliding parameters are determined based on the trigger parameters for the virtual control.

7. The method according to claim 1, characterized in that When the target operation is a scaling operation, the second information is the scaled first information; In response to the triggering operation on the virtual control, in the operation interface, updating the first information to second information includes: In response to a triggering operation on the virtual control, the first information is scaled, and the scaled first information is displayed in the operation interface.

8. The method according to claim 7, characterized in that The scaling of the first information and displaying the scaled first information in the operation interface includes: The first information is scaled according to a set scaling ratio, and the scaled first information is displayed in the operation interface, wherein the scaling ratio is determined based on a trigger parameter for the virtual control.

9. The method according to claim 1, characterized in that: When the target operation is a rotation operation, the second information is the first information after being rotated; In response to the triggering operation on the virtual control, in the operation interface, updating the first information to second information includes: In response to a triggering operation on the virtual control, the first information is rotated, and the rotated first information is displayed in the operation interface.

10. The method according to claim 9, characterized in that The rotating the first information and displaying the rotated first information in the operation interface includes: The first information is rotated by a set angle, and the rotated first information is displayed in the operation interface, wherein the angle is determined based on a trigger parameter for the virtual control.

11. The method according to claim 1, characterized in that: When the target operation is a move operation, the second information is the first information after the move; In response to the triggering operation on the virtual control, in the operation interface, updating the first information to second information includes: In response to a trigger operation on the virtual control, the first information is moved from a first area where the operation interface is located to a second area.

12. The method according to claim 11, characterized in that The moving the first information from the first area of ​​the operation interface to the second area includes: The first information is controlled to move in the operation interface according to a movement parameter of the movement operation, so as to move the first information from a first area to a second area of ​​the operation interface, wherein the movement parameter is determined based on a trigger parameter for the virtual control.

13. The method according to claim 1, characterized in that When the target operation is a format conversion operation, the second information is the first information after format conversion; In response to the triggering operation on the virtual control, in the operation interface, updating the first information to second information includes: In response to a triggering operation on the virtual control, the first information is format-converted, and the first information after format conversion is displayed in the operation interface.

14. The method according to claim 1, characterized in that When the target operation is a split operation, the second information is a plurality of sub-information obtained by splitting the first information; In response to the triggering operation on the virtual control, in the operation interface, updating the first information to second information includes: In response to a triggering operation on the virtual control, the first information is split, and a plurality of sub-information obtained by splitting the first information is displayed in the operation interface.

15. The method according to claim 1, characterized in that When the target operation is a compression operation, the second information is a compressed package obtained by compressing the first information; In response to the triggering operation on the virtual control, in the operation interface, updating the first information to second information includes: In response to a triggering operation on the virtual control, the first information is compressed, and a compressed package obtained by compressing the first information is displayed in the operation interface.

16. The method according to any one of claims 1 to 15, characterized in that In response to the information viewing operation, displaying the first information and the virtual control in the operation interface includes: In response to the information viewing operation, displaying first information in the operation interface; In response to satisfying a control display condition, a virtual control is displayed in the operation interface.

17. The method according to claim 16, characterized in that The operation interface includes an application icon of a first application running in the simulator; The step of displaying the first information in the operation interface in response to the information viewing operation includes: In response to a triggering operation on the application icon of the first application, a first page of the first application is displayed in the operation interface, wherein the first page includes first information.

18. The method according to claim 17, characterized in that In response to satisfying the control display condition, displaying the virtual control in the operation interface includes: Performing position detection on an operation pointer in an operating system running on a host machine of the simulator; When it is detected that the operation pointer contacts the sliding component in the first page, a virtual control is displayed in the operation interface, wherein the virtual control is used to perform a sliding operation or a page turning operation.

19. The method according to claim 18, characterized in that Before displaying the virtual controls in the operation interface, the method further includes: Obtaining an application window corresponding to the first page, and obtaining a top-level view object of the application window; A virtual control is created and added to the top-level view object.

20. The method according to claim 16, characterized in that After displaying the virtual controls in the operation interface, the method further includes: In response to satisfying a control cancellation condition, canceling display of the virtual control in the operation interface.

21. The method according to claim 20, characterized in that The first information is displayed in a first page of a first application running in the simulator; In response to satisfying a control cancellation condition, canceling display of the virtual control in the operation interface includes: Performing position detection on an operation pointer in an operating system running on a host machine of the simulator; In response to the operation pointer leaving the sliding component included in the first page, the virtual control is cancelled from being displayed in the operation interface.

22. An information processing device based on a simulator, characterized in that: The device comprises: A display module, used for displaying the operation interface of the simulator; The display module is further used to display the first information and the virtual control in the operation interface in response to the information viewing operation, wherein the virtual control is used to perform the corresponding target operation; An updating module is used to update the first information to second information in the operation interface in response to a triggering operation on the virtual control.

23. An electronic device, characterized in that: include: A memory for storing computer executable instructions; A processor is used to implement the simulator-based information processing method described in any one of claims 1 to 21 when executing the computer executable instructions stored in the memory.

24. A computer-readable storage medium storing computer-executable instructions, characterized in that: When the computer executable instructions are executed by a processor, the simulator-based information processing method described in any one of claims 1 to 21 is implemented.

25. A computer program product comprising a computer program or computer executable instructions, characterized in that: When the computer program or computer executable instructions are executed by a processor, the simulator-based information processing method described in any one of claims 1 to 21 is implemented.

Images