Information processing method and device, electronic equipment, computer readable storage medium and computer program product

Abstract

The invention provides an information processing method and device, electronic equipment, a computer readable storage medium and a computer program product. The method comprises the steps that a second operation interface is displayed in a first operation interface, the first operation interface is an operation interface of the electronic equipment, and the second operation interface is an operation interface of a simulator running in the electronic equipment; and in response to an information selection operation triggered in the second operation interface, highlighting selected target information in the second operation interface, and displaying the target information in a clipboard of the first operation interface. Through the method and the device, the cross-end information acquisition efficiency and the user experience can be remarkably improved.

Description

Technical Field

[0001] This application relates to the field of Internet technology, and in particular to an information processing method, apparatus, electronic device, computer-readable storage medium, and computer program product. Background Technology

[0002] An emulator is a tool that simulates the operating system (e.g., Android) of another type of terminal device (e.g., a mobile phone) on one type of terminal device (e.g., a computer), enabling applications adapted to the other type of terminal device to run on the original terminal device. For example, suppose application A is only compatible with Android. If you need to use application A on a computer, you need to open an emulator on the computer and run application A within the emulator. While using an emulator to run application A on a computer offers the convenience of a larger screen and keyboard / mouse operation, it still has the following drawbacks when selecting text: users must use the touch interaction logic of mobile devices (e.g., long press, dragging a floating cursor, etc.) to select text, or use a mouse to simulate mobile touch for text selection. This operation method is inaccurate and inefficient on a computer. Summary of the Invention

[0003] This application provides an information processing method, apparatus, electronic device, computer-readable storage medium, and computer program product, which can significantly improve the efficiency of cross-platform information acquisition and user experience.

[0004] The technical solution of this application embodiment is implemented as follows: This application provides an information processing method, including: The second operation interface is displayed in the first operation interface, wherein the first operation interface is the operation interface of the electronic device, and the second operation interface is the operation interface of the simulator running in the electronic device; In response to an information selection operation triggered in the second operation interface, the selected target information is highlighted in the second operation interface, and The target information is displayed in the clipboard of the first operation interface.

[0005] This application provides an information processing apparatus, including: The display module is used to display a second operation interface in a first operation interface, wherein the first operation interface is the operation interface of the electronic device, and the second operation interface is the operation interface of the simulator running in the electronic device. The display module is also used to highlight the selected target information in the second operation interface in response to an information selection operation triggered in the second operation interface; The display module is also used to display the target information in the clipboard of the first operation interface.

[0006] In the above scheme, the second operation interface displays an information stream; the display module is also used to respond to multiple information selection operations triggered in the second operation interface, and to highlight multiple target information selected in the information stream in the second operation interface, wherein each information selection operation corresponds to one target information.

[0007] In the above scheme, after the display module highlights multiple selected target information in the information stream in the second operation interface in response to multiple information selection operations triggered in the second operation interface, it is also used to switch the first target information from the highlighted state to the default display state in response to the undo selection operation triggered for the first target information, wherein the first target information is any one of the multiple target information.

[0008] In the above scheme, the undo selection operation is implemented through a keyboard and mouse connected to the electronic device; the display module is further configured to switch the first target information from a highlighted state to a default display state in response to controlling the mouse pointer corresponding to the mouse to move to the position of the first target information and receiving a pressing operation on the first key on the keyboard, wherein the highlighted state indicates that the first target information is selected, and the default display state indicates that the first target information is not selected.

[0009] In the above scheme, after the display module highlights multiple selected target information in the information stream in the second operation interface in response to multiple information selection operations triggered in the second operation interface, it is also used to switch the second target information from the highlighted state to the default display state in response to the pressing operation of the first key on the keyboard connected to the electronic device. The second target information is the target information selected latest among the multiple target information.

[0010] In the above scheme, the device further includes a splicing module, which is used to splice the multiple target information according to a preset format to obtain spliced ​​information; the display module is also used to display a clipboard in the first operation interface and display the spliced ​​information in the clipboard.

[0011] In the above scheme, the information selection operation is implemented through a keyboard and mouse connected to the electronic device; the device further includes a control module and a determination module, wherein the control module is used to control the mouse pointer corresponding to the mouse to move synchronously in the second operation interface in response to the pressing operation of the second key on the keyboard and the dragging operation of the mouse; the determination module is used to take the information traversed by the movement trajectory of the mouse pointer as the selected target information; the display module is also used to highlight the target information in the second operation interface.

[0012] In the above scheme, the display module is further configured to display a first prompt message in the second operation interface in response to a pressing operation of the second key on the keyboard, wherein the first prompt message is used to prompt information selection by dragging the mouse; the control module is further configured to control the mouse pointer corresponding to the mouse to move synchronously in the second operation interface in response to a dragging operation of the mouse.

[0013] In the above scheme, the device further includes a detection module for detecting the keyboard through a keyboard hook built into the operating system of the electronic device; the display module is further used to display a first prompt message in the second operation interface when the second key on the keyboard is detected to be pressed through the keyboard hook.

[0014] In the above scheme, the detection module is further configured to detect the mouse through a mouse hook built into the operating system running the electronic device, wherein the operating system includes a mouse pointer corresponding to the mouse; the device further includes an acquisition module, configured to acquire the drag trajectory of the mouse through the mouse hook in response to a drag operation of the mouse; the control module is further configured to control the mouse pointer to move synchronously in the second operation interface according to the drag trajectory.

[0015] In the above scheme, the display module is further configured to display a second prompt message in the second operation interface when the mouse pointer is detected by the mouse hook to be outside the second operation interface, wherein the second prompt message is used to prompt the mouse pointer to be moved to the second operation interface.

[0016] In the above scheme, the determining module is further used to determine the multiple pieces of information that the multiple discontinuous movement trajectories of the mouse pointer pass through as the multiple selected target information; the display module is further used to highlight the multiple target information in the second operation interface.

[0017] In the above scheme, the second operation interface is the operation interface of the application running in the simulator; the acquisition module is also used to acquire the view hierarchy tree of the application; the device further includes a traversal module, used to traverse the view hierarchy tree to obtain multiple components included in the application; the determination module is also used to determine the components through which the movement trajectory of the mouse pointer passes among the multiple components, and determine the information displayed on the passed components as the selected target information.

[0018] In the above scheme, the determining module is further configured to obtain multiple coordinates corresponding to the multiple components in the second operation interface; compare the coordinates included in the movement trajectory of the mouse pointer with the multiple coordinates corresponding to the multiple components; and determine the components whose coordinates are the same as those included in the movement trajectory as the components traversed by the movement trajectory of the mouse pointer.

[0019] In the above scheme, the display module is further configured to display a first operation interface, wherein the first operation interface includes an icon of the simulator; in response to a trigger operation on the icon, the simulator is started, and a second operation interface is displayed in the first operation interface.

[0020] In the above scheme, the display module is further configured to display multiple second operation interfaces in the first operation interface; the display module is further configured to display multiple target information selected from the multiple second operation interfaces in the clipboard of the first operation interface.

[0021] In the above scheme, the splicing module is further used to splice multiple target information selected from the multiple second operation interfaces to obtain spliced ​​information; the display module is further used to display a clipboard in the first operation interface and display the spliced ​​information in the clipboard.

[0022] In the above scheme, the device further includes a receiving module for receiving multiple target information sent by multiple simulators respectively, wherein one simulator corresponds to one second operation interface; the device further includes a deduplication module for deduplicating the multiple target information to obtain multiple target information after deduplication; the splicing module is further used to splice the multiple target information after deduplication according to a preset format to obtain spliced ​​information.

[0023] In the above scheme, the display module is further configured to display a clipboard in the first operation interface and display the target information in the clipboard in response to a copy operation on the target information. The copy operation includes: pressing a preset combination key on a keyboard connected to the electronic device and triggering a copy control displayed in the second operation interface.

[0024] In the above scheme, a data transmission channel is established between the electronic device and the simulator; before the display module displays the target information in the clipboard of the first operation interface, the receiving module is also used to receive the target information sent by the simulator through the data transmission channel; the device also includes a writing module, used to call the application programming interface of the clipboard to write the target information into the clipboard.

[0025] In the above scheme, before sending the target information to the electronic device, the simulator is also used to perform the following processing: downloading the target information; when the target information cannot be downloaded, generating an image of the target information by taking a screenshot.

[0026] This application provides an electronic device, including: Memory is used to store executable instructions for a computer; The processor, when executing computer-executable instructions stored in the memory, implements the information processing method provided in the embodiments of this application.

[0027] This application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the information processing method provided in this application.

[0028] This application provides a computer program product, including a computer program or computer executable instructions, which, when executed by a processor, implements the information processing method provided in this application.

[0029] The embodiments of this application have the following beneficial effects: By displaying the simulator's interface on the electronic device's interface, when a user selects the desired target information in the simulator's interface, the selected target information can be highlighted in the simulator's interface and displayed directly in the clipboard of the electronic device's interface. In this way, users can enjoy visual operation feedback, and the efficiency of cross-platform information acquisition and user experience can be significantly improved, greatly optimizing productivity in scenarios such as academic research and data organization. Attached Figure Description

[0030] Figure 1This is a schematic diagram of the architecture of the information processing system 100 provided in an embodiment of this application; Figure 2 This is a schematic diagram of the structure of the electronic device 500 provided in the embodiments of this application; Figure 3 This is a first flowchart illustrating the information processing method provided in the embodiments of this application; Figure 4 This is a second flowchart illustrating the information processing method provided in the embodiments of this application; Figure 5 This is a schematic diagram of the third process of the information processing method provided in the embodiments of this application; Figure 6 This is a schematic diagram of the information processing method provided in the embodiments of this application; Figure 7 This is a schematic diagram illustrating an application scenario of the information processing method provided in the embodiments of this application; Figure 8 This is a schematic diagram illustrating the principle of the information processing method provided in the embodiments of this application. Detailed Implementation

[0031] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0032] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0033] It is understood that in the embodiments of this application, data such as user information are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with relevant laws, regulations and standards.

[0034] In the following description, the terms “first, second, ...” are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that “first, second, ...” may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0035] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0036] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.

[0037] 1) Responding to: used to indicate the conditions or states on which the operation is performed depends. When the conditions or states on which it depends are met, one or more operations can be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.

[0038] 2) Emulator: An emulator is a tool (i.e., an application) that can simulate a computer program or software running on another operating system. Its main purpose is to run software or games that originally could only run on a specific platform on different hardware or operating systems. An emulator creates a virtual environment by copying the instruction set, hardware architecture, and peripheral interfaces of the target system, allowing source code or binary files to be executed on the host system while maintaining compatibility with the original environment. For example, an emulator can simulate (i.e., emulate) the operating system of a mobile device (e.g., a smartphone) (such as the Android operating system) on a personal computer (PC), enabling applications adapted for mobile phones to run on the PC. For instance, suppose application A is only compatible with the Android operating system; if you need to use application A on a PC, you need to open an emulator on your computer and run application A within the emulator.

[0039] 3) Clipboard: This is a temporary storage area in the memory of the Windows operating system, used to share data between different programs through copy, cut, and paste operations. Its storage capacity dynamically adjusts with the content, retaining only the most recently accessed data. In other words, the clipboard is a contiguous memory space in the Windows operating system that changes according to the size of the information stored, used for temporarily storing and exchanging information.

[0040] 4) Application Programming Interface (API): These are predefined functions designed to provide applications and developers with the ability to access a set of routines based on certain software or hardware, without needing to access the source code or understand the details of the internal workings.

[0041] 5) Keyboard hooks: This is a keyboard detection technology in the Windows operating system based on a message interception mechanism. It captures keyboard events by installing a system-wide hook. This technology uses the SetWindowsHookEx API to register hook callback functions and intercepts the WM_KETDOWN event during key message transmission. It can record virtual key codes, scan codes, and key status information in real time.

[0042] 6) Mouse hooks: These are the core mechanism in the Windows operating system used to intercept and process mouse input events. They primarily use two types, WH_MOUSE and WH_MOUSE_LL, for global detection and are widely used in automation, behavior logging, and other fields. Through the SetWindowsHookEx API, they employ a system-level message interception mechanism that can capture all mouse events, including clicks, drags, and scroll wheels.

[0043] In implementing the embodiments of this application, the applicant discovered that while using an emulator on a PC to simulate running mobile applications offers the convenience of a large screen and keyboard / mouse operation, it still has the following drawbacks when selecting text: 1) Fragmented operation logic: Users must use the touch interaction logic of the mobile device (such as long press, drag the floating cursor, etc.) to select text, or use the mouse to simulate the touch of the mobile device to select text. This operation method is inaccurate and inefficient in the PC environment, and is especially not good at handling long text or multi-paragraph selection.

[0044] 2) Inability to perform cross-paragraph / cross-screen selection: On mobile devices, text selection controls are typically limited to a single text component (TextView) or a scrolling container for one-time selection. Users cannot select multiple non-contiguous text items continuously by holding down the Ctrl key on the keyboard and using the mouse, as they can on a PC.

[0045] 3) Lack of flexible undo mechanism: In complex multi-segment selection processes, if an operation error occurs, the solutions provided by the relevant technologies usually require canceling the entire selection and starting over, and cannot provide flexible interaction for undoing segment by segment.

[0046] 4) Poor interactive experience: The entire copying process requires users to frequently switch between mobile and PC thinking modes, resulting in an inconsistent experience and failing to leverage the efficiency advantages of PC keyboard and mouse interaction.

[0047] In view of this, embodiments of this application provide an information processing method, apparatus, electronic device, computer-readable storage medium, and computer program product, which can significantly improve the efficiency of cross-terminal information acquisition and user experience. The electronic device provided in the embodiments of this application will be described below. The electronic device provided in the embodiments of this application can be implemented as various types of terminal devices such as smartphones, tablets, laptops, desktop computers, smart speakers, smartwatches, smart TVs, and in-vehicle terminals.

[0048] In some embodiments, see Figure 1 , Figure 1 This is a schematic diagram of the architecture of the information processing system 100 provided in this application embodiment. To support applications that significantly improve the efficiency of cross-platform information acquisition and user experience, such as... Figure 1 As shown in the embodiments of this application, the information processing system 100 includes: a server 200, a network 300, and a terminal device 400. The server 200 can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. The network 300 can be a local area network (LAN), a wide area network (WAN), or a combination of both. The terminal device 400 is a user-associated terminal device, on which an emulator 410 runs.

[0049] The structure of the electronic device provided in the embodiments of this application will be further described below. Taking the electronic device as a terminal device as an example, see... Figure 2 , Figure 2 This is a schematic diagram of the structure of the electronic device 500 provided in the embodiments of this application. Figure 2 The illustrated electronic device 500 includes at least one processor 510, a memory 550, at least one network interface 520, and a user interface 530. The various components in the electronic device 500 are coupled together via a bus system 540. It is understood that the bus system 540 is used to implement communication between these components. In addition to a data bus, the bus system 540 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 2 The general labeled all buses as Bus System 540.

[0050] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc.

[0051] User interface 530 includes one or more output devices 531 that enable the presentation of media content, including one or more speakers and / or one or more visual displays. User interface 530 also includes one or more input devices 532, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0052] The memory 550 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state storage, hard disk drives, optical disk drives, etc. The memory 550 may optionally include one or more storage devices physically located away from the processor 510.

[0053] The memory 550 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 550 described in this application embodiment is intended to include any suitable type of memory.

[0054] In some embodiments, memory 550 is capable of storing data to support various operations, examples of which include programs, modules, and data structures or subsets or supersets thereof, as illustrated below.

[0055] Operating system 551 includes system programs for handling various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic business functions and handling hardware-based tasks; The network communication module 552 is used to reach other computing devices via one or more (wired or wireless) network interfaces 520, exemplary network interfaces 520 including: Bluetooth, WiFi, and Universal Serial Bus (USB), etc. Presentation module 553 is used to enable the presentation of information (e.g., user interface for operating peripheral devices and displaying content and information) via one or more output devices 531 (e.g., display screen, speaker, etc.) associated with user interface 530. The input processing module 554 is used to detect and translate one or more user inputs or interactions from one or more input devices 532. In some embodiments, the apparatus provided in this application can be implemented in software. Figure 2 An information processing device 555 stored in memory 550 is shown. This device can be software in the form of programs and plug-ins, and includes the following software modules: display module 5551, splicing module 5552, control module 5553, determination module 5554, detection module 5555, acquisition module 5556, traversal module 5557, receiving module 5558, deduplication module 5559, and writing module 55510. These modules are logically connected and can therefore be arbitrarily combined or further split according to the functions implemented. It should be noted that... Figure 2 For ease of explanation, all the above modules are shown at once, but this should not be construed as excluding the implementation of the information processing device 555 which may only include the display module 5551. The functions of each module will be described below.

[0056] The information processing method provided in this application will be specifically described below with reference to exemplary applications and implementations of the electronic devices provided in the embodiments of this application.

[0057] For example, see Figure 3 , Figure 3 This is a first flowchart illustrating the information processing method provided in the embodiments of this application, which will be combined with... Figure 3 The steps shown are explained.

[0058] It should be noted that, Figure 3 The steps shown can be performed by an electronic device.

[0059] In step 101, the second operation interface is displayed in the first operation interface.

[0060] Here, the first operation interface can be the operation interface of an electronic device (i.e., the host machine), and the second operation interface can be the operation interface of an emulator running in the electronic device. The size of the first operation interface can be greater than or equal to the size of the second operation interface. For example, the second operation interface can be displayed in a non-full-screen manner in the first operation interface, or the second operation interface can be displayed in full screen in the first operation interface.

[0061] In some embodiments, step 101 can be implemented as follows: displaying a first operation interface, wherein the first operation interface may include an icon of the emulator; in response to a trigger operation on the icon of the emulator, starting the emulator, and displaying a second operation interface in the first operation interface.

[0062] For example, taking a laptop running a Windows operating system as an example, an emulator (such as a mobile phone emulator for emulating the Android operating system) can be installed on the laptop. When the user clicks on the emulator icon displayed on the laptop's interface, for example, by double-clicking the emulator icon, the emulator can be launched, and the emulator's interface can be displayed on the laptop's interface, for example, on the left side of the laptop's interface.

[0063] It should be noted that the emulator's user interface can be either the emulator's built-in interface or the interface of an application running within the emulator. The emulator's built-in interface refers to the basic unit for visual presentation; an emulator can consist of multiple interfaces, and the user interacts with the emulator through these interfaces. Similarly, the interface of an application running within the emulator refers to the basic unit for visual presentation; an application can also consist of multiple interfaces, and the user interacts with the application through its own interface.

[0064] Furthermore, it should be noted that the electronic device hosting the emulator corresponds to a first operating system, while the applications running on the emulator are developed based on the specifications of a second operating system. The first and second operating systems can be two different operating systems. Therefore, the electronic device needs an emulator to simulate the running environment of the second operating system, allowing applications developed based on its specifications to run on the device. For example, the application could be a mobile application running on the electronic device via an emulator, where the electronic device runs a Windows operating system, and the mobile application is developed based on the specifications of the Android operating system. Android is an open-source operating system based on the Linux kernel, primarily used for mobile devices and other embedded devices. It provides a rich application framework, allowing developers to build various applications and games.

[0065] In other embodiments, step 101 above can also be implemented by displaying multiple second operation interfaces in the first operation interface, wherein one second operation interface corresponds to one simulator, that is, multiple simulators can be run simultaneously in the electronic device.

[0066] For example, taking a laptop running the Windows operating system as an example, a user can install multiple emulators on the laptop at the same time. For instance, suppose there are two emulators, emulator 1 and emulator 2. The user can start emulator 1 and emulator 2 at the same time. At this time, the operation interface of emulator 1 and emulator 2 can be displayed on the laptop's operation interface at the same time. For example, the operation interface of emulator 1 can be displayed on the left side of the laptop's operation interface, and the operation interface of emulator 2 can be displayed on the right side of the laptop's operation interface. In this way, the target information selected from emulator 1 and emulator 2 can be transferred to the laptop's clipboard, further improving the efficiency of cross-platform information acquisition.

[0067] In step 102, in response to an information selection operation triggered in the second operation interface, the selected target information is highlighted in the second operation interface.

[0068] Here, the number of target information can be one or more, and the type of target information can include text, images, and videos, etc.

[0069] In some embodiments, an information stream can be displayed in the second operation interface, and step 102 can be implemented in the following way: in response to multiple information selection operations triggered in the second operation interface, multiple target information selected in the information stream is highlighted in the second operation interface (for example, multiple target information selected can be highlighted, or underlines can be displayed below multiple target information selected), wherein one information selection operation corresponds to one target information.

[0070] For example, taking a mobile phone emulator as an example, a mobile application can be simulated and run within the emulator. This could be an application developed based on the Android operating system specifications, such as a mobile news application. Specifically, a mobile news application can be installed on the emulator. When a user clicks on the app's icon, the application can be launched within the emulator. For instance, the emulator can display the app's homepage, which may include multiple trending news headlines (i.e., a news feed). Users can select news headlines while browsing. For example, they can hold down the Ctrl key on a keyboard connected to an electronic device (e.g., a laptop) and drag the mouse to select multiple headlines. The selected headlines can be highlighted individually, or underlined to indicate their selection. This allows users to use their familiar PC skills (Ctrl key + mouse drag) for selection, while providing immediate and expected visual feedback, offering a user-friendly interactive experience.

[0071] In other embodiments, following the above examples, after highlighting multiple selected target information in the information stream in the second operation interface in response to multiple information selection operations triggered in the second operation interface, the following processing can also be performed: in response to a cancellation selection operation triggered for the first target information, the first target information is switched from the highlighted state to the default display state, wherein the first target information can be any one of the selected target information.

[0072] For example, continuing from the previous example and using a mobile emulator as an example, users can select multiple, non-contiguous news headlines by holding down the Ctrl key on the keyboard and dragging the mouse. For instance, suppose a user selects five news headlines from the news feed displayed on the homepage of a news application, namely News Headline 1, News Headline 2, News Headline 3, News Headline 4, and News Headline 5. These five news headlines can be highlighted, or underlined below them to emphasize them, thus reminding the user that these are the currently selected news headlines. If the user no longer wants news headline 2, they can trigger an undo selection operation on news headline 2. When the user triggers an undo selection operation on news headline 2, the system can switch news headline 2 from the highlighted state back to the default display state. For example, the system can switch news headline 2 from the highlighted state back to the default display state, or remove the underline displayed below news headline 2. In other words, the technical solution provided by this application embodiment allows users to undo the selection of a selected news headline. This gives users the opportunity to regret their choices and encourages them to operate boldly without worrying about having to start all over again due to a small mistake.

[0073] In some embodiments, following the above example, the above-mentioned undo selection operation can be implemented through a keyboard and mouse connected to an electronic device. Then, the above-mentioned response to the undo selection operation triggered for the first target information can be implemented in the following way: in response to controlling the mouse pointer corresponding to the mouse to move to the position of the first target information and receiving a press operation on the first key on the keyboard (e.g., assuming it is the "Esc" key), the first target information is switched from the highlighted state to the default display state. The highlighted state can be used to indicate that the first target information is selected, and the default display state can be used to indicate that the first target information is not selected.

[0074] For example, continuing from the previous example and using a mobile emulator as an example, users can select multiple, non-contiguous news headlines by holding down the Ctrl key on the keyboard and dragging the mouse. For instance, suppose a user selects five news headlines from the news feed displayed on the homepage of a news application, namely News Headline 1, News Headline 2, News Headline 3, News Headline 4, and News Headline 5. These five news headlines can be highlighted, or underlined below them to emphasize them, thus reminding the user that these are the currently selected news headlines. If a user no longer wants news headline 2, they can trigger an undo selection operation for it. For example, the user can first move the mouse pointer to the location of news headline 2 by dragging the mouse, and then press the Esc key on the keyboard. At this time, news headline 2 can be switched back from the highlighted state to the default display state. For example, the underline displayed below news headline 2 can be removed, or news headline 2 can be switched back from the highlighted state to the default display state. In other words, the technical solution provided by this application embodiment allows users to undo the selection of any selected news headline. This gives users the opportunity to regret their choices and encourages them to operate boldly without worrying about having to start over due to a small mistake.

[0075] It should be noted that the mouse pointer is a visual symbol that indicates the cursor position in a computer graphical interface, which arose with the popularization of the mouse. The Windows operating system was the first to use different pointer shapes to reflect the operation status, such as waiting, link selection, and text input.

[0076] In other embodiments, following the above examples, after highlighting multiple selected target information in the information stream in the second operation interface in response to multiple information selection operations triggered in the second operation interface, the following processing can also be performed: in response to a pressing operation on a first key on a keyboard connected to an electronic device, the second target information is switched from a highlighted state to a default display state, wherein the second target information may be the target information with the latest selection time among the multiple selected target information.

[0077] For example, continuing from the previous example and using a mobile emulator, users can select multiple, non-contiguous news headlines by holding down the Ctrl key and dragging the mouse. For instance, suppose a user selects five news headlines from the news feed on the homepage of a news app: Headline 1, Headline 2, Headline 3, Headline 4, and Headline 5. These five headlines can be highlighted or underlined to emphasize their selection, reminding the user that they are currently selected. To undo the selection, the user can press the Esc key. When the system receives a press of the Esc key, the most recently selected news headline among the five headlines can be switched from highlighted to default display. For example, assuming the selection times of the five news headlines are from earliest to latest: Headline 1, Headline 2, Headline 3, Headline 4, and Headline 5, a press of the Esc key can switch Headline 5 from highlighted to default display, for instance, by removing the underline displayed below Headline 5. When the system receives another press of the Esc key, Headline 4 can be switched from highlighted to default display, effectively turning it from selected to unselected. In other words, users can undo their most recently selected headline by pressing the Esc key, giving them a chance to correct their mistakes and encouraging them to proceed without fear of having to start over due to a small error.

[0078] In some embodiments, when there are multiple target information items, after performing step 102 above, the following processing can also be performed: in response to a press operation on a first key on a keyboard connected to an electronic device, the target information with the latest selected time among the multiple target information items is switched from a highlighted state to a default display state.

[0079] For example, taking a desktop computer running Windows as an example, a mobile phone emulator can be run on the desktop computer. For instance, a user can install a mobile application (e.g., a news application) in the emulator. When the user clicks on the icon of the news application displayed in the emulator, the application can be simulated and run, displaying multiple trending news headlines. The user can select news headlines of interest by holding down the Ctrl key on the keyboard connected to the desktop and dragging the mouse. For example, if the user selects news headline 1 and news headline 2, and then finds they are not interested in news headline 2, they can press the Esc key. Receiving the Esc key press will toggle news headline 2 from selected to unselected. For example, it can switch news headline 2 from highlighted to its default display state, or remove the underline displayed below news headline 2. In other words, the user can undo the selection of news headlines by pressing the Esc key.

[0080] It should be noted that when there are multiple target information items, two adjacent target information items can be merged. For example, two adjacent target information items can be merged into a large selection area. In this way, when a subsequent undo operation is received for that selection area, the two target information items in that selection area can be switched from the highlighted state to the default display state at the same time.

[0081] In other embodiments, the information selection operation described above can be implemented using a keyboard and mouse connected to an electronic device, see [link to relevant documentation]. Figure 4 , Figure 4 This is a second flowchart illustrating the information processing method provided in the embodiments of this application, as shown below. Figure 4 As shown, Figure 3 Step 102 shown can be achieved through Figure 4 The implementation of steps 1021 and 1022 shown will be combined with Figure 4 The steps shown are explained.

[0082] In step 1021, in response to pressing a second key on the keyboard and dragging a mouse, the mouse pointer corresponding to the mouse is controlled to move synchronously in the second operation interface.

[0083] In some embodiments, step 1021 can be implemented as follows: in response to a pressing operation on a second key on the keyboard, a first prompt message is displayed in the second operation interface, wherein the first prompt message can be used to indicate that information can be selected by dragging the mouse; in response to a dragging operation on the mouse, the mouse pointer corresponding to the mouse is controlled to move synchronously in the second operation interface.

[0084] For example, taking a laptop running Windows as an example, a mobile phone emulator can be run on the laptop. Users can experience mobile applications on the laptop through the emulator. For instance, a user can launch a news application on the emulator. When browsing news and wanting to select a headline, the user can press the Ctrl key on the keyboard connected to the laptop. Upon receiving the Ctrl key press, a first prompt message appears in the emulator's interface, indicating that the headline can be selected by dragging the mouse. When the user drags the mouse connected to the laptop, the mouse pointer moves synchronously in the emulator's interface. For example, dragging the mouse to the left moves the pointer to the left, and dragging it to the right moves it to the right. In other words, the user can select multiple, non-contiguous headlines by holding down the Ctrl key and dragging the mouse.

[0085] It should be noted that keyboards can be externally connected to electronic devices or built into them. For example, for laptops, the keyboard can be built into the laptop, and for desktop computers, the keyboard can be externally connected to the desktop computer. For example, the keyboard can connect to the desktop computer via wired communication (such as a physical cable) or wireless communication (such as Bluetooth).

[0086] In other embodiments, following the examples above, the above-mentioned response to pressing a second key on the keyboard and displaying a first prompt message in the second operation interface can be achieved by: detecting the keyboard through a keyboard hook built into the operating system of the electronic device; when the keyboard hook detects that the second key on the keyboard has been pressed, displaying the first prompt message in the second operation interface.

[0087] For example, continuing with a laptop running a Windows operating system, the Windows operating system may have a built-in keyboard hook. This hook can be used to detect keyboard events, focusing on capturing the state changes of the Ctrl and Esc keys. When the keyboard hook detects that the Ctrl key on the laptop's built-in keyboard has been pressed, a first prompt message can be displayed on the interface of the mobile phone emulator running on the laptop. This prompt message can indicate to the user that they can select information (such as text selection, image selection, etc.) by dragging the mouse. In other words, the keyboard hook can detect whether the user has pressed the Ctrl key. When the keyboard hook detects that the user has pressed the Ctrl key, it can enter an unbounded selection mode, where the user can freely select the desired information by dragging the mouse. In some embodiments, following the above examples, the above-mentioned response to a drag operation of the mouse, controlling the mouse pointer corresponding to the mouse to move synchronously in the second operating interface, can be achieved in the following way: the mouse is detected by a mouse hook built into the operating system of the electronic device, wherein the operating system may include a mouse pointer corresponding to the mouse; in response to a drag operation of the mouse, the drag trajectory of the mouse is obtained through the mouse hook, and the mouse pointer is controlled to move synchronously in the second operating interface according to the drag trajectory. For example, assuming the user drags the mouse to the left, the mouse pointer can be controlled to move synchronously to the left in the second operating interface.

[0088] For example, continuing with a laptop running a Windows operating system, the Windows operating system can have a built-in mouse hook. This mouse hook can detect dragging, clicking, and releasing events of the mouse connected to the laptop. For instance, when the mouse hook detects that the mouse is being dragged, it can obtain the dragging trajectory and then control the mouse pointer to move synchronously along that trajectory within the operating interface of a mobile phone emulator running on the laptop. For example, if the user drags the mouse to the left, the mouse pointer can be controlled to move synchronously to the left within the mobile phone emulator's operating interface; similarly, if the user drags the mouse to the right, the mouse pointer can be controlled to move synchronously to the right within the mobile phone emulator's operating interface. In other words, this embodiment of the application can detect mouse dragging events using a mouse hook and control the mouse pointer to move synchronously along the dragging trajectory within the operating interface of a mobile phone emulator.

[0089] In other embodiments, following the examples above, when the mouse pointer is detected to be outside the second operation interface by the mouse hook, a second prompt message can be displayed in the second operation interface. The second prompt message can be used to prompt the user to move the mouse pointer to the second operation interface.

[0090] For example, continuing with the example of a laptop running a Windows operating system, the Windows operating system can have a built-in mouse hook. When the mouse hook detects that the mouse pointer is not in the operating interface of the mobile phone emulator running on the laptop (for example, due to the user dragging the mouse too much, causing the mouse pointer to leave the operating interface of the mobile phone emulator), a second prompt message can be displayed in the operating interface of the mobile phone emulator. The second prompt message can be used to prompt the user to move the mouse pointer to the operating interface of the mobile phone emulator, thus avoiding invalid operations.

[0091] In step 1022, the information traversed by the movement trajectory of the mouse pointer is used as the selected target information, and the target information is highlighted in the second operation interface.

[0092] In some embodiments, step 1022 can be implemented in the following way: the multiple pieces of information that the multiple discontinuous movement trajectories of the mouse pointer pass through are determined as multiple selected target information, and the multiple target information is highlighted in the second operation interface (for example, the multiple target information can be highlighted, or an underline can be displayed below the multiple target information, etc.).

[0093] For example, taking a mobile phone emulator as an example, a mobile application can be simulated and run within it. This application could be developed based on the Android operating system specifications, such as a mobile news application. Specifically, a mobile news application can be installed on the emulator. When a user clicks on the app's icon, the application can be launched within the emulator. For instance, the emulator can display the app's homepage, which may include multiple trending news headlines (i.e., a news feed). Users can select news headlines of interest while browsing. For example, users can hold down the Ctrl key on a keyboard connected to an electronic device (such as a laptop) and drag the mouse to select multiple headlines. While holding down the Ctrl key and dragging the mouse, the mouse pointer will move synchronously within the emulator's interface. Next, the multiple news headlines that the mouse pointer moves through in different segments can be identified as the selected news headlines. These selected news headlines are then highlighted in the mobile emulator's interface. For example, the selected news headlines can be highlighted, or underlines can be displayed below them. In this way, users can use their most familiar PC skills (holding down the Ctrl key on the keyboard and dragging the mouse) to select news headlines at will (e.g., selecting multiple segments or non-continuous news headlines). At the same time, users can receive immediate visual feedback that meets their expectations. Throughout the entire process, users are almost unaware of the presence of the mobile emulator, achieving a truly seamless experience.

[0094] In other embodiments, the second operation interface described above can be the operation interface of an application running in a simulator. In this case, the information traversed by the movement trajectory of the mouse pointer can be used as the selected target information in the following way: obtain the view hierarchy tree of the application; traverse the view hierarchy tree to obtain multiple components included in the application; determine the components traversed by the movement trajectory of the mouse pointer among the multiple components, and determine the information displayed on the traversed components as the selected target information.

[0095] For example, taking a mobile phone emulator as an example, a mobile application can be simulated and run within it. This application could be developed based on the Android operating system specifications. Specifically, a mobile news application could be installed on the emulator. When a user clicks on the app's icon, the emulator can launch the app and display its homepage. This homepage could include multiple trending news headlines (i.e., a news feed). Users can select news headlines of interest while browsing. For example, users can hold down the Ctrl key on a keyboard connected to an electronic device (e.g., a laptop) and drag the mouse to select multiple headlines. While holding down the Ctrl key and dragging the mouse, the mouse pointer will move synchronously within the emulator's interface. At this point, the mobile emulator will recognize the interface structure of the news application on the mobile device and identify selectable text elements. For example, it can first obtain the view hierarchy tree of the news application, then traverse the view hierarchy tree to obtain all the text components included in the news application. Subsequently, it can determine the text components that the mouse pointer's movement path passes through from these text components, and determine the news title displayed on the text component that the mouse pointer's movement path passes through as the selected news title. For example, if the user drags the mouse for the first time and the mouse pointer's movement path passes through text component 1, then the news title displayed on text component 1 (e.g., news title 1) can be selected as the news title. For example, news title 1 can be highlighted, or an underline can be displayed below news title 1. If the user drags the mouse for the second time and the mouse pointer's movement path passes through text component 2, then the news title displayed on text component 2 (e.g., news title 2) can be selected as the news title. For example, news title 2 can be highlighted, or an underline can be displayed below news title 2. In other words, the multiple news headlines displayed on multiple text components that the user selects can be obtained by observing the movement paths of multiple mouse pointers as the user drags the mouse multiple times.

[0096] In some embodiments, following the above example, the determination of the components traversed by the movement trajectory of the mouse pointer among multiple components can be achieved in the following manner: obtaining multiple coordinates corresponding to the multiple components in the second operation interface; comparing the coordinates included in the movement trajectory of the mouse pointer with the multiple coordinates corresponding to the multiple components; and determining the components whose coordinates are the same as those included in the movement trajectory of the mouse pointer as the components traversed by the movement trajectory of the mouse pointer.

[0097] For example, continuing from the previous example, let's take a news application running on a mobile emulator as an example. After traversing the view hierarchy tree of the news application and identifying all the text components included in the application, we can also obtain the coordinates of each text component in the emulator's interface. Next, we can compare the coordinates of the mouse pointer's movement path with the coordinates of each text component. If the coordinates of the mouse pointer's movement path match the coordinates of a certain text component, then that text component can be identified as one of the text components traversed by the mouse pointer's movement path. For example, assuming that a certain coordinate in the mouse pointer's movement path matches the coordinates of text component 1, then text component 1 can be identified as one of the text components traversed by the mouse pointer's movement path.

[0098] It should be noted that the above-mentioned information selection operation can be implemented not only through a keyboard and mouse connected to an electronic device, but also through other input devices connected to the electronic device, such as a touchpad or a gamepad. For example, a user can select the target information of interest from the simulator's operation interface by sliding the touchpad, or a user can select the target information of interest from the simulator's operation interface by shaking the gamepad. This application embodiment does not specifically limit this.

[0099] In step 103, the target information is displayed in the clipboard of the first operation interface.

[0100] Here, the clipboard can be displayed either before or after the user selects the target information.

[0101] In some embodiments, when there are multiple selected target information items, step 103 can be implemented in the following way: multiple target information items are spliced ​​together according to a preset format to obtain spliced ​​information; the clipboard is displayed in the first operation interface, and the spliced ​​information is displayed in the clipboard.

[0102] For example, taking a laptop running Windows as an example, a mobile phone emulator can be run on the laptop. Users can experience mobile applications on the laptop through the emulator. For instance, a user can launch a mobile news application in the emulator. Specifically, when the user clicks on the icon of the mobile news application displayed in the emulator, the application can be simulated to run, displaying multiple trending news headlines. The user can then select news headlines of interest from the emulator by holding down the Ctrl key and dragging the mouse. After selecting multiple news headlines, they can be concatenated to obtain a combined headline. The clipboard on the laptop's interface will then display the combined headline. In other words, multiple news headlines selected by the user from the emulator can be concatenated and transferred to the computer's clipboard for convenient use on the computer, such as pasting directly into applications like Word.

[0103] In other embodiments, step 103 above can also be implemented in the following way: in response to a copy operation on the target information, a clipboard is displayed in the first operation interface and the target information is displayed in the clipboard. The copy operation may include: pressing a preset combination key (e.g., Ctrl+C) on a keyboard connected to an electronic device, or triggering a copy control displayed in the second operation interface.

[0104] For example, continuing with the example of a desktop computer running a Windows operating system, a mobile phone emulator can be running on the desktop computer. Users can experience mobile applications (e.g., news and information applications) through the emulator. Users can select news headlines of interest from the news feed displayed on the mobile emulator by holding down the Ctrl key on the keyboard connected to the desktop computer and dragging the mouse. After selection, users can copy the headlines by pressing Ctrl+C on the keyboard, or by clicking the copy button displayed in the mobile emulator's interface (e.g., a copy button floating above a selected news headline). Then, a clipboard can be displayed on the desktop computer's interface, showing the news headlines selected by the user from the mobile emulator. For example, multiple news headlines selected by the user can be displayed in separate lines in the clipboard, or multiple news headlines selected by the user can be concatenated and the concatenated headline can be displayed in the clipboard. This embodiment does not specifically limit this approach.

[0105] It should be noted that when the target information is address text, after the address text selected by the user from the simulator is displayed in the clipboard of the first operation interface, a map application can be automatically launched on the electronic device, and the address text can be sent to the launched map application; when the target information is product name, after the product name selected by the user from the simulator is displayed in the clipboard of the first operation interface, a shopping application can be automatically launched on the electronic device, and the product name can be sent to the launched shopping application.

[0106] In some embodiments, a data transmission channel may be established between the electronic device and the simulator. Before performing step 103 above, the following process may also be performed: receiving target information sent by the simulator through the data transmission channel, and calling the clipboard's application programming interface to write the received target information into the clipboard.

[0107] It should be noted that before sending target information to electronic devices, the simulator can also encode the target information and send the encoded target information to the electronic devices through the data transmission channel to save resources.

[0108] For example, taking a laptop running a Windows operating system as an example, a mobile phone emulator can be running on the laptop, and a data transmission channel can be established between the laptop and the emulator. For instance, an ADB channel can be established between the laptop and the emulator. ADB stands for Android Debug Bridge, a command-line debugging tool in the Android operating system's Software Development Kit (SDK). It adopts a client-server-daemon architecture and uses the Transmission Control Protocol (TCP) port to achieve communication between the development machine and the Android device. After the user selects target information (e.g., a news headline of interest) from the emulator, the emulator can send the selected news headline to the laptop through the established ADB channel. Upon receiving the news headline from the emulator, the laptop can call the clipboard API to write the received news headline to the clipboard. Thus, the user can directly see the news headline selected in the emulator in the clipboard displayed on the laptop's interface, and then directly paste the selected news headline into applications such as Word.

[0109] It's worth noting that, in addition to establishing an ADB channel between the laptop and the mobile emulator, a direct TCP connection can also be established between the laptop and the mobile emulator as a high-performance backup. Data transmission can be maintained via the TCP connection in case the ADB channel fails.

[0110] Furthermore, it should be noted that the aforementioned data transmission channel is bidirectional. This means that the simulator can send target information to the electronic device via the data transmission channel, and the electronic device can also send information selected by the user on the electronic device to the simulator via the data transmission channel. For example, when the electronic device detects that the user has dragged the third target information displayed in the first operation interface to the second operation interface, it can send the third target information to the simulator via the aforementioned data transmission channel. After receiving the third target information, the simulator can display it in the second operation interface.

[0111] In other embodiments, the simulator may also perform the following processes before sending the target information to the electronic device: downloading the target information; and generating an image of the target information by taking a screenshot when the target information cannot be downloaded.

[0112] For example, taking a laptop running Windows as an example, a mobile phone emulator can be run on the laptop. Users can experience mobile applications (e.g., news apps) on the laptop through the emulator. For instance, a user can install a mobile news app on the emulator. When the user clicks on the app's icon displayed in the emulator, the app can be simulated to run. The emulator can then display the app's homepage, showing multiple trending news headlines. The user can select a headline of interest. After selection, the emulator can download the chosen headline. For headlines that cannot be downloaded, the emulator can generate an image of the headline by taking a screenshot. The emulator can then send the selected headline or its image to the laptop via a pre-established data transmission channel (e.g., ADB channel). After receiving a news title or image from a mobile phone emulator, the laptop can call the clipboard API to write the received news title or image to the clipboard. In this way, the user can directly see the news title selected from the mobile phone emulator in the laptop's clipboard.

[0113] In some embodiments, when the number of emulators running in the electronic device is multiple, see [reference needed]. Figure 5 , Figure 5 This is a schematic diagram of the third process of the information processing method provided in the embodiments of this application, as shown below. Figure 5 As shown, Figure 3 Step 103 shown can be achieved through Figure 5 Steps 1031 to 1034 shown are implemented, and will be combined with Figure 5 The steps shown are explained.

[0114] In step 1031, multiple target information sent by multiple simulators are received.

[0115] Here, one simulator corresponds to one second operation interface, and the types of multiple target information can be the same or different.

[0116] In some embodiments, taking a laptop running a Windows operating system as an example, a user can install multiple emulators simultaneously on the laptop, for example, three emulators: Emulator 1, Emulator 2, and Emulator 3. The user can launch these three emulators simultaneously, and the laptop's interface will display three corresponding user interfaces for each emulator. The user can select information of interest from these three user interfaces. For example, if Emulator 1 simulates a mobile news application, the user can select news headlines of interest; if Emulator 2 simulates a mobile shopping application, the user can select images of products of interest; and if Emulator 3 simulates a mobile Q&A application, the user can select answers of interest. Subsequently, simulator 1 can transmit the news headlines selected by the user from simulator 1 to the laptop via a pre-established data transmission channel (e.g., an ADB channel). Similarly, simulator 2 can transmit the images of the products selected by the user from simulator 2 to the laptop via a pre-established ADB channel. Simulator 3 can transmit the answers selected by the user from simulator 3 to the laptop via a pre-established ADB channel.

[0117] In step 1032, multiple target information is deduplicated to obtain multiple target information after deduplication.

[0118] In some embodiments, taking three simulators as an example, assuming they are simulator 1, simulator 2, and simulator 3, the user can select target information of interest (e.g., news headlines) from simulator 1, simulator 2, and simulator 3 respectively. After receiving multiple news headlines sent by the three simulators, the received news headlines can be deduplicated to obtain multiple deduplicated news headlines.

[0119] In step 1033, the multiple target information after deduplication are spliced ​​together according to a preset format to obtain the spliced ​​information.

[0120] In some embodiments, continuing from the previous text, we will take three emulators as an example. After deduplicating the multiple news titles sent by the three emulators, we can further concatenate the deduplicated news titles according to a preset format to obtain a concatenated news title.

[0121] In step 1034, the spliced ​​information is displayed in the clipboard of the first operation interface.

[0122] In some embodiments, following the above, after obtaining the spliced ​​news headline, a clipboard can be displayed on an electronic device (such as a laptop running the Windows operating system), and the spliced ​​news headline can be displayed in the clipboard, thus making it convenient for users to read.

[0123] The following will describe an exemplary application of the embodiments of this application in a real-world application scenario.

[0124] Currently, running mobile applications on Windows computers via emulators has become a common need. When users need to copy text from applications within the emulator (such as news reading applications, document readers, web browsers, etc.) to their computer, they typically rely on the clipboard synchronization function provided by the emulator itself, and can only copy consecutive content at a time.

[0125] In view of this, embodiments of this application provide an information processing method, proposing an "unbounded space" interaction concept, aiming to break down the interaction barriers between mobile applications running in Windows operating system emulators and the host PC environment, specifically including: 1) Unbounded interaction events: In this embodiment, the keyboard, mouse and other peripheral input events on the PC are intelligently associated and interpreted with the complex text layout view of the mobile application in the emulator to create a seamless interaction channel.

[0126] 2) Unbounded content space: This application embodiment accurately identifies multiple non-continuous text paragraphs that cross scrolling areas by real-time parsing of the view hierarchy structure of the mobile application, and merges these content spaces that were originally independent on the mobile device into a continuous unbounded selection area under the PC interaction logic.

[0127] 3) Unbounded data flow: This application embodiment establishes an efficient and low-latency data transmission channel to directly transmit the selected and processed formatted text content in the simulator to the clipboard on the PC, which can be used by any PC application, realizing seamless cross-terminal data flow.

[0128] In other words, the embodiments of this application provide an efficient cross-platform text selection scheme that conforms to the keyboard and mouse operation habits of PC users. It supports flexible text selection across multiple paragraphs, non-continuous text, and scrolling areas within the emulator. It also provides a user-friendly interactive experience with real-time visual feedback and undoable operation. Furthermore, it enables one-click seamless transfer of selected content to the clipboard on the PC.

[0129] The information processing method provided in the embodiments of this application will be described in detail below.

[0130] In some embodiments, see Figure 6 , Figure 6 This is a schematic diagram of the information processing method provided in the embodiments of this application, such as... Figure 6 As shown, when a user wants to copy multiple paragraphs of text while browsing a mobile application (such as a web browser) within the emulator, they can hold down the Ctrl key on the keyboard to enter "unbounded selection" mode. In this mode, the user can drag the mouse to freely select the paragraphs they want to copy. When a paragraph is selected, it can be highlighted. The user can also press the Esc key to undo the selection of the most recently selected paragraphs. When the user stops selecting paragraphs, they can release the Ctrl key. The text selected in the emulator will then be instantly transferred to the clipboard on the PC, allowing the user to directly paste the selected text into PC applications such as Word.

[0131] As can be seen, the technical solution provided in this application embodiment is linear and natural throughout the entire process. Users use their most familiar PC skills (hold down the Ctrl key and slide the mouse to select), and the system provides the expected feedback in real time. When the operation ends, the required content has already appeared in the clipboard on the PC. Throughout the process, users can hardly perceive the existence of the emulator, achieving a truly boundless experience.

[0132] For example, see Figure 7 , Figure 7This is a schematic diagram illustrating an application scenario of the information processing method provided in the embodiments of this application, such as... Figure 7 As shown, the PC's operation interface 701 displays the emulator's operation interface 702, which shows webpage content presented by a web browser (e.g., multiple headlines of popular news articles). When a user wants to copy multiple paragraphs of text from the webpage content, they can hold down the Ctrl key on the PC's built-in keyboard to enter bounded selection mode. For example, a user can select multiple paragraphs of text (e.g., multiple news headlines) by holding down the Ctrl key and dragging the mouse. An underline will appear below the selected text to remind the user. When the user stops selecting, they can release the Ctrl key and use the Ctrl+C key to copy, or they can right-click on a selected paragraph to bring up the copy button. At this time, the clipboard 703 will be displayed on the PC's operation interface 701, showing the text content selected by the user from the emulator. Thus, the user can directly paste the text into applications such as Word without waiting.

[0133] It's worth noting that when the mouse pointer hovers over text while the user is dragging the mouse, the highlighted area intelligently aligns with paragraph boundaries rather than simply forming a rectangular selection. This avoids selecting irrelevant text. Furthermore, when a user selects adjacent areas consecutively, they are automatically merged into a large, continuous selection, ensuring the final text flows smoothly. Additionally, each drag and release creates an independent selection, which can be undoed by pressing the Esc key. For example, when the Esc key is detected, the most recently selected text can be unselected. This gives users the opportunity to undo their selections, encouraging them to experiment boldly without worrying about having to start over due to minor mistakes.

[0134] The following continues... Figure 8 The information processing method provided in the embodiments of this application will be described.

[0135] In some embodiments, see Figure 8 , Figure 8 This is a schematic diagram illustrating the principle of the information processing method provided in the embodiments of this application, such as... Figure 8As shown, the Windows Event Detection Service resides in the Windows host environment and is used to globally capture user keyboard and mouse input events. This includes keyboard hooks and mouse hooks. The keyboard hook uses the `SetWindowsHookEx(WH_KEYBOARD_LL)` function to detect system-level keyboard events, focusing on capturing the state changes of the Ctrl and Esc keys. The mouse hook uses `SetWindowsHookEx(WH_MOUSE_LL)` to detect mouse movement, click, and release events. Furthermore, the mouse hook can intelligently determine whether mouse operations occur within the emulator's window area, avoiding invalid event handling. The event detection proxy module resides within the emulator and is primarily used to receive and forward events from the Windows host environment to the emulator's internal processing system. For example, it can establish a connection with the Windows host environment via local sockets or named pipes, converting native Windows events into a unified event format within the emulator. It can also use non-blocking I / O to process the event stream, ensuring real-time response. The content parsing engine, located within the simulator, is primarily used to analyze the interface structure of mobile applications and identify selectable text elements. Specifically, it can register with the system-level Accessibility Service to obtain the complete view hierarchy tree of third-party applications (such as mobile applications) running in the simulator. Then, it can traverse the obtained view hierarchy tree to identify all TextView components and their sub-components. Subsequently, it can extract the boundary coordinates and text content of each text element and intelligently handle text positioning within scrollable containers such as ScrollView and RecyclerView. The selection controller, also located within the simulator, is the system's control center, responsible for managing the state and logic of the entire selection process. It supports selection logic for non-contiguous paragraphs and can sort by selection order or layout order. Furthermore, the selection controller can maintain an operation history stack, supporting multi-level undo. For example, the stack can be popped using the Esc key on the keyboard to restore the previous state. The visual feedback module is located within the simulator and is used to provide users with real-time visual feedback, displaying the current selection status. For example, it can create a transparent window of type TYPE_APPLICATION_OVERLAY, and can also draw a semi-transparent highlighted area based on the selection coordinates in onDraw(), thereby achieving smooth animation and status prompts during the selection process.The cross-platform transmission proxy module resides within the emulator and is used to establish a data transmission channel between the emulator and the Windows host environment. For example, it can use the `adbshell am broadcast` command to send text data to the Windows host environment. It can also establish a direct TCP connection as a high-performance backup solution. Before sending text data, it can perform UTF-8 encoding and formatting. The ADB and Socket services reside in the Windows host environment and are used to receive text data sent by the emulator and write it to the clipboard. Specifically, the ADB and Socket services can run in the background. After receiving text data from the emulator, they can call Windows operating system APIs such as `OpenClipboard()` and `SetClipboardData()` to write the received text data to the clipboard. It supports various clipboard formats, including plain text and HTML. It also supports multiple emulator instances transmitting text data simultaneously, meaning it can concurrently process multiple text data sent by multiple emulators.

[0136] In other embodiments, this application may also provide a system for implementing the above solution, including: an interaction detection module, used to detect mouse drag events in real time and determine whether the drag trajectory exceeds the application window boundary; a resource parsing module, used to parse the text element corresponding to the drag point and attempt to extract resource links and types; a content acquisition module, used to acquire resources by performing a screenshot operation and save them to a preset directory on the PC when resources are not downloadable; a download module, used to process image and video download tasks and save resources to the emulator's disk; and a file transfer module, used to transfer resource files from the emulator's disk to the PC's hard drive directory.

[0137] In summary, the technical solutions provided by the embodiments of this application have the following beneficial effects: By establishing an interactive channel of "boundless space," the operational barriers between the PC environment and the Android emulator are completely eliminated, freeing users from the cumbersome and fragmented text selection logic of mobile devices. This significantly improves the efficiency of cross-platform content acquisition and user experience. Users can efficiently and accurately select multiple non-contiguous text segments in the emulator using familiar PC keyboard and mouse operations (such as holding down the Ctrl key on the keyboard and dragging the mouse), and enjoy smooth interaction with real-time visual feedback and operation undo. Ultimately, this achieves a convenient workflow of "one-click copy and seamless paste" to any application on the PC, greatly optimizing productivity in scenarios such as academic research and data organization.

[0138] The following description continues to illustrate the exemplary structure of the information processing device 555 provided in the embodiments of this application as a software module. In some embodiments, such as Figure 2As shown, the software modules stored in the information processing device 555 in the memory 550 may include: a display module 5551.

[0139] Display module 5551 is used to display a second operation interface in a first operation interface, wherein the first operation interface is the operation interface of an electronic device, and the second operation interface is the operation interface of an emulator running in the electronic device; display module 5551 is also used to highlight the selected target information in the second operation interface in response to an information selection operation triggered in the second operation interface; display module 5551 is also used to display the target information in the clipboard of the first operation interface.

[0140] In some embodiments, the second operation interface displays an information stream; the display module 5551 is further configured to, in response to multiple information selection operations triggered in the second operation interface, highlight multiple target information selected in the information stream in the second operation interface, wherein one information selection operation corresponds to one target information.

[0141] In some embodiments, after the display module 5551 highlights multiple selected target information in the information stream in the second operation interface in response to multiple information selection operations triggered in the second operation interface, it is further configured to switch the first target information from the highlighted state to the default display state in response to the undo selection operation triggered for the first target information, wherein the first target information is any one of the multiple target information.

[0142] In some embodiments, the deselection operation is implemented through a keyboard and mouse connected to an electronic device; the display module 5551 is further configured to switch the first target information from a highlighted state to a default display state in response to controlling the mouse pointer corresponding to the mouse to move to the position of the first target information and receiving a pressing operation on the first key on the keyboard, wherein the highlighted state indicates that the first target information is selected, and the default display state indicates that the first target information is not selected.

[0143] In some embodiments, after the display module 5551 highlights multiple selected target information in the information stream in the second operation interface in response to multiple information selection operations triggered in the second operation interface, it is further configured to switch the second target information from the highlighted state to the default display state in response to a pressing operation on the first key on the keyboard connected to the electronic device, wherein the second target information is the target information selected latest among the multiple target information.

[0144] In some embodiments, the information processing device 555 further includes a splicing module 5552, which is used to splice multiple target information according to a preset format to obtain spliced ​​information; and a display module 5551, which is used to display a clipboard in the first operation interface and display the spliced ​​information in the clipboard.

[0145] In some embodiments, the information selection operation is implemented through a keyboard and mouse connected to an electronic device; the information processing device 555 further includes a control module 5553 and a determination module 5554, wherein the control module 5553 is used to control the mouse pointer corresponding to the mouse to move synchronously in the second operation interface in response to a pressing operation of a second key on the keyboard and a dragging operation of the mouse; the determination module 5554 is used to take the information traversed by the movement trajectory of the mouse pointer as the selected target information; the display module 5551 is also used to highlight the target information in the second operation interface.

[0146] In some embodiments, the display module 5551 is further configured to display a first prompt message in the second operation interface in response to a pressing operation of a second key on the keyboard, wherein the first prompt message is used to prompt information selection by dragging the mouse; the control module 5553 is further configured to control the mouse pointer corresponding to the mouse to move synchronously in the second operation interface in response to a dragging operation of the mouse.

[0147] In some embodiments, the information processing device 555 further includes a detection module 5555 for detecting the keyboard through a keyboard hook built into the operating system of the electronic device; and a display module 5551 for displaying a first prompt message in a second operation interface when the second key on the keyboard is detected to be pressed through the keyboard hook.

[0148] In some embodiments, the detection module 5555 is further configured to detect the mouse via a mouse hook built into the operating system running on the electronic device, wherein the operating system includes a mouse pointer corresponding to the mouse; the information processing device 555 further includes an acquisition module 5556 configured to acquire the drag trajectory of the mouse via the mouse hook in response to a drag operation on the mouse; the control module 5553 is further configured to control the mouse pointer to move synchronously in the second operating interface according to the drag trajectory.

[0149] In some embodiments, the display module 5551 is further configured to display a second prompt message in the second operation interface when the mouse pointer is detected to be outside the second operation interface by the mouse hook, wherein the second prompt message is used to prompt the mouse pointer to be moved to the second operation interface.

[0150] In some embodiments, the determining module 5554 is further configured to determine the multiple pieces of information that the multiple discontinuous movement trajectories of the mouse pointer pass through as the multiple selected target information; the display module 5551 is further configured to highlight the multiple target information in the second operation interface.

[0151] In some embodiments, the second operation interface is the operation interface of an application running in a simulator; the acquisition module 5556 is further configured to acquire the view hierarchy tree of the application; the information processing device 555 further includes a traversal module 5557 configured to traverse the view hierarchy tree to obtain multiple components included in the application; the determination module 5554 is further configured to determine the components through which the movement trajectory of the mouse pointer passes among the multiple components, and determine the information displayed on the passed components as the selected target information.

[0152] In some embodiments, the determining module 5554 is further configured to obtain multiple coordinates corresponding to multiple components in the second operation interface; compare the coordinates included in the movement trajectory of the mouse pointer with the multiple coordinates corresponding to the multiple components; and determine the components whose coordinates are the same as those included in the movement trajectory as the components traversed by the movement trajectory of the mouse pointer.

[0153] In some embodiments, the display module 5551 is further configured to display a first operation interface, wherein the first operation interface includes an icon of the simulator; in response to a trigger operation on the icon, the simulator is started, and a second operation interface is displayed in the first operation interface.

[0154] In some embodiments, the display module 5551 is further configured to display a plurality of second operation interfaces in the first operation interface; the display module 5551 is further configured to display a plurality of target information selected from the plurality of second operation interfaces in the clipboard of the first operation interface.

[0155] In some embodiments, the splicing module 5552 is further configured to splice multiple target information selected from multiple second operation interfaces to obtain spliced ​​information; the display module 5551 is further configured to display a clipboard in the first operation interface and display the spliced ​​information in the clipboard.

[0156] In some embodiments, the information processing device 555 further includes a receiving module 5558, which is used to receive multiple target information sent by multiple simulators respectively, wherein one simulator corresponds to one second operation interface; the information processing device 555 further includes a deduplication module 5559, which is used to perform deduplication processing on the multiple target information to obtain multiple target information after deduplication; the splicing module 5552 is further used to splice the multiple target information after deduplication according to a preset format to obtain spliced ​​information.

[0157] In some embodiments, the display module 5551 is further configured to display a clipboard in a first operation interface and display the target information in the clipboard in response to a copy operation on the target information, wherein the copy operation includes: pressing a preset combination key on a keyboard connected to an electronic device, and triggering a copy control displayed in a second operation interface.

[0158] In some embodiments, a data transmission channel is established between the electronic device and the simulator; before the display module 5551 displays the target information in the clipboard of the first operation interface, the receiving module 5558 is also used to receive the target information sent by the simulator through the data transmission channel; the information processing device 555 further includes a writing module 55510, which is used to call the application programming interface of the clipboard to write the target information into the clipboard.

[0159] In some embodiments, before sending the target information to the electronic device, the simulator is also used to perform the following processes: downloading the target information; and generating an image of the target information by taking a screenshot when the target information cannot be downloaded.

[0160] It should be noted that the description of the apparatus in this application embodiment is similar to the description of the method embodiment above, and has similar beneficial effects as the method embodiment; therefore, it will not be repeated. For any technical details not covered in the information processing apparatus provided in this application embodiment, please refer to... Figure 3 , Figure 4 ,or Figure 5 The meaning is understood in accordance with the description of any of the accompanying drawings.

[0161] This application provides a computer program product, which includes a computer program or computer-executable instructions. The processor of an electronic device reads the computer-executable instructions from a computer-readable storage medium, and executes the computer-executable instructions, causing the electronic device to perform the information processing method described in this application.

[0162] This application provides a computer-readable storage medium storing computer-executable instructions. When these computer-executable instructions are executed by a processor, they cause the processor to perform the information processing method provided in this application. For example, ... Figure 3 , Figure 4 ,or Figure 5 The information processing method shown.

[0163] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or it may be a variety of devices including one or any combination of the above-mentioned memories.

[0164] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0165] As an example, executable instructions can be deployed to execute on a single electronic device, or on multiple electronic devices located in one location, or on multiple electronic devices distributed across multiple locations and interconnected via a communication network.

[0166] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.

Claims

1. An information processing method, characterized in that, The method includes: The second operation interface is displayed in the first operation interface, wherein the first operation interface is the operation interface of the electronic device, and the second operation interface is the operation interface of the simulator running in the electronic device; In response to an information selection operation triggered in the second operation interface, the selected target information is highlighted in the second operation interface, and the target information is displayed in the clipboard of the first operation interface.

2. The method according to claim 1, characterized in that, The second operation interface displays an information stream; The step of highlighting the selected target information in the second operation interface in response to an information selection operation triggered in the second operation interface includes: In response to multiple information selection operations triggered in the second operation interface, multiple selected target information in the information stream are highlighted in the second operation interface, wherein each information selection operation corresponds to one target information.

3. The method according to claim 2, characterized in that, After highlighting multiple selected target information items in the information stream in the second operation interface in response to multiple information selection operations triggered in the second operation interface, the method further includes: In response to an undo selection operation triggered for the first target information, the first target information is switched from a highlighted state to a default display state, wherein the first target information is any one of the plurality of target information.

4. The method according to claim 3, characterized in that, The undo selection operation is performed using a keyboard and mouse connected to the electronic device; The step of switching the first target information from a highlighted state to a default display state in response to a deselection operation triggered on the first target information includes: In response to controlling the mouse pointer corresponding to the mouse to move to the position of the first target information and receiving a press operation on the first key on the keyboard, the first target information is switched from a highlighted state to a default display state, wherein the highlighted state indicates that the first target information is selected, and the default display state indicates that the first target information is not selected.

5. The method according to claim 2, characterized in that, After highlighting multiple selected target information items in the information stream in the second operation interface in response to multiple information selection operations triggered in the second operation interface, the method further includes: In response to a press operation on a first key on a keyboard connected to the electronic device, the second target information is switched from a highlighted state to a default display state, wherein the second target information is the target information with the latest selection time among the plurality of target information.

6. The method according to claim 1, characterized in that, The information selection operation is performed using a keyboard and mouse connected to the electronic device; The step of highlighting the selected target information in the second operation interface in response to an information selection operation triggered in the second operation interface includes: In response to a pressing operation on a second key on the keyboard and a dragging operation on the mouse, the mouse pointer corresponding to the mouse is controlled to move synchronously in the second operation interface; The information traced by the mouse pointer is used as the selected target information, and the target information is highlighted in the second operation interface.

7. The method according to claim 6, characterized in that, The control of the mouse pointer corresponding to the mouse to move synchronously in the second operation interface in response to a pressing operation of a second key on the keyboard and a dragging operation of the mouse includes: In response to a press operation on a second key on the keyboard, a first prompt message is displayed in the second operation interface, wherein the first prompt message is used to prompt information selection by dragging the mouse; In response to a drag operation on the mouse, the mouse pointer corresponding to the mouse is controlled to move synchronously in the second operation interface.

8. The method according to claim 7, characterized in that, The first prompt message displayed in the second operation interface in response to a press operation on a second key on the keyboard includes: The keyboard is detected by a keyboard hook built into the operating system running the electronic device; When the second key on the keyboard is detected to be pressed via the keyboard hook, a first prompt message is displayed in the second operation interface.

9. The method according to claim 7, characterized in that, The step of controlling the mouse pointer corresponding to the mouse to move synchronously in the second operation interface in response to a drag operation on the mouse includes: The mouse is detected by a built-in mouse hook in the operating system running the electronic device, wherein the operating system includes a mouse pointer corresponding to the mouse; In response to a drag operation on the mouse, the drag trajectory of the mouse is obtained through the mouse hook, and the mouse pointer is controlled to move synchronously in the second operation interface according to the drag trajectory.

10. The method according to claim 9, characterized in that, The method further includes: When the mouse pointer is detected to be outside the second operation interface by the mouse hook, a second prompt message is displayed in the second operation interface, wherein the second prompt message is used to prompt the mouse pointer to be moved to the second operation interface.

11. The method according to claim 6, characterized in that, The step of using the information traversed by the mouse pointer's movement trajectory as the selected target information and highlighting the target information in the second operation interface includes: The multiple pieces of information that the discontinuous movement trajectory of the mouse pointer passes through are identified as multiple selected target information, and the multiple target information are highlighted in the second operation interface.

12. The method according to claim 6, characterized in that, The second user interface is the user interface of the application running in the simulator. The step of using the information traversed by the mouse pointer's movement trajectory as the selected target information includes: Obtain the view hierarchy tree of the application; Traverse the view hierarchy tree to obtain the multiple components included in the application; The components through which the mouse pointer's movement trajectory passes are determined among the plurality of components, and the information displayed on the passed components is determined as the selected target information.

13. The method according to claim 1, characterized in that, Displaying the second operation interface in the first operation interface includes: Multiple second operation interfaces are displayed within the first operation interface; Displaying the target information in the clipboard of the first operation interface includes: The clipboard of the first operation interface displays multiple target information selected from the multiple second operation interfaces.

14. The method according to claim 13, characterized in that, The step of displaying multiple target information selected from the plurality of second operation interfaces in the clipboard of the first operation interface includes: Multiple target information selected from the multiple second operation interfaces are spliced ​​together to obtain spliced ​​information; The clipboard is displayed in the first operation interface, and the spliced ​​information is displayed in the clipboard.

15. The method according to claim 14, characterized in that, The step of concatenating multiple target information selected from the multiple second operation interfaces to obtain concatenated information includes: Receive multiple target messages sent by multiple simulators respectively, wherein each simulator corresponds to one second operation interface; The multiple target information items are deduplicated to obtain the multiple target information items after deduplication. Multiple sets of target information after deduplication are concatenated according to a preset format to obtain concatenated information.

16. The method according to any one of claims 1 to 15, characterized in that, A data transmission channel is established between the electronic device and the simulator; Before displaying the target information in the clipboard of the first operation interface, the method further includes: The system receives the target information sent by the simulator through the data transmission channel and calls the clipboard's application programming interface to write the target information into the clipboard.

17. An information processing device, characterized in that, The device includes: The display module is used to display a second operation interface in a first operation interface, wherein the first operation interface is the operation interface of the electronic device, and the second operation interface is the operation interface of the simulator running in the electronic device. The display module is also used to highlight the selected target information in the second operation interface in response to an information selection operation triggered in the second operation interface; The display module is also used to display the target information in the clipboard of the first operation interface.

18. An electronic device, characterized in that, include: Memory is used to store executable instructions for a computer; A processor, when executing computer-executable instructions stored in the memory, implements the information processing method according to any one of claims 1 to 16.

19. A computer-readable storage medium storing computer-executable instructions, characterized in that, When the computer-executable instructions are executed by the processor, they implement the information processing method according to any one of claims 1 to 16.

20. A computer program product comprising a computer program or computer-executable instructions, characterized in that, When the computer program or computer-executable instructions are executed by a processor, the information processing method according to any one of claims 1 to 16 is implemented.

Images