A method and apparatus for opening a file

Abstract

The application relates to a method and device for opening a file. A first device displays a first interface and projects the first interface on a second interface of a second device, the first interface comprises at least one file icon, the second interface comprises the first interface, and a file corresponding to the at least one file icon is stored in the first device. The first device detects an operation on the file icon. When the file icon is displayed on the first interface, the first device calls a first application to open the file; when the file icon is displayed on the second interface, the first device sends metadata of the file to the second device, and the metadata of the file is used to open the file on the second device. According to the application, the current focus of a user can be determined according to the operation of the user in the projection process, so that a corresponding device is selected to open the file, the user's viewing is more favorable, and the operation steps of the user are reduced.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a method and device for opening files. Background Technology

[0002] With the development of smart terminals, it is becoming increasingly common for a user to own multiple smart terminals, such as smartphones, tablets (PADs), or personal computers (PCs). The interconnectivity between these multiple devices provides users with a better experience.

[0003] Currently, to improve user experience, a multi-screen collaboration function (or multi-device collaboration function) is provided. With multi-screen collaboration, a file on one device can be opened on another. For example, in multi-screen collaboration between a mobile phone and a PC, the mobile phone's display interface will be shown on the PC's screen; this mobile phone display interface on the PC can be understood as the projection interface. When a user operates on the projection interface on the PC, for example, if the user selects to open file A, then file A will open on the PC. Similarly, if a user operates on the mobile phone, for example, if the user selects to open file B, then file B will open on the PC, but not on the mobile phone. Since the PC's screen is larger than the mobile phone's, viewing the file on the PC enhances the user's viewing experience.

[0004] As can be seen, in multi-screen collaboration scenarios, regardless of which device the user operates on during the collaboration, the result is always a response on one of those devices. For example, when collaborating between a phone and a PC, if a user tries to open a file on either the phone or the PC, the file will open on the PC, not the phone. However, if the user actually wants to view the content on the phone, this is currently impossible. The user must exit multi-screen collaboration mode to open and view the content on the phone, a process that requires multiple steps and is quite cumbersome. Summary of the Invention

[0005] This application provides a method and apparatus for opening files, which simplifies the process of opening files.

[0006] In a first aspect, a method for opening a file is provided, the method comprising: a first device and a second device entering a multi-screen collaboration mode via a preset method; the first device displaying a first interface and projecting the first interface onto a second interface of the second device, the first interface containing at least one file icon, the second interface including the first interface, and the file corresponding to the at least one file icon being stored on the first device; the first device detecting an operation applied to the file icon; the first device determining that the operation is applied to the display screen of the first device or the display screen of the second device; when the operation is applied to the display screen of the first device, the first device invoking a first application to open the file; when the operation is applied to the display screen of the second device, the first device sending the file's metadata to the second device, the file's metadata being used to open the file on the second device.

[0007] The method can be executed by a first device, such as a mobile device, such as a mobile phone, tablet computer (PAD), or portable computer; or the first device can be a device with a fixed location, such as a desktop computer with a relatively fixed location.

[0008] When a first device projects its screen onto a second device, in the current approach, if the user operates on the first device to open a file, that file should also open on the second device. However, in this embodiment, if the first device detects that the user's operation is applied to its display screen, the first device can open the file locally and will not open it on the second device. If the user's operation is applied to the first device's display screen, it indicates that the user may currently be using the first device, and opening the file on the first device is obviously more convenient for the user to view. Through the method provided in this embodiment, since the file can be opened on the first device, the user does not need to exit the multi-screen collaboration mode, and naturally, does not need to perform multiple steps, simplifying the file opening process and reducing the number of device responses, thus helping to reduce device power consumption. Moreover, if the first device determines that the user's operation is applied to the second device's display screen, it can also open the file on the second device. In other words, the method provided in this embodiment can determine the user's current focus based on their operation, thereby selecting the appropriate device to open the file, which is more beneficial for the user's viewing and avoids excessive user operations.

[0009] In one possible implementation, the method further includes:

[0010] The first device receives an update file from the second device, the update file being the updated first file;

[0011] The first device updates the locally stored file with the update file.

[0012] If a file is opened on a second device, the user can edit it on the second device, for example, modify it. After editing, the user can save the modified file on the second device; this modified file is called an updated file. The second device can then send the updated file to the first device, which can use it to update the original file stored on the first device, thus updating the file.

[0013] In one possible implementation, the first device detects an operation applied to the file icon, including:

[0014] The first device receives event information from the second device, the event information being used to indicate the operation, and the event information including the identifier of the second device.

[0015] If the user's action is applied to the display screen of the first device, the first device can directly capture the user's action, or in other words, the first device can capture the user's action event. Therefore, if the first device can capture the user's action, it can determine that the action is applied to the display screen of the first device. However, if the user's action is applied to the display screen of the second device, the first device cannot directly capture the user's action, but the second device can capture the user's action, or in other words, the second device can capture the user's action event, obtain the event information corresponding to the action event, and send the event information to the first device. This event information can indicate the action, or in other words, the event information can describe the action. The event information may include the identifier of the second device to indicate that the action corresponding to the event information is applied to the second device.

[0016] In one possible implementation, the first device determines that the operation applies to the display screen of the second device, including:

[0017] The first device determines, based on the identifier of the second device, that the operation is performed on the display screen of the second device.

[0018] For example, the event information may include the identifier of the second device, so that the first device, upon receiving the event information, can determine that the operation was performed on the display screen of the second device. Optionally, the event information may also include information such as the relative position coordinates of the operation within the first interface displayed on the second device, so that the first device can determine the file corresponding to the user's operation. In this way, the first device can determine the user's focus and thus select the device to open the file.

[0019] In one possible implementation, the first device sends the metadata of the file to the second device, including:

[0020] The first device synchronizes (or sends) the metadata of the file to the distributed file management system of the second device through the first device's distributed file management system.

[0021] Both the first and second devices can be equipped with a distributed file management system. This system, for example, can be used to manage files. It can also synchronize file-related information between the two devices, allowing the first device to synchronize file metadata. Of course, the first device can also send file metadata to the second device in other ways; there are no specific restrictions.

[0022] In one possible implementation, before the first device invokes the first application to open the file, the method further includes:

[0023] The first device outputs a prompt message, which includes one or more options, the one or more options being used to determine the device to open the file;

[0024] The first device detects an operation to select a first option among the one or more options, the first option corresponding to the first application.

[0025] In other words, even if the first device determines that the user's operation is applied to its own display screen, it can still output a prompt message allowing the user to choose which device to open the file on. If the user chooses to open the file on the first device, then the file will open on that device. This method makes the device for opening the file more aligned with the user's needs and more conducive to viewing.

[0026] In one possible implementation,

[0027] When the operation is applied to the display screen of the first device, the first device outputs a prompt message, which includes one or more options, the one or more options being used to determine the device to open the file;

[0028] The first device detects an operation to select a second option from the one or more options, the second option indicating that the file be opened on the second device;

[0029] The first device sends the file's metadata to the second device, and the file's metadata is used to open the file on the second device.

[0030] Even if the first device determines that the user's operation is applied to its display screen, the first device can still output a prompt message allowing the user to choose which device to open the file on. If the user chooses to open the file on a second device, then the file will be opened on the second device according to the user's choice. For example, sometimes a user may be operating on the first device but actually wants to display the corresponding file to other users on a second device. In such a scenario, the technical solution provided in this application allows the user to choose to open the file on a portable computer, thus completing the display process. Therefore, the technical solution provided in this application provides users with a choice, making it easier for them to select the appropriate device to open the corresponding file.

[0031] In one possible implementation, the file's metadata includes the file's storage path information in the first device.

[0032] The file's metadata may include the file's storage path information in the first device, so that after the second device obtains the file's metadata, it can obtain the file from the first device based on the storage path information and open the file locally on the second device.

[0033] In one possible implementation, the file's metadata may also include one or more of the following: the file's type information, the file's size information, or the file's name.

[0034] In addition to the storage path information of the file on the first device, the file's metadata may also include other information, such as the file type information or the file size information, so that the second device can obtain more information about the file.

[0035] Secondly, a second communication method is provided, comprising: a first device and a second device entering a multi-screen collaboration mode via a preset method; the first device displaying a first interface and projecting the first interface onto a second interface of the second device, the first interface containing at least one file icon, the second interface including the first interface, and the file corresponding to the at least one file icon being stored on the first device; the first device detecting an operation performed on the file icon; when the file icon is an icon displayed on the first interface of the first device, the first device calling a first application to open the file; when the file icon is an icon displayed on the second interface, the first device sending the file's metadata to the second device, the file's metadata being used to open the file on the second device.

[0036] The method can be executed by a first device, such as a mobile device, like a mobile phone, tablet, or portable computer; or the first device can be a device with a fixed location, such as a desktop computer with a relatively fixed location.

[0037] In one possible implementation, the method further includes:

[0038] The first device receives an update file from the second device, the update file being the updated file;

[0039] The first device updates the locally stored file with the update file.

[0040] In one possible implementation, the first device detects an operation applied to the file icon, including:

[0041] The first device receives event information from the second device, the event information indicating the operation, and the event information including the identifier of the second device; or,

[0042] The first device detects the event information generated by the operation on the first device.

[0043] The statement "The first device detects the event information generated by the operation on the first device" can be understood as follows: the first device detects the operation on the first device and obtains the event information corresponding to the operation; therefore, it can be considered that the first device detected the event information generated by the operation on the first device. Alternatively, it can be understood as the first device detecting the event information corresponding to the operation on the first device. That is, the former interpretation means that the first device detected the operation and obtained the event information, while the latter interpretation means that the first device detected the event information, and this event information corresponds to the operation.

[0044] In one possible implementation, the first device determines that the file icon is an icon displayed on the second interface, including:

[0045] The first device determines, based on the identifier of the second device, that the file icon is the icon displayed on the second interface.

[0046] In one possible implementation, the first device sends the metadata of the file to the second device, including:

[0047] The first device sends the file's metadata to the second device's distributed file management system through its own distributed file management system.

[0048] In one possible implementation, before the first device invokes the first application to open the file, the method further includes:

[0049] The first device outputs a prompt message, which includes one or more options, the one or more options being used to determine the device to open the file;

[0050] The first device detects an operation to select a first option among the one or more options, the first option corresponding to the first application.

[0051] In one possible implementation, the method further includes:

[0052] When the file icon is the same icon displayed on the first interface, the first device outputs a prompt message, which includes one or more options, and the one or more options are used to determine the device to open the file;

[0053] The first device detects an operation to select a second option from the one or more options, the second option indicating that the file be opened on the second device;

[0054] The first device sends the file's metadata to the second device, and the file's metadata is used to open the file on the second device.

[0055] In one possible implementation, the file's metadata includes the file's storage path information in the first device.

[0056] In one possible implementation, the file's metadata may also include one or more of the following: the file's type information, the file's size information, or the file's name.

[0057] For information on the technical effects of the second aspect or its various possible implementations, please refer to the description of the technical effects of the first aspect or its corresponding implementations.

[0058] Thirdly, an electronic device is provided, comprising a display screen, one or more processors, a memory, and one or more programs. The one or more programs are stored in the memory, and include instructions that, when executed by the electronic device, cause the electronic device to perform the methods provided in the first aspect or any possible embodiment described above, or cause the electronic device to perform the methods provided in the second aspect or any possible embodiment described above.

[0059] Fourthly, an electronic device is provided, the electronic device including a module / unit for performing the method provided in the first aspect or any possible embodiment, or the electronic device including a module / unit for performing the method provided in the second aspect or any possible embodiment.

[0060] Fifthly, a computer-readable storage medium is provided for storing a computer program that, when run on a computer, causes the computer to perform the method provided in the first aspect or any possible embodiment described above, or causes the computer to perform the method provided in the second aspect or any possible embodiment described above.

[0061] In a sixth aspect, a computer program product comprising instructions is provided, the computer program product being used to store a computer program that, when the computer program is run on a computer, causes the computer to perform the method provided by the first aspect or any possible implementation thereof, or causes the computer to perform the method provided by the second aspect or any possible implementation thereof.

[0062] In a seventh aspect, a communication system is provided, the communication system comprising the electronic device described in the third aspect, or comprising the electronic device described in the fourth aspect.

[0063] In one alternative embodiment, the communication system further includes a second device, which is the second device described in the first aspect or various embodiments, or the second device described in the second aspect or various embodiments.

[0064] The method provided in this application can determine the user's current focus based on the user's operation, thereby selecting the appropriate device to open the file, which is more conducive to the user's viewing and avoids too many operation steps for the user. Attached Figure Description

[0065] Figure 1 This is a schematic diagram of the structure of an electronic device;

[0066] Figure 2 This is a diagram illustrating the process of opening a file in multi-screen collaboration mode.

[0067] Figure 3A This is a schematic diagram of the mobile phone desktop in an embodiment of this application;

[0068] Figure 3B This is a schematic diagram illustrating a user tapping a portable computer with their mobile phone in an embodiment of this application.

[0069] Figure 3CThis is a schematic diagram showing the mobile phone image displayed on the portable computer after entering the multi-screen collaboration mode in this embodiment of the application;

[0070] Figure 4A This is a schematic diagram of a user performing a first operation on the screen projection interface 202 displayed on a portable computer in an embodiment of this application;

[0071] Figure 4B This is a schematic diagram of opening file 3 on a portable computer in an embodiment of this application;

[0072] Figure 4C This is another schematic diagram of opening file 3 on a portable computer in an embodiment of this application;

[0073] Figure 4D This is another schematic diagram of opening file 3 on a portable computer in the embodiments of this application;

[0074] Figure 5A This is a schematic diagram of a user performing a second operation on mobile phone 100 in an embodiment of this application;

[0075] Figure 5B This is a schematic diagram of opening file 3 on mobile phone 100 in an embodiment of this application;

[0076] Figure 6 This is a schematic diagram illustrating the process of opening a file in multi-screen collaboration mode in an embodiment of this application;

[0077] Figure 7A This is a schematic diagram of a prompt message displayed on a mobile phone 100 in an embodiment of this application;

[0078] Figure 7B This is a schematic diagram illustrating a user's interaction with the options included in the prompt information in an embodiment of this application;

[0079] Figure 7C This is another schematic diagram showing the prompt information displayed on the mobile phone 100 in an embodiment of this application;

[0080] Figure 7D This is another schematic diagram illustrating how a user interacts with the options included in the prompt information in an embodiment of this application;

[0081] Figure 8 A flowchart illustrating a first method for opening a file as provided in this application embodiment;

[0082] Figure 9 A flowchart illustrating a second method for opening a file provided in an embodiment of this application;

[0083] Figure 10 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0084] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings.

[0085] The following explanations of some terms used in the embodiments of this application are provided to facilitate understanding by those skilled in the art.

[0086] The application (app) referred to in this application is a software program capable of performing one or more specific functions. Typically, multiple applications can be installed on an electronic device. Examples include camera apps, SMS apps, MMS apps, image apps, various email apps, WeChat, WhatsApp Messenger, Line, Instagram, and Kakao Talk. The applications mentioned below can be those pre-installed at the factory or those downloaded by the user from the network or obtained from other electronic devices during use (e.g., applications sent by other electronic devices).

[0087] The files involved in this application may be multimedia files, such as image files, video files, or audio files; or they may be text files, such as Microsoft Office files, such as Word files, Excel files, or PowerPoint files; or they may be image files corresponding to drawing applications, such as Microsoft Office Visio files or Photoshop files.

[0088] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, or B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0089] Furthermore, unless otherwise stated, the ordinal numbers such as "first" and "second" mentioned in the embodiments of this application are used to distinguish multiple objects and are not used to limit the size, content, order, timing, priority, or importance of multiple objects. For example, "second file" and "second file" are only used to distinguish different files and do not indicate that the two files are different in size, content, priority, or importance.

[0090] The technical solutions provided in this application can be applied to electronic devices. The following describes electronic devices, graphical user interfaces (GUIs) for such electronic devices, and embodiments for using such electronic devices. In some embodiments of this application, the electronic device can be a portable electronic device, such as a mobile phone, a tablet, a laptop computer, a wearable device with wireless communication capabilities (such as a smartwatch, smart glasses, a smart bracelet, or a smart helmet), or an in-vehicle device. Exemplary embodiments of the portable electronic device include, but are not limited to, devices equipped with… Alternatively, it could be a portable electronic device with another operating system. It should also be understood that in other embodiments of this application, the aforementioned electronic device may not be a portable device; for example, it could be a desktop computer, such as a PC, capable of capturing images and running image compression algorithms to compress them.

[0091] For example, Figure 1 A schematic diagram of the structure of an electronic device 100 is given.

[0092] It should be understood that the illustrated electronic device 100 is merely an example, and the electronic device 100 may have more or fewer components than those shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0093] like Figure 1As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0094] The following is combined Figure 1 A detailed description of each component of the electronic device 100 is provided.

[0095] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the electronic device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.

[0096] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory, thereby avoiding repeated accesses, reducing the waiting time of the processor 110, and thus improving the efficiency of the system.

[0097] The processor 110 can run the file opening method provided in the embodiments of this application. For example, the embodiments of this application provide a management software, which can be a software module that runs on the processor 110. This software module can be understood as a computer program. As another example, the embodiments of this application also provide screen mirroring software, which can be a software module that runs on the processor 110. This software module can be understood as a computer program. The management software and the screen mirroring software can be the same software module, or they can be different software modules. Furthermore, the management software can be standalone software or part of the system software; similarly, the screen mirroring software can be standalone software or part of the system software. When the processor 110 integrates different devices, such as a CPU and a GPU, the CPU and GPU can cooperate to execute the methods provided in the embodiments of this application. For example, in the methods provided in the embodiments of this application, some algorithms are executed by the CPU, and other algorithms are executed by the GPU to achieve faster processing efficiency.

[0098] In some embodiments, the processor 110 may include one or more interfaces. For example, the interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0099] The wireless communication function of electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0100] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0101] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0102] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0103] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0104] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0105] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc.

[0106] Electronic device 100 can achieve the shooting function, or the image acquisition function, through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0107] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0108] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0109] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP performs Fourier transforms on the frequency energy.

[0110] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0111] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0112] Internal memory 121 can be used to store executable program code, including instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of electronic device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory located within the processor.

[0113] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.

[0114] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0115] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0116] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with electronic device 100.

[0117] Understandable Figure 1 The components shown do not constitute a specific limitation on the electronic device 100. The mobile phone may also include more or fewer components than shown, or combine some components, or separate some components, or have different component arrangements. Furthermore, Figure 1 The combination / connection relationships between the components can also be adjusted and modified.

[0118] This application provides a first device and a second device. The first device may be implemented as, for example, an electronic device 100, or it may be a chip or other functional component disposed in the electronic device 100 (in which case, the first device may also be referred to as a first apparatus), or the first device may have other implementations. The second device may be implemented as, for example, the electronic device 100, or it may be a chip or other functional component disposed in the electronic device 100 (in which case, the second device may also be referred to as a second apparatus), or the second device may have other implementations. Figure 1 The microphone 170C, camera 193, fingerprint sensor 180H, touch sensor 180K, or bone conduction sensor 180M shown can all collect user operations in this application. Alternatively, embodiments of this application can also provide some peripheral input devices to collect user operations. For example, electronic device 100 is connected to some peripheral input devices, which can collect user operations. Peripheral input devices include, for example, a keyboard or mouse.

[0119] This application also provides a multi-screen collaboration system, which may include a first device and a second device. Of course, the multi-screen collaboration system may also include other devices; for example, three or more devices can also perform multi-screen collaboration. This application's embodiments mainly use the multi-screen collaboration process between two devices as an example.

[0120] Currently, in multi-screen collaboration (or multi-device collaboration) scenarios, regardless of which device the user operates on during the collaboration, the result is always a response on that device. For example, when collaborating between a phone and a PC, if a user tries to open a file on either the phone or the PC, the file will open on the PC, not the phone. However, if the user actually wants to view the content on the phone, this is currently impossible. The user must exit multi-screen collaboration mode to open and view the content on the phone, a process that requires multiple steps and is quite cumbersome.

[0121] For example, a user might be using a mobile phone and need to open a file on their phone on a personal computer (PC) so the PC user can view it. This avoids both users viewing the phone simultaneously, and the PC's larger screen provides a better viewing experience. In this scenario, the phone and PC can enter multi-screen collaboration mode. The phone can open the file in multi-screen collaboration mode, and the file will then be displayed on the PC. (See reference...) Figure 2 This is a diagram illustrating the process of opening a file in multi-screen collaboration mode.

[0122] Figure 2 The "1" in the code indicates that the user clicks on a file displayed on the phone screen. The phone's built-in assistant (or PC assistant) receives the user's click information and responds accordingly. Alternatively, Figure 2 The number 1 indicates that the user clicks on a file displayed on the PC's screen mirroring interface from the phone. The PC Manager installed on the PC receives the user's click information and responds accordingly.

[0123] Figure 2 The number 2 indicates that the PC Manager installed on the PC will send the user's click operation information to the mobile assistant.

[0124] Figure 2 The "3" indicates that the phone will truncate the file opening process. This is because, under normal circumstances, if the phone determines that the user has performed an operation to open a file on the phone, it will respond to the operation and open the corresponding file. However, in multi-screen collaboration mode, only the PC can open the file; the phone will not open it. Therefore, the phone needs to truncate the operation that would normally be performed to open the file.

[0125] Figure 2 The 4 in the text indicates the path the phone uses to retrieve the file. This path refers to the absolute path of the file, that is, its storage path on the phone.

[0126] Figure 2 The number 5 indicates that the phone assistant will create a symbolic link in the phone's distributed file system (MDFS). This symbolic link points to a storage path, which is the file's storage location on the phone. This could be the file's storage path on the phone's secure digital memory card (SD card) or the file's uniform resource locator (URL). Additionally, this symbolic link is associated with the file's metadata, which may include the file's storage path and other information such as its type.

[0127] Figure 2 The number 6 indicates that the distributed file management system on the mobile device synchronizes the file's metadata to the distributed file management system on the PC.

[0128] Figure 2 The 7 in the text indicates that the mobile assistant obtains the path of the symbolic link created in the distributed file management system.

[0129] Figure 2 The number 8 indicates that the phone assistant sends the path of the symbolic link created in the distributed file management system on the phone to PC Manager. Additionally, the phone assistant can also obtain the file's metadata, such as its type information, and can also send this metadata to PC Manager.

[0130] Figure 2 The numbers 9 and 10 indicate that PC Manager calls the application that can open the file based on the file type information, etc. In addition, PC Manager also sends the path of the symbolic link to the application. Figure 2 Taking this application as an example, which is a Microsoft Office application, in Figure 2 The term is used in the Chinese text to refer to "office applications".

[0131] Figure 2 The number 11 indicates that the Office application opens the symbolic link based on its path.

[0132] Figure 2The number 12 indicates that the PC-side distributed file management system requests the file from the mobile-side distributed file management system based on the metadata corresponding to the symbolic link (e.g., the file's storage path included in the metadata).

[0133] Figure 2 The number 13 indicates that the mobile device's distributed file management system reads the file that the symbolic link actually points to. Additionally, the mobile device's distributed file management system sends the read file to the PC's distributed file management system, allowing the PC's Office application to open the file.

[0134] As can be seen from the above process, in current multi-screen collaboration (or multi-device collaboration) scenarios, regardless of which device the user operates on during the collaboration, the result is always a response on one of those devices. For example, when collaborating between a phone and a PC, if a user tries to open a file on either the phone or the PC, the file will open on the PC, not the phone. However, if the user actually wants to view the content on the phone, this is currently impossible. The user must exit multi-screen collaboration mode to open and view the content on the phone, a process that requires multiple steps and is quite cumbersome.

[0135] Therefore, in this application, the device can determine the user's focus based on the user's actions, or in other words, determine which device the user wishes to view the content on, and then select the appropriate device to respond according to the user's intent. This approach ensures that the response meets the user's needs and improves the user experience. For example, in multi-screen collaboration between a mobile phone and a PC, if a user opens a file on their mobile phone, the file can be opened on the mobile phone; or if a user opens a file on their PC, the file can be opened on the PC. This demonstrates that the user can open and view the content on their mobile phone without exiting multi-screen collaboration mode, simplifying the user's operation process and reducing the need for multiple device responses, thus saving device power consumption.

[0136] The technical solutions provided in the embodiments of this application are described below.

[0137] In this embodiment, the first device and the second device are to perform multi-screen collaboration. For ease of understanding, the following description will use a mobile phone as the first device and a portable computer as the second device as an example. The structure of the mobile phone is as follows: Figure 1 The structure shown, in this sense, Figure 1The electronic device 100 shown can also be called a mobile phone 100. Furthermore, for the first device to achieve multi-screen collaboration, it can be achieved, for example, through a first management software installed on the first device; for the second device to achieve multi-screen collaboration, it can be achieved through a second management software installed on the second device. As mentioned above, the first management software can be a software module running independently on the first device, or it can be part of the first device's system software. The second management software can be a software module running independently on the second device, or it can be part of the second device's system software. Additionally, "screen mirroring software" can also have other names, such as "screen mirroring application (APP)." If the first device is mobile phone 100, then the first management software can also be called a mobile assistant, etc. It should be understood that management software can also be called other names; the word "manager" itself has no specific meaning and does not mean that management software necessarily manages other software on the device where it resides.

[0138] Furthermore, in this embodiment, software modules and applications (APPs) can be the same concept. For example, a mobile assistant is both a software module and an application. Therefore, "software" can also be replaced with "application (APP)". For example, "management software" can also be called "management application", and "screen casting software" can also be called "screen casting application". Alternatively, an application can include one or more software modules, but a software module itself cannot be considered an application. For example, management software is a software module, but not an independent application. It can be considered that management software is a software module set in the corresponding application (e.g., management application), or it can also be a software module set in the system software. Similarly, screen casting software is a software module, but not an independent application. It can be considered that screen casting software is a software module set in the corresponding application (e.g., screen casting application), or it can also be a software module set in the system software. Here, "application" refers to something that users can directly call, such as the "SMS" or "App Market" icons displayed on the phone's display interface, which represent the corresponding applications. In the following description, we will use the example of software modules and applications being the same concept.

[0139] Figure 3A A GUI of mobile phone 100 is shown, which is the phone's desktop 201. If a user wants to enable multi-screen collaboration between mobile phone 100 and a portable computer, the user needs to put both mobile phone 100 and the portable computer into multi-screen collaboration mode. To enable multi-screen collaboration mode, preset methods can be used, which may include various operation methods. For example, refer to... Figure 3BUsers can tap their mobile phone (phone 100) against the portable computer, for example, by tapping the NFC area of ​​the portable computer. This establishes an NFC connection between the phone and the computer, and both devices enter multi-screen collaboration mode. The default method is this "tap-to-connect" gesture. In other words, users only need to perform one operation (the tap-to-connect) to establish a connection between the two devices and enable them to enter multi-screen collaboration mode. Figure 3B The main point is to illustrate the process of the mobile phone 100 and the portable computer touching each other, so the display interface of the mobile phone 100 is not shown in detail.

[0140] Alternatively, the user can enable Bluetooth on both the mobile phone 100 and the laptop. For example, after enabling Bluetooth, the mobile phone 100 will scan for nearby Bluetooth devices. If it detects the laptop, a Bluetooth connection can be established between the mobile phone 100 and the laptop, and both will enter multi-screen collaboration mode. The default method is either the user enabling Bluetooth or the mobile phone 100 scanning for the laptop. That is, the user only needs to perform one operation (enabling Bluetooth) to establish a connection between the two devices and enable them to enter multi-screen collaboration mode. Alternatively, the user can enable Bluetooth on both the mobile phone 100 and the laptop. For example, after enabling Bluetooth, the mobile phone 100 will scan for nearby Bluetooth devices. If it detects the laptop, a Bluetooth connection can be established between the mobile phone 100 and the laptop. After the Bluetooth connection is established, the user can then perform corresponding operations to enable multi-screen collaboration mode. For example, if a portable computer has a second screen mirroring software installed and a mobile phone has a first screen mirroring software installed, the user's actions, such as scanning a QR code provided by the second screen mirroring software using the first screen mirroring software, are considered the default actions. That is, the user needs to perform at least two actions: establishing a connection between the two devices and entering multi-screen collaboration mode.

[0141] Alternatively, the mobile phone 100 and the laptop can also connect via Wi-Fi or other means and enter multi-screen collaboration mode.

[0142] Alternatively, the portable computer may have a second screen mirroring software installed, while the mobile phone 100 may have a first screen mirroring software installed. The first and second screen mirroring software can be two different types of software, or they can be the same software installed on different devices. As mentioned earlier, the first screen mirroring software can be a standalone software module running on the mobile phone 100, or it can be part of the mobile phone 100's system software. The second screen mirroring software can also be a standalone software module running on the portable computer, or it can be part of the portable computer's system software. It should be understood that "screen mirroring software" can also have other names, such as "screen mirroring application." Furthermore, the screen mirroring software and the management software can be the same software module; for example, the first screen mirroring software and the first management software can be the same software module, and the second screen mirroring software and the second management software can be the same software module. Alternatively, the screen mirroring software and the management software can be different software modules; for example, the first screen mirroring software and the first management software can be different software modules, and the second screen mirroring software and the second management software can be different software modules. For example, if the first screen mirroring software is part of the system software of phone 100, while the first manager software is a separate software module running on phone 100 and not part of the system software, then the first screen mirroring software and the first manager software are considered different software modules. Alternatively, if both the first screen mirroring software and the first manager software are separate software modules running on phone 100, but are different software modules, then they are also considered different software modules, and so on. Users can open the second screen mirroring software on the portable computer and also open the first screen mirroring software on phone 100. The second screen mirroring software on the portable computer can provide a QR code. Users can use phone 100 to scan the QR code provided by the second screen mirroring software on the portable computer through the first screen mirroring software on phone 100, thus establishing a connection between phone 100 and the portable computer and allowing both to enter multi-screen collaboration mode. Alternatively, the user's operation of scanning the QR code provided by the second screen mirroring software on the portable computer through the first screen mirroring software on phone 100 is only used for both devices to enter multi-screen collaboration mode, provided that the two devices have already established a connection, such as a Bluetooth or Wi-Fi connection.

[0143] Alternatively, users can log in to the same account on both the second screen mirroring software on the laptop and the first screen mirroring software on the phone. For example, by entering the same username and password on both platforms, the phone and laptop can establish a connection and enter multi-screen collaboration mode without scanning a QR code. The default method is for users to enter the same username and password on both platforms. Alternatively, the user entering the same username and password on both platforms is only used when both devices enter multi-screen collaboration mode, provided they have already established a connection, such as a Bluetooth or Wi-Fi connection.

[0144] If the mobile phone 100 has the first screen mirroring software installed, the first management software can capture the user's operations on the first screen mirroring software, and the first management software can send instructions from the portable computer (or, in other words, from the second management software) to the first screen mirroring software; similarly, if the portable computer has the second screen mirroring software installed, the second management software can capture the user's operations on the second screen mirroring software, and the second management software can send instructions from the mobile phone 100 (or, in other words, from the first management software) to the second screen mirroring software.

[0145] Alternatively, users can use other methods to enable both the mobile phone 100 and the portable computer to enter multi-screen collaboration mode; there are no restrictions on the specific methods.

[0146] Other references Figure 3C After entering multi-screen collaboration mode, the portable computer's screen will display the current display interface 202 of the mobile phone 100. This display interface 202 can also be called the projection interface 202 or screen recording interface 202. The projection interface 202 is a mirror image of the mobile phone 100's display interface. The projection interface 202 displayed on the portable computer and the mobile phone 100's display interface are from the same source, that is, both originate from the mobile phone 100. For example, the mobile phone 100 sends information about its display interface to the portable computer, so the portable computer can display the projection interface 202 at the same size ratio as the mobile phone 100's screen. After the portable computer displays the projection interface 202, the user can also zoom in or out of the projection interface 202 to change its area, or drag the projection interface 202 to change its position on the portable computer's screen.

[0147] After both the mobile phone 100 and the portable computer enter multi-screen collaboration mode, according to the technical solution provided in this application, the user can choose to view the content on the mobile phone on the portable computer side. The portable computer's screen is larger, and viewing on the larger screen provides a better viewing experience. Alternatively, the user can choose to view the content on the mobile phone side, as the mobile phone is more portable and can meet the user's need for viewing anytime. The following describes how to select a device for viewing.

[0148] For example, the user performs a first operation on the projection interface 202 displayed on the portable computer. This first operation may be a touch operation, as can be seen in the following example. Figure 4A The first operation is the user touching the "File 3" file icon on the projection interface 202 with their finger, indicating that the user wants to open file 3. The touch sensor on the portable computer's display screen can collect (or capture) the event information of the first operation, or in other words, the touch sensor on the portable computer's display screen can capture the user's first operation and obtain the event information corresponding to the first operation, which can indicate the first operation. Because the area targeted by the first operation is the projection interface 202, the touch sensor can send the collected event information of the first operation to the second management software. The event information of the first operation includes, for example, the identifier of the portable computer, and optionally, the location information of the first operation. The location information of the first operation is, for example, the relative position information of the first operation within the projection interface 202, so that even if the position of the projection interface 202 on the portable computer's display screen is different, the relative position information of the first operation remains unchanged. For the mobile phone 100, based on the area conversion ratio of the mobile phone 100's display screen 194 and the projection interface 202, and the relative position information of the first operation, the file corresponding to the first operation can be determined.

[0149] Alternatively, the first operation can be voice control, gesture control, or pressing on the display screen of a portable computer, etc., in which case the sensor in the portable computer that collects the first operation will also be different. This application does not limit the type of the first operation in its embodiments.

[0150] The second management software sends the event information of the first operation to the first management software. The sending method depends on the connection method between the mobile phone 100 and the portable computer, such as NFC, Bluetooth, Wi-Fi, or mobile network. After receiving the event information of the first operation, the first management software determines that the event information of the first operation corresponds to the portable computer, that is, it determines that the first operation was performed on the portable computer, or in other words, it determines that the file icon corresponding to the first operation (e.g., the file icon "File 3") is located on the display interface of the portable computer. Then, the first management software can determine the storage path of the file corresponding to the first operation. For example, if the event information of the first operation includes the relative position information of the first operation within the projection interface 202, then the first management software can determine the file corresponding to the first operation, such as File 3, based on the area conversion ratio between the projection interface 202 and the display screen 194 of the mobile phone 100, and the relative position information of the first operation, and thus the first management software can determine the storage path of File 3. The First Manager software can create a symbolic link corresponding to the file in the mobile phone's distributed file management system. This symbolic link points to the file's storage path, such as the file's storage path on the phone's SD card or the file's URL. Additionally, this symbolic link is associated with the file's metadata. The distributed file management system on the mobile phone can synchronize the metadata of the file corresponding to the first operation to the distributed file management system on the portable computer.

[0151] Metadata of a file, also known as its descriptive information, may include, for example, the file's storage path. Optionally, it may also include one or more of the following: the file's name, its type information, or its size information. For instance, a file's metadata may include its storage path information; or it may include both its type information and storage path information; or it may include its size information, name, and storage path information, and so on. The storage path indicated by the file's storage path information can refer to the file's storage path on mobile phone 100. In the example above, if the file corresponding to the first operation is file 3, then the distributed file management system on mobile phone 100 can synchronize the metadata of file 3 to the distributed file management system on the portable computer.

[0152] The first manager software can obtain the path of a symbolic link created in the distributed file management system on the mobile device, and can then send this path to the second manager software. Additionally, the first manager software can also obtain the file's metadata, such as its type information, and can also send this metadata to the second manager software.

[0153] The second management software determines and invokes an application capable of opening the file based on its type information, for example, the second management software determines that a second application can open the file. In this embodiment, if the terms "software" and "application" are interchangeable, then "second application" can also be called "second software"; or, if "software" and "application" are not concepts at the same level and cannot be interchanged, then it can be considered that one or more software modules are set within the second application. For example, if the type information of file 3 indicates that file 3 is an image, then the second management software can determine that an image application can open file 3; as another example, if the type information of file 3 indicates that file 3 is a Microsoft Word document, then the second management software can determine that a Microsoft Office Word application can open file 3. In addition, the second management software also sends the path of the soft link to the second application.

[0154] The second application opens the symbolic link based on its path. Then, the distributed file management system on the portable computer can retrieve file 3 from phone 100 based on the metadata corresponding to the symbolic link; this can be understood as retrieving the data of file 3 from phone 100. For example, the distributed file management system on the portable computer can retrieve file 3 from phone 100 based on the storage path information of file 3 included in the metadata corresponding to the symbolic link. Thus, the second application can open file 3.

[0155] For reference Figure 4B This is an illustration of file 3 being opened on a portable computer. Figure 4B Interface 203 in the text refers to the interface of file 3 opened on the portable computer. Figure 4B Taking file 3 as an example, which is a Word document, after opening the file on a portable computer, the user can adjust the size of interface 203, such as... Figure 4B The interface 203 and the projection interface 202 can be displayed together. Alternatively, the interface 203 can also cover the projection interface 202, such as... Figure 4C As shown. Alternatively, the user can set the screen mirroring interface 202 to "always show on top," in which case part or all of the screen mirroring interface 202 may also be located within the interface 203, such as... Figure 4D As shown.

[0156] In this way, if file 3 is opened on the portable computer, file 3 will not be opened on the mobile phone 100.

[0157] In addition, the portable computer can also store the data of file 3 on the portable computer. For example, the portable computer can store the data of file 3 in the local file system of the portable computer through a second application, such as storing it as a temporary file.

[0158] The user can view file 3 on the portable computer using a second application. The user can also edit file 3 on the portable computer using the second application, such as deleting, adding, or modifying content. After the user finishes editing file 3, they can save it. The portable computer then updates the stored data of file 3, obtaining the updated data. The updated data of file 3 can be understood as the updated version of file 3; essentially, the portable computer overwrites the original data of file 3 stored on the portable computer with the updated data. The portable computer can send the updated data of file 3 to mobile phone 100. For example, the portable computer can synchronize the second file to the distributed file management system of mobile phone 100 through its distributed file management system. Then, mobile phone 100 can overwrite the original data of file 3 stored on its local file system with the updated data, thus updating file 3. The portable computer can send the updated data of file 3 to mobile phone 100 every time the user updates file 3, ensuring that file 3 is updated promptly on the mobile phone. Alternatively, the portable computer can send the updated data of file 3 to mobile phone 100 only after the user closes file 3, reducing the number of times update data is sent and saving transmission costs. Furthermore, after sending the updated data of file 3 to mobile phone 100, the portable computer can delete the stored updated data of file 3, for example, by deleting the temporary file, to free up storage space.

[0159] The above describes the process of a user operating on the portable computer after entering multi-screen collaboration mode. Alternatively, after entering multi-screen collaboration mode, the user may continue operating on the mobile phone 100. For example, the user may be on the move, making it more convenient to view the mobile phone 100 while moving, or the user may be far from the portable computer, making it more convenient to view the mobile phone 100 closer. The following describes how the device responds when the user operates on the mobile phone.

[0160] For example, a user performs a second operation (or, it can also be called the first operation) on mobile phone 100. The second operation is, for example, a touch operation. (See reference...) Figure 5AThe second operation is the user touching the "File 3" file icon on the phone's display screen, indicating that the user wants to open File 3. The touch sensor 180K on the display screen 194 of the phone 100 can collect (or detect) the event information of the second operation; in other words, the touch sensor 180K on the display screen 194 of the phone 100 can capture the second operation and obtain its event information, which can then be used to instruct the second operation. The touch sensor 180K can send the collected event information of the second operation to the first management software. The event information of the second operation may include, for example, the identifier of the phone 100, and optionally, location information of the second operation. The location information of the second operation may be, for example, the absolute location information of the second operation within the display screen 194.

[0161] After obtaining the event information of the second operation, the first management software, since the event information of the second operation includes the identifier of the mobile phone 100, such as from the touch sensor 180K, can determine that the event information of the second operation corresponds to the mobile phone 100. That is, it determines that the second operation is performed on the mobile phone 100, or in other words, it determines that the file icon corresponding to the second operation (e.g., the file icon "File 3") is located on the display interface of the mobile phone 100. Then, the first management software can determine the file corresponding to the second operation based on the location information of the second operation, such as File 3. The first management software can then determine the application that can open File 3 based on the type of File 3, such as the first application. In this embodiment, if the terms "software" and "application" are interchangeable, then "first application" can also be called "first software"; or, if "software" and "application" are not concepts at the same level and cannot be interchanged, then it can be considered that one or more software modules are set within the first application. The second application mentioned above and the first application here can be the same application, such as Microsoft Office Word, but with different names because they are installed on different devices; or the first application and the second application can be different applications, such as Microsoft Office Word and WPS Office Word, but both applications can open the same type of file.

[0162] Next, the First Manager software can open file 3 stored in the local file system of phone 100 through the First Application. (See reference...) Figure 5B This is an illustration of file 3 being opened on a mobile phone (phone 100). Figure 5B Interface 204 in the text refers to the interface of file 3 opened on the display screen 194 of mobile phone 100. After opening the file on mobile phone 100, the user can adjust the size of interface 204.

[0163] In this way, if file 3 is opened on mobile phone 100, file 3 will not be opened on portable computer.

[0164] Users can view file 3 on mobile phone 100 through the first application, and users can also edit file 3 on mobile phone 100 through the first application, such as deleting, adding, or modifying content in file 3. After the user finishes operating on file 3, they can save file 3, and then mobile phone 100 can update the data of file 3 stored in the local file system of mobile phone 100.

[0165] For reference Figure 6 This is a schematic diagram illustrating the process of opening a file in multi-screen collaboration mode after implementing the method provided above, for example, according to this application.

[0166] Figure 6 The 1 in the text indicates that the user clicked on a file displayed on the screen of phone 100, and the first management software installed on phone 100 (for example, Figure 6 The mobile assistant (in the app) obtains the user's click information and responds to the click. Alternatively, Figure 6 The 1 in the text indicates that the user clicks on a file displayed on the screen mirroring interface 202 of the mobile phone on the portable computer screen, and the second management software installed on the portable computer (e.g., Figure 6 The PC Manager (in the software) obtains the user's click operation information and responds to the click.

[0167] Figure 6 The 2 in the text indicates that the second management software sends the user's click operation information to the first management software.

[0168] Figure 6 The number 3 indicates that the first management software performs focus determination, that is, determines where the user's focus is located. In this embodiment, for example, the first management software can determine the user's focus based on the parameters of the click response. For example, if the click operation information is sent by the second management software, the first management software can set the value of the click response parameter to a first value when responding to the click. If the click operation information is sent by a sensor within the phone 100 (such as the touch sensor 180K), the first management software can set the value of the click response parameter to a second value when responding to the click. In this way, when the first management software performs focus determination, it can determine which device the user's operation is targeting based on the different values ​​of the click operation parameters, or in other words, it can determine which device the user's focus is located on.

[0169] Figure 6 The number 4 indicates that the First Manager software will perform different processing based on the result of the focus judgment.

[0170] If the First Manager software determines that the user's focus is on the portable computer, it can truncate the file opening process. This is because the user's focus is on the portable computer, so the file needs to be opened on the portable computer, not on the mobile phone 100. Therefore, the mobile phone 100 needs to truncate the operation that would normally be performed to open the file.

[0171] Figure 6 The 5 in the text indicates the path to the file obtained by the first management software. The path to the file mentioned here refers to the absolute path of the file, that is, the storage path of the file on the phone 100.

[0172] Figure 6 The number 6 indicates that the First Manager software will create a symbolic link in the phone's distributed file management system. This symbolic link points to a first storage path, which is the storage path of the file on the phone, such as the file's storage path on the phone's SD card or the file's URL. Additionally, this symbolic link is also associated with the file's metadata, which may include, for example, the file's storage path, and optionally, the file's type information.

[0173] Figure 6 The 7 indicates that the distributed file management system on the mobile phone 100 terminal synchronizes the file's metadata to the distributed file management system on the portable computer terminal.

[0174] Figure 6 The 8 in the text indicates the path of the soft link created by the First Manager software in the distributed file management system on the mobile phone terminal.

[0175] Figure 6 The number 9 indicates that the first management software sends the path of the soft link created in the distributed file management system on the mobile phone 100 to the second management software. Additionally, the first management software can also obtain the file's metadata, such as its type information, and can also send this metadata to the second management software.

[0176] Figure 6 The numbers 10 and 11 indicate that the second-level management software calls the application that can open the file based on the file type information, etc. In addition, the second-level management software also sends the path of the symbolic link to the application. Figure 6 Take the example of a Microsoft Office application.

[0177] Figure 6 The number 12 indicates that the Office application opens the symbolic link based on its path.

[0178] Figure 6The number 13 indicates that the distributed file management system on the portable computer requests the file from the distributed file management system on the mobile phone 100 based on the metadata corresponding to the soft link (such as the storage path of the file included in the metadata).

[0179] Figure 6 The number 14 indicates that the distributed file management system on mobile phone 100 reads the file actually pointed to by the soft link, for example, the distributed file management system on mobile phone 100 reads the file from the local file system of mobile phone 100. In addition, the distributed file management system on mobile phone 100 also sends the read file to the distributed file management system on the portable computer, so that the Office application on the portable computer can open the file. Furthermore, the portable computer can also store the data of file 3 on the portable computer. For example, the portable computer can store the data of file 3 in the local file system of the portable computer through a second application, for example, as a temporary file. The user can modify, delete, or add content to file 3 through the second application on the portable computer, thus updating the temporary file stored in the local file system of the portable computer. After the update, the portable computer can send the updated file to mobile phone 100, so that mobile phone 100 can update the original file stored in its local file system according to the updated file.

[0180] Figure 6 Sections 5-14 describe operations for opening files on a portable computer. Alternatively, if the first management software determines that the user's focus is on phone 100, then phone 100 can invoke an application capable of opening the file, such as the first application. See then for further details. Figure 6 In step 15, the first application opens the file based on its storage path in the local file system of the phone 100.

[0181] For the same file on the first device, the final experience is different when operating on the first device versus operating in a collaborative window (e.g., projection interface 202) mirrored from the first device onto the second device, after using the method provided in the embodiments of this application. Even in a multi-screen collaboration scenario, the first device can intelligently select one of the devices to open, edit, and save the corresponding file based on the user's current focus (e.g., the device the user is targeting). The user can complete office work and other needs without leaving or switching the currently focused screen, thus providing the user with a better preview and editing experience.

[0182] In the previously described method, if the user performs an operation on mobile phone 100, mobile phone 100 will open the corresponding file. Next, we will introduce another method. In this method, if the user performs an operation on mobile phone 100, mobile phone 100 can provide the user with an option to choose whether to open the corresponding file on mobile phone 100 or on a portable computer. This method makes the device that ultimately opens the file more aligned with the user's needs.

[0183] For example, a user performs a second operation on phone 100, such as a touch operation, to open the first file. (See also...) Figure 5A The second operation is the user touching the "File 3" file icon on the phone's display screen with their finger, indicating that the user wants to open File 3. The touch sensor 180K on the display screen 194 of the phone 100 can capture the second operation and obtain its event information. The touch sensor 180K can then send this event information to the first management software. The event information of the second operation may include, for example, the identifier of the phone 100, and optionally, location information of the second operation. The location information of the second operation may be, for example, the absolute location of the second operation within the display screen 194. It should be understood that the touch operation described herein can be replaced by hover operations, voice commands, etc. This document uses touch operation as an example for explanation, but this does not constitute a limitation on the embodiments of this application.

[0184] After obtaining the event information of the second operation, the first management software can determine that the event information of the second operation corresponds to the mobile phone 100, since the event information includes the identifier of the mobile phone 100. That is, it determines that the second operation occurred on the mobile phone 100, or in other words, it determines that the file icon corresponding to the second operation (e.g., the file icon "File 3") is located on the display screen of the mobile phone 100. Then, the first management software can output a prompt message 205 through the display screen 194. This prompt message 205 may include one or more options and can be used to determine the device that opened File 3. For example, see [reference needed]. Figure 7AThis is a schematic diagram of a prompt message 205 displayed on the screen 194 of mobile phone 100. The prompt message 205, for example, includes four options. One option is "PC application," indicating that file 3 should be opened on a collaborative device (e.g., a laptop). The remaining three options are "1," "2," and "3," representing application 1, application 2, and application 3, respectively. These three applications are all on mobile phone 100 and can all open file 3. Mobile phone 100 may have one or more applications that can open the first file. If only one application on mobile phone 100 can open the first file, then prompt message 205 will only display one option besides "PC application." Alternatively, if multiple applications on mobile phone 100 can open the first file, then prompt message 205 may display options corresponding to all or some of the applications that can open the first file, in addition to "PC application." If the user selects "PC application", it means that the user chooses to open the first file on the collaborative device. If the user selects any application other than "PC application", it means that the user chooses to open the first file on the mobile phone using that application.

[0185] For reference Figure 7B For example, if a user touches the "PC application" option included in the prompt message 205, it indicates that the user has selected "PC application." The distributed file management system on the mobile phone 100 can then synchronize the metadata of the first file corresponding to the first operation to the distributed file management system on the portable computer. For information on file metadata, please refer to the previous section. The operation process after the portable computer obtains the metadata of the first file can also be found in the previous section describing the process of opening file 3 on the portable computer.

[0186] Optional, in Figure 7A or Figure 7B In this context, the prompt message 205 output by the mobile phone 100 may not include specific options on the portable computer; that is, the user cannot select a specific application on the portable computer based on the prompt message 205 output by the mobile phone 100. For example... Figure 7A or Figure 7B If the user wants to open the file on a portable computer, they can select the "PC Application" option. This option only applies to the portable computer and not to any specific application on it. If the user chooses to open the file on the portable computer, the portable computer will then select the appropriate application to open the first file based on its type. Alternatively, the prompt message 205 output by the mobile phone 100 can also include the options from the portable computer. For example, see [reference needed]. Figure 7CThis is a schematic diagram of another prompt message 205 displayed on the screen 194 of mobile phone 100. This prompt message 205, for example, includes five options: "1", "2", "3", "4", and "5", representing application 1, application 2, application 3, application 4, and application 5, respectively. Applications 4 and 5 are applications on a portable computer, both capable of opening file 3, indicating that file 3 should be opened on a collaborative device (e.g., a portable computer). Applications 1, 2, and 3 are applications on mobile phone 100, also capable of opening file 3. Figure 7B In the text, the font size of "4" and "5" is larger and bolder, indicating that application 4 and application 5 are applications on the portable computer. Alternatively, other prompts can be used to indicate that the corresponding application is on the portable computer, such as displaying prompt text. In this way, users can choose which application to open the first file on the portable computer, thus improving the user's viewing experience.

[0187] Alternatively, you can refer to Figure 7D For example, if a user touches the option "1" with their finger, it means that the user has selected to open the first file on the phone 100 through application 1 corresponding to "1". Then, the First Manager software can call application 1 corresponding to "1" to open file 3. The operation process after the First Manager software calls application 1 corresponding to "1" to open file 3 can also refer to the previous introduction on opening file 3 on the phone 100.

[0188] For example, sometimes a user may be operating on a mobile phone, but actually wants to display a file to other users on a portable computer. In such a scenario, the technical solution provided in this application allows the user to choose to open the file on a portable computer, thus completing the display process. Therefore, the technical solution provided in this application provides users with a choice, making it easier for them to select the appropriate device to open the file.

[0189] In multi-screen collaboration mode, the collaboration window displayed on the second device is a mirror image of the display interface of the first device. Therefore, in the existing method, regardless of whether the user operates within the collaboration window on the first or second device, the operation process is the same, and ultimately, the user's operation will be truly responded to on the second device. However, the embodiment of this application breaks down this "same source" barrier through technical implementation. The first device adds a judgment mechanism. For the same file, if the user operates on different devices, the file may be opened through different devices, thus creating a differentiated experience that is different from current technologies and can provide users with a better user experience. Moreover, users do not need to exit multi-screen collaboration mode before they can open the corresponding file on the first device, simplifying the user's operation steps, reducing the device's response time, and helping to save device power consumption.

[0190] In conjunction with the above embodiments and related drawings, this application provides a first method for opening a file, which can be applied in multi-screen collaboration scenarios. Exemplarily, the method involves a first device and a second device; the structure of the first device can be referred to... Figure 1 Please refer to the following. Figure 8 This section introduces the process of this method. For easier understanding, the following description will use a mobile phone (100) as the first device and a portable computer as the second device as an example.

[0191] S801, mobile phone 100, and portable computer enter multi-screen collaboration mode via a preset method. For example, if mobile phone 100 and portable computer enter multi-screen collaboration mode as soon as they establish a connection, then S801 can be replaced by mobile phone 100 and portable computer establishing a connection first. Alternatively, if mobile phone 100 and portable computer need to establish a connection first, and then the user performs corresponding operations to enter multi-screen collaboration mode, then mobile phone 100 and portable computer need to establish a connection before S801.

[0192] There are several ways to enter multi-screen collaboration mode between the mobile phone 100 and the portable computer. For example, the user can hold the mobile phone 100 and tap it against the portable computer to establish an NFC connection and enter multi-screen collaboration mode. The default method is the "tap" method. Alternatively, other methods can be used. For details, please refer to the previous introduction.

[0193] After the mobile phone 100 and the portable computer enter multi-screen collaboration mode, the portable computer's screen will display a first interface, which is a mirror image of the mobile phone 100's display interface. This can be understood as the mobile phone 100 displaying the first interface and the portable computer displaying the second interface. The mobile phone 100 can project the first interface onto the portable computer's screen, or in other words, onto the second interface. After projection, the second interface includes the first interface. The first interface can contain at least one file icon, where each file icon corresponds to a file, and at least one file is stored on the mobile phone 100. For example, one type of first interface might be... Figure 3C The screen mirroring interface 202 shown in the image has "File 1", "File 2" and "File 3" as three file icons, which correspond to three files: File 1, File 2 and File 3.

[0194] For more information about the S801, please refer to the previous introduction.

[0195] S802. The user performs an operation on the portable computer. The portable computer collects the user's operation and obtains the event information corresponding to the operation. For example, this operation is referred to as the first operation. The portable computer can capture the first operation and obtain the event information of the first operation. The first operation can be applied to a file icon. For example, this file icon is referred to as the first file icon. The first file icon can belong to at least one of the aforementioned file icons. That is, the user performs the first operation on the first file icon within the first interface included in the second interface displayed on the portable computer. Here, the first file icon corresponds to a file. For example, this file is referred to as the first file. For a description of the event information of the first operation, please refer to the relevant content above.

[0196] For example, if the first operation is a touch operation, please refer to the example. Figure 4A Alternatively, the first action could be another type of action, such as a gesture, voice control, or hover action. The user's purpose in performing the first action is to open the first file; therefore, the first action is the action used to open the first file.

[0197] For more information about the S802, please refer to the previous introduction.

[0198] S803, the portable computer sends the event information of the first operation to the mobile phone 100, and the mobile phone 100 receives the event information of the first operation from the portable computer. The mobile phone 100 receiving the event information of the first operation can also be considered as the mobile phone 100 detecting the operation performed on the first file icon.

[0199] For example, a sensor within the portable computer (such as a touch sensor or other sensor) collects event information of the first operation and sends this event information to a second management software installed within the portable computer. The second management software can then send the event information of the first operation to a first management software installed on the mobile phone 100, in which case the first management software receives the event information of the first operation from the second management software. The first management software receiving the event information of the first operation can also be considered equivalent to the first management software detecting an operation performed on the first file icon.

[0200] For more information about the S803, please refer to the previous introduction.

[0201] S804, Mobile Phone 100 determines that the event information of the first operation corresponds to the portable computer. In other words, Mobile Phone 100 determines that the first operation acts on the portable computer. Alternatively, Mobile Phone 100 determines that the first operation (or the event information of the first operation) acts on the display screen of the portable computer. Or, Mobile Phone 100 determines that the file icon corresponding to the first operation is located on the display interface of the portable computer. Here, "the first operation corresponds to the portable computer" means that the first operation is performed on the portable computer.

[0202] For example, after receiving the event information of the first operation, the first management software determines that the event information of the first operation corresponds to a portable computer because the event information of the first operation includes the identifier of the second device. That is, it determines that the first operation is performed on the portable computer, or in other words, it determines that the file icon corresponding to the first operation is located on the display interface of the portable computer. For example, if the event information of the first operation indicates that the first operation is a touch operation, the first management software can determine that the first operation is performed on the display screen of the portable computer, or in other words, it determines that the file icon corresponding to the first operation is located on the display interface of the portable computer.

[0203] For more information about S804, please refer to the previous introduction.

[0204] S805, Mobile phone 100 determines that the file corresponding to the event information of the first operation is the first file, or in other words, Mobile phone 100 determines the storage path of the first file corresponding to the event information of the first operation, or in other words, Mobile phone 100 determines that the first operation corresponds to the first file.

[0205] For example, if the event information of the first operation includes the relative position information of the first operation within the first interface, then the first management software can determine the file corresponding to the first operation, such as the first file, based on the area conversion ratio between the first interface and the display screen 194 of the mobile phone 100, and the relative position information of the first operation. The first file could be file 3 as described above. Furthermore, the first management software can determine the storage path of the first file, and it creates a soft link corresponding to the first file in the distributed file management system of the mobile phone 100. This soft link points to the storage path of the first file, such as the storage path of the first file on the phone's SD card or the file's URL. Additionally, this soft link is also associated with the metadata of the first file.

[0206] For more information about the S805, please refer to the previous introduction.

[0207] S806, mobile phone 100 sends the metadata of the first file to portable computer, and portable computer receives the metadata of the first file from mobile phone 100.

[0208] The metadata of the first file may include one or more of the following: the name of the first file, the type information of the first file, the size information of the first file, or the storage path information of the first file. For more information on the metadata of the first file, please refer to the preceding text.

[0209] For example, the distributed file management system on the mobile phone can synchronize (or send) the metadata of the file corresponding to the first operation to the distributed file management system on the portable computer.

[0210] For more information about S806, please refer to the previous introduction.

[0211] S807, The portable computer determines the application used to open the first file based on the metadata of the first file, for example, referred to as the second application.

[0212] The first management software can obtain the path of a symbolic link created in the distributed file management system on the mobile device. It can then send this path to the second management software. Additionally, the first management software can also obtain the file's metadata, such as its type information, and can send this metadata to the second management software. Based on the file's type information, the second management software determines and invokes the appropriate application to open the file; for example, it determines that a second application can open the file.

[0213] For more information about the S807, please refer to the previous introduction.

[0214] S808, the portable computer calls the second application to open the first file.

[0215] Based on the metadata of the first file, the first file is retrieved from mobile phone 100, that is, the data of the first file is retrieved.

[0216] The portable computer invokes a second application, which opens the symbolic link based on its path. Then, the distributed file management system on the portable computer can retrieve the first file from the mobile phone 100 based on the metadata corresponding to the symbolic link; this can be understood as retrieving the data of the first file from the mobile phone 100. For example, the distributed file management system on the portable computer can retrieve the first file from the mobile phone 100 based on the storage path information of the first file included in the metadata corresponding to the symbolic link. Thus, the second application can open the first file. Additionally, the portable computer can also store the data of the first file on its own system. For example, the portable computer can use the second application to store the data of the first file in its local file system, such as as a temporary file.

[0217] For an example of how the second manager software opens the first file, please refer to [link / reference]. Figures 4B to 4D Any of the attached figures.

[0218] For more information about the S808, please refer to the previous introduction.

[0219] S809. The user edits the first file on the portable computer and saves the edited first file. The edited first file may be called the second file, or it may also be called the update file, etc. There is no restriction on the name of the file.

[0220] Users can view and edit the first file on the portable computer, such as deleting, adding, or modifying content. After the user finishes editing the first file, they can save it. The portable computer can then update the stored first file, or in other words, update its data, resulting in the updated data. This updated data can be understood as the updated first file, which is essentially the second file.

[0221] For more information about the S809, please refer to the previous introduction.

[0222] S810: The portable computer sends the second file to the mobile phone 100, and the mobile phone 100 receives the second file from the portable computer.

[0223] The portable computer can send a second file to the mobile phone 100. For example, the portable computer can synchronize the second file to the mobile phone 100's distributed file management system via its own distributed file management system. The mobile phone 100 can then use the second file to overwrite the first file stored on its local file system, thus updating the first file. Specifically, the portable computer can send the obtained second file to the mobile phone 100 every time the user updates the first file, ensuring the first file is updated promptly on the mobile phone. Alternatively, the portable computer can send the obtained second file to the mobile phone 100 only after the user closes the first file, reducing the number of times update data is sent and saving transmission overhead.

[0224] In addition, after the portable computer sends the second file to the mobile phone 100, the portable computer can delete the stored second file to free up storage space.

[0225] For more information about the S810, please refer to the previous introduction.

[0226] S811. When a user performs an operation on mobile phone 100, mobile phone 100 collects the user's operation and obtains the event information corresponding to the operation; in other words, mobile phone 100 detects the event information corresponding to the operation. For example, this operation is referred to as the first operation. Mobile phone 100 can capture the first operation and obtain the event information of the first operation. The first operation can be applied to a file icon; for example, this file icon is referred to as the first file icon. The first file icon can belong to at least one of the aforementioned file icons, that is, the user performs the first operation on the first file icon within the first interface displayed on mobile phone 100. Here, the first file icon corresponds to a file; for example, this file is referred to as the first file.

[0227] Mobile phone 100 collects (or detects) the event information of the user's first operation, which is equivalent to mobile phone 100 detecting the first operation applied to the first file icon.

[0228] For example, if the first operation is a touch operation, please refer to the example. Figure 5A Alternatively, the first action could be another type of action, such as a gesture, voice control, or hover action. The user's purpose in performing the first action is to open the first file; therefore, the first action is the action used to open the first file.

[0229] For more information about the S811, please refer to the previous introduction.

[0230] S812, Mobile phone 100 determines that the event information of the first operation corresponds to mobile phone 100. Alternatively, mobile phone 100 determines that the first operation acts on mobile phone 100. Or, mobile phone 100 determines that the first operation (or the event information of the first operation) acts on the display screen of mobile phone 100. Or, mobile phone 100 determines that the file icon corresponding to the first operation is located on the display interface of mobile phone 100. Here, "the first operation corresponds to mobile phone 100" means that the first operation is performed on mobile phone 100.

[0231] For example, after obtaining the event information of the first operation, the first management software can determine that the event information of the first operation corresponds to the mobile phone 100 because the event information of the first operation includes the identifier of the mobile phone 100. That is, it can determine that the second operation is performed on the mobile phone 100, or in other words, it can determine that the file icon corresponding to the second operation is located on the display interface of the mobile phone 100. For example, if the event information of the first operation indicates that the first operation is a touch operation, the first management software can determine that the touch operation is performed on the display screen of the mobile phone 100, or in other words, it can determine that the file icon corresponding to the touch operation is located on the display interface of the mobile phone 100.

[0232] For more information about the S812, please refer to the previous introduction.

[0233] S813, Mobile phone 100 determines that the file corresponding to the event information of the first operation is the first file, or in other words, Mobile phone 100 determines the storage path of the first file corresponding to the event information of the first operation, or in other words, Mobile phone 100 determines that the first operation corresponds to the first file.

[0234] For example, if the event information of the first operation includes the absolute location information of the first operation within the display interface of the mobile phone, then the first management software can determine the file corresponding to the first operation based on the location information of the first operation, such as the first file, or in other words, the first management software can determine the storage path of the first file, such as the file 3 mentioned above.

[0235] For more information about the S813, please refer to the previous introduction.

[0236] S814, mobile phone 100 calls the first application to open the first file.

[0237] For example, the First Manager software can determine the application that can open the first file based on the type of the first file, such as the first application.

[0238] For more information about the S814, please refer to the previous introduction.

[0239] S815, The user edits the first file on the mobile phone 100 and saves the edited first file. The edited first file is, for example, called the second file.

[0240] For more information about the S815, please refer to the previous introduction.

[0241] Users can view and edit the first file on their phone 100, such as deleting, adding, or modifying content. After the user finishes editing the first file, they can save it. The phone 100 then updates the first file stored in its memory, or in other words, updates the data in the first file, resulting in the updated data. This updated data can be understood as the updated first file, which is essentially the second file.

[0242] S802-S810 and S811-S815 are two parallel schemes that may not occur simultaneously. For example, if a user chooses to operate on a portable computer, S802-S810 will be executed; if the user chooses to operate on the mobile phone 100, S811-S815 will be executed.

[0243] For the same file in the first device, the final experience is different when operating on the mobile phone 100 and operating in a collaborative window (e.g., projection interface 202) mirrored from the mobile phone 100 to the portable computer, after using the method provided in the embodiments of this application. Even in a multi-screen collaboration scenario, the mobile phone 100 can intelligently select one of the devices (e.g., the mobile phone 100 or the portable computer) to open, edit, and save the corresponding file according to the user's current focus (e.g., the device the user is targeting). The user can complete office work and other needs without leaving or switching the currently focused screen, thus providing the user with a better preview and editing experience.

[0244] In the first method of opening a file, if the user performs an operation on mobile phone 100, mobile phone 100 will open the corresponding file. Next, this application embodiment also provides a second method of opening a file. In this method, if the user performs an operation on mobile phone 100, mobile phone 100 can provide the user with an option to choose whether to open the corresponding file on mobile phone 100 or on a portable computer. The second method of opening a file provided in this application embodiment can be applied in multi-screen collaboration scenarios. Exemplarily, this method involves a first device and a second device; the structure of the first device can be referred to... Figure 1 Please refer to the following. Figure 9 This section introduces the process of this method. For easier understanding, the following description will use a mobile phone (100) as the first device and a portable computer as the second device as an example.

[0245] S901, mobile phone 100 and portable computer enter multi-screen collaboration mode through preset methods.

[0246] For more information about the S901, please refer to [link / reference]. Figure 8 S801 in the illustrated embodiment can be referred to in the preceding description.

[0247] S902. The user performs an operation on the portable computer. The portable computer collects the user's operation and obtains the event information corresponding to the operation. For example, this operation is referred to as the first operation. The portable computer can capture the first operation and obtain the event information of the first operation. The first operation can be applied to a file icon. For example, this file icon is referred to as the first file icon. The first file icon can belong to at least one of the aforementioned file icons. That is, the user performs the first operation on the first file icon within the first interface included in the second interface displayed on the portable computer. The first file icon corresponds to a file. For example, this file is referred to as the first file.

[0248] For more information about the S902, please refer to [link / reference]. Figure 8 S802 in the illustrated embodiment can be referred to in the preceding description.

[0249] S903, the portable computer sends the event information of the first operation to the mobile phone 100, and the mobile phone 100 receives the event information of the first operation from the portable computer. The mobile phone 100 receiving the event information of the first operation can also be considered as the mobile phone 100 detecting the operation performed on the first file icon.

[0250] For more information about the S903, please refer to [link / reference]. Figure 8 S803 in the illustrated embodiment can be referred to in the preceding description.

[0251] S904, Mobile phone 100 determines that the event information of the first operation corresponds to the portable computer. In other words, Mobile phone 100 determines that the first operation acts on the portable computer. Alternatively, Mobile phone 100 determines that the first operation (or the event information of the first operation) acts on the display screen of the portable computer. Or, Mobile phone 100 determines that the file icon corresponding to the first operation is located on the display interface of the portable computer. Here, "the first operation corresponds to the portable computer" means that the first operation is performed on the portable computer.

[0252] For more information about the S904, please refer to [link / reference]. Figure 8 S804 in the illustrated embodiment can be referred to in the preceding description.

[0253] S905, Mobile phone 100 determines that the file corresponding to the event information of the first operation is the first file, or in other words, Mobile phone 100 determines the storage path of the first file corresponding to the event information of the first operation, or in other words, Mobile phone 100 determines that the first operation corresponds to the first file.

[0254] For more information about the S905, please refer to [link / reference]. Figure 8 S805 in the illustrated embodiment can be referred to in the preceding description.

[0255] S906, mobile phone 100 sends the metadata of the first file to portable computer, and portable computer receives the metadata of the first file from mobile phone 100.

[0256] For more information about the S906, please refer to [link / reference]. Figure 8 S806 in the illustrated embodiment can be referred to in the preceding description.

[0257] S907. The portable computer determines the application used to open the first file based on the metadata of the first file, for example, referred to as the second application.

[0258] For more information about the S907, please refer to [link / reference]. Figure 8 S807 in the illustrated embodiment may be referred to in the preceding description.

[0259] S908, The portable computer calls the second application to open the first file.

[0260] For more information about the S908, please refer to [link / reference]. Figure 8 S808 in the illustrated embodiment may be referred to in the preceding description.

[0261] S909. The user edits a first file on a portable computer and saves the edited first file. The edited first file may be called a second file, or an updated file, etc., and there are no restrictions on the name of the file.

[0262] For more information about the S909, please refer to [link / reference]. Figure 8 S809 in the illustrated embodiment may be referred to in the preceding description.

[0263] S910, the portable computer sends the second file to the mobile phone 100, and the mobile phone 100 receives the second file from the portable computer.

[0264] For more information about the S910, please refer to [link / reference]. Figure 8 S810 in the illustrated embodiment may be referred to in the preceding description.

[0265] S911. When a user performs an operation on mobile phone 100, mobile phone 100 collects the user's operation information and obtains the event information corresponding to the operation; in other words, mobile phone 100 detects the event information corresponding to the operation. For example, this operation is referred to as the first operation. Mobile phone 100 can capture the first operation and obtain the event information of the first operation. The first operation can be applied to a file icon; for example, this file icon is referred to as the first file icon. The first file icon can belong to at least one of the aforementioned file icons, that is, the user performs the first operation on the first file icon within the first interface displayed on mobile phone 100. The first file icon corresponds to a file; for example, this file is referred to as the first file.

[0266] Mobile phone 100 collects (or detects) the event information of the user's first operation, which is equivalent to mobile phone 100 detecting the first operation applied to the first file icon.

[0267] For more information about the S911, please refer to [link / reference]. Figure 8 S811 in the illustrated embodiment may be referred to in the preceding description.

[0268] S912, Mobile phone 100 determines that the event information of the first operation corresponds to mobile phone 100. Alternatively, mobile phone 100 determines that the first operation acts on mobile phone 100. Alternatively, mobile phone 100 determines that the first operation (or the event information of the first operation) acts on the display screen of mobile phone 100. Alternatively, mobile phone 100 determines that the file icon corresponding to the first operation is located on the display interface of mobile phone 100.

[0269] For more information about the S912, please refer to [link / reference]. Figure 8 S812 in the illustrated embodiment may be referred to in the preceding description.

[0270] S913 and Mobile Phone 100 output a prompt message, which is used to identify the device that opened the first file.

[0271] For example, mobile phone 100 can output a prompt message via display screen 194, which may include one or more options that can be used to determine the device to open the first file. An example of this prompt message can be found here. Figure 7A or Figure 7B .

[0272] For more information about the S913, please refer to the previous introduction.

[0273] S914, the user selects the first option among one or more options, and the mobile phone 100 detects the operation used to select the first option.

[0274] For example, you can continue to refer to... Figure 7DWhen a user touches option "1" with their finger, the touch sensor 180K detects this action and collects the event information. After collecting the event information, the touch sensor 180K sends it to the first management software. Upon receiving the event information from the touch sensor 180K, the first management software determines that the user has selected to open the first file on phone 100 using application 1 corresponding to "1".

[0275] The first option corresponds to, for example, the first application, which is installed on phone 100.

[0276] For more information about the S914, please refer to the previous introduction.

[0277] S915, Mobile phone 100 determines that the file corresponding to the event information of the first operation is the first file, or in other words, Mobile phone 100 determines the storage path of the first file corresponding to the event information of the first operation, or in other words, Mobile phone 100 determines that the first operation corresponds to the first file.

[0278] For more information about the S915, please refer to [link / reference]. Figure 8 S813 in the illustrated embodiment may be referred to in the preceding description.

[0279] S916, phone 100 calls the first application to open the first file.

[0280] For more information about the S916, please refer to [link / reference]. Figure 8 S814 in the illustrated embodiment may be referred to in the preceding description.

[0281] S917: The user edits a first file on mobile phone 100 and saves the edited first file. The edited first file is, for example, called the second file.

[0282] For more information about the S917, please refer to [link / reference]. Figure 8 S815 in the illustrated embodiment may be referred to in the preceding description.

[0283] S918, The user selected the second option from one or more options included in the prompt message, and the mobile phone 100 detected the operation for selecting the second option.

[0284] For example, you can continue to refer to... Figure 7B When a user touches the "PC Application" option with their finger, the touch sensor 180K detects this action and collects the event information. After collecting the event information, the touch sensor 180K sends it to the First Manager software. Upon receiving the event information from the touch sensor 180K, the First Manager software determines that the user has selected to open the first file on the portable computer.

[0285] For more information about the S918, please refer to the previous introduction.

[0286] After executing S918, you can continue to execute S906 to S910, which will not be elaborated further.

[0287] Steps S902-S910 and S911-S918 and beyond represent two parallel scenarios and may not occur simultaneously. For example, if the user selects to operate on a portable computer, steps S902-S910 will be executed; however, if the user selects to operate on mobile phone 100, steps S911-S918 and beyond will be executed. Similarly, steps S914-S917 and S918 and beyond also represent two parallel scenarios and may not occur simultaneously. For example, if the user selects to open the first file on the portable computer, steps S918 and beyond will be executed; however, if the user selects to open the first file on mobile phone 100, steps S914-S917 will be executed.

[0288] For example, sometimes a user may be operating on a mobile phone, but actually wants to display a file to other users on a portable computer. In such a scenario, the technical solution provided in this application allows the user to choose to open the file on a portable computer, thus completing the display process. Therefore, the technical solution provided in this application provides users with a choice, making it easier for them to select the appropriate device to open the file.

[0289] In the embodiments provided above, the methods provided by this application are described from the perspective of mobile phone 100 and portable computer as the executing entities. To implement the functions of the methods provided in the embodiments of this application, the mobile device (e.g., mobile phone 100 or portable computer) may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

[0290] like Figure 10As shown, other embodiments of this application disclose an electronic device, such as a mobile phone (e.g., mobile phone 100), a tablet, or a portable computer. The electronic device may include: a touchscreen 1001, wherein the touchscreen 1001 includes a touch-sensitive surface 1006 and a display screen 1007; an application program 1008; one or more processors 1002; and one or more memories 1003 for storing one or more programs 1004. The above devices can be connected via one or more communication buses 1005. The display screen 1007 can be used to display the content of a file in the electronic device; or the display screen 1007 can also be used to display the desktop of the electronic device; or the display screen 1007 can be used to display an image, etc.

[0291] When one or more programs 1004 stored in memory 1003 are executed by one or more processors 1002, the electronic device can be used to perform, for example... Figure 8 The illustrated embodiments or Figure 9 The steps in the illustrated embodiment or other corresponding embodiments.

[0292] It should be noted that the division of units in this embodiment is illustrative and represents only one logical functional division. In actual implementation, other division methods may be used. The functional units in this embodiment can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. For example, in the above embodiment, the first acquisition unit and the second acquisition unit can be the same unit or different units. The integrated unit can be implemented in hardware, as a software functional unit, or a combination of hardware and software functional units.

[0293] As used in the above embodiments, depending on the context, the term "when..." can be interpreted as meaning "if...", "after...", "in response to determining...", or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining...", "in response to determining...", "when (the stated condition or event) is detected", or "in response to detecting (the stated condition or event)".

[0294] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a program product. The program product includes one or more computer instructions. When the program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.

[0295] For purposes of explanation, the foregoing description has been given with reference to specific embodiments. However, the exemplary discussion above is not intended to be exhaustive, nor is it intended to limit the application to the precise forms disclosed. Many modifications and variations are possible based on the teachings above. The embodiments were chosen and described to fully elucidate the principles of the application and its practical application, thereby enabling others skilled in the art to fully utilize the application and its various embodiments with various modifications suitable for the particular intended use.

[0296] The methods provided in the embodiments of this application above are described from the perspective of a terminal device as the executing entity. To implement the functions of the methods provided in the embodiments of this application above, the terminal device may include hardware structures and / or software modules, implementing the above functions in the form of hardware structures, software modules, or a combination of hardware structures and software modules. Whether a particular function is executed in the form of hardware structures, software modules, or a combination of hardware structures and software modules depends on the specific application and design constraints of the technical solution.

Claims

1. A method of opening a file, characterized by, include: The first and second devices enter multi-screen collaboration mode through a preset method; The first device displays a first interface and projects the first interface onto the second interface of the second device. The second interface includes a projection interface, which is a mirror image of the first interface. The first interface includes at least one file icon, and the file corresponding to the at least one file icon is saved on the first device. The projection interface includes the at least one icon, and the file corresponding to the at least one file icon is saved on the first device. The first device detects an operation performed on one of the at least one file icons, so the file icon corresponds to a file; The first device determines that the operation is performed on the display screen of the first device or the display screen of the second device; When the operation is performed on the display screen of the first device, the file is opened on the first device; When the operation is applied to the display screen of the second device, the first device sends the file's metadata to the second device. The file's metadata is used to open the file on the second device. The file's metadata includes the file's storage path information in the first device, the file's type information, and the file's size information. The first device also sends the path of the symbolic link created by the first device to the second device.

2. The method of claim 1, wherein, The method further includes: The first device receives an update file from the second device, the update file being the updated file; The first device updates the locally stored file with the update file.

3. The method according to claim 1 or 2, characterized in that, The first device detects an operation performed on one of the at least one file icons, including: The first device receives event information from the second device, the event information indicating the operation, and the event information including the identifier of the second device; or, The first device detects the event information generated by the operation on the first device.

4. The method of claim 3, wherein, The first device determines that the operation is performed on the display screen of the second device, including: The first device determines, based on the identifier of the second device, that the operation is performed on the display screen of the second device.

5. The method of claim 1, wherein, The first device sends the file's metadata to the second device, including: The first device sends the file's metadata to the second device's distributed file management system through its own distributed file management system.

6. An apparatus, comprising: include: A display screen, one or more processors, a memory, and one or more programs; wherein the one or more programs are stored in the memory, and the one or more programs include instructions that, when executed by the device, cause the device to perform the method as described in any one of claims 1 to 5.

7. A readable storage medium, characterized by, The readable storage medium is used to store a program that, when run on the device, causes the device to perform the method as described in any one of claims 1 to 5.

Images