Processing method and related equipment

Abstract

The invention discloses a processing method and related equipment, and belongs to the technical field of terminal application, the disclosed processing method comprises a processing method applied to electronic equipment and a processing method applied to terminal equipment, and the processing method applied to the electronic equipment comprises the following steps: establishing a connection channel with the terminal equipment; configuring the terminal equipment as a virtual storage device based on the connection channel and the first service; obtaining a display image from the terminal device based on the connection channel and a second service, wherein the display image is used for representing an interactive interface of a first application program of the terminal device; the first application program corresponds to a plurality of first files belonging to the terminal equipment; obtaining operation information for the display image; first address information is obtained in response to the operation information, a target file is accessed through the first address information by a second application program based on the first service, and the target file belongs to a plurality of first files; the first application program belongs to terminal equipment, and the second application program belongs to electronic equipment.

Description

Technical Field

[0001] The present application belongs to the field of terminal application technology, and in particular, relates to a processing method and related equipment. Background Art

[0002] Screen projection has become one of the commonly used functions in terminal applications. It supports projecting application information of a connected terminal device onto the display screen of another device for display and use.

[0003] Currently, in a screen projection scenario, after projecting the application information of one terminal device onto the display screen of another device, when it is necessary to operate the projected information on the display screen of the destination device to access files on the source terminal device, there are problems such as low access efficiency and inconvenient access operations. Summary of the invention

[0004] To this end, this application discloses the following technical solutions:

[0005] A processing method, comprising:

[0006] Establish a connection channel with the terminal device;

[0007] Configuring the terminal device as a virtual storage device based on the connection channel and the first service, so that the electronic device can open the file on the terminal device;

[0008] Obtaining a display image from the terminal device based on the connection channel and the second service, the display image being used to represent an interactive interface of a first application of the terminal device; the first application corresponds to a plurality of accessible first files, and the plurality of first files belong to the terminal device;

[0009] Obtaining operation information for the displayed image;

[0010] obtaining first address information through the connection channel in response to the operation information;

[0011] In response to the operation information, based on the first service, a second application program accesses a target file through the first address information, the target file belonging to the plurality of first files;

[0012] The first application belongs to the terminal device, and the second application belongs to the electronic device.

[0013] Optionally, configuring the terminal device as a virtual storage device based on the connection channel and the first service includes:

[0014] In response to satisfying the mounting condition, the terminal device is mounted on a directory of the electronic device file system based on the connection channel and the first service, so as to configure the terminal device as a virtual storage device of the electronic device.

[0015] Optionally, obtaining the first address information through the connection channel in response to the operation information includes:

[0016] In response to the operation information, transmitting the operation information to the terminal device through the connection channel, so that the terminal device identifies the target file indicated by the operation information and determines the first address information of the target file on the terminal device;

[0017] The first address information transmitted by the terminal device is obtained through the connection channel.

[0018] Optionally, the accessing the target file by using the second application program through the first address information based on the first service includes:

[0019] Determine, according to an address mapping rule, second address information corresponding to the first address information in the file system directory of the electronic device; the address mapping rule is used to characterize a mapping relationship between the file system directory of the terminal device and the file system directory of the electronic device;

[0020] Based on the first service, the second application program accesses the target file through the second address information.

[0021] Optionally, before accessing the target file by using the second application program through the first address information based on the first service, the method further includes:

[0022] The target file is located based on the first business through the first address information, and the location result of the target file is displayed, so as to trigger the step of accessing the target file with a second application based on the first business when operation information applied to the location result is obtained to indicate access to the target file.

[0023] A processing method, comprising:

[0024] Establishing a connection channel with electronic equipment;

[0025] Based on the connection channel and the first service, the terminal device is configured as a virtual storage device of the electronic device, wherein the virtual storage device stores a plurality of first files that are accessible to the first application program;

[0026] Transmitting a display image for display to the electronic device based on the connection channel and the second service, wherein the display image is used to represent an interactive interface of the first application;

[0027] Obtaining operation information for the display image transmitted by the electronic device based on the connection channel;

[0028] In response to obtaining the operation information, transmitting first address information to the electronic device through the connection channel, so that the electronic device accesses a target file on the terminal device through the first address information with a second application based on the first service; the target file belongs to the plurality of first files;

[0029] The first application belongs to the terminal device, and the second application belongs to the electronic device.

[0030] Optionally, configuring the terminal device as a virtual storage device of the electronic device based on the connection channel and the first service includes:

[0031] In response to satisfying the mounting condition, the terminal device is mounted on a directory of the electronic device file system based on the connection channel and the first service, so as to configure the terminal device as a virtual storage device of the electronic device.

[0032] Optionally, transmitting the first address information to the electronic device through the connection channel includes:

[0033] In response to obtaining the operation information, identifying a target file indicated by the operation information;

[0034] Determine first address information of the target file on the terminal device;

[0035] The first address information is transmitted to the electronic device through the connection channel.

[0036] An electronic device, comprising:

[0037] A first memory, for storing a computer instruction set;

[0038] The first processor is configured to implement the following processing by executing a computer instruction set in the first memory:

[0039] Establish a connection channel with the terminal device;

[0040] Configuring the terminal device as a virtual storage device based on the connection channel and the first service, so that the electronic device can open the file on the terminal device;

[0041] Obtaining a display image from the terminal device based on the connection channel and the second service, the display image being used to represent an interactive interface of a first application of the terminal device; the first application corresponds to a plurality of accessible first files, and the plurality of first files belong to the terminal device;

[0042] Obtaining operation information for the displayed image;

[0043] obtaining first address information through the connection channel in response to the operation information;

[0044] In response to the operation information, based on the first service, a second application program accesses a target file through the first address information, the target file belonging to the plurality of first files;

[0045] The first application belongs to the terminal device, and the second application belongs to the electronic device.

[0046] A terminal device, comprising:

[0047] A second memory for storing a computer instruction set;

[0048] The second processor is configured to implement the following processing by executing the computer instruction set in the second memory:

[0049] Establishing a connection channel with electronic equipment;

[0050] Based on the connection channel and the first service, the terminal device is configured as a virtual storage device of the electronic device, wherein the virtual storage device stores a plurality of first files that are accessible to the first application program;

[0051] Transmitting a display image for display to the electronic device based on the connection channel and the second service, wherein the display image is used to represent an interactive interface of the first application;

[0052] Obtaining operation information for the display image transmitted by the electronic device based on the connection channel;

[0053] In response to obtaining the operation information, transmitting first address information to the electronic device through the connection channel, so that the electronic device accesses a target file on the terminal device through the first address information with a second application based on the first service; the target file belongs to the plurality of first files;

[0054] The first application belongs to the terminal device, and the second application belongs to the electronic device. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are merely embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0056] Figure 1 is a flow chart of a processing method applied to an electronic device provided by the present application;

[0057] Figure 2 This is an example of displaying a display image transmitted by a terminal device on an electronic device provided by the present application;

[0058] FIG. 3( a ) and FIG. 3( b ) are respectively different examples of accessing a target file with a second application based on a first service on an electronic device provided by the present application;

[0059] Figure 4 is a flow chart of a processing method applied to a terminal device provided by the present application;

[0060] Figure 5 It is a composition structure diagram of a processing device applied to an electronic device provided by the present application;

[0061] Figure 6 It is a composition structure diagram of a processing device applied to a terminal device provided by the present application;

[0062] Figure 7 It is a structural diagram of the electronic device provided by this application;

[0063] Figure 8 This is a composition structure diagram of the terminal device provided by this application. DETAILED DESCRIPTION

[0064] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0065] The embodiments of the present application provide a processing method and related equipment for improving the efficiency and convenience of accessing files on a screen projection source device at a screen projection destination in a screen projection application scenario.

[0066] The processing method provided in the embodiment of the present application includes a processing method applied to an electronic device and a processing method applied to a terminal device. For the screen projection application scenario, the electronic device is a screen projection destination device, and the terminal device is a screen projection source device, that is, the electronic device is a device that passively receives projection content, and the terminal device is a device that actively projects the screen to provide projection content.

[0067] The electronic device and the terminal device may be electronic devices in various general or special computing device environments or configurations, such as personal computers, server computers, handheld devices or portable devices, tablet devices, multi-processor devices, etc. Optionally, the electronic device and the terminal device may each have a display screen, which may include a display screen built into the device and / or an external display screen.

[0068] See also Figure 1 As shown in the method flow chart, the processing method provided in the embodiment of the present application for an electronic device (i.e., a device that passively receives projection content) may include at least the following steps 101 to 106, which are described in detail below.

[0069] Step 101: Establish a connection channel with a terminal device.

[0070] When a user needs to perform screen projection application between a terminal device and an electronic device, a connection channel can be first established between the electronic device and the terminal device. Optionally, the established connection channel can be a wireless connection channel, which can be but is not limited to a wireless connection channel based on Bluetooth or Wi-Fi.

[0071] During implementation, intelligent connection software that can be used to establish a connection channel between devices and support multiple services related to screen projection (such as the first service and the second service involved later in the embodiments of the present application) can be developed in advance and installed on the electronic device and the terminal device respectively. On this basis, when the user needs to perform screen projection applications between the terminal device and the electronic device, the user can operate the connection software on the electronic device and / or the terminal device, such as clicking the connection function control on the software interface on the electronic device or the terminal device, to trigger the electronic device or the terminal device to scan the devices in the environment space and establish a communication connection with the scanned corresponding devices, etc., so as to establish a connection channel between the electronic device and the terminal device.

[0072] In addition, optionally, when establishing a connection channel between an electronic device and a terminal device, the identities of the two-end devices establishing the connection channel can also be configured. For example, the terminal device (such as a mobile phone) can be configured as a screen projection source device, that is, a device that actively projects the screen to provide projection content, and the electronic device (such as a PC) can be configured as a screen projection destination device, that is, a device that passively receives projection content, etc.

[0073] Step 102: configure the terminal device as a virtual storage device based on the connection channel and the first service, so that the electronic device can open the file on the terminal device.

[0074] The first service is a service that can be used to process the screen projection source device as a virtual storage device of the screen projection destination device, and supports opening files of the screen projection source device on the screen projection destination device. Based on this first service, the screen projection destination device can use the screen projection source device as its own (screen projection destination device, such as a PC) virtual storage device to conveniently and efficiently access files on the screen projection source device.

[0075] In this step, the terminal device can be configured as a virtual storage device of the electronic device by mounting the terminal device to a directory of the electronic device file system based on the connection channel and the first service in response to satisfying the mounting condition.

[0076] In an optional implementation, the mounting condition may be that the electronic device completes the establishment of a connection channel with the terminal device. In this implementation, once the electronic device detects that the connection channel with the terminal device is completed, it can automatically obtain the system file directory of the terminal device (such as a mobile phone) through the connection channel based on the first service, and adaptively connect the system file directory of the terminal device to a predetermined node of the system file directory of the electronic device, such as the E drive of the PC, to achieve the mounting of the terminal device to the electronic device file system directory, thereby configuring the terminal device as an electronic virtual storage device, thereby supporting the electronic device to use the terminal device as its own (electronic device, such as a PC) virtual storage device to efficiently and conveniently access files on the terminal device.

[0077] In other optional implementations, the mounting condition may also be that the electronic device detects the start of the first service / second service, or the electronic device detects operation information for a display image from the terminal device, or the electronic device receives a mount instruction from the terminal device through the connection channel, etc. In this implementation, the electronic device obtains the system file directory of the terminal device (such as a mobile phone) based on the first service, and connects the system file directory of the terminal device to a predetermined node of the system file directory of the electronic device, so as to configure the terminal device as an electronic virtual storage device.

[0078] The second service is a screen projection service, which supports the electronic device and the terminal device to perform screen projection applications based on a connection channel between the two.

[0079] The display image from the terminal device is used to represent the interactive interface of the first application of the terminal device. The first application can be any application running on the terminal device, and can be an application running in the foreground or background of the terminal device. There is no limitation on this and it can be determined according to the actual application situation.

[0080] Step 103: obtaining a display image from the terminal device based on the connection channel and the second service, wherein the display image is used to represent an interactive interface of a first application of the terminal device; the first application corresponds to a plurality of accessible first files, and the plurality of first files belong to the terminal device.

[0081] The first application is essentially an application on the terminal device that is used to project the screen to the electronic device. In actual applications, after the connection channel between the electronic device and the terminal device is established, the terminal device can be further configured with an application on the electronic device and / or the terminal device that is used to project the screen to the electronic device. For example, on the interface of the above-mentioned smart connection software of the electronic device and / or the terminal device, the WeChat application on the terminal device is selected, thereby configuring WeChat as an application on the terminal device that is used to project the screen to the electronic device, that is, the first application.

[0082] Under the second service, the terminal device can obtain the display image by taking a screenshot of the interactive interface of the first application, and can transmit the display image to the electronic device through the connection channel between the electronic device, for example, transmitting the display image to the electronic device in the form of streaming media.

[0083] For the electronic device that serves as the screen projection destination, it can receive the display image from the terminal device based on the connection channel and the second service, and display the received display image, so as to realize the screen projection of the first application on the terminal device to the electronic device.

[0084] It is easy to understand that the form of the display image displayed by the electronic device is consistent with the form of the display image on the terminal device, see Figure 2 , shows an example of the display image displayed on the PC (the screen projection destination), which is specifically a display image formed by the interactive interface of the WeChat application on the mobile phone (the screen projection source), and the form of the display image displayed on the PC is consistent with the form of the WeChat interactive interface on the mobile phone.

[0085] The first application corresponds to multiple accessible first files, and the multiple first files belong to the terminal device. That is to say, the multiple first files are stored in the storage space of the terminal device. Still taking the screen projection source device as a mobile phone and the screen projection destination device as a PC as an example, assuming that the first application is WeChat on the mobile phone, the multiple first files may include but are not limited to office documents (such as PDF files, word files), pictures and / or audio and video files received and stored by the user through WeChat. These files belong to the mobile phone (not the PC) and are stored in the local storage space of the mobile phone.

[0086] Step 104: Obtain operation information for the displayed image.

[0087] After the display image is displayed on the electronic device, the user can perform corresponding operations on the display image according to actual needs, for example, clicking on a PDF file, a picture, or a video on the WeChat chat interface of the mobile phone displayed on the PC to open the PDF file / picture / video for use.

[0088] The electronic device can detect operation information for the display image. The detected operation information for the display image includes at least the operation position of the operation applied to the display image, and in addition, may also include but is not limited to a mark indicating that the operation position is within the position area of ​​the display image, the operation event type of the operation, etc. Among them, the operation position of the operation applied to the display image can be, but is not limited to, expressed in the form of operation position coordinates. The operation event type can be, but is not limited to, click, double-click, slide, etc.

[0089] The display image (that is, the image projected from the terminal device) corresponds to a corresponding position area on the electronic device. In actual applications, for operations applied to the content displayed by the electronic device, when the electronic device detects the applied operation, it can first identify whether the operation position of the operation is located in the position area of ​​the display image. If so, it indicates that the applied operation is an operation for the display image, that is, an operation for the content projected from the terminal device. If not, it indicates that the applied operation is an operation for the display content of the electronic device itself (such as an application interface that is run and displayed by the electronic device itself, which is different from the projected content).

[0090] When it is identified that the operation position of the applied operation is located within the position area of ​​the display image, and the applied operation is correspondingly characterized as an operation for the display image, the electronic device can obtain operation information for the display image, such as the position coordinates of the applied operation on the display image, an identifier indicating that the operation position of the applied operation is within the position area of ​​the display image, the operation event type of the applied operation, and the like.

[0091] When it is identified that the operation position of the applied operation is not located within the position area of ​​the displayed image, and the corresponding characterization shows that the applied operation is an operation for displaying content of the electronic device itself, the electronic device can directly respond to the operation to achieve a response to the operation. For example, when it is detected that the user double-clicks the application icon operation applied to an application installed on the electronic device itself, the application is started and the application interface of the application is displayed.

[0092] Step 105: Obtain first address information through the connection channel in response to the operation information.

[0093] In the case where the applied operation is an operation on the displayed image, the electronic device responds to obtaining the operation information on the displayed image, and specifically transmits the operation information to the terminal device through the connection channel, so that the terminal device identifies the target file indicated by the operation information and determines the first address information of the target file on the terminal device. For example, the mobile phone converts the click position coordinates of the WeChat display image (the image of the WeChat projection interface) transmitted from the PC into the touch coordinates of the WeChat interface on the mobile phone, and identifies the target file indicated by the operation information based on the touch coordinates, such as the PDF file received in WeChat, and can further determine the first address information of the PDF file on the mobile phone.

[0094] On this basis, terminal devices such as mobile phones can transmit the first address information to electronic devices such as PCs through the connection channel, and electronic devices such as PCs can correspondingly receive the first address information transmitted by the terminal devices through the connection channel.

[0095] Step 106: In response to the operation information, based on the first service, a second application program accesses a target file through the first address information, where the target file belongs to the plurality of first files.

[0096] The first application belongs to a terminal device, and the second application belongs to an electronic device.

[0097] On the basis of step 105, in this step, the electronic device can further automatically access the target file on the terminal device through the first address information using the second application based on the first service. In this access event, the electronic device specifically uses the terminal device as the electronic device's own virtual storage device to access the target file indicated by the first address information on the terminal device using the second application of the electronic device.

[0098] By mounting the terminal device on the directory of the file system of the electronic device so as to configure the terminal device as a virtual storage device of the electronic device, there is a certain mapping relationship between the system file directory of the terminal device and the system file directory of the electronic device after the mounting is completed. In view of this situation, the embodiment of the present application has formulated a corresponding address mapping rule based on the mounting event in advance, and the address mapping rule is used to characterize the mapping relationship between the file system directory of the terminal device and the file system directory of the electronic device. For example, assuming that the mobile phone is mounted on the E disk of the PC, the address mapping rule can specifically characterize the mapping relationship between the system file directory of the mobile phone and its file directory on the E disk of the PC.

[0099] Based on this, in this step 106, the electronic device such as a PC can first determine the second address information corresponding to the first address information in the file system directory of the electronic device according to the address mapping rule, that is, the first address information corresponding to the file system directory of the mobile phone sent by the terminal device such as the mobile phone is converted into the second address information that can be recognized by the electronic device such as the PC and matches the file system directory of the electronic device such as the PC itself.

[0100] Afterwards, the electronic device can further access the target file on the terminal device through the second address information with a second application based on the first service. The second application belongs to the electronic device, and the second application matches the target file. For example, if the target file is a PDF file, the second application can be a PDF reader / editor installed on the electronic device; if the target file is a picture or video, the second application can be a picture browser / editor or video player installed on the electronic device.

[0101] Based on the above processing, during the screen projection application process, electronic devices such as PCs can, based on the first service, use the terminal device that actively projects the screen to provide the projection content as the electronic device's own virtual storage device, and use the electronic device's own second application to directly access the files stored on the terminal device, rather than treating the terminal device as a device independent of the electronic device. Accordingly, the electronic device does not need to access the target file on the terminal device in a projection manner. Moreover, the two services (the first service for processing the projection source device as a virtual storage device of the projection destination device and supporting related applications, and the second service for projection) do not conflict with each other. The two services can run in parallel or serially according to actual needs during the screen projection application process between the terminal device and the electronic device.

[0102] Through the above processing method, based on the solution of the embodiment of the present application, when a user needs to access a target file belonging to a terminal device displayed on the display image (the image of the content projected by the terminal device) on an electronic device such as a PC, such as when a PDF file received and stored in WeChat on a mobile phone is needed, on the one hand, the electronic device does not need to obtain the file content of the target file on the terminal device through the traditional screen projection method, and accordingly does not need to perform complicated screen projection interactions with the terminal device to obtain the projection content of each frame of the target file. It is only necessary to configure the terminal device as a virtual storage device of the electronic device, and obtain the first storage address of the target file in the terminal device, and then locate the target file in the terminal device based on the first application and the first storage address for access, thereby reducing the complexity of interaction between devices and improving file access efficiency.

[0103] On the other hand, since the terminal device is configured as a virtual storage device of the electronic device under the first service rather than a device independent of the electronic device, it supports the electronic device to use its own second application to open the target file on the terminal device for access. For example, the PC can directly use its PDF reader / editor based on the first application to open the PDF file received and stored on the mobile phone by WeChat. This allows the file content of the target file to be displayed in the interface form of the electronic device without being limited to the form of the projection interface.

[0104] For example, see Figure 3 (a), in the application scenario of mobile phone screen projection to PC, based on the present application scheme, the display interface form after using the PC's pdf reader / editor to open the pdf file received and stored on the mobile phone WeChat is a large-screen display form adapted to the display screen of electronic devices such as PC, getting rid of the limitation of the screen projection interface form of the mobile phone on the PC, and making it more convenient for users to access the file content on electronic devices such as PC. For another example, see Figure 3 (b), if the user clicks on the thumbnail of a certain picture on the album interface projected from the mobile phone on an electronic device such as PC, the large-size high-definition picture can be directly displayed in the large-size picture form of electronic devices such as PC based on the PC's picture browser, without being limited to the screen projection interface form of the album. And the large-size high-definition picture displayed in the large-size picture form of electronic devices such as PC is different from the content in the projection window. For example, in combination with the content displayed in the mobile phone projection window form in Figure 3 (b), the projection window can display the homepage of the album, such as thumbnails of multiple pictures.

[0105] Access to the target file on the electronic device may include, but is not limited to, browsing the file content of the target file based on the first business, editing the file content (such as adding, deleting, or formatting the file content), and / or changing the storage location of the target file on the terminal device, etc.

[0106] Since the terminal device under the first service is a virtual storage device of the electronic device, therefore, when the user accesses the target file on the electronic device, the processing results of the editing processing on the target file (such as adding new content or deleting content, etc.) will be directly synchronized with the save operation and saved to the terminal device. In this process, the electronic device also does not need to interact with the terminal device through screen projection to realize the feedback of editing instructions, editing content and other editing-related data information to the terminal device. Accordingly, the terminal device does not need to perform corresponding screen projection processing based on this information (such as identifying the operation object according to the operation position, determining and generating the processing result of the operation object according to the operation event of the operation object, and taking a screenshot of the operation result and synchronizing it to the electronic device in streaming media to realize screen projection, etc.), thereby further reducing the complexity of interaction between devices and improving file access efficiency.

[0107] In summary, the processing method applied to an electronic device provided in the embodiment of the present application sets a first service and a second service based on a connection channel, and on this basis, establishes a connection channel between the electronic device and the terminal device, configures the terminal device as a virtual storage device based on the connection channel and the first service, and obtains a display image from the terminal device based on the connection channel and the second service. In the screen projection application scenario between the electronic device and the terminal device, the electronic device can use the terminal device as the electronic device's own virtual storage device to directly access files on the terminal device without having to treat the terminal device as a device independent of the electronic device. Accordingly, there is no need to access the target file on the terminal device in a screen projection manner, thereby reducing the complexity of interaction between devices during the screen projection application process, improving file access efficiency, and supporting the electronic device to access the target file in an interface form that adapts to its display screen, without limiting the file interface to the form of the projection interface, thereby further improving the convenience of users accessing target files and improving user experience.

[0108] In an optional embodiment, the processing method applied to the electronic device provided in the embodiment of the present application may further include the following processing before the second application program accesses the target file through the first address information based on the first service:

[0109] The target file is located based on the first business through the first address information, and the location result of the target file is displayed, so as to trigger the step of accessing the target file with a second application based on the first business when operation information applied to the location result is obtained to indicate access to the target file.

[0110] In this embodiment, when the electronic device obtains the first address information transmitted by the terminal device and locates the target file through the first address information based on the first service, it can first determine the second address information corresponding to the first address information in the file system directory of the electronic device according to the address mapping rule described above, and on this basis, locate the target file in the terminal device through the second address information based on the first service, and generate a positioning result of the target file for display.

[0111] Among them, the positioning result of the target file may specifically include a file icon of the target file located on the corresponding directory node of the file system directory of the electronic device (in this case, the terminal device is a virtual storage device of the electronic device, and the file system directory of the terminal device is converted into a part of the file system directory of the electronic device) according to the second address information, and the directory node and the target file icon under the node may be displayed to support the user to decide whether to open and access the target file according to actual needs. Among them, if the user needs to open and access the target file, the target file can be quickly opened by directly applying an open operation to the target file icon under the corresponding directory node displayed to access it.

[0112] In response to the user's operation of opening the target file, the electronic device can open the target file with the second application based on the first service, so that the user can access the target file such as viewing and editing the content.

[0113] In this embodiment, after the electronic device obtains the first address information transmitted by the terminal device, it first locates the target file based on the first service using the first address information and displays the location result of the target file, so that the user can decide whether to open and access the target file according to actual needs. When the user instructs to open the target file, the target file is further opened with the second application based on the first service for user access. Therefore, this embodiment further improves the human-computer interactivity in the screen projection application and further improves the user experience.

[0114] See also Figure 4 As shown in the method flow chart, the processing method provided in the embodiment of the present application and applied to the terminal device (i.e., the device that actively projects the screen to provide projection content) may at least include the following steps 401 to 405, which are described in detail below.

[0115] Step 401: Establish a connection channel with an electronic device.

[0116] As mentioned above, when a user needs to perform a screen projection application between a terminal device and an electronic device, a connection channel can be first established between the electronic device and the terminal device. The established connection channel can be a wireless connection channel, which can be but is not limited to a wireless connection channel based on Bluetooth or Wi-Fi.

[0117] Specifically, but not limited to, operating smart connection software on the terminal device and / or electronic device, such as by clicking a connection function control on the software interface on the electronic device or terminal device, to trigger the electronic device or terminal device to scan the devices in the environment space and establish a connection channel with the scanned corresponding devices.

[0118] Step 402: Based on the connection channel and the first service, the terminal device is configured as a virtual storage device of the electronic device, wherein the virtual storage device stores a plurality of first files that are accessible to the first application program.

[0119] For details of the first service, please refer to the previous description, which will not be repeated here.

[0120] To match the processing at the electronic device end, the terminal device can also be configured as a virtual storage device of the electronic device through mounting processing.

[0121] Optionally, in response to satisfying the mounting condition, the terminal device may mount the terminal device to a directory of the electronic device file system based on the connection channel and the first service, thereby configuring the terminal device as a virtual storage device of the electronic device.

[0122] The mounting conditions here correspond to the mounting conditions on the electronic device side, and may specifically be but are not limited to any one of the following: the terminal device completes establishing a connection channel with the electronic device; the terminal device detects the start of the first service / second service; the terminal device receives operation information from the electronic device for the displayed image; the terminal device receives a mounting instruction from the electronic device.

[0123] In response to meeting the mounting conditions, terminal devices such as mobile phones can specifically transmit their file system directories to electronic devices through the connection channel, so that electronic devices such as PCs can mount the terminal device in the file system directory of the electronic device by adaptively connecting the file system directory of the terminal device to a predetermined node (such as drive E) of the file system directory of the electronic device, and based on the mounting process, configure the terminal device as a virtual storage device of the electronic device.

[0124] Step 403: Transmit a display image for display to the electronic device based on the connection channel and the second service, where the display image is used to represent an interactive interface of the first application.

[0125] The second service is a screen projection service, which supports the electronic device and the terminal device to perform screen projection applications based on a connection channel between the two.

[0126] The first application is essentially an application on the terminal device that is used to project the screen to the electronic device. In actual applications, after the connection channel between the electronic device and the terminal device is established, the terminal device can be further configured with an application on the electronic device and / or the terminal device that is used to project the screen to the electronic device. For example, on the interface of the above-mentioned smart connection software of the electronic device and / or the terminal device, the WeChat application on the terminal device is selected, thereby configuring WeChat as an application on the terminal device that is used to project the screen to the electronic device, that is, the first application.

[0127] Under the second service, the terminal device can obtain the display image by taking a screenshot of the interactive interface of its first application, and can transmit the display image to the electronic device through a connection channel between the electronic device, for example, transmitting the display image to the electronic device in the form of streaming media, etc., so as to realize screen projection of the interactive interface of the first application to the electronic device.

[0128] The electronic device can correspondingly receive the display image from the terminal device based on the connection channel and the second service, and display the received display image, thereby realizing the screen projection of the first application on the terminal device to the electronic device.

[0129] Step 404: Obtain operation information for the display image transmitted by the electronic device based on the connection channel.

[0130] The operation information is operation information for performing operations on the display image on the electronic device, and at least includes the operation position of the operation applied to the display image on the electronic device. In addition, optionally, it may also include but is not limited to information such as an identifier for indicating that the operation position is within the position area of ​​the display image, the operation event type of the operation, and the like.

[0131] Step 405: In response to obtaining the operation information, transmit first address information to the electronic device through the connection channel, so that the electronic device accesses a target file on the terminal device through the first address information with a second application based on the first service; the target file belongs to the multiple first files.

[0132] The first application belongs to the terminal device, and the second application belongs to the electronic device.

[0133] In response to obtaining the operation information, the terminal device may first identify the target file indicated by the operation information on the terminal device based on the operation information (such as the operation position of the operation applied to the displayed image), and determine the first address information of the target file on the terminal device. For example, the operation position of the operation applied to the displayed image is converted to the touch position on the mobile phone, and the operation information is identified according to the touch position as indicating a PDF file received by the mobile phone WeChat, and the first address information of the PDF file on the mobile phone is determined, etc. On this basis, the first address information can be further transmitted to an electronic device, such as a PC, through the connection channel.

[0134] After receiving the first address information, the PC or other electronic device can determine the second address information corresponding to the first address information in the file system directory of the electronic device according to the above-mentioned address mapping rule, and access the target file through the second address information with the second application based on the first service. For example, based on the first service, the PC or other electronic device can access the PDF file received and stored from WeChat on the mobile phone or other terminal device through the second address information with the PDF reader / editor on the PC.

[0135] The processing method applied to the terminal device in the embodiment of the present application is matched with the processing method applied to the electronic device in the previous embodiment. Specifically, the processing methods respectively applied to the devices at both ends can be referred to each other to understand the solution.

[0136] In summary, the processing method applied to the terminal device provided in the embodiment of the present application sets a first service and a second service based on a connection channel, and on this basis, establishes a connection channel between the terminal device and the electronic device, configures the terminal device as a virtual storage device based on the connection channel and the first service, and transmits a display image for display to the electronic device through the connection channel and the second service. In the screen projection application scenario between the electronic device and the terminal device, the electronic device can use the terminal device as the electronic device's own virtual storage device to directly access the files on the terminal device without having to treat the terminal device as a device independent of the electronic device. Accordingly, there is no need to access the target file on the terminal device in a screen projection manner, thereby reducing the complexity of interaction between devices during the screen projection application process, improving file access efficiency, and enabling the electronic device to access the target file in an interface form that adapts to its display screen, without limiting the file interface to the form of the projection interface, thereby further improving the convenience of users accessing the target file and improving the user experience.

[0137] In an optional embodiment, the processing method applied to the terminal device provided by the present application may further include the following processing from 1-1 to 1-2 before transmitting the first address information to the electronic device through the connection channel:

[0138] 1-1. Determine whether the first service has been started and whether the first service is running successfully.

[0139] Specifically, after the terminal device identifies the target file indicated by the operation information on the terminal device based on the operation information from the electronic device, it can first detect whether the first service has been started, and if started, it can further detect whether the first service is running successfully and whether there are any abnormalities.

[0140] 1-2. If so, trigger the step of transmitting the first address information to the electronic device through the connection channel; if not, start the first application, and if the startup is successful, trigger the step of transmitting the first address information to the electronic device through the connection channel; if the startup fails, transmit the display image of the file content of the target file to the electronic device based on the corresponding connection channel.

[0141] If, based on the detection in step 1-1, it is determined that the first service is started and runs successfully, the step of transmitting the first address information to the electronic device through the connection channel can be triggered to transmit the first address information of the target file on the terminal device to the electronic device, thereby supporting the electronic device to use the terminal device as the electronic device's own virtual storage device, and based on the first service, using the second application to access the target file in the terminal device through the first address information.

[0142] On the contrary, if the first service is not started or fails to run successfully after being started, the terminal device can temporarily restart the first service, and then transmit the first address information to the electronic device through the connection channel when the first service is temporarily started and successfully started, so as to avoid the phenomenon that the electronic device cannot effectively respond to the first address information when the first service is not started or the first service fails to run successfully. If the startup fails, the terminal device can take a screenshot of the file content interface of the target file indicated by the operation information based on the screen projection method, obtain the display image of the file content, and transmit the display image to the electronic device through the connection channel, so as to access the target file on the electronic device based on the conventional screen projection method.

[0143] In this embodiment, before the terminal device transmits the first address information to the electronic device, it first determines whether the first service has been started and the first service is successfully running, and performs different matching processing for different determination results, which can effectively avoid the problem that the first address information is transmitted to the electronic device when the first service is not started or the first service is not successfully running, causing the electronic device to be unable to effectively respond to the first address information. At the same time, when the first service fails to start, it can support the electronic device's access to the target file on the terminal device by intelligently switching to the conventional screen projection method, thereby effectively avoiding the electronic device's access to the target file on the terminal device being affected by the abnormality of the first service. While ensuring the efficiency and convenience of the electronic device's access to the target file of the terminal device based on the first service as much as possible, it can also ensure normal access to the target file on the terminal device on the electronic device in the event of an abnormality of the first service.

[0144] Corresponding to the above-mentioned processing method applied to electronic devices, the present application embodiment also provides a processing device applied to electronic devices, and its composition structure is as follows: Figure 5 As shown, including:

[0145] A first connection establishing module 501, used to establish a connection channel with a terminal device;

[0146] A first configuration module 502, configured to configure the terminal device as a virtual storage device based on the connection channel and the first service, so that the electronic device can open the file on the terminal device;

[0147] A first acquisition module 503 is used to obtain a display image from the terminal device based on the connection channel and the second service, wherein the display image is used to represent an interactive interface of a first application of the terminal device; the first application corresponds to a plurality of first files that are accessible, and the plurality of first files belong to the terminal device;

[0148] A second acquisition module 504, used to obtain operation information for the display image;

[0149] A third acquisition module 505, configured to obtain first address information through the connection channel in response to the operation information;

[0150] An access module 506, configured to access a target file through the first address information with a second application program based on the first service in response to the operation information, the target file belonging to the plurality of first files;

[0151] The first application belongs to the terminal device, and the second application belongs to the electronic device.

[0152] In an optional implementation manner, the first configuration module 502 is specifically configured to:

[0153] In response to satisfying the mounting condition, the terminal device is mounted on a directory of the electronic device file system based on the connection channel and the first service, so as to configure the terminal device as a virtual storage device of the electronic device.

[0154] In an optional implementation manner, the third acquisition module 505 is specifically configured to:

[0155] In response to the operation information, transmitting the operation information to the terminal device through the connection channel, so that the terminal device identifies the target file indicated by the operation information and determines the first address information of the target file on the terminal device;

[0156] The first address information transmitted by the terminal device is obtained through the connection channel.

[0157] In an optional implementation, the access module 506 is specifically configured to:

[0158] Determine, according to an address mapping rule, second address information corresponding to the first address information in the file system directory of the electronic device; the address mapping rule is used to characterize a mapping relationship between the file system directory of the terminal device and the file system directory of the electronic device;

[0159] Based on the first service, the second application program accesses the target file through the second address information.

[0160] In an optional embodiment, the above-mentioned device also includes a positioning processing module, which is used to locate the target file based on the first business through the first address information before the target file is accessed by the second application through the first address information based on the first business, and display the positioning result of the target file, so as to trigger the processing of accessing the target file by the second application based on the first business when the operation information applied to the positioning result for indicating access to the target file is obtained.

[0161] Corresponding to the above-mentioned processing method applied to the terminal device, the embodiment of the present application also provides a processing device applied to the terminal device, and its composition structure is as follows: Figure 6 As shown, including:

[0162] The second connection establishing module 601 is used to establish a connection channel with an electronic device;

[0163] A second configuration module 602, configured to configure the terminal device as a virtual storage device of the electronic device based on the connection channel and the first service, wherein the virtual storage device stores a plurality of first files that are accessible to the first application program;

[0164] A first transmission module 603, configured to transmit a display image for display to the electronic device based on the connection channel and the second service, wherein the display image is used to represent an interactive interface of the first application;

[0165] A fourth acquisition module 604 is configured to obtain, based on the connection channel, operation information for the display image transmitted by the electronic device;

[0166] A second transmission module 605 is configured to transmit first address information to the electronic device through the connection channel in response to obtaining the operation information, so that the electronic device can access a target file on the terminal device through the first address information with a second application based on the first service; the target file belongs to the multiple first files;

[0167] The first application belongs to the terminal device, and the second application belongs to the electronic device.

[0168] In an optional implementation manner, the second configuration module 602 is specifically configured to:

[0169] In response to satisfying the mounting condition, the terminal device is mounted on a directory of the electronic device file system based on the connection channel and the first service, so as to configure the terminal device as a virtual storage device of the electronic device.

[0170] In an optional implementation manner, the second transmission module 605 is specifically configured to:

[0171] In response to obtaining the operation information, identifying a target file indicated by the operation information;

[0172] Determine first address information of the target file on the terminal device;

[0173] The first address information is transmitted to the electronic device through the connection channel.

[0174] The present application also provides an electronic device, the structure of which is as follows: Figure 7 As shown, including:

[0175] The first memory 701 is used to store a computer instruction set;

[0176] The first processor 702 is configured to implement a processing method applied to an electronic device provided in any of the above method embodiments by executing a computer instruction set in the first memory.

[0177] At the same time, the embodiment of the present application also provides a terminal device, whose composition structure is as follows Figure 8 As shown, including:

[0178] The second memory 801 is used to store a computer instruction set;

[0179] The second processor 802 is configured to implement the processing method applied to the terminal device provided in any of the above method embodiments by executing the computer instruction set in the first memory.

[0180] In addition to the memory and the processor, the electronic device or terminal device may also be provided with a display device and / or a display interface and may be able to be connected to an external display device.

[0181] Optionally, the electronic device or terminal device may further include a camera component, and / or be connected to an external camera component.

[0182] In addition, the electronic device or terminal device may also include components such as a communication interface and a communication bus. The memory, the processor and the communication interface communicate with each other through the communication bus.

[0183] The communication interface is used for communication between electronic devices or terminal devices and other devices. The communication bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc.

[0184] An embodiment of the present application also provides a storage medium, which carries one or more computer instruction sets. When the one or more computer instruction sets are executed by an electronic device, the electronic device can implement a processing method applied to an electronic device or a processing method applied to a terminal device as described in any one of the above items.

[0185] It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0186] For the convenience of description, the above system or device is described by dividing it into various modules or units according to its functions. Of course, when implementing the present application, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0187] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or the part that makes a creative contribution can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., including several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application or some parts of the embodiments.

[0188] Finally, it should be noted that, in this article, relational terms such as first, second, third and fourth are used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0189] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A processing method comprising: Establish a connection channel with the terminal device; Configuring the terminal device as a virtual storage device based on the connection channel and the first service, so that the electronic device can open the file on the terminal device; Obtaining a display image from the terminal device based on the connection channel and the second service, wherein the display image is used to represent an interactive interface of a first application program of the terminal device; The first application corresponds to a plurality of first files that are accessible, and the plurality of first files belong to the terminal device; Obtaining operation information for the displayed image; obtaining first address information through the connection channel in response to the operation information; In response to the operation information, based on the first service, a second application program accesses a target file through the first address information, the target file belonging to the plurality of first files; The first application belongs to the terminal device, and the second application belongs to the electronic device.

2. The processing method according to claim 1, wherein configuring the terminal device as a virtual storage device based on the connection channel and the first service comprises: In response to satisfying the mounting condition, the terminal device is mounted on a directory of the electronic device file system based on the connection channel and the first service, so as to configure the terminal device as a virtual storage device of the electronic device.

3. The processing method according to claim 1, wherein obtaining the first address information through the connection channel in response to the operation information comprises: In response to the operation information, transmitting the operation information to the terminal device through the connection channel, so that the terminal device identifies the target file indicated by the operation information and determines the first address information of the target file on the terminal device; The first address information transmitted by the terminal device is obtained through the connection channel.

4. The processing method according to claim 2, wherein the accessing the target file by the second application program through the first address information based on the first service comprises: Determine, according to an address mapping rule, second address information corresponding to the first address information in a file system directory of the electronic device; The address mapping rule is used to characterize the mapping relationship between the file system directory of the terminal device and the file system directory of the electronic device; Based on the first service, the second application program accesses the target file through the second address information.

5. The processing method according to claim 1, before accessing the target file by the second application program through the first address information based on the first service, further comprising: The target file is located based on the first business through the first address information, and the location result of the target file is displayed, so as to trigger the step of accessing the target file with a second application based on the first business when operation information applied to the location result is obtained to indicate access to the target file.

6. A processing method comprising: Establishing a connection channel with electronic equipment; Based on the connection channel and the first service, the terminal device is configured as a virtual storage device of the electronic device, wherein the virtual storage device stores a plurality of first files that are accessible to the first application program; Transmitting a display image for display to the electronic device based on the connection channel and the second service, wherein the display image is used to represent an interactive interface of the first application; Obtaining operation information for the display image transmitted by the electronic device based on the connection channel; In response to obtaining the operation information, transmitting first address information to the electronic device through the connection channel, so that the electronic device accesses the target file on the terminal device through the first address information with a second application based on the first service; The target file belongs to the plurality of first files; The first application belongs to the terminal device, and the second application belongs to the electronic device.

7. The processing method according to claim 6, wherein configuring the terminal device as a virtual storage device of the electronic device based on the connection channel and the first service comprises: In response to satisfying the mounting condition, the terminal device is mounted on a directory of the electronic device file system based on the connection channel and the first service, so as to configure the terminal device as a virtual storage device of the electronic device.

8. The processing method according to claim 6, wherein in response to obtaining the operation information, transmitting the first address information to the electronic device through the connection channel comprises: In response to obtaining the operation information, identifying a target file indicated by the operation information; Determine first address information of the target file on the terminal device; The first address information is transmitted to the electronic device through the connection channel.

9. An electronic device, comprising: A first memory, for storing a computer instruction set; The first processor is configured to implement the following processing by executing a computer instruction set in the first memory: Establish a connection channel with the terminal device; Configuring the terminal device as a virtual storage device based on the connection channel and the first service, so that the electronic device can open the file on the terminal device; Obtaining a display image from the terminal device based on the connection channel and the second service, wherein the display image is used to represent an interactive interface of a first application program of the terminal device; The first application corresponds to a plurality of first files that are accessible, and the plurality of first files belong to the terminal device; Obtaining operation information for the displayed image; obtaining first address information through the connection channel in response to the operation information; In response to the operation information, based on the first service, a second application program accesses a target file through the first address information, the target file belonging to the plurality of first files; The first application belongs to the terminal device, and the second application belongs to the electronic device.

10. A terminal device, comprising: A second memory for storing a computer instruction set; The second processor is configured to implement the following processing by executing the computer instruction set in the second memory: Establishing a connection channel with electronic equipment; Based on the connection channel and the first service, the terminal device is configured as a virtual storage device of the electronic device, wherein the virtual storage device stores a plurality of first files that are accessible to the first application program; Transmitting a display image for display to the electronic device based on the connection channel and the second service, wherein the display image is used to represent an interactive interface of the first application; Obtaining operation information for the display image transmitted by the electronic device based on the connection channel; In response to obtaining the operation information, transmitting first address information to the electronic device through the connection channel, so that the electronic device accesses the target file on the terminal device through the first address information with a second application based on the first service; The target file belongs to the plurality of first files; The first application belongs to the terminal device, and the second application belongs to the electronic device.

Images