Processing method and equipment

Abstract

The invention discloses a processing method and device, and the method comprises the steps: drawing the display content of a target application program, transmitting an image of the display content of the target application program to a second device for display output through a data channel in the form of streaming media, and enabling the data channel to be a channel where a first electronic device and the second electronic device are connected; in response to the target instruction, obtaining an image of display content of the target application program in real time to generate a target file of the target application program; wherein the target file is used for displaying and outputting.

Description

Technical Field

[0001] The present application relates to a processing method and a device. Background Art

[0002] Current electronic devices have a screen projection function. When the screen projection function is applied, the electronic device can display a local application on the screen of another electronic device, and allow the user to operate the target application on the other electronic device.

[0003] In the related art, electronic devices provide screen recording functions, but they can only record the display content on the electronic device's own display screen. When the above application is projected, the electronic device's own display screen displays the application. This cannot meet the user's recording needs for the above application. Summary of the invention

[0004] To this end, this application discloses the following technical solutions:

[0005] The first aspect of the present application provides a processing method, comprising:

[0006] Drawing the display content of the target application and transmitting the image of the display content of the target application in the form of streaming media through a data channel to the second device for display output, wherein the data channel is a channel through which the first electronic device and the second electronic device are already connected;

[0007] In response to the target instruction, an image of the display content of the target application is obtained in real time to generate a target file of the target application; wherein the target file is used for display output.

[0008] Optionally, also include:

[0009] obtaining position information from the data channel in real time, the position information representing a position of an input focus of the second device on an image of displayed content of the target application;

[0010] Obtaining a focus map based on the position information;

[0011] An image of the display content of the target application is obtained in real time and superimposed with the focus map.

[0012] Optionally, when the target file is displayed and output, prompt information is output to indicate that the display output device where the display content of the target application included in the target file is located is the second electronic device.

[0013] Optionally, also include:

[0014] Obtaining a screenshot image from the data channel, wherein the screenshot image represents display content of a display screen of the second device;

[0015] Overlaying an image of the display content of the target application based on the screenshot image;

[0016] The screenshot image is used as prompt information for indicating that the display output device where the display content of the target application included in the target file is located is the second electronic device when the target file is displayed and output.

[0017] Optionally, in response to the target instruction, obtaining in real time an image of the display content of the target application to generate a target file of the target application includes:

[0018] Obtaining a screenshot image in real time from the data channel, the screenshot image representing display content of a display screen of the second device, wherein the display content of the display screen of the second device includes an image of display content of the target application;

[0019] The screenshot image is used as prompt information for indicating that the display output device where the display content of the target application included in the target file is located is the second electronic device when the target file is displayed and output.

[0020] Optionally, the display content of the drawing target application includes:

[0021] Drawing the display content of the target application based on the virtual screen;

[0022] The step of obtaining an image of the display content of the target application in real time and generating a target file of the target application in response to the target instruction includes:

[0023] In response to the target instruction, obtaining a target image of the virtual screen, the target image being an image of display content of the target application;

[0024] If the target image is obtained from the virtual screen, prompt information is added to the target file.

[0025] Optionally, in response to the target instruction, obtaining in real time an image of the display content of the target application to generate a target file of the target application includes:

[0026] In response to the target instruction, displaying a device selection interface, wherein the device selection interface is used to display options representing the first electronic device and the second electronic device;

[0027] In response to a selection instruction for selecting an option of the second electronic device, an image of the display content of the target application is obtained in real time to generate a target file of the target application.

[0028] Optionally, in response to the target instruction, obtaining in real time an image of the display content of the target application to generate a target file of the target application includes:

[0029] In response to a target instruction, a portion of an image of display content of the target application is obtained in real time to generate a target file of the target application.

[0030] Optionally, at least one of the following is also included:

[0031] In response to a selection instruction for selecting an application, determining the application corresponding to the selection instruction as a target application;

[0032] The target application is determined according to the historical operation data, where the historical operation data represents an application that displays images of content for display on the second electronic device within a past period of time.

[0033] A second aspect of the present application provides an electronic device, including a memory, a processor and a display;

[0034] The memory is used to store the interconnection program;

[0035] The processor is configured to at least one of:

[0036] Used to execute the interconnection program to achieve:

[0037] Drawing the display content of the target application and transmitting the image of the display content of the target application in the form of streaming media through a data channel to the second device for display output, wherein the data channel is a channel through which the first electronic device and the second electronic device are already connected;

[0038] In response to the target instruction, an image of the display content of the target application is obtained in real time to generate a target file of the target application; wherein the target file is used for display output. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0040] Figure 1is a flowchart of a processing method provided in an embodiment of the present application;

[0041] Figure 2 is a schematic diagram of adjusting the display content of a target application according to an input focus provided by an embodiment of the present application;

[0042] Figure 3 is a schematic diagram of superimposing a focus image and an image of display content provided by an embodiment of the present application;

[0043] Figure 4 This is a schematic diagram of interaction between a mobile phone and a computer provided in an embodiment of the present application;

[0044] Figure 5 It is a schematic diagram of superimposing a screenshot image and an image of displayed content provided by an embodiment of the present application;

[0045] Figure 6 This is a schematic diagram of adding text prompt information provided by an embodiment of the present application;

[0046] Figure 7 It is a schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0048] This application embodiment provides a processing method, see Figure 1 , is a flow chart of the method, and the method may include the following steps.

[0049] S101, drawing the display content of the target application and transmitting the image of the display content of the target application in the form of streaming media through a data channel to a second device for display output, where the data channel is a channel that the first electronic device and the second electronic device are connected.

[0050] The processing method of this embodiment can be executed by the first electronic device.

[0051] Before drawing the display content of the target application, the first electronic device may establish a data channel for transmitting data with the second electronic device. The data channel may be a wireless data channel or a wired data channel. For example, the first electronic device may establish a wireless data channel with the second electronic device through a local area network, or may establish a wired data channel with the second electronic device through a data cable.

[0052] The target application may be any application installed locally on the first electronic device, for example, a video application for playing videos, a communication application for instant messaging, a browser application for browsing web pages, etc. on the first electronic device.

[0053] The first electronic device may determine the target application according to the user's operation. For example, after establishing the data channel, the first electronic device may prompt the user to select a target application, and then, in response to a selection instruction for selecting an application, determine the application corresponding to the selection instruction as the target application.

[0054] Alternatively, the first electronic device may determine the target application based on historical operation data, where the historical operation data represents an application for which images of displayed content within a past period of time are displayed on the second electronic device.

[0055] For example, the historical operation data may indicate that the first electronic device sends an image of the display content of the video application to the second electronic device for display each time after establishing a data channel within the last day. The first electronic device may determine that the video application is the target application.

[0056] The first electronic device can switch the target application according to the user's operation, for example, switching from a desktop application to a video application, from a video application to a communication application, etc.

[0057] The first electronic device can draw the display content of the target application into an image containing the display content based on the local graphics processor. For example, draw the application interface of the target application into an image containing the application interface, and draw the text information of the target application into an image containing the text information.

[0058] Transmitting the image of the display content to the second device display output in the form of streaming media may include:

[0059] After the first electronic device starts the target application, the application can output a frame of display content in real time at a certain time interval, and the first electronic device also draws the image of each frame of display content in real time at a certain time interval. Each time an image of a frame of display content is drawn, the first electronic device transmits the image to the second electronic device, and the second electronic device can directly display the received frame of image in a display window created in advance on the screen. After a certain time interval, the first electronic device transmits the image of the next frame of display content to the second electronic device, and the second electronic device displays the next received frame of image in the display window.

[0060] That is, when transmitted in the form of streaming media, the first electronic device draws an image of the display content in real time and transmits each frame of the drawn image to the second electronic device in real time, so that each frame of the display content drawn by the first electronic device is displayed in real time on the screen of the second electronic device.

[0061] The image of the display content of the target application may be displayed in a manner consistent with the size of the display window of the second electronic device, and the resolution of the image may be consistent with the screen resolution of the second electronic device.

[0062] S102, in response to the target instruction, obtaining in real time an image of the display content of the target application to generate a target file of the target application; wherein the target file is used for display output.

[0063] The target instruction may be a screen recording instruction for recording the display content of the target application. In this case, the first electronic device may obtain an image of the display content of each frame of the target application in real time, and generate a target file of the target application based on each frame of the image obtained. The generated target file may be a video file, which contains an image of the display content of each frame of the target application during the period from detecting the screen recording instruction (indicating the start of screen recording) to detecting the end of screen recording instruction (indicating the end of screen recording).

[0064] The target instruction may also be a screenshot instruction for capturing a frame of display content of the target application. In this case, the first electronic device may obtain an image of a frame of display content of the target application drawn when the screenshot instruction is detected, and save the frame image as the target file.

[0065] The target file can be displayed on the screen of any electronic device.

[0066] The beneficial effect of this embodiment is that it is possible to obtain an image of the display content of the target application displayed on the second electronic device, and generate a target file based on the obtained image, whereby, by displaying and outputting the target file on the electronic device, the user can review the display content of the target application displayed on the second electronic device.

[0067] In some embodiments, when the input focus of the second electronic device is located within the image of the display content of the target application, the second electronic device can send the position information of the input focus to the first electronic device through the data channel.

[0068] The position information may represent a position of the input focus of the second device on the image of the display content of the target application.

[0069] In some embodiments, the position information may be the coordinates of the input focus relative to the screen of the second electronic device. The first electronic device may determine the coordinates of the input focus relative to the image of the display content of the target application based on the coordinates of the input focus relative to the screen of the second electronic device and the position of the image of the display content of the target application on the screen of the second electronic device.

[0070] In some embodiments, the second electronic device may also directly determine the coordinates of the input focus relative to the image of the display content of the target application based on the coordinates of the input focus relative to the screen of the second electronic device and the position of the image of the display content of the target application on the screen of the second electronic device, and then send the coordinates of the input focus relative to the image of the display content of the target application as the above-mentioned position information to the first electronic device.

[0071] The input focus refers to the point on the screen of the second electronic device for inputting operation instructions. As an example, if the second electronic device is a host device, the input focus can be the cursor on the screen. If the second electronic device is a tablet device, the input focus can be the point on the screen where a finger or stylus clicks.

[0072] When the input focus is located within the image of the display content of the target application, if the second electronic device detects an operation instruction for the input focus, such as a single-click or double-click instruction, a drag instruction, etc., the second electronic device can send these operation instructions along with the position information to the first electronic device. After the first electronic device receives the operation instruction, it can map the operation instruction of the second electronic device to the operation instruction of the first electronic device, and then update the content of the target application according to the position of the input focus relative to the image of the display content and the operation instruction of the first electronic device.

[0073] As an example, the first device may be a mobile phone and the second device may be a computer. Figure 2 When the target application is a video application, it is assumed that the display content of the current video application includes the following Figure 2 In the example of FIG. 1 , when the input focus is on one of the thumbnails, the first electronic device can map the double-click instruction sent by the second electronic device to an instruction to play the video, and then control the video application to start playing the video corresponding to the thumbnail where the input focus is located. At this time, the display content of the video application is changed from the thumbnails of the multiple videos to the screen of the corresponding video. Correspondingly, as shown in FIG. Figure 2 As shown in (2), the image of the target application displayed by the second electronic device is also changed from the thumbnails of the previous multiple videos to the screen of the corresponding video.

[0074] In order to represent the operation process of the target application on the second electronic device in the target file, the first electronic device may further perform the following steps when generating the target file:

[0075] Obtaining position information from the data channel in real time, the position information representing a position of an input focus of the second device on an image of displayed content of the target application;

[0076] Obtaining a focus map based on the location information;

[0077] An image overlay focus map of the target application's display content is obtained in real time.

[0078] The focus map may be an image representing the position of the input focus on the image of the display content of the target application. As an example, the first electronic device may obtain the position information based on the position information. Figure 3 The focus map shown in (1) may have a size consistent with the size of an image of the display content of the target application, and may include a cursor displayed at a position corresponding to the position information.

[0079] When the first electronic device generates a target file, it can include Figure 3 The image of the display content of the target application obtained in real time as shown in (2) is superimposed with the focus map to form Figure 3 An image with input focus is displayed at a specific position as shown in (3), and the image is stored in a target file.

[0080] When superimposing the focus map, the first electronic device can superimpose the image of the display content at the corresponding moment and the focus map. For example, the first electronic device obtains an image of a frame of display content at time T0, and generates a focus map corresponding to time T0 based on the position information obtained at time T0, and then superimposes the image of the display content at time T0 and the focus map at time T0 to obtain a frame of image corresponding to time T0 in the target file, and then superimposes the image of the display content at time T1 and the focus map at time T1 to obtain a frame of image corresponding to time T1 in the target file, and so on.

[0081] Optionally, the target file may further include prompt information, and when the target file is displayed and output by any output device, the output device may further output the prompt information. The prompt information may be used to indicate that the display output device where the display content of the target application included in the target file is located is the second electronic device, that is, by outputting the prompt information, the output device may inform the viewing user that the display content currently being viewed is the content displayed on the second electronic device.

[0082] The above prompt information may include various forms, and different forms of prompt information may be obtained in different ways.

[0083] As an example, when the first electronic device is a mobile phone and the second electronic device is a computer, the first electronic device can press Figure 4 The target file is obtained in the manner described.

[0084] When the mobile phone detects a screen projection instruction to start screen projection, it first creates a virtual screen, then draws the display content of the specified target application on the virtual screen, obtains an image of the display content of the target application, and then sends the image of the display content of the target application displayed on the virtual screen to the computer through a pre-established data channel.

[0085] The computer can create a display window on its own display screen for accommodating the display content of the target application, and display the image drawn by the mobile phone on the virtual screen in the display window.

[0086] During screen projection, the mobile phone can respond to the virtual screen recording instruction for recording the virtual screen, and obtain and cache each frame of the image drawn on the virtual screen in real time.

[0087] At the same time, when the computer cursor is located in the computer display window, the computer converts the coordinates of the cursor on the computer screen into the coordinates of the cursor relative to the image drawn on the virtual screen, and sends the latter as the cursor position information to the mobile phone in real time.

[0088] The mobile phone generates a frame of cursor image based on a cached frame of image and the cursor position information. The cursor image has the same size as the image drawn on the virtual screen, and the cursor image includes the cursor at the cursor position information.

[0089] Then, the mobile phone combines the cached frame image and the cursor image generated based on the position information of the cursor at the corresponding moment into a frame of screen recording image obtained by recording the virtual screen.

[0090] The mobile phone repeats the above operations in real time to obtain a screen recording video file consisting of multiple consecutive frames of recorded screen images.

[0091] One way to obtain prompt information may include:

[0092] Obtaining a screenshot image from the data channel, where the screenshot image represents display content of a display screen of the second device;

[0093] overlaying an image of the display content of the target application based on the screenshot image;

[0094] The screenshot image is used as prompt information for indicating that the display output device where the display content of the target application included in the target file is located is the second electronic device when the target file is displayed and output.

[0095] The screenshot image may include a display window displayed on the display screen of the second electronic device for accommodating the display content of the target application. The first electronic device may superimpose the image of the display content of the target application onto the display window of the screenshot image, thereby obtaining a frame of image contained in the target file.

[0096] See also Figure 5 , the first electronic device can obtain from the data channel such as Figure 5 (1) of the second electronic device, and the screenshot image and Figure 5 The image of the display content of the target application shown in (2) is superimposed to form Figure 5 A frame of image contained in the target file shown in (3).

[0097] During the period when the second electronic device displays the image of the display content of the target application, the first electronic device can obtain a frame of screenshot image of the second electronic device at any time, and then superimpose the screenshot image with each frame of the display content image of the target application obtained by the first electronic device to form an image in the target file. In this case, if the target file is a video file, the display content of the target application in the video file can change over time, while the content of the screenshot image can remain unchanged.

[0098] Obtaining the screenshot image in the above manner can reduce the amount of data transmitted from the second electronic device to the first electronic device, and avoid the second electronic device from frequently transmitting the screenshot image to the first electronic device and occupying the data channel.

[0099] In another embodiment, the first electronic device may also obtain a frame of screenshot image of the second electronic device when the second electronic device starts to display the image of the display content of the target application. Thereafter, whenever the display content of the display screen of the second electronic device changes, the second electronic device sends a frame of screenshot image to the first electronic device. Each time the first electronic device receives a new frame of screenshot image, it superimposes the new screenshot image and the image of the display content of the target application to form an image contained in the target file.

[0100] In another embodiment, when the first electronic device needs to generate a screenshot image to generate a target file, the second electronic device can also capture the display content of the local display screen in real time at a certain time interval (which may be consistent with the time interval for the first electronic device to send the target image), and send each frame of the screenshot image to the first device in real time.

[0101] In this case, if the target file is a video file, when the target file is displayed and output, the display content of the target application in the video file may change over time, and the display content of the second electronic device may also change over time.

[0102] Obtaining a screenshot image in the above manner can make the obtained target file more realistically reflect the content displayed on the screen of the second electronic device during the period when the second electronic device displays the image of the display content of the target application. For example, it can reflect the process of the cursor moving from an area outside the image of the display content of the target application to within the image of the display content of the target application, thereby providing more information to users viewing the target file.

[0103] like Figure 5 As shown in (3), when the target file obtained in the above manner is displayed and output by the output device, the output device can display and output the screenshot image superimposed on the target file as prompt information, and explain to the user who is viewing the target file through the screenshot image that the display content of the application contained in the display window is the display content output by the second electronic device during recording.

[0104] Optionally, when generating the target file, the first electronic device may also superimpose the screenshot image, the focus map generated based on the position information of the input focus, and the image of the display content of the target application to form an image including the prompt information, the input focus, and the display content of the target application.

[0105] In some optional embodiments, the first electronic device may also obtain the image of the display content of the target application in real time in the following manner:

[0106] Obtaining a screenshot image in real time from the data channel, the screenshot image representing display content of a display screen of the second device, wherein the display content of the display screen of the second device includes an image of display content of the target application;

[0107] The screenshot image is used as a prompt for indicating that the display output device where the display content of the target application included in the target file is located is the second electronic device when the target file is displayed and output.

[0108] That is to say, in this embodiment, the second electronic device can take screenshots of all display content on the local display screen in real time, and transmit each frame of the screenshot image obtained by the screenshot to the first electronic device through the data channel in real time. The screenshot image may include the display content output by the local application of the second electronic device, the display window created by the second electronic device, and the image of the display content of the target application displayed in the display window.

[0109] At this time, a frame of screenshot image obtained by the first electronic device is equivalent to Figure 5 In this case, the first electronic device can directly store the screenshot image containing the display content of the second electronic device and the display content of the target application as the image of the target file in the target file.

[0110] In some optional embodiments, the first electronic device may draw the display content of the target application in the following manner:

[0111] The display content of the target application is drawn based on the virtual screen.

[0112] In the above drawing method, the first electronic device can create a virtual screen with the same size as the display window of the second electronic device and the same resolution as the screen of the second electronic device, and then draw an image of the display content of the target application on the virtual screen.

[0113] When drawing in the above manner, the first electronic device may obtain the image of the display content of the target application in real time in the following manner:

[0114] In response to the target instruction, a target image of the virtual screen is obtained, where the target image is an image of the display content of the target application.

[0115] Among them, if the target instruction is a screen recording instruction, the first electronic device can obtain each frame of the target image drawn on the virtual screen in real time. If the target instruction is a screenshot instruction, the first electronic device can obtain a frame of image drawn on the virtual screen when the screenshot instruction is detected.

[0116] In the case of obtaining the target image from the virtual screen, the first electronic device may directly add prompt information to the generated target file.

[0117] The content and form of the prompt information are not limited.

[0118] As some examples, the prompt information may be image information, text information, or audio information.

[0119] When the prompt information is image information, the prompt information may be a background image frame generated by the first electronic device. The size of the background image may be consistent with the size of the screen of the second electronic device, and the background image includes the same display window displayed on the screen of the second electronic device. The first electronic device may superimpose the background image and each frame of the target image obtained to form the image contained in the target file.

[0120] When the prompt information is text information, such as Figure 6 As shown, the prompt information may include "The following screen recording content is the content displayed when the mobile phone is cast to the computer". The first electronic device can overlay the text information on each frame of the target image obtained, or on a part of the target image obtained. When the target file is displayed and output, the above text information can be displayed and output together.

[0121] When the prompt information is audio information, the first electronic device can directly store the audio information into the target file. When the target file is displayed and output by the output device, the output device can play the audio information to serve as a prompt. The content of the audio is not limited, for example, it can include the content of the above text information.

[0122] The beneficial effect of this embodiment is that the first electronic device does not need to receive the prompt information transmitted by the second electronic device through the data channel, which can save the transmission bandwidth of the data channel and ensure that the first electronic device has better fluency when transmitting the target image to the second electronic device.

[0123] In some optional embodiments, the target instruction may be a screen recording instruction or a screen capture instruction for the target application being projected, or may be a general screen recording instruction or a screen capture instruction.

[0124] For the latter case, while the image of the display content of the target application is displayed by the second electronic device, the first electronic device can display a device selection interface in response to the target instruction, and the device selection interface is used to display options representing the first electronic device and the second electronic device.

[0125] Through the device selection interface, the first electronic device can prompt the user whether to record (or take screenshots) the content displayed on the screen of the first electronic device or to record (or take screenshots) the display content of the target application displayed on the second electronic device.

[0126] After the device selection interface is displayed, the first electronic device can generate a target file of the target application by acquiring an image of the display content of the target application in real time in response to a selection instruction for selecting an option of the second electronic device.

[0127] In some optional embodiments, when the first electronic device obtains the image of the display content of the target application in real time to generate the target file of the target application in response to the target instruction, it may also:

[0128] In response to the target instruction, a portion of the image of the display content of the target application is obtained in real time to generate a target file of the target application.

[0129] That is, the first electronic device can respond to the screenshot or screen recording instruction and capture a part of the image of the display content of the target application, such as the upper half or the lower half, in real time to generate a screenshot image or screen recording video of the corresponding part.

[0130] The present application also provides an electronic device. Figure 7 , the electronic device may include a memory 701 , a processor 702 and a display 703 .

[0131] The memory 701 is used to store the interconnection program;

[0132] The processor 702 is configured to at least one of:

[0133] Used to execute the interconnection program to achieve:

[0134] Drawing the display content of the target application and transmitting the image of the display content of the target application to the second device for display output in the form of streaming media through a data channel, where the data channel is a channel that the first electronic device and the second electronic device are connected;

[0135] In response to the target instruction, an image of the display content of the target application is obtained in real time to generate a target file of the target application; wherein the target file is used for display output.

[0136] For example, the interconnection program is used to establish a secure data channel between two devices. The interconnection program has at least an application screen projection function, that is, the application that needs to be projected to another device for output is transmitted frame by frame in real time to another device in the form of a data stream. The interconnection program also provides a screen recording function for the target application, that is, in response to the target instruction, the image of the display content of the target application is obtained in real time to generate the target file of the target application; wherein the target file is used for display output.

[0137] Optionally, the processor 702 is further configured to:

[0138] Obtaining position information from the data channel in real time, the position information representing a position of an input focus of the second device on an image of displayed content of the target application;

[0139] Obtaining a focus map based on the location information;

[0140] An image overlay focus map of the target application's display content is obtained in real time.

[0141] Optionally, when the target file is displayed and output, prompt information is output to indicate that the display output device where the display content of the target application included in the target file is located is the second electronic device.

[0142] Optionally, the processor 702 is further configured to:

[0143] Obtaining a screenshot image from the data channel, where the screenshot image represents display content of a display screen of the second device;

[0144] overlaying an image of the display content of the target application based on the screenshot image;

[0145] The screenshot image is used as prompt information for indicating that the display output device where the display content of the target application included in the target file is located is the second electronic device when the target file is displayed and output.

[0146] Optionally, when the processor 702 obtains the image of the display content of the target application in real time in response to the target instruction to generate the target file of the target application, it may be the same as:

[0147] Obtaining a screenshot image in real time from the data channel, the screenshot image representing display content of a display screen of the second device, wherein the display content of the display screen of the second device includes an image of display content of the target application;

[0148] The screenshot image is used as prompt information for indicating that the display output device where the display content of the target application included in the target file is located is the second electronic device when the target file is displayed and output.

[0149] Optionally, when the processor 702 draws the display content of the target application, it can be used to:

[0150] Drawing the display content of the target application based on the virtual screen;

[0151] When the processor 702 obtains the image of the display content of the target application in real time in response to the target instruction and generates the target file of the target application, it can be used to:

[0152] In response to the target instruction, obtaining a target image of the virtual screen, the target image being an image of display content of the target application;

[0153] If the target image is obtained from the virtual screen, add prompt information for the target file.

[0154] Optionally, when the processor 702 obtains the image of the display content of the target application in real time to generate the target file of the target application in response to the target instruction, it can be used to:

[0155] In response to the target instruction, displaying a device selection interface, the device selection interface is used to display options representing the first electronic device and the second electronic device;

[0156] In response to a selection instruction for selecting an option of the second electronic device, an image of display content of a target application is obtained in real time to generate a target file of the target application.

[0157] Optionally, when the processor 702 obtains the image of the display content of the target application in real time to generate the target file of the target application in response to the target instruction, it can be used to:

[0158] In response to the target instruction, a portion of the image of the display content of the target application is obtained in real time to generate a target file of the target application.

[0159] Optionally, the processor 702 is further configured to perform at least one of the following:

[0160] In response to a selection instruction for selecting an application, determining the application corresponding to the selection instruction as a target application;

[0161] The target application is determined according to the historical operation data, where the historical operation data represents an application for displaying images of contents in a past period of time for display on the second electronic device.

[0162] In some optional embodiments, the electronic device can also serve as the second electronic device of the aforementioned embodiment. In this case, the interconnection program is used to establish a secure data channel between the two devices. The interconnection program at least has the function of receiving the application screen projection image, that is, receiving the image of the application page that needs to be projected output by another device frame by frame in the form of a data stream, so that the electronic device can display the image of the application page output by another device on the local screen. The interconnection program also provides the function of transmitting the screenshot image of the device to the device that outputs the image of the application page, so that the device that outputs the image of the application page can obtain the above-mentioned target file based on the received screenshot image. The interconnection program can also provide the function of transmitting the position information of the input focus and the operation instructions of the second device, so that the device that outputs the image of the application page can obtain the target file based on the position information of the input focus, and adjust the page content of the output application based on the position information of the input focus and the operation instructions.

[0163] It should be noted that the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0164] For the convenience of description, the above system or device is described by dividing it into various modules or units according to its functions. Of course, when implementing the present application, the functions of each unit can be implemented in the same or multiple software and / or hardware.

[0165] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly contributed to the prior art in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.

[0166] Finally, it should be noted that, in this article, relational terms such as first, second, third and fourth are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0167] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A processing method comprising: Drawing the display content of the target application and transmitting the image of the display content of the target application in the form of streaming media through a data channel to the second device for display output, wherein the data channel is a channel through which the first electronic device and the second electronic device are already connected; In response to the target instruction, an image of the display content of the target application is obtained in real time to generate a target file of the target application; wherein the target file is used for display output.

2. The method according to claim 1, further comprising: obtaining position information from the data channel in real time, the position information representing a position of an input focus of the second device on an image of displayed content of the target application; Obtaining a focus map based on the position information; An image of the display content of the target application is obtained in real time and superimposed with the focus map.

3. The method according to claim 1, when the target file is displayed and output, prompt information is output to indicate that the display output device where the display content of the target application included in the target file is located is the second electronic device.

4. The method according to claim 3, further comprising: Obtaining a screenshot image from the data channel, wherein the screenshot image represents display content of a display screen of the second device; Overlaying an image of the display content of the target application based on the screenshot image; The screenshot image is used as prompt information for indicating that the display output device where the display content of the target application included in the target file is located is the second electronic device when the target file is displayed and output.

5. The method according to claim 3, wherein in response to the target instruction, obtaining in real time an image of the display content of the target application to generate a target file of the target application comprises: Obtaining a screenshot image in real time from the data channel, the screenshot image representing display content of a display screen of the second device, wherein the display content of the display screen of the second device includes an image of display content of the target application; The screenshot image is used as prompt information for indicating that the display output device where the display content of the target application included in the target file is located is the second electronic device when the target file is displayed and output.

6. The method according to claim 3, wherein drawing the display content of the target application comprises: Drawing the display content of the target application based on the virtual screen; The step of obtaining an image of the display content of the target application in real time in response to the target instruction and generating a target file of the target application includes: In response to the target instruction, obtaining a target image of the virtual screen, the target image being an image of display content of the target application; If the target image is obtained from the virtual screen, prompt information is added to the target file.

7. The method according to claim 1, wherein in response to the target instruction, obtaining in real time an image of the display content of the target application to generate a target file of the target application comprises: In response to the target instruction, displaying a device selection interface, wherein the device selection interface is used to display options representing the first electronic device and the second electronic device; In response to a selection instruction for selecting an option of the second electronic device, an image of the display content of the target application is obtained in real time to generate a target file of the target application.

8. The method according to claim 1, wherein in response to the target instruction, obtaining in real time an image of the display content of the target application to generate a target file of the target application comprises: In response to a target instruction, a portion of an image of display content of the target application is obtained in real time to generate a target file of the target application.

9. The method according to claim 1, further comprising at least one of the following: In response to a selection instruction for selecting an application, determining the application corresponding to the selection instruction as a target application; The target application is determined according to the historical operation data, where the historical operation data represents an application that displays images of content for display on the second electronic device within a past period of time.

10. An electronic device comprising a memory, a processor and a display; The memory is used to store the interconnection program; The processor is configured to at least one of: Used to execute the interconnection program to achieve: Drawing the display content of the target application and transmitting the image of the display content of the target application in the form of streaming media through a data channel to the second device for display output, wherein the data channel is a channel through which the first electronic device and the second electronic device are already connected; In response to the target instruction, an image of the display content of the target application is obtained in real time to generate a target file of the target application; wherein, The target file is used for display output.

Images