Screen projection method, device, terminal, equipment, computer medium and program product

Abstract

The present application discloses a screen projection method, apparatus, terminal, device, computer medium and program product, which belongs to the field of screen projection technology. The method includes: in response to the first area editing operation in the screen projection state, determining the first screen projection editing area; when the first object is included in the first screen projection editing area, determining the first object content corresponding to the first object as the first screen projection content; transmitting the first screen projection content to the screen projection device so that the screen projection device displays the first screen projection content. Allowing the user to edit the screen projection editing area in the terminal, the user can manually avoid privacy information or unnecessary display information in the user interface during the editing of the screen projection editing area, thereby avoiding the screen projection display of unnecessary privacy information while achieving normal screen projection display, further improving the security of terminal information.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of screen projection technology, and in particular to a screen projection method, apparatus, terminal, equipment, computer medium and program product. Background Art

[0002] With the development of terminal technology, terminals have more interactive functions with other terminals. For example, the screen projection function is to display the picture displayed by the terminal in other terminals in real time through specific screen projection technology.

[0003] In the related technology, when a user wants to project the display content of a mobile phone to a computer, he can turn on the projection function on both the mobile phone and the computer, and select the computer as the projection device on the mobile phone. Then, the real-time image displayed on the terminal can be projected to the computer.

[0004] Obviously, in the related technology, when the screen is projected, all real-time display content on the mobile phone will be projected to the computer, and unnecessary privacy information may be leaked during the projection process. Summary of the invention

[0005] The embodiments of the present application provide a screen projection method, device, terminal, equipment, computer medium and program product. The technical solution is as follows:

[0006] On the one hand, an embodiment of the present application provides a screen projection method, which is executed by a terminal and includes:

[0007] In response to a first area editing operation in the screen projection state, determining a first screen projection editing area;

[0008] When the first projection screen editing area includes a first object, determining a first object content corresponding to the first object as a first projection screen content;

[0009] Transmit the first projection content to the projection device so that the projection device displays the first projection content.

[0010] On the other hand, an embodiment of the present application provides a screen projection method, which is performed by a screen projection device, and the method includes:

[0011] In the screen projection state, receiving first screen projection content sent by the terminal, the first screen projection content is determined based on the first object content corresponding to the first object contained in the first screen projection editing area of ​​the terminal, and the first screen projection editing area is determined based on the first area editing operation in the screen projection state of the terminal;

[0012] Display the first projection content.

[0013] On the other hand, an embodiment of the present application provides a screen projection device, which is executed by a terminal and includes:

[0014] An editing module, comprising: determining a first screen projection editing area in response to a first area editing operation in a screen projection state;

[0015] A determination module, comprising, when the first projection screen editing area includes a first object, determining a first object content corresponding to the first object as a first projection screen content;

[0016] The sending module includes transmitting the first screen projection content to the screen projection device so that the screen projection device displays the first screen projection content.

[0017] On the other hand, an embodiment of the present application provides a screen projection device, which is executed by a screen projection device, and the device includes:

[0018] A receiving module, used for receiving a first screen projection content sent by a terminal in a screen projection state, wherein the first screen projection content is determined based on a first object content corresponding to a first object contained in a first screen projection editing area of ​​the terminal, and the first screen projection editing area is determined based on an editing operation of the first area in the screen projection state of the terminal;

[0019] The display module is used to display the first projection content.

[0020] On the other hand, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the screen projection method as described in the above aspects.

[0021] On the other hand, an embodiment of the present application provides a computer-readable storage medium, in which at least one program code is stored, and the program code is loaded and executed by a processor to implement the screen projection method as described in the above aspects.

[0022] On the other hand, an embodiment of the present application provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the screen projection method provided in various optional implementations of the above aspects.

[0023] The technical solution provided in the embodiments of the present application can bring the following beneficial effects:

[0024] In the projection state, the user can edit the projection editing area in the terminal, and when the projection editing area contains an object, the object content corresponding to the object can be determined as the projection content to be provided to the projection device for projection display; on the one hand, the user is allowed to edit the projection editing area in the terminal. During the process of editing the projection editing area, the user can manually avoid privacy information or non-essential display information in the user interface, thereby achieving normal projection display while avoiding the projection display of non-essential privacy information, thereby improving the security of terminal information; on the other hand, when the projection editing area only contains objects, the object content corresponding to the object can also be projected to the projection device without selecting the object content through the projection editing area, which can improve the projection efficiency of selecting the projection content through the projection editing area. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0026] Figure 1 A schematic diagram showing an implementation environment of an exemplary embodiment of the present application is shown;

[0027] Figure 2 A flowchart of a screen projection method provided by an exemplary embodiment of the present application is shown;

[0028] Figure 3 A schematic diagram of a screen projection process shown in an exemplary embodiment of the present application is shown;

[0029] Figure 4 A flowchart of a screen projection method provided by another exemplary embodiment of the present application is shown;

[0030] Figure 5 It is a schematic diagram of the corresponding screen projection process in the scenario containing the target application icon in the screen projection editing area;

[0031] Figure 6 It is a schematic diagram of the corresponding screen projection process in the scenario where the target file is included in the screen projection editing area;

[0032] Figure 7 It is a schematic diagram of the corresponding screen projection process in the scenario where the target file is included in the screen projection editing area;

[0033] Figure 8 A flowchart of a screen projection method provided by another exemplary embodiment of the present application is shown;

[0034] Fig. 9A schematic diagram of a process of adding a new object in a projection screen editing area by dragging operation is shown in an exemplary embodiment of the present application;

[0035] Fig.10 A flowchart of a screen projection method provided by another exemplary embodiment of the present application is shown;

[0036] Fig.11 The process of adding a new projection content by adding a projection editing area is shown in an exemplary embodiment of the present application;

[0037] Fig.12 A complete flow chart of the screen projection process shown in an exemplary embodiment of the present application is shown;

[0038] Fig.13 A flowchart of a screen projection method provided by an exemplary embodiment of the present application is shown;

[0039] Fig.14 A structural block diagram of a screen projection device provided by an embodiment of the present application is shown;

[0040] Fig.15 A structural block diagram of a screen projection device provided by another embodiment of the present application is shown;

[0041] Fig.16 A structural block diagram of a computer device provided by an exemplary embodiment of the present application is shown. DETAILED DESCRIPTION

[0042] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0043] Please refer to Figure 1 , which shows a schematic diagram of an implementation environment of an exemplary embodiment of the present application, wherein the implementation environment includes a terminal 110 and a screen projection device 120.

[0044] The terminal 110 is a device with a screen projection function, and can be a desktop computer, a mobile phone, a smart watch, a tablet computer, an e-book reader, or other electronic device.

[0045] In the embodiment of the present application, when the terminal 110 has a screen projection requirement, the screen projection function can be turned on, the screen projection device 120 can be selected, and the screen projection data corresponding to the screen projection content can be transmitted to the screen projection device 120. Optionally, in the screen projection process of this embodiment, the terminal only uses the objects located in the screen projection editing area and the object content corresponding to the objects as the screen projection content; and the screen projection editing area can be edited.

[0046] The screen projection device 120 is a device with a screen projection function. The screen projection device 120 can be an electronic device such as a smart TV, a projector, a desktop computer, a tablet computer, etc.

[0047] In an embodiment of the present application, when the screen projection device 120 receives the projection data transmitted by the first terminal 110, it can display the corresponding projection content based on the projection data; optionally, when the terminal 110 adds a new projection object in the projection editing area, the screen projection device 120 can simultaneously display the original projection content and the projection content corresponding to the newly added projection object.

[0048] Please refer to Figure 2 , which shows a flowchart of a screen projection method provided by an exemplary embodiment of the present application. The present application embodiment is applied to the method Figure 1 Taking the terminal 110 as an example, the method includes:

[0049] Step 201, in response to a first area editing operation in a screen projection state, determine a first screen projection editing area.

[0050] Unlike the related art, in the screen projection state, the terminal will transmit all real-time displayed images to the screen projection device, which may lead to unnecessary leakage of privacy information. In this embodiment, in order to improve the problem of privacy leakage that may be caused in the screen projection process, the user is allowed to edit the screen projection editing area that needs to be projected during the screen projection process, and the screen projection editing area and non-screen projection area in the terminal interface are divided, so that only the information or content in the screen projection editing area is displayed on the screen projection device, thereby effectively reducing unnecessary information or unnecessary display of user privacy information, and avoiding information leakage problems.

[0051] In one possible implementation, when the terminal is in the projection state, the user is allowed to edit the projectable area in the current user interface, and the corresponding terminal receives the first area editing operation in the projection state, and based on the first area editing operation, determines the first projection editing area indicated by the area editing operation, so that the current user interface can be divided into a projection editing area and a non-projection area through the first projection editing area.

[0052] Optionally, the first area editing operation may be to draw an arbitrary closed figure in the current user interface, and the area enclosed by the closed figure is the first projection editing area. The closed figure may be a triangle, a circle, an ellipse, a rectangle, etc., and the embodiment of the present application does not limit the closed figure; or, the first area editing operation may be to draw an arbitrary line in the current user interface, and the arbitrary line divides the current user interface into two areas, and further designates any area as the first projection editing area. The arbitrary line may be a straight line, a curve, etc., and the embodiment of the present application does not limit the arbitrary line.

[0053] Optionally, in order to avoid the impact of other trigger controls in the original user interface when performing area editing operations, in a possible implementation, a projection area selection control is provided in the projection state, and the user can enter the area editing state by triggering the projection area selection control. In this area editing state, other trigger controls are in an untriggerable state, thereby avoiding accidental touches of other controls during the editing process of the projection editing area. Optionally, when the area editing operation is completed, the area editing state can also be exited, and the user can then trigger other trigger controls outside the projection editing area and perform other terminal operations normally.

[0054] like Figure 3 As shown, it shows a schematic diagram of the screen projection process shown in an exemplary embodiment of the present application. In the screen projection state, a screen projection area selection control 302 is displayed in the user interface 301, and the user can trigger the drawing of the screen projection editing area in the user interface 301 by selecting the screen projection area control 302; when the terminal receives the area editing operation, the first screen projection editing area 303 indicated by the area editing operation is displayed in the user interface 301.

[0055] Step 202, when the first screen projection editing area includes a first object, determine the first object content corresponding to the first object as the first screen projection content.

[0056] In one possible implementation, when the user performs the (first) area editing operation, he or she will generally choose to select the content box to be projected into the first projection editing area. Correspondingly, when the terminal determines that the first projection editing area contains a first object, the first object and the first object content corresponding to the first object will be determined as the first projection content.

[0057] Optionally, in other possible embodiments, the first object is not originally located in the first projection editing area, and the first object can be dragged to the first projection editing area by a drag operation. The corresponding process of including the first object in the first projection editing area can be: when the first projection editing area is displayed in the user interface, the first projection editing area does not include the first object. The user drags the first object to the first projection editing area, the corresponding terminal receives the drag operation on the first object, and the first object is located in the first projection editing area when the drag operation stops, then it is determined that the first object is included in the first projection editing area.

[0058] Optionally, the first projection editing area can also be dragged to include the first object. The corresponding process of making the first projection editing area include the first object can be: when the first projection editing area is displayed in the user interface, the first projection editing area does not include the first object. The user drags the first projection editing area to make the first projection editing area include the first object. The corresponding terminal receives the dragging operation on the first projection editing area, and determines whether the first projection editing area contains the first object when the dragging operation stops.

[0059] In order to further improve the efficiency of selecting projection content for projection through the projection editing area, when the projection editing area contains a first object, not only the first object contained in the projection editing area can be projected and displayed, but also the first object content corresponding to the first object can be projected and displayed, and the first object content is not all contained in the first projection editing area. Schematically, taking the application icon A of application A as the first object as an example, when the first projection editing area contains application icon A, not only can application icon A be projected and displayed as projection content, but when application A corresponding to application icon A is opened and displays the application interface, even if the first projection editing area cannot contain the application interface, the application interface can still be projected and displayed as projection content.

[0060] like Figure 3 As shown, a calendar application icon 304 is displayed in the first projection screen editing area 303, and the calendar application corresponding to the calendar application icon 304 is determined as the first projection screen content.

[0061] Optionally, when the first screen projection editing area contains two or more first objects, the first object content corresponding to each first object is used as the first screen projection content, so that the screen projection device can simultaneously display the first object content corresponding to multiple first objects.

[0062] Optionally, the first object may be any object displayed in the current user interface, which may be an application icon, a tool icon, a picture, a document, a table, a floating window, etc. The embodiment of the present application does not limit the first object.

[0063] Step 203: transmit the first projection content to the projection device so that the projection device displays the first projection content.

[0064] In a possible implementation, after the terminal determines the first projection content, it can transmit the first projection content to the projection device, so that the projection device displays the first projection content after receiving the first projection content.

[0065] like Figure 3As shown, after determining the projection content, the terminal can transmit the projection content to the projection device so that the projection device displays the calendar application icon 304 in the device interface 305. Optionally, when the user opens the calendar application, the calendar application interface corresponding to the calendar application can be displayed in the device interface 305.

[0066] To summarize, in an embodiment of the present application, in the projection state, the user can edit the projection editing area in the terminal, and when the projection editing area contains an object, the object content corresponding to the object can be determined as the projection content to be provided to the projection device for projection display; on the one hand, the user is allowed to edit the projection editing area in the terminal, so that the user can manually avoid privacy information or non-essential display information in the user interface during the process of editing the projection editing area, thereby achieving normal projection display while avoiding the projection display of non-essential privacy information, thereby improving the security of terminal information; on the other hand, when the projection editing area only contains objects, the object content corresponding to the object can also be projected to the projection device without selecting the object content through the projection area, which can improve the projection efficiency of projecting by selecting the projection content through the projection editing area.

[0067] Since in the embodiment of the present application, during the screen projection process, not only the objects contained in the projection editing area are projected to the projection device, but the corresponding object contents can also be projected and displayed as projection contents, that is, the first object content can be the object itself or specific object content, and the selection of different first object contents needs to be determined according to the projection status of the current object. For example, when the user drags the application icon to the projection editing area and opens the application interface of the application corresponding to the application icon, it means that the user needs to project the application interface and display it on the projection device. The projection status at this time indicates that the application interface needs to be determined as the projection content.

[0068] Please refer to Figure 4 , which shows a flowchart of a screen projection method provided by another exemplary embodiment of the present application. The present application embodiment is applied to the method Figure 1 Taking the terminal 110 as an example, the method includes:

[0069] Step 401, in response to a first area editing operation in a screen projection state, determine a first screen projection editing area.

[0070] In a possible implementation, when the terminal receives a first area editing operation in the projection state, it can determine the first projection editing area according to the first area editing operation, and then display the first projection editing area in the user interface.

[0071] Optionally, in order to avoid the impact of the subsequent first projection editing area on the normal use of the current user interface, when the first projection editing area is displayed in the user interface, a new layer can be added to the upper layer of the user interface, and the first projection editing area can be displayed on the newly added layer, so that the first projection editing area is displayed on the upper layer of the user interface.

[0072] Optionally, in order to distinguish the first projection editing area and the non-projection area in the current user interface, the first projection editing area can be displayed in a semi-transparent or fully transparent manner, or the area outline of the first projection editing area can be set to use a special line type, such as a dotted line, a thick solid line, etc.

[0073] Step 402, when the first projection editing area includes the first object, determine the projection state of the first object, and the projection state is determined by the running state of the first object.

[0074] In a possible implementation, when the first projection editing area contains a first object, the first object itself can be directly determined as the first projection content for projection display, or the object content corresponding to the first object can be used as the first projection content for projection display.

[0075] In order to determine the object content of the first object transmitted to the projection device (the first projection content), in a possible implementation manner, the current projection state of the first object can be determined according to the running state of the first object, and then the first object content that needs to be projected can be determined; for example, when the first object is an application icon, the projection content of the first object can be either the application icon or the application interface of the application corresponding to the application icon. In this case, how to determine whether to project the application icon or the application interface needs to be determined based on the running state of the first object. When the application indicated by the application icon is in a closed state, it may only be necessary to project the application icon. If the application indicated by the application icon is in an open state, an application interface will be displayed, and it may be necessary to project the application interface.

[0076] Step 403: Determine the first object content corresponding to the first object based on the screen projection state, wherein different screen projection states correspond to different first object contents.

[0077] In a possible implementation, the first object content corresponding to the first object may be determined according to the projection state corresponding to the first object, and then different first object contents may be projected and displayed as projection contents.

[0078] In this embodiment, the first object is in the form of an application icon, a file, and a floating window to illustrate the first object content (first projection content) corresponding to the first object in different projection states.

[0079] For the scenario where the first object is the target application icon, when the target application icon is included in the first projection editing area, not only the target application icon can be projected and displayed, but also the application interface of the application corresponding to the target application icon can be projected and displayed; and the specific content of the projection display depends on the application running status of the application corresponding to the target application icon. For example, when the application is in the application-closed state, it indicates that the user does not have the need to project the application interface, and only the target application icon can be projected and displayed; and when the application is in the application-open state, it indicates that the user has the need to project the application interface, and the application interface can be projected and displayed; the corresponding step 402 can be replaced by step 402A, and step 403 can include step 403A and step 403B.

[0080] Step 402A, when the target application icon is included in the first projection editing area, the application running state of the target application icon corresponding to the first application is determined as the projection state.

[0081] In a possible implementation, when the first projection editing area includes a target application icon, the application running state of the first application corresponding to the target application icon can be determined as the projection state; then the projection state corresponding to the corresponding target application icon includes: application on state and application off state, wherein the application on state indicates that the first application corresponding to the target application icon is the projection focus object; and the application off state indicates that the first application corresponding to the target application icon is not the projection focus object.

[0082] Step 403A: when the application running state of the first application is the application opening state, determine the first application interface corresponding to the first application as the first object content.

[0083] When the first projection editing area includes a target application icon corresponding to the first application and the user opens the first application corresponding to the target application icon, the terminal will inevitably display the first application interface of the first application, and at the same time indicate that the user has a need to display the first application interface by projection. Therefore, in a possible implementation, when the application running state of the first application is the application opening state, the first application interface corresponding to the first application can be determined as the first object content for projection display.

[0084] Optionally, when the application running state of the first application is the application opening state, the first application may be in the foreground running state or in the background running state. When the first application is in the foreground running state, the first application interface is the application interface currently displayed by the first application; when the first application is in the background running state, the first application interface is the application interface displayed before switching to the background running. It can be seen that when the first application is in the application opening state, even if the first application switches to the background running, the projection device will also display its corresponding first application interface.

[0085] In order to realize that when the projection editing area contains an application icon, the application interface of the application corresponding to the application icon can also be projected and displayed on the projection device, in a possible implementation, when the target application icon is included in the first projection editing area, a projection mark can be added for the first application corresponding to the target application icon, so that it can be determined whether to project and display the application interface based on the projection mark later.

[0086] Optionally, when the terminal displays the first application interface and it is determined that the first application corresponding to the first application interface has a projection mark, the first application interface corresponding to the first application is determined as the first object content, and then the first application interface is projected and displayed on the projection device; this makes it possible to distinguish whether the application interface needs to be projected based on the projection mark, without requiring the first application interface to be displayed in its entirety in the first projection editing area, and only requires the first projection editing area to include the application icon of the application corresponding to the application interface.

[0087] Step 403B: when the application running state of the first application is the application closed state, determine the target application icon corresponding to the first application as the first object content.

[0088] If the first projection editing area contains a target application icon corresponding to the first application and the user has not opened the first application corresponding to the target application icon, the terminal does not display the first application interface of the first application, which means that the user does not have the need to project the first application interface for the time being, and only the target application icon located in the first projection editing area can be used as the projection content. Therefore, in a possible implementation, when the application running state of the first application is the application closed state, the target application icon corresponding to the first application can be determined as the first object content (first projection content) for projection display.

[0089] like Figure 5 As shown, it is a schematic diagram of the corresponding screen projection process in the scenario where the target application icon is included in the screen projection editing area. When the first screen projection editing area 501 contains an album application icon 502, and the album application corresponding to the album application icon 502 is not opened, the screen projection interface 503 corresponding to the screen projection device displays the album application icon 502; optionally, when the user triggers the album application icon 502 to open the album application, the terminal displays the album interface 504 corresponding to the album application, and the screen projection interface 503 corresponding to the screen projection device displays the album interface 504.

[0090] When the target application icon is included in the projection editing area, the first application corresponding to the target application icon may be an instant messaging application, and the instant messaging application may receive unread messages during projection. In order to avoid automatically synchronizing and displaying the unread messages in real time on the projection device during projection, in one possible implementation, when the first application has unread messages and receives a user's viewing operation on the unread messages, it means that the user manually allows the synchronous projection of the unread messages. In this case, the message viewing interface corresponding to the unread messages is determined as the first projection content, and the unread messages are then displayed on the projection device.

[0091] Optionally, when there are unread messages in the first application and no viewing operation on the unread messages is received, indicating that the user has no need to display the unread messages on the screen, the message viewing interface corresponding to the unread messages will stop being determined as the first projection content, and the unread messages will not be displayed on the projection device, thereby avoiding the leakage of user privacy information during the projection display of the first application.

[0092] For the scenario where the first object is the target file, the projection status of the target file may be affected by the opening and closing status of the target file. For example, when the target file is in the opening state, the corresponding projection screen displays the target file content corresponding to the target file; if the target file is in the closing state, the corresponding projection screen displays the target file icon corresponding to the target file; the corresponding step 402 can be replaced by step 402B, and step 403 can include step 403C and step 403D.

[0093] Step 402B, when the target file is included in the first projection editing area, the file usage status of the target file is determined as the projection status.

[0094] In a possible implementation, when the target file is included in the first projection editing area, the file usage status corresponding to the target file can be determined as the projection status; then the projection status corresponding to the corresponding target file includes: a file closed status and a file open status, wherein the file open status indicates that the target file is the projection focus object; and the file closed status indicates that the target file is not the projection focus object.

[0095] Optionally, the target file may be a target image, a target document, a target table, a target folder, etc.

[0096] Regarding the case where the target file is included in the first projection editing area, the user can manually drag the target file located in the application interface corresponding to the second application to the first projection editing area, and then the target file will be included in the first projection editing area; or, in the case where the target file is included in the application interface corresponding to the second application, the user can select the target file through the first projection editing area when performing the area editing operation.

[0097] Step 403C: when the file use status of the target file is the file open status, determine the target file content corresponding to the target file as the first object content.

[0098] When the target file is included in the first projection editing area and the user opens the target file, the terminal will inevitably display the target file content corresponding to the target file, which means that the user has a need to display the target file content corresponding to the target file on the screen. Therefore, in one possible implementation, when the file usage status of the target file is the file open state, the target file content corresponding to the target file is determined as the first object content for projection display.

[0099] In an illustrative example, if the target file contained in the projection editing area is a "schedule", when the user opens the "schedule", the table content corresponding to the "schedule" is determined as the projection content.

[0100] Step 403D: when the file use status of the target file is the file closed status, determine the target file icon corresponding to the target file as the first object content.

[0101] If the target file is included in the first projection editing area and the user has not opened the target file, the terminal does not display the target file content corresponding to the target file, which means that the user does not have the need to project the file content temporarily, and only the target file icon located in the first projection editing area can be used as the projection content. Therefore, in a possible implementation, when the file usage status of the target file is the file closed state, the target file icon corresponding to the target file is determined as the first object content (first projection content) for projection display.

[0102] In an exemplary example, if the target file contained in the projection editing area is a "schedule", when the user has not opened the "schedule", only the "schedule" icon contained in the projection editing area is determined as the projection content.

[0103] like Figure 6As shown, it is a schematic diagram of the corresponding screen projection process in the scenario where the target file is included in the screen projection editing area; when the application interface 601 contains the target file 602, if the user has the need to project the target file 602, the target file 602 can be directly dragged to the screen projection editing area 603 along the direction indicated by the arrow; when the user has not opened the target file 602, the file icon corresponding to the target file 602 is displayed in the projection interface 604 corresponding to the corresponding projection device; after the user opens the target file 602, the file content 605 corresponding to the target file 602 is displayed in the user interface, and the file content 605 is also projected and displayed in the projection interface 604 corresponding to the corresponding projection device; it can be seen that although the target file 602 belongs to the application interface 601, no content related to the application interface 601 is displayed during the entire projection process.

[0104] For the scenario where the first object is the target floating window, when the target floating window does not display the application interface, the target floating window can be displayed in the form of a floating window icon, and the floating window icon is used as the projection content; when the target floating window displays the application interface, the application interface is used as the projection display content, and the first object is the target application icon; the corresponding step 402 can be replaced by step 402C, and step 403 can include step 403E and step 403F.

[0105] Step 402C, when the target floating window is included in the first projection editing area, the floating window display state of the target floating window is determined to be the projection state.

[0106] In a possible implementation, when the first projection editing area includes a target floating window, the floating window display state of the target floating window can be determined as the projection state; then the projection state corresponding to the corresponding target floating window includes: no application interface is displayed and the application interface is displayed, wherein the display of the application interface indicates that the target floating window is the projection focus object; and the absence of the application interface indicates that the target floating window is not the projection focus object.

[0107] Step 403E: when the floating window display state indicates that a second application interface is displayed in the target floating window, the second application interface is determined as the first object content.

[0108] When a target floating window is included in the first projection editing area and the target floating window displays an application interface that the user needs to operate, it indicates that the user has a need to project the application interface in the target floating window. Therefore, in one possible implementation, when the floating window display status indicates that a second application interface is displayed in the target floating window, the second application interface is determined as the first object content for projection display.

[0109] Step 403F: when the floating window display state indicates that the second application interface is not displayed in the target floating window, determine the target floating window icon corresponding to the target floating window as the first object content.

[0110] When the target floating window is included in the first projection editing area and the target floating window does not display the application interface that the user needs to operate, the target floating window is generally displayed in the form of a floating window icon, and only the target floating window icon corresponding to the target floating window can be used as the projection content. Therefore, in a possible implementation, when the floating window display status indicates that the second application interface is not displayed in the target floating window, the target floating window icon corresponding to the target floating window is determined as the first object content (first projection content) for projection display.

[0111] like Figure 7 As shown, it is a schematic diagram of the corresponding screen projection process in the scenario where the screen projection editing area contains the target file. The first screen projection editing area 701 contains a target floating window 702. When the target floating window does not display the application interface, the corresponding screen projection interface 703 corresponding to the corresponding screen projection device only displays the floating window icon corresponding to the target floating window 702; when the target floating window displays the video chat interface 704, the corresponding screen projection interface 703 corresponding to the corresponding screen projection device displays the video chat interface 704.

[0112] Step 404: determine the first object content as the first projection content.

[0113] In a possible implementation, after the terminal determines the first object content that needs to be projected and displayed according to the projection status of the first object, it further generates first projection content based on the first object content to transmit it to the projection device for projection display.

[0114] Step 405: transmit the first projection content to the projection device so that the projection device displays the first projection content.

[0115] The implementation of step 405 may refer to the above embodiment, and this embodiment will not be described in detail here.

[0116] In a possible application scenario, when the user no longer needs to continue projecting and displaying the first object content corresponding to the first object, the first object can be moved out of the first projection editing area. When the corresponding terminal receives the removal operation of the first object in the first projection editing area, a stop projection instruction can be sent to the projection device, so that the projection device stops displaying the first projection content containing the first object content based on the stop projection instruction.

[0117] Optionally, when the terminal is in the projection state, users can operate objects outside the (first) projection editing area normally in the terminal, and they will not be displayed in the projection device. In other words, the projection device will only display the object content corresponding to the objects in the (first) projection editing area. Taking the first corresponding application icon as an example, the projection device will only display the activities of the application corresponding to the application icon in the projection editing area. Even if the application is switched to the background, the projection device will display the application interface of the application; the projection editing area is equivalent to a small electronic fence. Only the applications and their activities within the fence can be displayed on the projection device, and the applications outside the fence that are not surrounded by the closed area, that is, the applications without projection marks, will not be displayed by the projection device even if they are displayed on the terminal screen at this time.

[0118] Optionally, since the projection content displayed by the projection device is directly related only to the first object in the projection editing area, but has no direct relationship with the real-time display screen of the terminal user interface, when the application corresponding to the first object switches to background operation, the first object content corresponding to the first object continues to be determined as the first projection content, that is, the first object content corresponding to the first object remains displayed in the projection device.

[0119] In this embodiment, the projection status of the first object in the first projection editing area is determined to determine the first projection content displayed in the projection device. The projection content can be manually determined by the user in real time without affecting the user's continued use of other applications in the non-projection editing area. In addition, when projecting the application interface, there is no need to circle the entire application interface in the projection editing area. Only the application icon corresponding to the application interface needs to be dragged to the projection editing area, thereby improving the efficiency of projecting the application interface. In addition, for the application that is being projected, if an unread message is received, the unread message will not be automatically projected and displayed. Instead, it will be projected and displayed when the user manually views the unread message. This can prevent the leakage of privacy information while projecting the application interface.

[0120] The above embodiments are all exemplified by the inclusion of a single object in the projection editing area. In other possible implementations, the projection editing area may include two or more objects. That is to say, under the premise that the projection editing area includes the first object, if the user needs to add projection content to the projection device, then a second object can be added to the projection editing area in the terminal accordingly, so that the projection device can simultaneously project and display the object contents corresponding to the first object and the second object respectively.

[0121] Please refer to Figure 8 , which shows a flowchart of a screen projection method provided by another exemplary embodiment of the present application. The present application embodiment is applied to the method Figure 1Taking the terminal 110 as an example, the method includes:

[0122] Step 801, in response to the first area editing operation in the screen projection state, determine the first screen projection editing area.

[0123] Step 802: When the first screen projection editing area includes a first object, the first object content corresponding to the first object is determined as the first screen projection content.

[0124] Step 803: transmit the first projection content to the projection device so that the projection device displays the first projection content.

[0125] The implementation of steps 801 to 803 may refer to the above embodiments, and will not be described in detail in this embodiment.

[0126] Step 804: receiving a drag operation on the second object.

[0127] In a possible implementation, the second object can be added to the first projection editing area by dragging the second object to the first projection editing area, thereby achieving the purpose of simultaneously projecting and displaying the corresponding object contents of the first object and the second object by the projection device.

[0128] Optionally, in order to avoid affecting other objects in the current user interface during the dragging of the second object, you can re-enter the projection area editing state, and then perform the dragging operation on the second object in the projection area editing state, and the corresponding terminal receives the dragging operation on the second object.

[0129] Step 805: Determine the target position of the second object when the dragging operation stops.

[0130] In one possible implementation, when the terminal receives a drag operation on the second object and when the drag operation stops, it determines the target position of the second object, and then determines whether to add the second object to the first projection editing area based on the target position and the position of the first projection editing area.

[0131] Step 806: When the target position is located in the first projection editing area, the second object content corresponding to the second object is determined as the second projection content.

[0132] In a possible implementation, when the target position is located in the first projection editing area, it is determined that a second object is added in the first projection editing area, and the second object content corresponding to the second object can be determined as the second projection content to execute the subsequent projection display process.

[0133] Optionally, if the target position is not within the first projection screen editing area, adding a second object to the first projection screen editing area fails, corresponding to an invalid drag operation, and the user is required to re-execute the drag operation.

[0134] It should be noted that when dragging the second object to the first projection editing area in the projection state, the dragging operation is only temporarily used for projection. When the projection is completed, the second object will still be displayed at the position before dragging, and the dragging operation will not affect the original display position of the second object.

[0135] Step 807, transmit the second projection content to the projection device so that the projection device displays the second projection content while displaying the first projection content.

[0136] In a possible implementation, when a first object is already included in the first projection editing area and the corresponding projection device has displayed the first projection content corresponding to the first object, after the user adds a second object in the first projection editing area through a drag operation, the terminal determines the second object content corresponding to the second object as the second projection content and transmits it to the projection device. At this time, the projection device will display the first projection content and the second projection content at the same time, so that the projection content from different objects can be displayed simultaneously.

[0137] like Fig. 9 As shown, it shows a schematic diagram of the process of adding an object in the projection screen editing area by dragging an exemplary embodiment of the present application. Among them, a first projection screen editing area 902 is displayed in the user interface 901, and the first projection screen editing area contains a first object 903; the first object 903 is displayed in the projection screen interface 905 corresponding to the corresponding projection screen device; when the second object 904 needs to be added, it can be dragged in the direction indicated by the arrow, and the second object 904 can be dragged into the first projection screen editing area 902, so that the first projection screen editing area 902 contains the first object 903 and the second object 904, and the first object 903 and the second object 904 are displayed simultaneously in the projection screen interface 905 corresponding to the corresponding projection screen device.

[0138] In this embodiment, by dragging the second object to the existing projection editing area (the first projection editing area) and adding a new object in the first projection editing area (the existing projection editing area), it is possible to add new projection content to the projection device; and the newly added projection content does not affect the display of the original projection content, and the common display of projection content corresponding to multiple objects can be achieved.

[0139] In other possible scenarios, if the distance between the first projection screen editing area and the second object is far, for example, the first projection screen editing area is located on the first screen of the terminal desktop, and the second object is located on the third screen of the terminal desktop, then by dragging the second object to the first projection screen editing area, it is necessary to drag the second object from the third screen to the first screen, and then drag it to the first projection screen editing area, which requires multiple dragging operations, and the dragging operation is relatively cumbersome. In order to reduce the operating cost of adding a second object to the projection screen editing area, in a possible implementation method, the second projection screen editing area can be redrawn so that the second projection screen editing area contains the second object. The terminal can automatically merge the first projection screen editing area and the second projection screen editing area, thereby achieving the purpose of adding the second object corresponding to the second projection screen content.

[0140] In an illustrative example, in Figure 8 On the basis of Fig.10 As shown, steps 804 to 807 can be replaced by steps 1001 to 1003.

[0141] Step 1001, in response to the second area editing operation in the screen projection state, determine the second screen projection editing area.

[0142] In order to improve the operational efficiency of adding a second object corresponding to the second projection content, in a possible implementation, a second projection editing area can be added to include the second object, and the corresponding terminal receives the second area editing operation in the projection state, and determines the second projection editing area based on the second area editing operation.

[0143] Step 1002, when the second projection editing area contains a second object, merge the first projection editing area and the second projection editing area to generate a third projection editing area, and determine the second object content corresponding to the second object as the second projection content.

[0144] Optionally, to implement the process of including the second object in the second projection screen editing area, the user can draw a second projection screen editing area around the second object, and the corresponding terminal receives the second area editing operation, displays the second projection screen editing area generated based on the second area editing operation, and the second projection screen editing area includes the second object; or the user can draw an arbitrary second projection screen editing area (the second projection screen editing area may not include the second object) in the user interface displaying the second object, and then drag the second object to the second projection screen editing area.

[0145] In a possible implementation, when the second projection screen editing area contains a second object, the terminal automatically merges the first projection screen editing area and the second projection screen editing area to generate a third projection screen editing area, which may contain the first object and the second object; while generating the third projection screen editing area, the second object content corresponding to the second object may also be determined as the second projection screen content.

[0146] Step 1003, transmit the second projection content to the projection device so that the projection device displays the second projection content while displaying the first projection content.

[0147] In a possible implementation, after the terminal merges the first projection editing area and the second projection editing area to generate a third projection editing area containing the first object and the second object, the terminal determines the second object content corresponding to the second object as the second projection content and transmits it to the projection device. At this time, the projection device will display the first projection content and the second projection content at the same time, so as to realize the simultaneous display of projection content from different objects.

[0148] like Fig.11 As shown, it shows the process of adding projection content by adding a projection editing area, as shown in an exemplary embodiment of the present application. Among them, the first projection editing area 1102 is displayed in the user interface 1101, and the first projection editing area 1102 contains the first object 1103, then the projection interface 1104 corresponding to the projection device displays the first object 1103; when the user adds the second object 1105, the second projection editing area 1106 can be drawn to include the second object 1105, and the terminal automatically merges the first projection editing area 1102 and the second projection editing area 1106 to obtain the third projection editing area 1107, which contains the first object 1103 and the second object 1105, and the projection interface 1104 corresponding to the projection device displays the first object 1103 and the second object 1105 at the same time.

[0149] For the two provided methods of adding the second projection content, users can choose at will according to their needs. If the distance between the second object and the first projection editing area is relatively close, for example, the second object and the first projection editing area are located in the same user interface, then you can drag the second object to add the second projection content; if the distance between the second object and the first projection editing area is relatively far, for example, the second object and the first projection editing area are located on different user interfaces, then you can add a new projection editing area to include the second object and then add the second projection content.

[0150] In this embodiment, the second projection editing area containing the second object can be redrawn, and the first projection editing area and the second projection editing area can be merged so that the merged projection editing area can contain the first object and the second object at the same time, thereby achieving the purpose of displaying the second projection content corresponding to the newly added second object in the projection device. At the same time, by adding a new projection editing area, the operation cost of adding a new object in the projection editing area by dragging when the second object and the first projection editing area are far apart can be avoided, further improving the operation efficiency of adding new projection content.

[0151] Please refer to Fig.12 , which shows a complete flow chart of the screen projection process shown in an exemplary embodiment of the present application.

[0152] Step 1201, the user chooses to cast the screen.

[0153] Step 1202, the terminal enters the screen projection state, waiting for the user to select the screen projection editing area.

[0154] Step 1203: The user draws a closed area around application A to be projected on the screen to include application A.

[0155] Among them, the closed area is the screen projection editing area.

[0156] Step 1204: Project the applications in the closed area and the content displayed by the applications to the projection device

[0157] Step 1205: Whether application B is adjacent to application A.

[0158] Step 1206 , draw a closed area at the location of application B to include application B.

[0159] Step 1207, merge the closed areas of application A and application B and project application A, application B and their corresponding application contents.

[0160] Step 1208, drag application B into the closed area corresponding to application A.

[0161] Step 1209, projecting the screen to display application A, application B and their corresponding application contents.

[0162] Step 1210, screen projection ends and exits the screen projection state.

[0163] The above embodiments describe the screen projection process with the terminal as the execution subject. This embodiment mainly takes the screen projection device as the execution subject and describes the process of how the screen projection device displays each screen projection content.

[0164] Please refer to Fig.13, which shows a flowchart of a screen projection method provided by an exemplary embodiment of the present application. The present application embodiment is applied to the method Figure 1 Taking the screen projection device 120 as an example, the method includes:

[0165] Step 1301, in the screen projection state, receiving the first screen projection content sent by the terminal, the first screen projection content is determined based on the first object content corresponding to the first object contained in the first screen projection editing area of ​​the terminal, and the first screen projection editing area is determined based on the first area editing operation of the terminal in the screen projection state.

[0166] In a possible implementation, when the terminal and the screen projection device are both in the screen projection state, the user draws a first screen projection editing area in the terminal through the first area editing operation in the terminal, and when the first screen projection editing area includes a first object, the first object content corresponding to the first object is determined as the first screen projection content and transmitted to the screen projection device, and the corresponding screen projection device receives the first screen projection content sent by the terminal.

[0167] Step 1302, display the first projection content.

[0168] In a possible implementation, the screen projection device can receive the first screen projection content sent by the terminal in the screen projection state, and display it according to the first screen projection content.

[0169] Among them, the process of determining the first projection screen content can refer to the projection screen method on the terminal side in the above embodiment, and this embodiment will not be repeated here.

[0170] In other possible scenarios, when the user needs to add new projection content, the corresponding projection device receives the request to add new projection content and the second projection content sent by the terminal. The projection device can display the first projection content and the second projection content at the same time. While displaying the second projection content, it will not affect the display of the first projection content.

[0171] The request for adding projection content can be triggered when a second object is added to the first projection editing area, which corresponds to the process of adding a second object to the first projection editing area by dragging in the above embodiment; it can also be triggered by adding a second projection editing area, which corresponds to the process of adding a second projection editing area to add a second object corresponding to the second projection content in the above embodiment. The specific process of adding a second object corresponding to the second projection content can be referred to the above embodiment, which will not be described in detail in this embodiment.

[0172] Optionally, when displaying the first projection content and the second projection content at the same time, the projection device can display the first projection content and the second projection content separately in different areas, or can display the first projection content and the second projection content separately in different windows to distinguish the projection content corresponding to different objects.

[0173] Regarding the method of displaying each projected screen content in different areas, the projection device can divide the display area into a first display area and a second display area, and then display the first projected screen content in the first display area and display the second projected screen content in the second display area.

[0174] Optionally, the display area areas of the first display area and the second display area may be the same or different. For example, they may be determined according to the display size of the projection content to be displayed.

[0175] Regarding the method of displaying the first projection content and the second projection content in separate windows, the projection device can generate a first display window and a second display window, display the first projection content in the first display window, and display the second projection content in the second display window.

[0176] Optionally, the window sizes of the first display window and the second display window may be the same or different. For example, the window sizes may be determined according to the amount of projection content that needs to be displayed.

[0177] To summarize, in this embodiment, in the projection state, the user can edit the projection editing area in the terminal, and when the projection editing area contains an object, the object content corresponding to the object can be determined as the projection content to be provided to the projection device for projection display; on the one hand, the user is allowed to edit the projection editing area in the terminal, so that the user can manually avoid privacy information or non-essential display information in the user interface during the editing of the projection editing area, thereby achieving normal projection display while avoiding the projection display of non-essential privacy information, thereby improving the security of terminal information; on the other hand, when the projection editing area only contains objects, the object content corresponding to the object can also be projected to the projection device without selecting the object content through the projection editing area, which can improve the projection efficiency of projecting by selecting the projection content through the projection editing area; in addition, when the projection device displays the newly added projection content, the newly added projection content and the original projection content can be displayed at the same time, so that the display of the original projection content will not be affected when the new projection content is added.

[0178] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0179] Please refer to Fig.14, which shows a structural block diagram of a screen projection device provided by an embodiment of the present application. The device has the function of implementing the functions performed by the terminal side in the above method embodiment, and the functions can be implemented by hardware or by hardware executing corresponding software. Fig.14 As shown, the device may include:

[0180] The editing module 1401 includes determining a first screen projection editing area in response to a first area editing operation in the screen projection state;

[0181] The determination module 1402 includes determining, when the first projection screen editing area includes a first object, first object content corresponding to the first object as a first projection screen content;

[0182] The sending module 1403 includes transmitting the first screen projection content to the screen projection device so that the screen projection device displays the first screen projection content.

[0183] Optionally, the determining module 1402 is further configured to:

[0184] When the first screen projection editing area includes the first object, determining a screen projection state of the first object, where the screen projection state is determined by a running state of the first object;

[0185] Based on the screen projection state, determining the first object content corresponding to the first object, wherein different screen projection states correspond to different first object contents;

[0186] Determine the first object content as the first projection screen content.

[0187] Optionally, the first object is a target application icon;

[0188] The determining module 1402 is further configured to:

[0189] When the target application icon is included in the first projection screen editing area, determining the application running state of the first application corresponding to the target application icon as the projection screen state;

[0190] The determining module 1402 is further configured to:

[0191] When the application running state of the first application is an application opening state, determining a first application interface corresponding to the first application as the first object content;

[0192] When the application running state of the first application is an application closed state, the target application icon corresponding to the first application is determined as the first object content.

[0193] Optionally, the device further comprises:

[0194] an adding module, configured to add a screen projection mark to the first application corresponding to the target application icon when the target application icon is included in the first screen projection editing area;

[0195] The determining module 1402 is further configured to:

[0196] When the first application interface is displayed and it is determined that the first application corresponding to the first application interface has the screen projection mark, the first application interface corresponding to the first application is determined as the first object content.

[0197] Optionally, the device further comprises:

[0198] The determining module 1402 is further configured to, in response to the first application having unread messages and receiving a viewing operation on the unread messages, determine a message viewing interface corresponding to the unread messages as the first projection content;

[0199] The determination module 1402 is further used to stop determining the message viewing interface corresponding to the unread message as the first projection content in response to the first application having the unread message and not receiving a viewing operation for the unread message.

[0200] Optionally, the first object is a target file, and the target file is dragged from an application interface of a second application to the first projection editing area;

[0201] The determining module 1402 is further configured to:

[0202] When the target file is included in the first screen projection editing area, determining the file usage status of the target file as the screen projection status;

[0203] The determining module 1402 is further configured to:

[0204] When the file usage state of the target file is a file open state, determining the target file content corresponding to the target file as the first object content;

[0205] When the file use status of the target file is a file closed status, a target file icon corresponding to the target file is determined as the first object content.

[0206] Optionally, the first object is a target floating window;

[0207] The determining module 1402 is further configured to:

[0208] When the target floating window is included in the first projection screen editing area, determining the floating window display state of the target floating window as the projection screen state;

[0209] The determining module 1402 is further configured to:

[0210] When the floating window display state indicates that a second application interface is displayed in the target floating window, determining the second application interface as the first object content;

[0211] When the floating window display state indicates that the second application interface is not displayed in the target floating window, a target floating window icon corresponding to the target floating window is determined as the first object content.

[0212] Optionally, the editing module 1401 is further used for:

[0213] In response to the first area editing operation in the projection state, based on the first area editing operation, the first projection editing area is displayed on the upper layer of the user interface.

[0214] Optionally, the device further comprises:

[0215] A receiving module, used for receiving a drag operation on a second object;

[0216] The determining module 1402 is further configured to determine a target position of the second object when the dragging operation stops;

[0217] The determining module 1402 is further configured to determine, when the target position is located in the first projection screen editing area, a second object content corresponding to the second object as a second projection screen content;

[0218] The sending module 1403 is also used to transmit the second screen projection content to the screen projection device, so that the screen projection device displays the second screen projection content while displaying the first screen projection content.

[0219] Optionally, the device further comprises:

[0220] The editing module 1401 is further configured to determine a second screen projection editing area in response to a second area editing operation in the screen projection state;

[0221] A generating module, configured to merge the first projection editing area and the second projection editing area to generate a third projection editing area when the second projection editing area includes a second object, and determine the second object content corresponding to the second object as the second projection content;

[0222] The sending module 1403 is also used to transmit the second screen projection content to the screen projection device, so that the screen projection device displays the second screen projection content while displaying the first screen projection content.

[0223] Optionally, the device further comprises:

[0224] The sending module 1403 is also used to send a stop screen projection instruction to the screen projection device in response to a move-out operation of the first object in the first screen projection editing area, so that the screen projection device stops displaying the first screen projection content based on the stop screen projection instruction.

[0225] Optionally, the device further comprises:

[0226] The determination module 1402 is further configured to continue determining the first object content corresponding to the first object as the first projection screen content when the application corresponding to the first object is switched to background operation.

[0227] To summarize, in an embodiment of the present application, in the projection state, the user can edit the projection editing area in the terminal, and when the projection editing area contains an object, the object content corresponding to the object can be determined as the projection content to be provided to the projection device for projection display; on the one hand, the user is allowed to edit the projection editing area in the terminal, so that the user can manually avoid privacy information or non-essential display information in the user interface during the process of editing the projection editing area, thereby achieving normal projection display while avoiding the projection display of non-essential privacy information, thereby improving the security of terminal information; on the other hand, when the projection editing area only contains objects, the object content corresponding to the object can also be projected to the projection device without selecting the object content through the projection editing area, which can improve the projection efficiency of selecting the projection content through the projection editing area.

[0228] Please refer to Fig.15 , which shows a structural block diagram of a screen projection device provided by another embodiment of the present application. The device has the function of implementing the above method embodiment performed by the screen projection device side, and the function can be implemented by hardware or by hardware executing corresponding software. Fig.15 As shown, the device may include:

[0229] Receiving module 1501, used for receiving first screen projection content sent by the terminal in the screen projection state, where the first screen projection content is determined based on the first object content corresponding to the first object contained in the first screen projection editing area of ​​the terminal, and the first screen projection editing area is determined by the first area editing operation in the screen projection state of the terminal;

[0230] The display module 1502 is used to display the first projection content.

[0231] Optionally, the device further comprises:

[0232] The receiving module 1501 is further configured to receive, in response to a request for adding projection content, a second projection content sent by the terminal, wherein the request for adding projection content is triggered by adding a second object to the first projection editing area, or the request for adding projection content is triggered by adding a second projection editing area, and the second projection content is a second object content corresponding to the second object;

[0233] The display module 1502 is also used to display the first projection content and the second projection content.

[0234] Optionally, the display module 1502 is further used for:

[0235] Dividing a display area into a first display area and a second display area; displaying the first projection content in the first display area, and displaying the second projection content in the second display area;

[0236] or,

[0237] Generate a first display window and a second display window; display the first projection content in the first display window, and display the second projection content in the second display window.

[0238] To summarize, in this embodiment, in the projection state, the user can edit the projection editing area in the terminal, and when the projection editing area contains an object, the object content corresponding to the object can be determined as the projection content to be provided to the projection device for projection display; on the one hand, the user is allowed to edit the projection editing area in the terminal, so that the user can manually avoid privacy information or non-essential display information in the user interface during the editing of the projection editing area, thereby achieving normal projection display while avoiding the projection display of non-essential privacy information, thereby improving the security of terminal information; on the other hand, when the projection editing area only contains objects, the object content corresponding to the object can also be projected to the projection device without selecting the object content through the projection editing area, which can improve the projection efficiency of selecting the projection content through the projection editing area; in addition, when the projection device displays the newly added projection content, the newly added projection content and the original projection content can be displayed at the same time, so that the display of the original projection content will not be affected when the new projection content is added.

[0239] It should be noted that: when the device provided in the above embodiment realizes its function, only the division of the above functional modules is used as an example. In actual application, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0240] Please refer to Fig.16 , which shows a structural block diagram of an electronic device 1600 provided by an exemplary embodiment of the present application. The electronic device 1600 may be a terminal or a screen projection device in the above-mentioned embodiment. The electronic device 1600 in the present application may include one or more of the following components: a memory 1620, a processor 1610, and a display screen 1630.

[0241] The processor 1610 may include one or more processing cores. The processor 1610 uses various interfaces and lines to connect various parts of the entire computer device 1600, and executes various functions and processes data of the computer device 1600 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1620, and calling data stored in the memory 1620. Optionally, the processor 1610 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 1610 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen 1630; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1610, but may be implemented separately through a communication chip.

[0242] The memory 1620 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 1620 includes a non-transitory computer-readable storage medium. The memory 1620 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 1620 may include a storage program area and a storage data area, wherein the storage program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The operating system may be an Android system (including a system deeply developed based on the Android system), an IOS system developed by Apple (including a system deeply developed based on the IOS system) or other systems. The storage data area may also store data (such as a phone book, audio and video data, chat record data) created by the computer device 1600 during use.

[0243] The display screen 1630 may be a capacitive touch display screen, which is used to receive a touch operation on or near it by a user using any suitable object such as a finger, a touch pen, etc., and to display the user interface of each application. The touch display screen is usually arranged on the front panel of the computer device 1600. The touch display screen may be designed as a full screen, a curved screen, or a special-shaped screen. The touch display screen may also be designed as a combination of a full screen and a curved screen, or a combination of a special-shaped screen and a curved screen, which is not limited in the embodiments of the present application.

[0244] In addition, those skilled in the art can understand that the structure of the electronic device 1600 shown in the above figures does not constitute a limitation on the electronic device 1600, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange the components differently. For example, the computer device 1600 also includes a radio frequency circuit, a shooting component, a sensor, an audio circuit, a wireless fidelity (WiFi) component, a power supply, a Bluetooth component, and other components, which will not be described in detail here.

[0245] The present application also provides a computer-readable storage medium, in which at least one instruction, at least one program, a code set or an instruction set is stored. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement the screen projection method provided by any of the above exemplary embodiments.

[0246] The embodiment of the present application provides a computer program product, which includes computer instructions, which are stored in a computer-readable storage medium. The processor of the printing device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the screen projection method provided in the above optional implementation.

[0247] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application are not limited to this.

[0248] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A screen projection method, characterized in that: The method is executed by a terminal, and includes: In response to a first area editing operation in the projection state, based on the first area editing operation, a first projection editing area is displayed in a newly added layer on the upper layer of the user interface, and the projection object includes at least one of an application icon, a file, and a floating window; When the first projection screen editing area includes a first object, determining a first object content corresponding to the first object as a first projection screen content; Transmitting the first screen projection content to a screen projection device so that the screen projection device displays the first screen projection content; receiving a drag operation on the second object; determining a target position of the second object when the dragging operation stops; When the target position is located in the first projection screen editing area, determining the second object content corresponding to the second object as the second projection screen content; Transmit the second projection content to the projection device so that the projection device displays the second projection content while displaying the first projection content.

2. The method according to claim 1, characterized in that When the first screen projection editing area includes a first object, determining first object content corresponding to the first object as first screen projection content includes: When the first screen projection editing area includes the first object, determining a screen projection state of the first object, where the screen projection state is determined by a running state of the first object; Based on the screen projection state, determining the first object content corresponding to the first object, wherein different screen projection states correspond to different first object contents; Determine the first object content as the first projection screen content.

3. The method according to claim 2, characterized in that The first object is a target application icon; The determining, when the first object is included in the first screen projection editing area, a screen projection state of the first object includes: When the target application icon is included in the first projection screen editing area, determining the application running state of the first application corresponding to the target application icon as the projection screen state; The determining, based on the screen projection state, the first object content corresponding to the first object includes: When the application running state of the first application is an application opening state, determining a first application interface corresponding to the first application as the first object content; When the application running state of the first application is an application closed state, the target application icon corresponding to the first application is determined as the first object content.

4. The method according to claim 3, characterized in that The method further comprises: When the target application icon is included in the first screen projection editing area, adding a screen projection mark to the first application corresponding to the target application icon; The determining the first application interface corresponding to the first application as the first object content includes: When the first application interface is displayed and it is determined that the first application corresponding to the first application interface has the screen projection mark, the first application interface corresponding to the first application is determined as the first object content.

5. The method according to claim 3, characterized in that: The method further comprises: In response to the first application having unread messages and receiving a viewing operation for the unread messages, determining a message viewing interface corresponding to the unread messages as the first projection content; In response to the first application having the unread messages and not receiving a viewing operation for the unread messages, stop determining the message viewing interface corresponding to the unread messages as the first projection content.

6. The method according to claim 2, characterized in that The first object is a target file, and the target file is dragged from the application interface of the second application to the first projection editing area; The determining, when the first object is included in the first screen projection editing area, a screen projection state of the first object includes: When the target file is included in the first screen projection editing area, determining the file usage status of the target file as the screen projection status; The determining, based on the screen projection state, the first object content corresponding to the first object includes: When the file usage state of the target file is a file open state, determining the target file content corresponding to the target file as the first object content; When the file use status of the target file is a file closed status, a target file icon corresponding to the target file is determined as the first object content.

7. The method according to claim 2, characterized in that The first object is a target floating window; The determining, when the first object is included in the first screen projection editing area, a screen projection state of the first object includes: When the target floating window is included in the first projection screen editing area, determining the floating window display state of the target floating window as the projection screen state; The determining, based on the screen projection state, the first object content corresponding to the first object includes: When the floating window display state indicates that a second application interface is displayed in the target floating window, determining the second application interface as the first object content; When the floating window display state indicates that the second application interface is not displayed in the target floating window, a target floating window icon corresponding to the target floating window is determined as the first object content.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: In response to the second area editing operation in the screen projection state, determining a second screen projection editing area; In the case where the second projection screen editing area includes a second object, the first projection screen editing area and the second projection screen editing area are merged to generate a third projection screen editing area, and the second object content corresponding to the second object is determined as the second projection screen content; Transmit the second projection content to the projection device so that the projection device displays the second projection content while displaying the first projection content.

9. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: In response to a move-out operation on the first object in the first projection editing area, a stop projection instruction is sent to the projection device so that the projection device stops displaying the first projection content based on the stop projection instruction.

10. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: When the application corresponding to the first object is switched to background operation, the first object content corresponding to the first object continues to be determined as the first projection screen content.

11. A screen projection method, characterized in that: The method is performed by a screen projection device, and the method includes: In the screen projection state, receiving first screen projection content sent by the terminal, the first screen projection content is determined based on the first object content corresponding to the first object contained in the first screen projection editing area of ​​the terminal, the first screen projection editing area is determined based on the first area editing operation of the terminal in the screen projection state, the first screen projection editing area is displayed in a newly added layer on the upper layer of the user interface, and the screen projection object includes at least one of an application icon, a file, and a floating window; Displaying the first projection content; In response to a request for adding projection content, receiving second projection content sent by the terminal, wherein the request for adding projection content is triggered by adding a second object in the first projection editing area; Display the first projection content and the second projection content.

12. The method according to claim 11, characterized in that The displaying the first screen projection content and the second screen projection content includes: Dividing a display area into a first display area and a second display area; displaying the first projection content in the first display area, and displaying the second projection content in the second display area; or, Generate a first display window and a second display window; display the first projection content in the first display window, and display the second projection content in the second display window.

13. A screen projection device, characterized in that: The device is executed by a terminal, and the device includes: An editing module, comprising: responding to a first area editing operation in a projection state, and displaying a first projection editing area in a newly added layer on an upper layer of a user interface based on the first area editing operation, wherein the projection object includes at least one of an application icon, a file, and a floating window; A determination module, comprising, when the first projection screen editing area includes a first object, determining a first object content corresponding to the first object as a first projection screen content; A sending module, comprising transmitting the first screen projection content to a screen projection device so that the screen projection device displays the first screen projection content; A receiving module, used for receiving a drag operation on a second object; The determining module is further used to determine the target position of the second object when the dragging operation stops; The determination module is further configured to, when the target position is located in the first projection screen editing area, determine the second object content corresponding to the second object as the second projection screen content; The sending module is also used to transmit the second screen projection content to the screen projection device, so that the screen projection device displays the second screen projection content while displaying the first screen projection content.

14. A screen projection device, characterized in that: The device is executed by a screen projection device, and the device includes: a receiving module, configured to receive first projection content sent by a terminal in a projection state, wherein the first projection content is determined based on a first object content corresponding to a first object contained in a first projection editing area of ​​the terminal, wherein the first projection editing area is determined based on an editing operation of the first area in the projection state of the terminal, wherein the first projection editing area is displayed in a newly added layer on an upper layer of a user interface, and the projection object includes at least one of an application icon, a file, and a floating window; A display module, used to display the first projection content; The receiving module is further configured to receive, in response to a screen projection content addition request, a second screen projection content sent by the terminal, wherein the screen projection content addition request is triggered by adding a second object in the first screen projection editing area; The display module is also used to display the first projection content and the second projection content.

15. An electronic device, characterized in that: The electronic device includes a processor and a memory, wherein the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the screen projection method as described in any one of claims 1 to 10, or to implement the screen projection method as described in any one of claims 11 to 12.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one program code, and the program code is loaded and executed by the processor to implement the screen projection method as described in any one of claims 1 to 10, or to implement the screen projection method as described in any one of claims 11 to 12.

17. A computer program product, characterized in that The computer program product includes computer instructions, which are stored in a computer-readable storage medium. The processor reads and executes the computer instructions from the computer-readable storage medium to implement the screen projection method as described in any one of claims 1 to 10, or to implement the screen projection method as described in any one of claims 11 to 12.

Images