Screen projection method, device, electronic device and storage medium
By detecting application switching during screen mirroring and using a screen mirroring whitelist to determine whether to pause or continue transmitting the screen mirroring signal, the problem of privacy leakage during screen mirroring is solved, and personal privacy is effectively protected.
Patent Information
- Application Number
- CN202210113740.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-30
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2042-01-30
AI Technical Summary
During screen mirroring, private content from mobile devices can easily be simultaneously projected onto public display devices, leading to the leakage of personal privacy.
If a switch to an upper-layer application is detected during the screen mirroring process, the screen mirroring signal transmission is paused. The screen mirroring whitelist is obtained to determine whether the target application is a whitelisted application. If it is, the signal transmission continues; otherwise, the system checks whether to switch to a whitelisted application and continues transmission.
It effectively protects personal privacy, avoids the instantaneous display of private content, ensures that only content from whitelisted applications is displayed during screen casting, and enhances privacy protection during the screen casting process.
Smart Images

Figure CN114428598B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of screen projection technology, and in particular to a screen projection method, device, electronic device and storage medium. Background Art
[0002] With the development of science and technology and the improvement of people's living standards, the function of displaying the screens of mobile devices such as mobile phones, tablets, and computers through display devices such as large-screen TVs and projectors has become increasingly popular. Users often push pictures, music, videos, etc. from mobile devices to display devices for playback. However, when the screen of a mobile device is projected on the same screen, when private content is displayed on the mobile phone, it will also be projected to the display device at the same time. The display device is often a screen with public attributes, which may cause the leakage of personal privacy. Summary of the invention
[0003] The main purpose of this application is to provide a screen projection method, device, electronic device and storage medium, aiming to solve the technical problem of privacy leakage in the screen projection process in the prior art.
[0004] To achieve the above object, the present application provides a screen projection method, which includes:
[0005] When it is detected during the screen projection process that the upper layer application switches from the first target application to the second target application, the transmission of the screen projection signal is suspended;
[0006] Obtain a screen projection whitelist, and determine whether the second target application is a whitelist application according to the screen projection whitelist;
[0007] If it is determined that the second target application is a whitelist application, the screen projection signal continues to be transmitted.
[0008] Optionally, after the step of determining whether the second target application is a whitelist application according to the screen projection whitelist, the method further includes:
[0009] If it is determined that the second target application is not a whitelist application, detecting whether the upper layer application is switched to a whitelist application;
[0010] When it is detected that the upper-layer application switches to the whitelist application, the screen projection signal continues to be transmitted.
[0011] Optionally, when it is detected that the upper layer application switches from the first target application to the second target application during the screen projection process, before the step of suspending the transmission of the screen projection signal, the method further includes:
[0012] Get the current projection display mode;
[0013] If it is determined that the current projection display mode is the privacy protection mode, monitor whether the upper-layer application performs application switching.
[0014] Optionally, when it is detected that the upper layer application switches from the first target application to the second target application during the screen projection process, the step of suspending the transmission of the screen projection signal includes:
[0015] When it is detected during the screen projection process that the upper layer application switches from the first target application to the second target application, the playback of the playback content corresponding to the first target application is paused, and the transmission of the screen projection signal is paused.
[0016] Optionally, the step of pausing the playing of the content corresponding to the first target application includes:
[0017] Determine whether the playback content corresponding to the first target application is a recorded playback resource;
[0018] If it is determined that the playback content corresponding to the first target application is a recorded broadcast resource, pausing the playback of the recorded broadcast resource, and obtaining a pause time of the recorded broadcast resource;
[0019] When it is detected that the upper layer application switches to the first target application, the recorded broadcast resource continues to be played from the pause time.
[0020] Optionally, the step of pausing the playing of the content corresponding to the first target application includes:
[0021] Determine whether the playback content corresponding to the first target application is a live broadcast resource;
[0022] If it is determined that the playback content corresponding to the first target application is a live broadcast resource, freezing the current playback screen of the live broadcast resource, and recording the live broadcast resource to obtain a recording file;
[0023] When it is detected that the upper layer application switches to the first target application, the recorded file is played.
[0024] Optionally, after the step of pausing transmission of the screen projection signal, the method further includes:
[0025] The last frame received before pausing the transmission of the screen projection signal is displayed on the display device.
[0026] The present application also provides a screen projection device, which is applied to a screen projection device, and the screen projection device includes:
[0027] A pause module, used to pause the transmission of the screen projection signal when it is detected that the upper layer application switches from the first target application to the second target application during the screen projection process;
[0028] A judgment module, used to obtain a screen projection whitelist, and judge whether the second target application is a whitelist application according to the screen projection whitelist;
[0029] The transmission module is used to continue transmitting the screen projection signal if it is determined that the second target application is a whitelist application.
[0030] The present application also provides an electronic device, which is a physical device, and includes: a memory, a processor, and a program of the screen projection method stored in the memory and executable on the processor. When the program of the screen projection method is executed by the processor, the steps of the screen projection method as described above can be implemented.
[0031] The present application also provides a storage medium, which is a computer-readable storage medium. The computer-readable storage medium stores a program for implementing the screen projection method. When the program of the screen projection method is executed by a processor, the steps of the screen projection method as described above are implemented.
[0032] The present application also provides a computer program product, including a computer program, which implements the steps of the screen projection method as described above when executed by a processor.
[0033] The present application provides a screen projection method, device, electronic device and storage medium. When it is detected that the upper-layer application switches from the first target application to the second target application during the screen projection process, the transmission of the screen projection signal is suspended. This achieves the suspension of the transmission of the screen projection signal each time the application is switched to ensure that if the display content of the second target application switched to contains privacy content, it will not be displayed synchronously immediately. Then, by obtaining a screen projection whitelist, it is determined whether the second target application is a whitelist application according to the screen projection whitelist. If it is determined that the second target application is a whitelist application, the screen projection signal continues to be transmitted. This achieves the determination of whether the second target application can be projected and displayed according to the screen projection whitelist. If it is determined that the second target application is a whitelist application, it means that the second target application does not contain privacy content. In this case, the screen projection signal can continue to be transmitted, and the display screen corresponding to the second target application can be projected and displayed. This achieves the suspension of the transmission of the screen projection signal only for applications that are not on the screen projection whitelist. This effectively improves the protection of personal privacy during the screen projection process and overcomes the technical problem of privacy leakage during the screen projection process in the prior art. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0035] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0036] Figure 1 Schematic diagram of screen projection connection scenario in one embodiment of the screen projection call method of the present application;
[0037] Figure 2 A schematic diagram of the structure of an electronic device of a hardware operating environment involved in the screen projection call method in an embodiment of the present application;
[0038] Figure 3 This is a flowchart of an embodiment of the screen projection method of the present application;
[0039] Figure 4 A schematic diagram of a scenario in which the screen projection call method of the present application can be implemented;
[0040] Figure 5 This is a schematic diagram of the device structure involved in the screen projection call method in an embodiment of the present application.
[0041] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0042] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work belong to the scope of protection of the present invention.
[0043] Reference Figure 1 , Figure 1 This is a schematic diagram of screen projection connection involved in an embodiment of the present invention.
[0044] like Figure 1 As shown, the screen projector includes: a screen projector transmitter and / or a screen projector receiver, wherein the first electronic device can be a personal computer, or a mobile terminal device such as a smart phone, a tablet computer, an e-book reader, a portable computer, etc., and the second electronic device can be a TV, or a display device with a display function such as a monitor or a projector.
[0045] In some embodiments, the first electronic device is connected to the screen projector transmitter and / or the screen projector receiver through a wired or wireless network for data transmission and interaction; the screen projector transmitter is connected to the screen projector receiver through a wireless network for data transmission and interaction, or the screen projector transmitter is connected to the second electronic device through a wireless network for data transmission and interaction; the screen projector receiver is connected to the second electronic device through a wired or wireless network for data transmission and interaction. In an optional implementation, the wired connection between the screen projector receiver and the second electronic device and between the screen projector transmitter and the first electronic device may include wired connections based on HDMI (High Definition Multimedia Interface), USB (Universal Serial Bus), DP (DisplayPort) and VGA (Video Graphics Array). The wireless communication between the first electronic device and the screen projector transmitter and the screen projector receiver, and between the second electronic device and the screen projector transmitter and the screen projector receiver may include wireless communication such as Bluetooth, wireless broadband (Wi-Fi), infrared communication, etc.
[0046] Therefore, possible connection modes for implementing screen projection between the first electronic device, the screen projection transmitter, the screen projection receiver and the second electronic device include at least:
[0047] (1) The screen projector transmitter is connected to the screen projector receiver, and the screen of the first electronic device is finally projected to the second electronic device through the screen projector transmitter and the screen projector receiver;
[0048] (2) The screen projector transmitter is wirelessly connected to the second electronic device, and the screen of the first electronic device is projected to the second electronic device through the screen projector transmitter. At this time, the screen projector transmitter is connected to the wireless communication module built into the second electronic device through a wireless network;
[0049] (3) The first electronic device is connected to a screen projector receiver, and the screen of the first electronic device is projected to the second electronic device through the screen projector receiver.
[0050] Reference Figure 2 , Figure 2 The electronic device structure diagram of the hardware operating environment involved in the screen projection call method in the embodiment of the present application. The electronic device in the embodiment of the present disclosure may include but is not limited to fixed terminals such as televisions, screen projectors, screen projector receivers, screen projector transmitters, mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), digital TVs, desktop computers, etc.
[0051] like Figure 2 As shown, the electronic device also includes: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a network interface 1003, and a memory 1004. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The network interface 1003 may optionally include a standard wired interface, a wireless interface (such as a wireless fidelity (Wireless-Fidelity, WI-FI) interface). The memory 1004 can be a high-speed random access memory (Random Access Memory, RAM) memory, or it can be a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1004 can also be a storage device independent of the aforementioned processor 1001.
[0052] Optionally, the terminal may also include a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like. Among them, sensors include light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display screen according to the brightness of the ambient light, and the proximity sensor may turn off the display screen and / or backlight when the mobile terminal is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; of course, the mobile terminal may also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which will not be repeated here.
[0053] Those skilled in the art will understand that Figure 2 The structure shown in the figure does not constitute a limitation on the operating device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.
[0054] like Figure 2 As shown, the memory 1004 as a storage medium may include an operating system, a data storage module, a network communication module, and a screen projection call program.
[0055] exist Figure 2In the running device shown, the network interface 1003 is mainly used for data communication with other devices. The processor 1001 and the memory 1004 in the running device of the present invention can be set in the running device, and the running device calls the screen projection call program stored in the memory 1004 through the processor 1001, and performs the following operations:
[0056] When it is detected during the screen projection process that the upper layer application switches from the first target application to the second target application, the transmission of the screen projection signal is suspended;
[0057] Obtain a screen projection whitelist, and determine whether the second target application is a whitelist application according to the screen projection whitelist;
[0058] If it is determined that the second target application is a whitelist application, the screen projection signal continues to be transmitted.
[0059] Further, the processor 1001 may call the screen projection call program stored in the memory 1004, and further perform the following operations:
[0060] If it is determined that the second target application is not a whitelist application, detecting whether the upper layer application is switched to a whitelist application;
[0061] When it is detected that the upper-layer application switches to the whitelist application, the screen projection signal continues to be transmitted.
[0062] Further, the processor 1001 may call the screen projection call program stored in the memory 1004, and further perform the following operations:
[0063] Get the current projection display mode;
[0064] If it is determined that the current projection display mode is the privacy protection mode, monitor whether the upper-layer application performs application switching.
[0065] Further, the processor 1001 may call the screen projection call program stored in the memory 1004, and further perform the following operations:
[0066] When it is detected during the screen projection process that the upper layer application switches from the first target application to the second target application, the playback of the playback content corresponding to the first target application is paused, and the transmission of the screen projection signal is paused.
[0067] Further, the processor 1001 may call the screen projection call program stored in the memory 1004, and further perform the following operations:
[0068] Determine whether the playback content corresponding to the first target application is a recorded playback resource;
[0069] If it is determined that the playback content corresponding to the first target application is a recorded broadcast resource, pausing the playback of the recorded broadcast resource, and obtaining a pause time of the recorded broadcast resource;
[0070] When it is detected that the upper layer application switches to the first target application, the recorded broadcast resource continues to be played from the pause time.
[0071] Further, the processor 1001 may call the screen projection call program stored in the memory 1004, and further perform the following operations:
[0072] Determine whether the playback content corresponding to the first target application is a live broadcast resource;
[0073] If it is determined that the playback content corresponding to the first target application is a live broadcast resource, freezing the current playback screen of the live broadcast resource, and recording the live broadcast resource to obtain a recording file;
[0074] When it is detected that the upper layer application switches to the first target application, the recorded file is played.
[0075] Further, the processor 1001 may call the screen projection call program stored in the memory 1004, and further perform the following operations:
[0076] The last frame received before pausing the transmission of the screen projection signal is displayed on the display device.
[0077] The present application embodiment provides a screen projection method. In the first embodiment of the screen projection method of the present application, refer to Figure 3 , the screen projection method includes:
[0078] Step S10, when it is detected that the upper layer application switches from the first target application to the second target application during the screen projection process, suspending the transmission of the screen projection signal;
[0079] In this embodiment, it should be noted that the screen projection is the process of projecting the display screen of the screen projection push end to the screen projection receiving end for display, and the screen projection receiving end is communicatively connected with the screen projection push end. The execution subject of this embodiment can be the screen projection push end or the screen projection receiving end, wherein the screen projection receiving end is a device for receiving the screen projection, such as a television, a computer or a projector, etc. In an implementable manner, the screen projection receiving end can also be a screen projection receiver connected to a display and / or a speaker, and the screen projection receiver and the display and / or the speaker can be connected by wire or wirelessly. After receiving the audio signal and image signal of the screen projection, the audio signal and image signal received by the screen projection are output through the display and / or the speaker connected to the screen projection receiver; the screen projection push end is a mobile device that pushes the screen projection, such as a mobile phone, a computer or a tablet computer, etc. In an implementable manner, the screen projection push end can also be a screen projection transmitter connected to a mobile device, and the screen projection transmitter and the mobile device can be connected by wire or wirelessly, and the mobile device sends the required audio signal and image signal of the screen projection to the screen projection receiving end through the screen projection transmitter.
[0080] Specifically, in the process of projecting the screen from the projection push end to the projection receiving end, it is detected in real time whether the upper-layer application corresponding to the projection push end changes. When it is detected that the upper-layer application switches from the currently displayed first target application to the second target application, the transmission of the projection signal to the projection receiving end is suspended, wherein the projection signal includes a projection audio signal and a projection image signal, etc. The upper-layer application is the application displayed at the top layer of the projection push end. The upper-layer application switches from the first target application to the second target application in a manner including pop-up message notification, incoming call or switching application (for example: switching application through top message notification or directly switching application by switching screen, etc.). In an implementable manner, the upper-layer application can also be set. In the exception scenario, if it is determined that the current upper-layer application belongs to the exception scenario, a new upper-layer application is re-determined from other applications except the current upper-layer application. For example, if the exception scenario is determined to be a top floating window, and a top floating window of WeChat is received during screen casting to watch a video, a new upper-layer application is re-determined from other applications except the WeChat application. At this time, the new upper-layer application should be the original application for watching the video. In this way, the poor experience of watching videos and other continuous screen casting processes due to constant interruptions of WeChat messages can be avoided. In an implementable manner, the privacy protection of the upper-layer application corresponding to the exception scenario can be achieved by blurring or otherwise hiding the upper-layer application corresponding to the exception scenario.
[0081] Optionally, when it is detected that the upper layer application switches from the first target application to the second target application during the screen projection process, before the step of suspending the transmission of the screen projection signal, the method further includes:
[0082] Step A10, obtaining the current projection display mode;
[0083] Step A20: If it is determined that the current projection display mode is the privacy protection mode, monitor whether the upper-layer application performs application switching.
[0084] In this embodiment, specifically, the currently set screen projection display mode of the screen projection connection is obtained, and it is determined whether the currently set screen projection display mode is a privacy protection mode. If it is determined that the current screen projection display mode is a privacy protection mode, then it is monitored whether the upper-layer application of the mobile device at the screen projection push end performs application switching. The screen projection display mode is a display mode for performing screen projection display or not according to different scenarios during the screen projection process, including a privacy protection mode, an unlimited projection mode, a conference mode and / or a game mode, etc. It can be pre-set according to big data or test data, and the user can be guided to set and change it according to their own needs. The privacy protection mode is to not perform screen projection display on privacy protection applications that require privacy protection. mode, the privacy protection application corresponding to the privacy protection mode can be determined according to the screen projection whitelist or the screen projection blacklist. The screen projection whitelist is a list of applications that are allowed to be projected and displayed, and the blacklist is a list of applications that are not allowed to be projected and displayed. The screen projection whitelist and the screen projection blacklist can be pre-set according to big data or test data, and the user can be guided to set and change them according to their own needs. The privacy protection mode can be turned on by default when the screen projection connection is established, can be turned on when a user operation to switch to the privacy protection mode is detected, and the number of people watching the projection can also be determined by the sound signal collected by the microphone and / or the image signal captured by the camera. If it is detected that the number of people watching the projection exceeds the preset number, the privacy protection mode is automatically turned on.
[0085] In one feasible method, after the step of obtaining the current projection display mode, it also includes: outputting prompt information of the current projection display mode to remind the user of the current projection display mode. If the current projection display mode does not meet the user's current needs, the user can make timely adjustments.
[0086] Optionally, when it is detected that the upper layer application switches from the first target application to the second target application during the screen projection process, the step of suspending the transmission of the screen projection signal includes:
[0087] When it is detected during the screen projection process that the upper layer application switches from the first target application to the second target application, the playback of the playback content corresponding to the first target application is paused, and the transmission of the screen projection signal is paused.
[0088] In this embodiment, specifically, during the screen projection process, it is detected in real time whether the upper-layer application changes. When it is detected that the upper-layer application switches from the currently displayed first target application to the second target application, the playback of the playback content corresponding to the first target application is paused, and the transmission of the screen projection signal to the screen projection receiving end is paused, wherein the playback content includes recorded resources (for example: online videos, music, etc.), live resources (for example: online live broadcasts, radio stations, etc.) and / or instant resources (for example: games, calls, etc.), etc.
[0089] Optionally, the step of pausing the playing of the content corresponding to the first target application includes:
[0090] Step B10, determining whether the playback content corresponding to the first target application is a recorded playback resource;
[0091] In this embodiment, specifically, based on the resource information of the playback content corresponding to the first target application, it is determined whether the playback content is a recorded broadcast resource, wherein the resource information is relevant information of the playback resource, and is used to determine whether the playback resource is a live broadcast resource or a recorded broadcast resource. For example, if it is detected that the playback content is video content of a live broadcast platform, then the playback content is a live broadcast resource; if it is detected that the playback content is an updated episode on a video website, then the playback content is a recorded broadcast resource. In an implementable manner, the resource information can also be obtained by performing text recognition on the playback content. If live broadcast-related text is recognized, then the playback content is determined to be a live broadcast resource; if no live broadcast-related text is recognized, then the playback content is determined to be a recorded broadcast resource.
[0092] Step B20: if it is determined that the playback content corresponding to the first target application is a recorded playback resource, pausing the playback of the recorded playback resource and obtaining the pause time of the recorded playback resource;
[0093] Step B30: When it is detected that the upper layer application switches to the first target application, the recorded broadcast resource continues to be played from the pause time.
[0094] In this embodiment, specifically, if it is determined that the playback content corresponding to the first target application is a recorded broadcast resource, the playback of the recorded broadcast resource is paused, and the pause time of the recorded broadcast resource is obtained. When it is detected that the upper-layer application switches to the first target application, the playback of the recorded broadcast resource continues from the pause time. If it is determined that the currently played content is not a recorded broadcast resource, the currently played content may be a live broadcast resource or a resource that cannot be paused, etc., the currently played content is not paused, or the current playback screen of the live broadcast resource is frozen, and the currently played content is recorded to obtain a recorded file. When it is detected that the upper-layer application switches to the first target application, the recorded file is played.
[0095] In this embodiment, the content being played is automatically paused when switching applications, and the originally played content is automatically resumed when switching back to the original application. This can avoid the problem of privacy leakage that may be caused by switching applications, and can also avoid missing the content played in the original application due to switching applications. There is no need to manually pause or roll back, and you can continue watching the content played in the original application from the time when you switched applications. This not only protects user privacy, but also ensures the screen projection experience and simplifies user operations.
[0096] Optionally, the step of pausing the playing of the content corresponding to the first target application includes:
[0097] Step C10, determining whether the playback content corresponding to the first target application is a live broadcast resource;
[0098] In this embodiment, specifically, based on the resource information of the playback content corresponding to the first target application, it is determined whether the playback content is a live broadcast resource, wherein the resource information is relevant information of the playback resource, and is used to determine whether the playback resource is a live broadcast resource or a recorded broadcast resource. For example, if it is detected that the playback content is video content of a live broadcast platform, then the playback content is a live broadcast resource; if it is detected that the playback content is an updated episode on a video website, then the playback content is a recorded broadcast resource. In an implementable manner, the resource information can also be obtained by performing text recognition on the playback content. If live broadcast-related text is recognized, then the playback content is determined to be a live broadcast resource; if no live broadcast-related text is recognized, then the playback content is determined to be a recorded broadcast resource.
[0099] Step C20: if it is determined that the playback content corresponding to the first target application is a live broadcast resource, freezing the current playback screen of the live broadcast resource, and recording the live broadcast resource to obtain a recording file;
[0100] Step C30: when it is detected that the upper layer application switches to the first target application, the recorded file is played.
[0101] In this embodiment, specifically, if it is determined that the playback content corresponding to the first target application is a recorded broadcast resource, the current playback screen of the live broadcast resource is frozen, and the live broadcast resource is recorded from the frozen current playback screen to obtain a recording file. When it is detected that the upper-layer application switches to the first target application, the recording file is played from the frozen current playback screen, and the live broadcast resource is continued to be recorded until the live broadcast resource ends or the user ends the playback of the live broadcast resource. If it is determined that the playback content corresponding to the first target application is not a live broadcast resource, the current playback content may be a recorded broadcast resource or a resource that cannot be paused, etc., then the current playback content is paused or not paused. If it is detected that the current playback content is successfully paused, the pause time of the recorded broadcast resource is obtained. When it is detected that the upper-layer application switches to the first target application, the recorded broadcast resource continues to be played from the pause time.
[0102] In this embodiment, by recording the content being played when switching applications and playing the recorded file when switching back to the original application, the problem of privacy leakage that may be caused by switching applications can be avoided, and the problem of missing the live content played in the original application due to switching applications can be avoided. This protects user privacy and ensures the screen projection experience.
[0103] Optionally, after the step of pausing transmission of the screen projection signal, the method further includes:
[0104] The last frame received before pausing the transmission of the screen projection signal is displayed on the display device.
[0105] In this embodiment, specifically, the last frame of picture received before pausing the transmission of the screen projection signal is determined, and the last frame of picture is output and displayed by the display device corresponding to the screen projection receiving end, wherein the last frame of picture received by the screen projection receiving end is the last frame of picture when the upper-layer application of the screen projection pushing end is the first target application before switching from the first target application to the second target application. By sending a pause screen projection instruction to the screen projection receiving end, the screen projection receiving end displays the last frame of picture received. When the upper-layer application switches back to the first target application and continues to transmit the screen projection signal to the screen projection receiving end, the screens can be made to have continuity, thereby reducing the impact on the user's screen projection experience.
[0106] In an practicable manner, after the step of pausing the transmission of the screen projection signal, the method further includes:
[0107] Send a reminder message to the screen projection receiver to pause the screen projection to remind the user the reason for the current screen projection pause, so as to avoid the user mistakenly thinking that a fault has occurred. It can also remind the user to handle privacy information in a timely manner.
[0108] Step S20, obtaining a screen projection whitelist, and determining whether the second target application is a whitelist application according to the screen projection whitelist;
[0109] In this embodiment, specifically, a screen projection whitelist is obtained, and it is determined whether there is application information matching the second target application in the screen projection whitelist. If it is determined that there is application information matching the second target application in the screen projection whitelist, then the second target application is a whitelist application. If it is determined that there is no application information matching the second target application in the screen projection whitelist, then the second target application is not a whitelist application. The screen projection whitelist is a list of applications that are allowed to be displayed on the screen projection receiving end through screen projection. The screen projection whitelist can be pre-set based on big data or test data, etc., and can also guide users to set and change it according to their own needs.
[0110] Optionally, after the step of determining whether the second target application is a whitelist application according to the screen projection whitelist, the method further includes:
[0111] Step D10, if it is determined that the second target application is not a whitelist application, detecting whether the upper layer application is switched to a whitelist application;
[0112] Step D20, when it is detected that the upper layer application switches to the whitelist application, the screen projection signal continues to be transmitted.
[0113] In this embodiment, specifically, if it is determined that the second target application is not a whitelist application, then the upper-layer application is detected in real time to see if there is any change in the upper-layer application. When it is detected that the upper-layer application switches to the third target application, the third target application is matched with the screen projection whitelist to determine whether the third target application is a whitelist application. If it is determined that the third target application is not a whitelist application, then the process returns to the step of detecting in real time whether there is any change in the upper-layer application. If it is determined that the third target application is a whitelist application, then the screen projection signal continues to be transmitted to the screen projection receiving end, wherein the third target application can be the first target application or other applications.
[0114] Step S30: If it is determined that the second target application is a whitelist application, continue to transmit the screen projection signal;
[0115] In this embodiment, specifically, if it is determined that the second target application is a whitelist application, the pause transmission operation of the screen projection signal is canceled, and the screen projection signal continues to be transmitted to the screen projection receiving end. If it is determined that the second target application is not a whitelist application, the transmission of the screen projection signal to the screen projection receiving end continues to be suspended.
[0116] In one practicable manner, referring to Figure 4The screen projection receiving end includes a TV set 400 and a screen projection receiver 300, the TV set 400 and the screen projection receiver 300 are in communication connection, the screen projection push end includes a mobile phone 100 and a screen projection transmitter 200, the mobile phone 100 and the screen projection transmitter 200 are in communication connection, the screen projection receiver 300 is in communication connection with the screen projection transmitter 200, during the screen projection process of the mobile phone 100 to the TV set 400, the screen projection transmitter 200 synchronously transmits the screen image and sound of the mobile phone 100 to the screen projection receiver 300, the screen projection receiver 300 sends the received screen image and sound of the mobile phone 100 to the TV set 400 for image display and sound playback, when the mobile phone 100 detects that the upper layer When the application switches from the first target application to the second target application, the projection signal to the projector transmitter 200 is stopped to prevent the projector transmitter 200 from sending privacy information to the projector receiver 300, thereby preventing the TV 400 from outputting privacy information, and obtaining a projection whitelist. According to the projection whitelist, it is determined whether the second target application is a whitelist application. If it is determined that the second target application is a whitelist application, it means that the playback content of the second target application can be projected for display. Therefore, the projection signal continues to be transmitted to the projector transmitter 200, so that the projector transmitter 200 can continue to send the projection signal to the projector receiver 300, and then send it to the TV 400 through the projector 300 for picture display and sound playback.
[0117] In this embodiment, when it is detected that the upper-layer application switches from the first target application to the second target application during the screen projection process, the transmission of the screen projection signal is suspended, so that the transmission of the screen projection signal is suspended each time the application is switched to ensure that if the display content of the second target application switched to contains privacy content, it will not be displayed synchronously immediately, and then by obtaining the screen projection whitelist, it is determined whether the second target application is a whitelist application according to the screen projection whitelist; if it is determined that the second target application is a whitelist application, the screen projection signal continues to be transmitted, so that it is determined according to the screen projection whitelist whether the second target application can be projected and displayed; if it is determined that the second target application is a whitelist application, it means that the second target application does not contain privacy content, and the screen projection signal can continue to be transmitted, and the display screen corresponding to the second target application can be projected and displayed, so that the transmission of the screen projection signal is suspended only for applications that are not on the screen projection whitelist, thereby effectively improving the protection of personal privacy during the screen projection process and overcoming the technical problem of privacy leakage during the screen projection process in the prior art.
[0118] Furthermore, the present application also provides a screen projection device, referring to Figure 5 The screen projection device is applied to a screen projection device, and the screen projection device includes:
[0119] The pause module 10 is used to pause the transmission of the screen projection signal when it is detected that the upper layer application switches from the first target application to the second target application during the screen projection process;
[0120] A judgment module 20 is used to obtain a screen projection whitelist and judge whether the second target application is a whitelist application according to the screen projection whitelist;
[0121] The transmission module 30 is used to continue transmitting the screen projection signal if it is determined that the second target application is a whitelist application.
[0122] Optionally, the transmission module 30 is further used for:
[0123] If it is determined that the second target application is not a whitelist application, detecting whether the upper layer application is switched to a whitelist application;
[0124] When it is detected that the upper-layer application switches to the whitelist application, the screen projection signal continues to be transmitted.
[0125] Optionally, the screen projection device further includes a monitoring module, and the monitoring module is further used to:
[0126] Get the current projection display mode;
[0127] If it is determined that the current projection display mode is the privacy protection mode, monitor whether the upper-layer application performs application switching.
[0128] Optionally, the pause module 10 is further used for:
[0129] When it is detected during the screen projection process that the upper layer application switches from the first target application to the second target application, the playback of the playback content corresponding to the first target application is paused, and the transmission of the screen projection signal is paused.
[0130] Optionally, the pause module 10 is further used for:
[0131] Determine whether the playback content corresponding to the first target application is a recorded playback resource;
[0132] If it is determined that the playback content corresponding to the first target application is a recorded broadcast resource, pausing the playback of the recorded broadcast resource, and obtaining a pause time of the recorded broadcast resource;
[0133] When it is detected that the upper layer application switches to the first target application, the recorded broadcast resource continues to be played from the pause time.
[0134] Optionally, the pause module 10 is further used for:
[0135] Determine whether the playback content corresponding to the first target application is a live broadcast resource;
[0136] If it is determined that the playback content corresponding to the first target application is a live broadcast resource, freezing the current playback screen of the live broadcast resource, and recording the live broadcast resource to obtain a recording file;
[0137] When it is detected that the upper layer application switches to the first target application, the recorded file is played.
[0138] Optionally, the screen projection device further includes a command sending module, and the command sending module is further used to:
[0139] The last frame received before pausing the transmission of the screen projection signal is displayed on the display device.
[0140] The screen projection device provided by the present invention adopts the screen projection method in the above embodiment, which solves the technical problem of privacy leakage in the screen projection process of the prior art. Compared with the prior art, the beneficial effects of the screen projection device provided by the embodiment of the present invention are the same as the beneficial effects of the screen projection method provided by the above embodiment, and other technical features in the screen projection device are the same as the features disclosed in the above embodiment method, which will not be repeated here.
[0141] Furthermore, the present application also provides a computer program product, including a computer program, which implements the steps of the screen projection method as described above when executed by a processor.
[0142] The computer program product provided by this application solves the technical problem of privacy leakage in the screen projection process of the prior art. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present invention are the same as the beneficial effects of the screen projection method provided by the above embodiment, which will not be repeated here.
[0143] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent processing scope of the present application.
Claims
1. A screen projection method, characterized in that: The screen projection method comprises: Get the current projection display mode; If it is determined that the current projection screen display mode is the privacy protection mode, monitor whether the upper-layer application performs application switching, wherein the privacy protection mode includes being turned on by default when the projection screen connection is established, or being turned on when a user operation of switching to the privacy protection mode is detected, or judging the number of people watching the projection screen through sound signals collected by a microphone and / or image signals captured by a camera, and automatically turning on the privacy protection mode if it is detected that the number of people watching the projection screen exceeds a preset number; When it is detected during the screen projection process that the upper layer application switches from the first target application to the second target application, the transmission of the screen projection signal is suspended; Obtain a screen projection whitelist, and determine whether the second target application is a whitelist application according to the screen projection whitelist; If it is determined that the second target application is a whitelist application, the screen projection signal continues to be transmitted.
2. The screen projection method according to claim 1, characterized in that: After the step of determining whether the second target application is a whitelist application according to the screen projection whitelist, the method further includes: If it is determined that the second target application is not a whitelist application, detecting whether the upper layer application is switched to a whitelist application; When it is detected that the upper-layer application switches to the whitelist application, the screen projection signal continues to be transmitted.
3. The screen projection method according to claim 1, characterized in that: The step of suspending transmission of the screen projection signal when it is detected that the upper layer application switches from the first target application to the second target application during the screen projection process includes: When it is detected during the screen projection process that the upper layer application switches from the first target application to the second target application, the playback of the playback content corresponding to the first target application is paused, and the transmission of the screen projection signal is paused.
4. The screen projection method according to claim 3, characterized in that: The step of pausing the playing of the content corresponding to the first target application includes: Determine whether the playback content corresponding to the first target application is a recorded playback resource; If it is determined that the playback content corresponding to the first target application is a recorded broadcast resource, pausing the playback of the recorded broadcast resource, and obtaining a pause time of the recorded broadcast resource; When it is detected that the upper layer application switches to the first target application, the recorded broadcast resource continues to be played from the pause time.
5. The screen projection method according to claim 3, characterized in that: The step of pausing the playing of the content corresponding to the first target application includes: Determine whether the playback content corresponding to the first target application is a live broadcast resource; If it is determined that the playback content corresponding to the first target application is a live broadcast resource, freezing the current playback screen of the live broadcast resource, and recording the live broadcast resource to obtain a recording file; When it is detected that the upper layer application switches to the first target application, the recorded file is played.
6. The screen projection method according to claim 1, characterized in that: After the step of pausing the transmission of the screen projection signal, the method further includes: The last frame received before pausing the transmission of the screen projection signal is displayed on the display device.
7. A screen projection device, characterized in that: The screen projection device comprises: A pause module, used to pause the transmission of the screen projection signal when it is detected that the upper layer application switches from the first target application to the second target application during the screen projection process; A judgment module, used to obtain a screen projection whitelist, and judge whether the second target application is a whitelist application according to the screen projection whitelist; A transmission module, configured to continue transmitting the screen projection signal if it is determined that the second target application is a whitelist application; Among them, the screen projection device also includes: obtaining the current screen projection display mode; if it is determined that the current screen projection display mode is a privacy protection mode, monitoring whether the upper-layer application performs application switching, wherein the privacy protection mode includes being turned on by default when establishing a screen projection connection, or being turned on when a user operation of switching to the privacy protection mode is detected, or judging the number of people watching the projection through sound signals collected by a microphone and / or image signals captured by a camera, and if it is detected that the number of people watching the projection exceeds a preset number, the privacy protection mode is automatically turned on.
8. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can perform the steps of the screen projection method described in any one of claims 1 to 6.
9. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, on which is stored a program for implementing the screen projection method. The program for implementing the screen projection method is executed by a processor to implement the steps of the screen projection method as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Self-adaptive control method of smart television
CN104378681A
Wireless screen projection method and device, intelligent tablet, terminal and system
CN110312160A
Incoming call privacy protection method and system
CN111367486A
Application screen projection control method and device, equipment and medium
CN111432070A
Screen projection method and device and electronic equipment
CN112099705A
