A secure display method and electronic device
By configuring security identifiers in electronic devices and using preset layers to replace or overwrite them, the problem of privacy and copyright information leakage during screenshots, screen recordings, screen projections, or screen sharing is solved, achieving a simplified operation and improved user experience with enhanced privacy protection.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-11-05
- Publication Date
- 2026-03-17
AI Technical Summary
When performing operations such as screenshotting, screen recording, screen casting, or screen sharing, user privacy and copyright information are easily leaked. Existing technologies also result in cumbersome user editing processes and poor user experience.
By configuring security identifiers in electronic devices, it can identify whether layers or controls contain security identifiers, and generate images that do not display privacy or copyright information by using preset layer replacement or overlay methods, prompting users for the reason for their operation and improving the user experience.
While protecting user privacy and copyright, it simplifies user operation processes, improves user experience, and avoids the leakage of privacy and copyright information.
Smart Images

Figure CN114528581B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of communications, and more particularly to a secure display method and electronic device. Background Technology
[0002] To facilitate user communication, users can share the interface of their electronic devices with other users through screenshots, screen recordings, screen sharing, and screen mirroring. However, sharing the interface through these methods may involve copyright issues or leak user privacy. Typically, to avoid leaking their own or others' privacy, users can use editing tools to blur or mosaic sensitive information before sending it. However, this method is cumbersome and provides a poor user experience. Summary of the Invention
[0003] This application provides a secure display method and electronic device that can improve user experience while protecting user privacy information.
[0004] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:
[0005] A first aspect of this application provides a secure display method, comprising: a first electronic device displaying a first image; the first electronic device receiving a first operation from a user, the first operation being used to acquire the first image displayed by the first electronic device; in response to the user's first operation, if the first electronic device determines that a first layer in the first image includes a security identifier, the first electronic device replaces or overwrites the first layer with a first preset layer, and generates a second image. Based on this solution, when the first electronic device determines that a layer in the first image includes a security identifier, by replacing or overwriting the layer containing the security identifier with a first preset layer, the generated second image does not display the layer containing the security identifier, thus protecting the user's privacy or copyright. Furthermore, this solution does not require user editing to generate a second image that does not display user privacy or copyright, thus improving the user experience.
[0006] Understandably, when the first electronic device uses a first preset layer to cover the first layer, it can composite multiple layers of the first image with the first preset layer. During this composite process, the first preset layer is positioned above the first layer, allowing the first layer to be covered by it. Although the generated second image still includes the first layer, because it is covered by the first preset layer, the generated second image does not display the first layer; that is, the first layer is invisible to the user. This ensures that the generated second image does not display user privacy information or copyright information.
[0007] Optionally, the first image may be the entire image displayed on the screen of the first display device, or it may be a partial image displayed on the screen of the first electronic device.
[0008] Optionally, the security identifier mentioned above can be pre-configured by a third-party application or system. For example, a third-party application can pre-configure a security identifier for layers involving user privacy information. As another example, a third-party application can pre-configure a security identifier for layers involving copyright. Optionally, the security identifier can be LayoutParams.FLAG_SECURE.
[0009] In conjunction with the first aspect, in one possible implementation, the first electronic device replaces the first layer with a first preset layer and generates a second image, including: the first electronic device replacing the first layer with the first preset layer; the first electronic device combining the second layer in the first image with the first preset layer to generate the second image; the second layer does not include the security identifier. Based on this solution, when generating the second image, the first electronic device replaces the first layer in the first image with the first preset layer, and then combines the second layer in the first image (excluding the security identifier) with the first preset layer to obtain the second image. Therefore, the generated second image no longer includes the first layer, thereby protecting copyright if the first layer involves copyright, and protecting user privacy if the first layer includes user privacy information.
[0010] In conjunction with the first aspect and the aforementioned possible implementations, in another possible implementation, the first preset layer includes a prompt message indicating that the first image contains security information. Based on this solution, the prompt message in the first preset layer allows the user to understand why the second image differs from the first image, thus improving the user experience.
[0011] Optionally, the prompt information in the first preset layer can be text information such as "Safe interface prohibits screenshots" or "Safe interface prohibits screen recording", or it can be an animated or icon prompt. This application does not limit the specific content and type of the prompt information.
[0012] In conjunction with the first aspect and the aforementioned possible implementations, in another possible implementation, the first operation includes a screenshot operation, a screen recording operation, a screen casting operation, or a screen sharing operation. Based on this solution, when the first electronic device receives a user's screenshot operation, screen recording operation, screen casting operation, or screen sharing operation, in response to the operation, the first electronic device further determines whether the first layer in the first image includes a security identifier. If the first electronic device determines that the first layer in the first image includes a security identifier, the first electronic device replaces or covers the first layer with a first preset layer and generates a second image, thereby ensuring that the layer containing the security identifier is not displayed in the generated second image, thus protecting the user's privacy or copyright.
[0013] In conjunction with the first aspect and the aforementioned possible implementations, in another possible implementation, when the first operation is a screenshot or screen recording operation, the method further includes: the first electronic device displaying the second image. Based on this solution, when the user input operation is a screenshot or screen recording operation, the first electronic device replaces or overwrites the first layer in the first image to generate a second image, and displays the processed second image on the display screen. It is understood that the second image displayed by the first electronic device does not involve copyright or privacy information, thus protecting the user's privacy or copyright.
[0014] In conjunction with the first aspect and the aforementioned possible implementations, in another possible implementation, when the first operation is a screen mirroring operation or a screen sharing operation, the method further includes: the first electronic device sending the second image to the second electronic device. Based on this solution, when the user input operation is a screen mirroring operation or a screen sharing operation, the first electronic device replaces or overwrites the first layer in the first image to generate a second image, and sends the second image to the second electronic device. Upon receiving the second image, the second electronic device can display it. Therefore, in screen mirroring or screen sharing scenarios, the second image displayed by the second electronic device is different from the first image displayed by the first electronic device, thereby ensuring that security information is not leaked.
[0015] In conjunction with the first aspect and the aforementioned possible implementations, in another possible implementation, the method further includes: the first electronic device receiving a second operation from a user, the second operation being used to activate a security switch control; in response to the user's second operation, the electronic device filtering a third layer in the second image to generate a third image; the third layer including pop-up notification information. Based on this solution, by activating the security switch control, the pop-up notification information of the first electronic device can be further filtered, thereby preventing other users from seeing user SMS notifications or application notifications, thus better protecting user privacy.
[0016] In conjunction with the first aspect and the aforementioned possible implementations, in another possible implementation, when the first operation is a screenshot or screen recording operation, the method further includes: the first electronic device displaying the third image. Based on this solution, when the user input operation is a screenshot or screen recording operation, the first electronic device displays the processed third image on the display screen. It is understood that the third image displayed by the first electronic device does not involve copyright or privacy information and does not include pop-up prompts, thus better protecting the user's privacy or copyright.
[0017] In conjunction with the first aspect and the aforementioned possible implementations, in another possible implementation, when the first operation is a screen mirroring operation or a screen sharing operation, the method further includes: the first electronic device sending the third image to the second electronic device. Based on this solution, when the user input operation is a screen mirroring operation or a screen sharing operation, the first electronic device sends a third image to the second electronic device, so that the second electronic device, after receiving the third image, can display it. Therefore, in screen mirroring or screen sharing scenarios, the third image displayed by the second electronic device is different from the first image displayed by the first electronic device, thereby ensuring that the third image displayed by the second electronic device does not involve copyright or privacy information and does not include pop-up prompts, thus better protecting the user's privacy or copyright.
[0018] A second aspect of this application provides a secure display method, comprising: a first electronic device displaying a first image; the first electronic device receiving a first operation from a user, the first operation being used to acquire the first image displayed by the first electronic device; in response to the user's first operation, if the first electronic device determines that a first control in the first image includes a security identifier, the first electronic device covers the first control with a second preset layer to generate a fourth image. Based on this solution, when the first electronic device determines that a control in the first image includes a security identifier, by covering the control including the security identifier with a second preset layer, the generated fourth image does not display the control including the security identifier, thus providing more precise protection of user privacy and improving user experience. Moreover, this solution does not require user editing to generate a fourth image that does not display user privacy or copyright information, thereby improving user experience. This solution can process security controls so that the information of the controls cannot be seen by other users, thus not only protecting user security but also further improving the user experience due to the smaller area of security processing.
[0019] In conjunction with the second aspect, in one possible implementation, the first electronic device uses a second preset layer to cover the first control to generate a fourth image. This includes: the first electronic device acquiring the position information of the first control within the first image; and based on this position information, the first electronic device using the second preset layer to cover the area where the first control is located to generate the fourth image. Based on this solution, by using a second preset layer to cover the first control, including the security identifier, the generated fourth image does not display the first control, meaning the first control is invisible to the user. This ensures that the generated fourth image does not display the information of the first control, protecting user privacy without requiring manual editing and improving the user experience. Furthermore, because the area of security processing is smaller, the user experience is further enhanced.
[0020] Combining the second aspect and the aforementioned possible implementations, in another possible implementation, the second preset layer includes a prompt message to inform the user that the first control includes security information. Based on this solution, the prompt message in the second preset layer allows the user to understand why the fourth image differs from the first image, thus improving the user experience.
[0021] Optionally, the prompt information in the second preset layer can be text information such as "Security control prohibits screenshot" or "Security control prohibits screen recording", or it can be an animated or icon prompt. This application does not limit the specific content and type of the prompt information.
[0022] In conjunction with the second aspect and the aforementioned possible implementations, in another possible implementation, the first operation includes a screenshot operation, a screen recording operation, a screen casting operation, or a screen sharing operation. Based on this solution, when the first electronic device receives a user's screenshot operation, screen recording operation, screen casting operation, or screen sharing operation, in response to the operation, the first electronic device further determines whether the first control in the first image includes a security identifier. If the first electronic device determines that the first control in the first image includes a security identifier, the first electronic device uses a second preset layer to cover the first control and generates a fourth image, thereby ensuring that the layer including the security identifier is not displayed in the generated fourth image, thus protecting the user's privacy.
[0023] In conjunction with the second aspect and the aforementioned possible implementations, in another possible implementation, when the first operation is a screenshot or screen recording operation, the method further includes: the first electronic device displaying the fourth image. Based on this solution, when the user input operation is a screenshot or screen recording operation, the first electronic device overwrites the first control in the fourth image to generate the fourth image, and displays the processed fourth image on the display screen. It is understood that the fourth image displayed by the first electronic device does not show control information, thus protecting user privacy.
[0024] In conjunction with the second aspect and the aforementioned possible implementations, in another possible implementation, when the first operation is a screen projection or screen sharing operation, the method further includes: the first electronic device sending the fourth image to the second electronic device. Based on this solution, when the user input operation is a screen projection or screen sharing operation, the first electronic device overlays the first control in the first image to generate a fourth image and sends the fourth image to the second electronic device. Upon receiving the fourth image, the second electronic device can display it. Therefore, in screen projection or screen sharing scenarios, the fourth image displayed by the second electronic device is different from the first image displayed by the first electronic device, thus ensuring that security information is not leaked.
[0025] In conjunction with the second aspect and the aforementioned possible implementations, in another possible implementation, the method further includes: the first electronic device receiving a second operation from a user, the second operation being used to activate a security switch control; in response to the user's second operation, the electronic device filtering the third layer in the fourth image to generate a fifth image; the third layer including pop-up notification information. Based on this solution, by activating the security switch control, the pop-up notification information of the first electronic device can be further filtered, therefore the generated fifth image does not include pop-up notification information, thus preventing other users from seeing user SMS notifications or application notifications, and better protecting user privacy information.
[0026] In conjunction with the second aspect and the aforementioned possible implementations, in another possible implementation, when the first operation is a screenshot or screen recording operation, the method further includes: the first electronic device displaying the fifth image. Based on this solution, when the user input operation is a screenshot or screen recording operation, the first electronic device displays the processed fifth image on the display screen. It is understood that the fifth image displayed by the first electronic device does not involve copyright or privacy information and does not include pop-up prompts, thus better protecting the user's privacy or copyright.
[0027] In conjunction with the second aspect and the aforementioned possible implementations, in another possible implementation, when the first operation is a screen casting or screen sharing operation, the method further includes: the first electronic device sending the fifth image to the second electronic device. Based on this solution, when the user input is a screen casting or screen sharing operation, the first electronic device sends the fifth image to the second electronic device, so that the second electronic device, after receiving the fifth image, can display it. Therefore, in screen casting or screen sharing scenarios, the fifth image displayed by the second electronic device is different from the first image displayed by the first electronic device, thereby ensuring that the fifth image displayed by the second electronic device does not involve copyright or privacy information and does not include pop-up prompts, thus better protecting the user's privacy or copyright.
[0028] A third aspect of this application provides a secure display method, comprising: a first electronic device displaying a first image; the first electronic device receiving a first operation from a user, the first operation being used to acquire the first image displayed by the first electronic device; if the first electronic device determines that a security switch control is not turned on, in response to the first operation, if the first electronic device determines that a first layer in the first image includes a security identifier, the first electronic device replaces or covers the first layer with a first preset layer to generate a second image; if the first electronic device determines that the security switch control is turned on, in response to the first operation, if the first electronic device determines that a first layer in the first image includes a security identifier, the first electronic device replaces or covers the first layer with a first preset layer and filters a third layer to generate a third image; the third layer includes a pop-up prompt message. Based on this solution, after receiving the user's first operation, the first electronic device further determines whether the security switch control is turned on. If it determines that the security switch control is not turned on, and if the first electronic device determines that a layer in the first image includes a security identifier, by replacing or covering the layer including the security identifier with a first preset layer, the layer including the security identifier is not displayed in the generated second image, thus protecting the user's privacy or copyright. Furthermore, this solution generates a second image that does not display user privacy or copyright information without requiring user editing, thus improving the user experience. When the security switch control is confirmed to be enabled, if the first electronic device determines that a layer in the first image includes a security identifier, it replaces or overwrites the layer containing the security identifier with a first preset layer and filters the third layer. This ensures that the generated third image neither displays the layer containing the security identifier nor any pop-up notifications, thereby further protecting user privacy and enhancing the user experience.
[0029] In conjunction with the third aspect, in one possible implementation, the aforementioned first operation includes a screenshot operation, a screen recording operation, a screen casting operation, or a screen sharing operation. Based on this solution, when the first electronic device receives a user's screenshot operation, screen recording operation, screen casting operation, or screen sharing operation, the first electronic device further determines whether the security switch control is enabled. If the security switch control is determined to be disabled, and if the first electronic device determines that a layer in the first image includes a security identifier, the first electronic device replaces or overwrites the first layer with a first preset layer and generates a second image, thereby ensuring that the generated second image does not display the layer containing the security identifier, thus protecting the user's privacy or copyright. If the security switch control is determined to be enabled, and if the first electronic device determines that a layer in the first image includes a security identifier, by replacing or overwriting the layer containing the security identifier with a first preset layer and filtering the third layer, the generated third image neither displays the layer containing the security identifier nor any pop-up notification information, thus further protecting the user's privacy and improving the user experience.
[0030] A fourth aspect of this application provides a secure display method, comprising: a first electronic device displaying a first image; the first electronic device receiving a first operation from a user, the first operation being used to acquire the first image displayed by the first electronic device; if the first electronic device determines that a security switch control is not turned on, in response to the first operation, if the first electronic device determines that a first control in the first image includes a security icon, the first electronic device covers the first control with a second preset layer to generate a fourth image; if the first electronic device determines that the security switch control is turned on, in response to the first operation, if the first electronic device determines that a first control in the first image includes a security icon, the first electronic device replaces or covers the first layer with a second preset layer and filters a third layer to generate a fifth image; the third layer includes pop-up prompt information. Based on this solution, after receiving the user's first operation, the first electronic device further determines whether the security switch control is turned on. If it determines that the security switch control is not turned on, and if the first electronic device determines that a control in the first image includes a security icon, by covering the control including the security icon with a second preset layer, the control including the security icon is not displayed in the generated fourth image, thus protecting the user's privacy. Furthermore, this solution generates a fourth image that does not display user privacy or copyright information without requiring user editing, thus improving the user experience. If the first electronic device determines that the control in the first image includes a security symbol when the security switch control is enabled, it covers the control containing the security symbol with a second preset layer and filters the third layer. This ensures that the generated fifth image neither displays the control containing the security symbol nor any pop-up notifications, further protecting user privacy and enhancing the user experience.
[0031] In conjunction with the fourth aspect, in one possible implementation, the aforementioned first operation includes a screenshot operation, a screen recording operation, a screen casting operation, or a screen sharing operation. Based on this solution, when the first electronic device receives a user's screenshot operation, screen recording operation, screen casting operation, or screen sharing operation, the first electronic device further determines whether the security switch control is enabled. If the security switch control is not enabled, and the first electronic device determines that the control in the first image includes a security symbol, it covers the control including the security symbol with a second preset layer, thereby preventing the control including the security symbol from being displayed in the generated fourth image, thus protecting the user's privacy. Moreover, this solution does not require user editing to generate a fourth image that does not display user privacy or copyright information, thus improving the user experience. If the security switch control is enabled, and the first electronic device determines that the control in the first image includes a security symbol, it covers the control including the security symbol with a second preset layer and filters the third layer, thereby preventing the control including the security symbol from being displayed in the generated fifth image, and also preventing the display of pop-up prompts, thus further protecting the user's privacy information and improving the user experience.
[0032] A fifth aspect of this application provides an electronic device, the electronic device including a memory for storing a computer program; a transceiver for receiving or transmitting radio signals; and a processor for executing the computer program, causing the electronic device to implement the secure display method as described in any of the preceding aspects.
[0033] A sixth aspect of the embodiments of this application provides a computer-readable storage medium storing computer program code that, when executed by a processor, implements the secure display method as described in any of the preceding aspects.
[0034] A seventh aspect of this application provides a chip system including a processor and a memory, wherein computer program code is stored in the memory; when the computer program code is executed by the processor, it implements the secure display method as described in any of the preceding aspects. The chip system may be composed of chips or may include chips and other discrete devices.
[0035] An eighth aspect of this application provides a computer program product that, when run on a computer, enables the implementation of the secure display method as described in any of the preceding aspects. Attached Figure Description
[0036] Figure 1 A schematic diagram of a display method provided in an embodiment of this application;
[0037] Figure 2 A schematic diagram illustrating another display method provided in an embodiment of this application;
[0038] Figure 3 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application;
[0039] Figure 3a A schematic diagram of the software framework of an electronic device provided in an embodiment of this application;
[0040] Figure 4 A flowchart illustrating a secure display method provided in an embodiment of this application;
[0041] Figure 5 An application illustration of a security display method provided in this application embodiment. Figure 1 ;
[0042] Figure 6 A flowchart illustrating another secure display method provided in an embodiment of this application;
[0043] Figure 7 An application illustration of a security display method provided in this application embodiment. Figure 2 ;
[0044] Figure 8 An application illustration of a security display method provided in this application embodiment. Figure 3 ;
[0045] Figure 9 A flowchart illustrating another secure display method provided in an embodiment of this application;
[0046] Figure 10 An application illustration of a security display method provided in this application embodiment. Figure 4 ;
[0047] Figure 11 A flowchart illustrating another secure display method provided in an embodiment of this application;
[0048] Figure 12 An application illustration of a security display method provided in this application embodiment. Figure 5 ;
[0049] Figure 13 An application illustration of a security display method provided in this application embodiment. Figure 6 ;
[0050] Figure 14 A flowchart illustrating another secure display method provided in an embodiment of this application;
[0051] Figure 15 A flowchart illustrating another secure display method provided in an embodiment of this application;
[0052] Figure 16 An application illustration of a security display method provided in this application embodiment. Figure 7 ;
[0053] Figure 17 An application illustration of a security display method provided in this application embodiment. Figure 8 ;
[0054] Figure 18 An application illustration of a security display method provided in this application embodiment. Figure 9 ;
[0055] Figure 19 A flowchart illustrating another secure display method provided in an embodiment of this application;
[0056] Figure 20 An application illustration of a security display method provided in this application embodiment. Figure 10 ;
[0057] Figure 21 A flowchart illustrating another secure display method provided in an embodiment of this application;
[0058] Figure 22 A structural block diagram of an electronic device provided in an embodiment of this application;
[0059] Figure 23 A structural block diagram of another electronic device provided in an embodiment of this application;
[0060] Figure 24 This is a schematic structural diagram of an electronic device provided in an embodiment of this application. Detailed Implementation
[0061] The technical solutions in the embodiments of this application will be described below with reference to the accompanying drawings. In this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, or B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple. Furthermore, to facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with essentially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order. For example, the "first" in the first preset layer and the "second" in the second preset layer in the embodiments of this application are only used to distinguish different preset layers. The descriptions of "first" and "second" appearing in the embodiments of this application are only for illustration and to distinguish the described objects, and have no order, nor do they indicate a special limitation on the number of devices in the embodiments of this application, and cannot constitute any limitation on the embodiments of this application.
[0062] It should be noted that, in this application, the terms "exemplary" or "for example" are used to indicate that something is being described as an example, illustration, or illustration. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0063] First, a brief introduction to the terms used in this application.
[0064] A screenshot (also known as a screen capture or screenshot image) is an image captured by an electronic device and displayed on its screen or other display device. There are usually several ways to take a screenshot. For example, a user can simultaneously press and hold the volume down button ("-") and the lock screen button to take a screenshot of the phone's display. Another example is using the system's screenshot control. Yet another example is using screenshot software to take a screenshot of a computer's display.
[0065] Screen recording, or recording the screen, is the recording of the interface displayed on an electronic device. It is usually done using screen recording software. For example, screen recording software can be used to record the operation of a specific application on an electronic device.
[0066] Screen mirroring is the process of projecting an application running on a first electronic device onto a second electronic device, allowing the application to be displayed and run on the second device. When using screen mirroring, a communication connection is established between the first and second electronic devices. This connection can be wired (e.g., a data cable connection) or wireless (e.g., Bluetooth or Wi-Fi). For example, if a mobile phone and a laptop are connected to the same Wi-Fi network, and the mobile phone is running the Tencent Video app, in a screen mirroring scenario, the mobile phone can send a message to the laptop via Wi-Fi, allowing the video to be played on the laptop. Typically, the content mirrored is streaming audio or video resources.
[0067] Optionally, in screen mirroring scenarios, since the application interface is being projected, the interface displayed on the second electronic device may differ from that displayed on the first electronic device. For example, after casting a video playing on a mobile phone to a TV, the user can browse photo albums or other applications, while the TV continues to play the cast video. Therefore, the interface displayed on the mobile phone is inconsistent with the interface displayed on the laptop.
[0068] Screen sharing is the process of synchronously displaying the interface of a first electronic device on a second electronic device. When using screen sharing, a communication connection is established between the first and second electronic devices. For example, the first and second electronic devices may be connected to the same Wi-Fi network. Generally, there are no restrictions on the content that can be shared; web pages, games, office documents, videos, and other content can be shared to other devices. Optionally, in a screen sharing scenario, only the interface displayed on the first electronic device is shared. Therefore, when a user triggers an operation on the first electronic device, the interface responding to that operation will be synchronously displayed on the second electronic device; that is, the interface displayed on the second electronic device is identical to the interface displayed on the first electronic device.
[0069] Electronic devices often incorporate numerous design features and capabilities to facilitate user communication, such as screenshots, screen recording, screen sharing, and screen casting. When using electronic devices, users can share the device's or application's display interface with other users through these methods. However, sharing the interface may include sensitive information such as friends' or contacts' avatars, names, and user account passwords. Directly sharing this information could lead to privacy breaches, potentially exposing the user's own or others' privacy, posing ethical or legal risks. Typically, to avoid leaking their own or others' privacy, users can use editing tools to blur or pixelate sensitive information before sending. However, this method is cumbersome and provides a poor user experience.
[0070] To address the aforementioned issues, one display method involves third-party applications configuring a security flag (LayoutParams.FLAG_SECURE) on the interface. When the operating system performs image display composition, if it recognizes this security flag, it will filter out this interface.
[0071] like Figure 1 As shown in (a), the mobile phone runs a first application whose display interface includes a "person" that involves copyright. The first application pre-configures a security identifier on this display interface. In a screenshot scenario, the mobile phone receives the user's screenshot operation and, in response, after recognizing that the first application's display interface includes the security identifier, filters the first application's display interface, as follows: Figure 1 As shown in (b), in a screenshot scenario, the screenshot image has no content. In a screen mirroring or screen sharing scenario, the phone receives the user's screen mirroring or screen sharing operation and, in response to the operation, after recognizing that the display interface of the first application includes a security icon, the phone filters the display interface of the first application and sends the filtered image to the laptop, such as... Figure 1 As shown in (c), the laptop screen is empty during screen mirroring or screen sharing.
[0072] The above display method will cause users to not understand how the layers are isolated, which may lead to product complaints.
[0073] Another method involves the electronic device blocking screenshots and screen recordings upon recognizing the aforementioned security identifier. For example, after recognizing the security identifier, the electronic device displays a prompt message and simultaneously stops screenshotting or screen recording.
[0074] like Figure 2As shown in (a), the phone runs a first application whose display interface is "People." These "People" involve copyright issues, and the first application has a security flag pre-configured on this display interface. In a screen recording scenario, when the control policy is in effect, calls to the screen recording function from the user interface or background programs will be blocked by the system, such as... Figure 2 As shown in (b), in the screen recording scenario, the phone blocks the screen recording operation and displays the message "Security policy prohibits screen recording" on the display interface of the first application.
[0075] While users understand the rationale behind this solution, its granular control is too strict. During the policy's effective period, screen recording or screenshotting is prohibited on any interface. However, the secure interface may only be part of the user's screen recording process. Completely blocking screen recording will result in a poor user experience. Furthermore, this method makes it impossible for users to accurately know which interfaces can be recorded and which cannot.
[0076] In order to improve user experience while protecting user privacy or copyright, this application provides a secure display method. This method can prompt users that the current page involves security issues while protecting user privacy information or copyright, thereby improving user experience.
[0077] In this embodiment, both the first electronic device and the second electronic device include a display screen. The first electronic device and the second electronic device may include, but are not limited to, mobile phones, tablets, desktop computers, laptops, handheld computers, notebook computers, personal computers (PCs), ultra-mobile personal computers (UMPCs), netbooks, as well as cellular phones, smartwatches, smart bracelets, phone watches, smart cameras, personal digital assistants (PDAs), augmented reality (AR) / virtual reality (VR) devices, televisions, projection devices, or motion-sensing game consoles in human-computer interaction scenarios, etc., all of which include a display screen. This embodiment does not impose any special limitations on the specific form of the electronic device.
[0078] Please refer to Figure 3 This is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of this application. Figure 3As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0079] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0080] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0081] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0082] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0083] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0084] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0085] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.
[0086] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0087] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.
[0088] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.
[0089] The GPIO interface can be configured via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0090] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0091] It is understood that the interface connection relationships between the modules illustrated in this embodiment are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0092] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.
[0093] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.
[0094] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0095] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0096] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0097] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.
[0098] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0099] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0100] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0101] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0102] In this embodiment of the application, the display screen 194 can be used to display the interface of an electronic device. For example... Figure 1 and Figure 2 As shown, the display screen 194 can be used to display the interface of an electronic device's application.
[0103] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0104] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0105] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0106] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0107] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0108] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0109] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.
[0110] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0111] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0112] Audio module 170 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. Audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, audio module 170 may be located in processor 110, or some functional modules of audio module 170 may be located in processor 110. Speaker 170A, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. Electronic device 100 can listen to music or hands-free calls through speaker 170A. Receiver 170B, also called a "handpiece," is used to convert audio electrical signals into sound signals. When electronic device 100 answers a phone call or voice message, it can listen to the voice by bringing receiver 170B close to the user's ear. Microphone 170C, also called a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting sound signals into microphone 170C.
[0113] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.
[0114] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.
[0115] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.
[0116] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.
[0117] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.
[0118] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.
[0119] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.
[0120] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 may use the proximity sensor 180G to detect when a user holds the electronic device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.
[0121] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
[0122] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.
[0123] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs thermal protection by reducing the performance of a processor located near temperature sensor 180J to reduce power consumption. In other embodiments, when the temperature is below another threshold, electronic device 100 heats battery 142 to prevent abnormal shutdown of electronic device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, electronic device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.
[0124] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.
[0125] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.
[0126] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.
[0127] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.
[0128] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.
[0129] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0130] It should be noted that, Figure 3 The hardware modules included in the illustrated electronic device are merely illustrative and do not limit the specific structure of the first and second electronic devices in the following embodiments. The first or second electronic device described below may include, but are not limited to, the hardware modules described above. Figure 3 The electronic device shown has more or fewer components.
[0131] The first electronic device and the second electronic device in the following embodiments can both be implemented in the electronic device 100 having the above-described hardware structure.
[0132] For example, in this application, the operating system of the electronic device (including the first electronic device and the second electronic device) may include, but is not limited to, (Symbian) (Android) (iOS) This application does not limit the scope to operating systems such as Blackberry and Harmony.
[0133] Please refer to Figure 3a , Figure 3a Taking the Android system, which includes a layered architecture, as an example, a schematic diagram of a display process provided by an embodiment of this application is shown. Figure 3a As shown, the layered architecture of the Android system can include an application layer, a system framework layer, a hardware driver layer, and a hardware layer.
[0134] The application layer may include a series of application packages, such as camera, gallery, calendar, call, map, navigation, Bluetooth, music, video, and SMS applications. For ease of description, applications will be referred to as "applications" below. Applications on the first device can be native applications (such as those installed on the electronic device before it leaves the factory when the operating system is installed) or third-party applications (such as those downloaded and installed by the user through an app store). This embodiment of the application does not limit the scope of the application.
[0135] The system framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. For example... Figure 3a As shown, the system framework layer may include an input subsystem, a graphics subsystem, an activity manager service (AMS), and a package manager service (PMS). In some embodiments, the framework layer may also include a screen mirroring management module, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc. Figure 3a (Not shown in the image).
[0136] The Activity Manager (AMS) is responsible for managing Activities, including starting, switching, and scheduling components within the system, as well as managing and scheduling applications. The Package Manager (PMS) manages all package information, including installation, uninstallation, updates, and parsing AndroidManifest.xml to organize the corresponding data structures. In this application, the first image can be input into the input subsystem. The graphics subsystem is used to composite and arrange multiple layers in a specific order.
[0137] The hardware driver layer includes the touchpad (TP) driver, the input hub driver, and other driver modules.
[0138] The hardware layer includes hardware devices such as the screen (TP), USB / Type-C, Bluetooth, Wi-Fi, and sensors.
[0139] like Figure 3a As shown in this application, hardware devices such as Bluetooth or Wi-Fi at the hardware layer receive input events and report them to the hardware driver layer. The hardware driver layer encodes the input events and reports them to the system framework layer, which then reports them to the application layer. The application layer transmits user-triggered screenshot events to the PMS and AMS, and after security processing by the graphics subsystem in the system framework layer, the processed image is finally displayed on the hardware layer.
[0140] It should be noted that, Figure 3a This paper uses the layered architecture of the Android system as an example to introduce the display process of a secure display method. This application does not limit the specific architecture of the software systems of the first and second electronic devices; for details on other software systems, please refer to conventional techniques.
[0141] The following embodiments use a mobile phone as the first electronic device and a laptop computer as the second electronic device to introduce the secure display method provided in the embodiments of this application.
[0142] Combination Figures 2 to 3a ,like Figure 4 As shown, this application provides a secure display method, which includes steps S401-S403.
[0143] S401, The first electronic device displays the first image.
[0144] The first image can be the entire image displayed on the screen of the first electronic device, or it can be a partial image displayed on the screen of the first electronic device. For example, the first image can be the display interface of the first electronic device. As another example, when the first electronic device is running a first application, the first image can also be the display interface of the first application. Optionally, when the screen of the first electronic device displays the interface of the first application in full screen, the display interface of the first electronic device is the same as the display interface of the first application.
[0145] Optionally, the first image may include multiple layers, and the first image is a composite of the multiple layers.
[0146] S402, The first electronic device receives the user's first operation.
[0147] The first operation is used to acquire the first image.
[0148] Optionally, the first operation may include a screenshot operation, a screen recording operation, a screen sharing operation, or a screen projection operation. It should be noted that, in this embodiment, the first operation may also be other operations for acquiring a first image displayed on an electronic device; this embodiment does not limit the specific form of the first operation.
[0149] For example, when the first operation is a screenshot operation, the screenshot operation is used to capture the interface displayed by the first electronic device. For instance, such as... Figure 5As shown in (a), when a user simultaneously presses the lock screen button and the volume down button ("-") to trigger a screenshot operation, the electronic device receives the user's screenshot operation. Optionally, the screenshot operation triggered by the user can also be triggered through the screenshot control in the drop-down menu, or through a specific gesture. This application embodiment does not limit the specific triggering method of the screenshot operation, and it is only an exemplary description here.
[0150] For example, when the first operation is a screen recording operation, this screen recording operation can be used to acquire multiple frames of the first image, which are the interface displayed by the first electronic device at different times. For example, such as Figure 5 As shown in (b) above, when the user clicks the "Screen Recording" control, the electronic device receives the user's click. Optionally, the user can also trigger the screen recording operation through screen recording software. This application embodiment does not limit the specific triggering method of the screen recording operation; it is only an illustrative example.
[0151] For example, when the first operation is a screen sharing operation, the screen sharing operation is used to acquire the interface displayed by the first electronic device. For instance, such as... Figure 5 As shown in (c), when the user clicks the "Wireless Screen Sharing" control, the electronic device receives the user's screen sharing operation. This application embodiment does not limit the specific triggering method for the screen sharing operation; it is merely an illustrative example.
[0152] For example, when the first operation is a screen mirroring operation, the user can trigger the screen mirroring operation by clicking the screen mirroring control in the first application running on the first electronic device. For example, as Figure 5 As shown in (d), the first electronic device runs a first application to watch a video. After the user clicks the screen casting control in the first application, they can select a screen casting device, and the electronic device receives the user's screen casting operation. This application embodiment does not limit the specific triggering method of the screen casting operation; it is merely an illustrative example.
[0153] It should be noted that this application does not strictly distinguish between screen casting and screen sharing scenarios. Any scenario in which the interface displayed on the first electronic device is projected onto the second electronic device can be called a screen casting scenario or a screen sharing scenario. Any user-triggered operation to project the interface displayed on the first electronic device onto the second electronic device can be called a screen sharing operation or a screen casting operation. For example, such as... Figure 5 As shown in (c), the user's action of clicking the "Wireless Screen Casting" control can also be called a screen casting operation. For example, as... Figure 5 As shown in (d) in the diagram, after clicking the screen casting control in the first application, the user can select a screen casting device. This series of operations can also be called screen sharing operations.
[0154] Optionally, the first operation described above, which acquires the first image, can be achieved through one trigger action or through multiple trigger actions.
[0155] S403. In response to the user's first operation, if the first electronic device determines that the first layer in the first image includes a security symbol, the first electronic device replaces or covers the first layer with a first preset layer and generates a second image.
[0156] For example, in response to a user's screenshot, screen recording, screen sharing, or screen casting operation, the first electronic device determines whether the multiple layers included in the first image include a security identifier.
[0157] Optionally, the security identifier can be a pre-configured identifier for the application or system. For example, the application or system can pre-configure security identifiers for layers related to security, such as copyright and user privacy. Optionally, the security identifier can be LayoutParams.FLAG_SECURE.
[0158] In one implementation, if the first electronic device determines that the first layer in the first image includes a security identifier, the first layer can be replaced with a first preset layer, and a second image can be generated.
[0159] For example, the first electronic device can replace the first layer with a first preset layer and composite the second layer (excluding the security symbol) from the first image with the first preset layer to generate a second image. In other words, when generating the second image, the first electronic device replaces the first layer in the first image with the first preset layer, and then composites the second layer (excluding the security symbol) from the first image with the first preset layer to obtain the second image. Therefore, the generated second image no longer includes the first layer, thus protecting copyright if the first layer involves copyright issues, and protecting user privacy if the first layer includes user privacy information.
[0160] In this implementation, by replacing the first layer with a first preset layer, the generated second image no longer includes the first layer, thus ensuring that the generated second image does not contain user privacy or copyright information. This solution protects copyright or user privacy information without requiring manual editing by the user, improving the user experience.
[0161] In another implementation, if the first electronic device determines that the first layer in the first image includes a security identifier, it can use a first preset layer to cover the first layer and generate a second image.
[0162] For example, when the first electronic device uses a first preset layer to cover the first layer, it can composite multiple layers of the first image with the first preset layer. Moreover, during the composite, the first preset layer is located above the first layer, so that the first layer can be covered by the first preset layer.
[0163] In this implementation, although the second image still includes the first layer, it is covered by a first preset layer. Therefore, the generated second image does not display the first layer, making it invisible to the user. This ensures that the generated second image does not display user privacy or copyright information. This solution protects copyright or user privacy without requiring manual editing by the user, thus improving the user experience.
[0164] Optionally, the aforementioned first preset layer may include a prompt message to inform the user that the first image includes security information. This security information is security-related and may involve user privacy or copyright, etc. This prompt message helps the user understand why the second image differs from the first image, improving the user experience.
[0165] For example, the prompt information in the first preset layer can be text information such as "Safe interface prohibits screenshots" or "Safe interface prohibits screen recording", or it can be an animated or icon prompt information. This application does not limit the specific content and type of the prompt information.
[0166] Optionally, the size of the first preset layer can be the same as the size of the first layer.
[0167] Understandably, the display method provided in this application, when acquiring an image displayed by a first electronic device, identifies whether the first image includes a security identifier. If it is determined that the first layer in the first image includes a security identifier, a first preset layer is used to replace or cover the first layer, and a second image is generated. Therefore, the first layer is not displayed in the generated second image, thereby ensuring that the generated second image protects the user's privacy information and copyright. This solution protects copyright or user privacy information without requiring manual editing by the user, and by prompting the user that the current page involves security, the user can understand the action, thus improving the user experience.
[0168] Optional, such as Figure 6 As shown, when the first operation is a screenshot operation or a screen recording operation, the above display method may include step S404 in addition to the steps S401-S403 described above.
[0169] S404, The first electronic device displays the second image.
[0170] For example, a first electronic device replaces or overwrites a first layer in a first image to generate a second image, and displays the processed second image on a display screen. It is understood that the second image displayed by the first electronic device does not involve copyright or privacy information.
[0171] For example, in a screenshot scenario, the first image displayed on the phone is like... Figure 7 As shown in (a) in the example, Figure 7 The first image shown in (a) is composed of multiple layers. The layer containing the "person" involves copyright, and a third-party application pre-configures a security identifier for this layer. When a user triggers a screenshot operation, the phone receives the screenshot operation. In response to this operation, the phone recognizes that the layer containing the "person" in the first image includes a security identifier. It can then replace the first layer with a first preset layer, and then combine the second layer in the first image (which does not include a security identifier) with the first preset layer to generate the image shown in (a). Figure 7 The second image shown in (b) does not display "people". The phone can display this second image after it is generated.
[0172] For example, in a screenshot scenario, the first image displayed on the phone is like... Figure 7 As shown in (c) in the example, Figure 7 The first image shown in (c) is composed of multiple layers. The account password involves user privacy information, and the third-party application pre-configures a security identifier for the layer containing the account password. When the user triggers a screenshot operation, the phone receives the screenshot operation. In response to the screenshot operation, after recognizing that the layer containing the user's account password in the first image includes the security identifier, the phone can overlay the first layer with a first preset layer to generate an image as shown in (c). Figure 7 The second image is shown in (d) above. Understandably, after overlaying the first layer with the first preset layer, the generated second image does not display the user account password information. The phone can display this second image after it is generated.
[0173] It should be noted that, in the screenshot scenario, when the first image displayed by the first electronic device involves security information such as copyright or privacy, the display method of this application embodiment will not prevent the user from taking a screenshot. Instead, the security information involving copyright or privacy will not be displayed in the screenshot image (second image), and the user will be prompted that the current interface is a safe interface, thereby enabling the user to understand the behavior and improving the user experience.
[0174] For example, in screen recording scenarios, using the phone's display interface as... Figure 8Taking (a) as an example, when a user triggers a screen recording operation, the phone receives the user's screen recording operation. In response to this operation, if the phone recognizes that the layer containing the "person" in the first image includes a security icon, then the phone can replace the first layer with a first preset layer, and then combine the second layer (which does not include the security icon) in the first image with the first preset layer to generate a second image. Figure 8 As shown in (b), the first electronic device displays the second image when recording the screen, and the second image does not display "people".
[0175] For example, in screen recording scenarios, using the phone's display interface as... Figure 8 Taking (c) as an example, when a user triggers a screen recording operation, the mobile phone receives the user's screen recording operation. In response to this operation, if the mobile phone recognizes that the layer containing the user's account password in the first image includes a security icon, it can use a first preset layer to overlay the first layer, thus obtaining a second image. Figure 8 As shown in (d) above, the phone displays a second image during screen recording. Understandably, after overlaying the first layer with the first preset layer, the generated second image does not display the user account password information.
[0176] It should be noted that, in the screen recording scenario, when the first image displayed by the first electronic device involves security information such as copyright or privacy, the recording process will not be interrupted. The security information involving copyright or privacy will not be displayed on the first electronic device, and the user will be prompted that the current interface is a safe interface, thereby enabling the user to understand the behavior and improving the user experience.
[0177] The display method provided in this application embodiment, in response to a user-triggered screenshot or screen recording operation, involves a first electronic device acquiring a first image and identifying whether the first image includes a security identifier. If it is determined that the first layer in the first image includes a security identifier, a second image is generated by replacing or overwriting the first layer with a first preset layer, and the first electronic device displays the second image. Therefore, the first layer is not displayed in the generated second image, thereby ensuring that the generated second image does not leak user privacy information or infringe copyright. This solution protects copyright or user privacy information without requiring manual editing by the user, and by prompting the user that the current interface is a secure interface, it helps the user understand the action, thus improving the user experience.
[0178] Optional, such as Figure 9 As shown, when the first operation is a screen projection operation or a screen sharing operation, the above display method may include steps S405-S407 in addition to the steps S401-S403 described above.
[0179] S405, The first electronic device sends a second image to the second electronic device.
[0180] The second electronic device can be the same type of device as the first electronic device, or it can be a different type of device than the first electronic device.
[0181] For example, in response to a user's screen mirroring or screen sharing operation, the first electronic device replaces or overwrites the first layer in the first image to generate a second image, and then sends the second image to the second electronic device. It is understood that the second image sent by the first electronic device to the second electronic device does not involve copyright or privacy information.
[0182] S406, The second electronic device receives the second image.
[0183] S407, The second electronic device displays the second image.
[0184] For example, since the second image is generated after the first image has been replaced or overwritten, the content displayed by the second image is different from that of the first image. Therefore, the second image displayed by the second electronic device is different from the first image displayed by the first electronic device.
[0185] For example, in screen mirroring or screen sharing scenarios, the phone's display interface, such as... Figure 10 Taking (a) as an example, when a user triggers a screen mirroring or screen sharing operation, the mobile phone receives the screen mirroring or screen sharing operation and, in response to the operation, acquires the first image it displays. Since the "person" involves copyright, after the mobile phone recognizes that the layer containing the "person" in the first image includes a security identifier, it can replace the first layer with a first preset layer, and then combine the second layer (which does not include the security identifier) in the first image with the first preset layer to obtain the second image. The mobile phone sends the second image to the laptop computer, and the laptop computer receives the second image and displays it on its screen, as shown below. Figure 10 As shown in (b), the second image displayed by the laptop does not include "people".
[0186] For example, in screen mirroring or screen sharing scenarios, the phone's display interface, such as... Figure 10 Taking (c) as an example, when a user triggers a screen mirroring or screen sharing operation, the mobile phone receives the screen mirroring or screen sharing operation and, in response to the operation, acquires a first image. Since this first image includes the user's account password information, which involves user privacy, the mobile phone, after recognizing that the layer containing the user's account password in the first image includes a security identifier, can overlay the first layer with a first preset layer to obtain a second image. The mobile phone sends the second image to the laptop computer, and the laptop computer receives the second image and displays it on its screen, as shown below. Figure 10 As shown in (d) above, the second image displayed by the laptop does not include the user's private information. (Combined with...) Figure 10 (c) and Figure 10 As shown in (d), when the user enters their account and password, the user's account and password information is not displayed on the mobile phone screen projected from the laptop.
[0187] It is understood that, in this embodiment of the application, the first layer involving security information in the first image is replaced or covered, so that the first layer is not displayed in the generated second image. Therefore, in the scenario of screen projection or screen sharing, the second image displayed by the second electronic device is different from the first image displayed by the first electronic device, thereby ensuring that security information is not leaked.
[0188] The display method provided in this application embodiment, in response to a user-triggered screen projection or screen sharing operation, involves a first electronic device acquiring a first image and identifying whether the first image includes a security identifier. If it is determined that the first layer in the first image includes a security identifier, a second image is generated by replacing or overwriting the first layer with a first preset layer. The first electronic device sends the second image to a second electronic device, which receives and displays the second image. Therefore, the second image displayed by the second electronic device differs from the first image displayed by the first electronic device; the first layer is not displayed in the second image, thus ensuring that the generated second image does not leak user privacy information or infringe copyright. This solution, while protecting copyright or user privacy information, does not prevent operations such as screenshots and screen recordings. Furthermore, by prompting the user that the current interface is a secure interface, it helps the user understand the behavior, thereby improving the user experience.
[0189] This application also provides a secure display method, such as... Figure 11 As shown, in addition to the steps S401-S403 described above, the method may also include steps S408-S409.
[0190] S408, The first electronic device receives the user's second operation.
[0191] This second operation is used to activate the safety switch control.
[0192] Optionally, the safety switch control can be displayed on the screen of the first electronic device as a floating switch, or it can be a control in the settings page of the first electronic device, or it can be a control in the drop-down menu of the first electronic device.
[0193] For example, such as Figure 12 As shown in (a), when a user clicks the safety switch control, the mobile phone receives the user's click operation to turn on the safety switch. This embodiment of the application does not limit the specific action the user takes to turn on the safety switch control. Figure 12 (a) in the example is merely illustrative.
[0194] Optionally, the embodiments of this application do not limit the order in which the first electronic device receives the first operation and the second operation.
[0195] S409. In response to a second user operation, the first electronic device filters the third layer in the second image and generates a third image.
[0196] This third layer includes pop-up notifications. These pop-up notifications can be SMS messages, application notifications, or other notifications displayed in a pop-up format.
[0197] For example, when the user activates the safety switch control, the display interface of the first electronic device, as shown... Figure 12 As shown in (b) in the example, the first image displayed by the first electronic device includes a text message notification. This notification includes the user's salary information, which involves user privacy; the user does not want others to see their salary information. Figure 12 As shown in (c), in response to the user's screenshot operation, the mobile phone uses a first preset layer to replace or cover the first layer involving security in the first image, resulting in... Figure 12 The second image shown in (c) is as follows. Figure 12 As shown in (d) above, in response to the user's action of turning on the security switch, the phone filters the layer containing the SMS notification information in the second image to obtain... Figure 12 The third image shown in (d) does not include the SMS notification message containing the user's salary information.
[0198] For example, when the user activates the safety switch control, the display interface of the first electronic device, as shown... Figure 13 As shown in (a) in the example, the first image displayed by the first electronic device includes a text message notification. Figure 13 As shown in (b), in response to the user's screen recording operation, the mobile phone uses a first preset layer to replace or cover the first layer involving security in the first image, resulting in... Figure 13 The second image shown in (b) of the diagram. Figure 13 As shown in (c), in response to the user's action of turning on the security switch, the phone filters the layer containing the SMS notification information in the second image to obtain... Figure 13 The third image shown in (c) is shown in the image.
[0199] The display method provided in this embodiment, by enabling the security switch control, can further filter the pop-up notification information of the first electronic device, thereby preventing other users from seeing the user's SMS notification messages or application notification messages, and thus better protecting the user's privacy information.
[0200] Optionally, in the scenario where the first operation is a screenshot or screen recording, the steps S408-S409 above may further include the first electronic device displaying a third image. In the scenario where the first operation is a screen projection or screen sharing, the steps S408-S409 above may further include the first electronic device sending the third image to a second electronic device, the second electronic device receiving the third image, and the second electronic device displaying the third image.
[0201] This application also provides a secure display method, such as... Figure 14 As shown, the method includes steps S1401-S1405.
[0202] S1401, The first electronic device displays the first image.
[0203] S1402, The first electronic device receives the user's first operation.
[0204] The first operation can be a screenshot, screen recording, screen casting, or screen sharing operation.
[0205] S1403, The first electronic device determines whether the safety switch control is turned on.
[0206] Optionally, if the first electronic device receives a second operation from the user before step S1403, the first electronic device determines that the safety switch control is turned on. This second operation is used to turn on the safety switch control.
[0207] Optionally, if the first electronic device does not receive the user's second operation before step S1403, the first electronic device determines that the safety switch control is not turned on.
[0208] S1404. If the first electronic device determines that the safety switch control is not turned on, in response to the first operation, if the first electronic device determines that the first layer in the first image includes a safety symbol, the first electronic device replaces or covers the first layer with a first preset layer to generate a second image.
[0209] S1405. When the first electronic device determines that the safety switch control is turned on, in response to the first operation, if the first electronic device determines that the first layer in the first image includes a safety symbol, the first electronic device replaces or covers the first layer with a first preset layer, filters the third layer, and generates a third image.
[0210] This third layer includes pop-up notifications. These pop-up notifications can be SMS messages, application notifications, or other information displayed in a pop-up window.
[0211] It should be noted that the embodiments of this application do not limit the execution order of replacing or covering the first layer with the first preset layer and filtering the third layer in step S1405 of the above application. For example, the first electronic device can first replace or cover the first layer with the first preset layer and then filter the third layer. Alternatively, it can filter the third layer first and then replace or cover the first layer with the first preset layer. It can also simultaneously replace or cover the first layer with the first preset layer and filter the third layer. It is understood that the scheme of the first electronic device first replacing or covering the first layer with the first preset layer and then filtering the third layer is the same as the scheme of step S409 above.
[0212] Understandably, the difference between steps S1404 and S1405 lies in whether the safety switch control is enabled. When the safety switch control is enabled, the first electronic device not only needs to replace or overwrite the layer containing the safety label, but also needs to filter the pop-up notification information. When the safety switch control is disabled, the first electronic device only needs to replace or overwrite the layer containing the safety label.
[0213] It is understood that the specific implementation of the above steps S1401-S1405 can refer to the specific implementation of the foregoing embodiments.
[0214] The display method provided in this application embodiment involves a first electronic device receiving a first operation from a user and further determining whether a safety switch is on. If the first electronic device determines that the safety switch control is not on, in response to the first operation, if the first electronic device determines that the first layer in the first image includes a safety symbol, the first electronic device replaces or covers the first layer with a first preset layer to generate a second image. If the first electronic device determines that the safety switch control is on, in response to the first operation, if the first electronic device determines that the first layer in the first image includes a safety symbol, it replaces or covers the first layer with a first preset layer and filters the third layer to generate a third image. This ensures that the generated third image does not leak the user's privacy information or infringe on copyright, and this solution further protects the user's pop-up notification information from being seen by other users, improving the user experience.
[0215] Optionally, in the scenario where the first operation is a screenshot or screen recording, step S1404 may further include the first electronic device displaying a second image. In the scenario where the first operation is a screen projection or screen sharing, step S1404 may further include the first electronic device sending the second image to a second electronic device, the second electronic device receiving the second image, and the second electronic device displaying the second image.
[0216] Optionally, in the scenario where the first operation is a screenshot or screen recording, step S1405 may further include the first electronic device displaying a third image. In the scenario where the first operation is a screen projection or screen sharing, step S1405 may further include the first electronic device sending the third image to a second electronic device, the second electronic device receiving the third image, and the second electronic device displaying the third image.
[0217] This application also provides a secure display method, such as... Figure 15 As shown, the method includes steps S1501-S1503.
[0218] S1501, The first electronic device displays the first image.
[0219] S1502, The first electronic device receives the user's first operation.
[0220] The first operation is used to acquire the first image.
[0221] Optionally, the first operation may include a screenshot operation, a screen recording operation, a screen sharing operation, or a screen projection operation. It should be noted that, in this embodiment, the first operation may also be other operations for acquiring images displayed on an electronic device; this embodiment does not limit the specific form of the first operation.
[0222] S1503. In response to the user's first operation, if the first electronic device determines that the first control in the first image includes a security symbol, the first electronic device uses a second preset layer to cover the first control and generates a fourth image.
[0223] Optionally, the first electronic device covering the first control with a second preset layer may include the first electronic device adding a watermark, mosaic, or blurring to the first control.
[0224] For example, in response to a user's screenshot, screen recording, screen sharing, or screen projection operation, the first electronic device determines whether the controls included in the first image include a security identifier. Optionally, the first image may include multiple security controls, which may be controls in a single layer or controls in multiple layers.
[0225] Optionally, the security identifier can be a pre-configured security identifier for the application or system. For example, the application or system can pre-configure security identifiers for controls related to user privacy and security, such as account controls, password controls, and keyboard controls. Optionally, the security identifier can be LayoutParams.FLAG_SECURE.
[0226] Optionally, the second preset layer may include a prompt message to inform the user that the first image includes security information. This security information is security-related and may involve user privacy or copyright, etc. This application does not limit the specific content of the prompt message.
[0227] For example, the first electronic device uses a second preset layer to cover the first control and generate a fourth image, which may include: the first electronic device obtaining the position information of the first control in the first image; based on the position information, the first electronic device uses the second preset layer to cover the area where the first control is located and generates a fourth image.
[0228] Optionally, if the first electronic device determines that the first control in the first image includes a security symbol, a second preset layer can be used to cover the first control. For example, when the first electronic device generates the fourth image, the second preset layer can be located above the layer where the first control is located, so that the first control can be covered by the second preset layer.
[0229] In this implementation, because the first control is covered by the second preset layer, the generated fourth image does not display the first control; that is, the first control is invisible to the user, thus ensuring that the generated fourth image does not display user privacy information. This solution protects copyright or user privacy information without requiring manual editing by the user, improving the user experience.
[0230] Optionally, after step S1503 above, the method may further include: the first electronic device displaying a fourth image.
[0231] For example, such as Figure 16 As shown, in a screenshot scenario, the first image displayed on the phone is as follows: Figure 16 As shown in (a) in the example, the third-party application pre-configures security identifiers for the account control and password control. When the user triggers a screenshot operation, the mobile phone receives the screenshot operation and, in response to the screenshot operation, identifies the account control and password control in the first image, including the security identifiers. It then obtains the position information of the account control and password control in the first image and uses a second preset layer to cover the areas where the account control and password control are located, respectively, to generate a fourth image. This fourth image is shown below. Figure 16 As shown in (b) of the image, the account control and password control in the fourth image are both covered by the second preset layer.
[0232] For example, such as Figure 17 As shown, in a screen recording scenario, the first image displayed on the phone is as follows: Figure 17As shown in (a) above, the third-party application pre-configures security identifiers for the account control and password control. When the user triggers a screenshot, the phone recognizes the security identifiers in the account control and password control in the first image, obtains their location information in the first image, and uses a second preset layer to cover the areas where the account control and password control are located, respectively, to generate a fourth image. This fourth image is shown below. Figure 17 As shown in (b) of the image, the account control and password control in the fourth image are both covered by the second preset layer.
[0233] Optionally, after step S1503 above, the method may further include: the first electronic device sending a fourth image to the second electronic device, the second electronic device receiving the fourth image, and the second electronic device displaying the fourth image.
[0234] For example, such as Figure 18 As shown, in a screen mirroring scenario, the first image displayed on the mobile phone is as follows: Figure 18 Taking (a) as an example, the third-party application pre-configures security identifiers for the account and password controls. When the user triggers screen mirroring, the phone recognizes the security identifiers in the account and password controls in the first image, obtains their location information within the first image, and uses a second preset layer to cover the areas where the account and password controls are located, respectively, generating a fourth image. The phone sends the fourth image to the laptop, which receives and displays it. Figure 18 As shown in (b), the account control and password control in the fourth image displayed by the laptop are both covered by the second preset layer.
[0235] Understandably, in the display method provided in this application, when acquiring an image displayed by a first electronic device, if the first electronic device recognizes that a first control in the first image includes a security identifier, the first electronic device uses a second preset layer to cover the first control and generates a fourth image. Therefore, the generated fourth image does not display the information of the first control, thereby ensuring that the generated fourth image does not leak the user's privacy information. This solution can process the security control so that the information of the control cannot be seen by other users, thereby not only protecting user security, but also further improving the user experience due to the smaller area of security processing.
[0236] Optional, such as Figure 19 As shown, when the first operation is a screenshot operation or a screen recording operation, the above display method may include steps S1504-S1505 in addition to the steps S1501-S1503 mentioned above.
[0237] S1504, The first electronic device receives the user's second operation.
[0238] This second operation is used to activate the safety switch control.
[0239] S1505, In response to the user's second operation, the first electronic device filters the third layer in the fourth image and generates the fifth image.
[0240] This third layer includes pop-up notifications. These pop-up notifications can be SMS messages, application notifications, or other information displayed in a pop-up window.
[0241] For example, when the user activates the safety switch control, the display interface of the first electronic device, as shown... Figure 20 As shown in (a) for example, the first image displayed by the first electronic device includes a text message notification. This notification includes the user's salary information, which involves user privacy; the user does not wish for others to see their salary information. Figure 20 As shown in (b), in response to the user's screenshot operation, the mobile phone uses a second preset layer to cover the account and password controls involving security in the first image, resulting in... Figure 20 The fourth image is shown in (b) above. In response to the user's activation of the security switch, the phone filters the layer containing the SMS notification information in the fourth image, resulting in the image shown below. Figure 20 The fifth image shown in (c) does not include the SMS notification message containing the user's salary information.
[0242] The display method provided in this embodiment, by enabling the security switch control, can further filter the pop-up prompts of the first electronic device, thereby preventing other users from seeing the user's SMS notifications or application notifications, and better protecting the user's privacy and security information.
[0243] Optionally, in the scenario where the first operation is a screenshot or screen recording, the steps S1504-S1505 above may further include: the first electronic device displaying the fifth image. In the scenario where the first operation is a screen projection or screen sharing, the steps S1504-S1505 above may further include: the first electronic device sending the fifth image to the second electronic device, the second electronic device receiving the fifth image, and the second electronic device displaying the fifth image.
[0244] This application also provides a secure display method, such as... Figure 21 As shown, the method includes steps S2101-S2105.
[0245] S2101, The first electronic device displays the first image.
[0246] S2102, The first electronic device receives the user's first operation.
[0247] The first operation can be a screenshot, screen recording, screen casting, or screen sharing operation.
[0248] S2103, The first electronic device determines whether the safety switch control is turned on.
[0249] Optionally, if the first electronic device receives the user's second operation before step S2103, the first electronic device determines that the safety switch control is turned on. This second operation is used to turn on the safety switch control.
[0250] Optionally, if the first electronic device does not receive the user's second operation before step S2103, the first electronic device determines that the safety switch control is not turned on.
[0251] S2104. If the first electronic device determines that the safety switch control is not turned on, in response to the first operation, if the first electronic device determines that the first control in the first image includes a safety symbol, the first electronic device uses a second preset layer to cover the first control and generates a fourth image.
[0252] S2105. When the first electronic device determines that the safety switch control is turned on, in response to the first operation, if the first electronic device determines that the first control in the first image includes a safety symbol, the first electronic device uses a second preset layer to cover the first control and filters the third layer to generate a fifth image.
[0253] This third layer includes pop-up notifications. These pop-up notifications can be SMS messages, application notifications, or other information displayed in a pop-up window.
[0254] It should be noted that the embodiments of this application do not limit the execution order of the first electronic device covering the first control with the second preset layer and filtering the third layer in step S2105 above. For example, the first electronic device can first cover the first control with the second preset layer and then filter the third layer. Alternatively, it can filter the third layer first and then cover the first control with the second preset layer. It can also simultaneously cover the first control with the second preset layer and filter the third layer. It is understood that the scheme of the first electronic device first covering the first control with the second preset layer and then filtering the third layer is the same as the scheme of step S1505 above.
[0255] Understandably, the difference between steps S2104 and S2105 is that, when the safety switch control is enabled, the first electronic device not only needs to cover the control including the safety symbol, but also needs to filter the pop-up prompt information. However, when the safety switch control is disabled, the first electronic device only needs to cover the control including the safety symbol.
[0256] It is understood that the specific implementation of the above steps S2101-S2105 can refer to the specific implementation of the foregoing embodiments.
[0257] The display method provided in this application embodiment involves a first electronic device receiving a first operation from a user and further determining whether a safety switch is on. If the first electronic device determines that the safety switch control is not on, in response to the first operation, if the first electronic device determines that the first control in the first image includes a safety icon, the first electronic device uses a second preset layer to cover the first control, generating a fourth image. If the first electronic device determines that the safety switch control is on, in response to the first operation, if the first electronic device determines that the first control in the first image includes a safety icon, it uses a second preset layer to cover the first control and filters the third layer, generating a fifth image. This ensures that the generated fifth image does not leak the user's privacy information or infringe on copyright, and further protects the user's pop-up notification information from being seen by other users, improving the user experience. Moreover, this solution, by processing the safety control, ensures that the control information is not seen by other users, thereby not only protecting user safety but also further improving the user experience due to the smaller area of security processing.
[0258] Optionally, in the scenario where the first operation is a screenshot or screen recording, step S2104 may further include the first electronic device displaying a fourth image. In the scenario where the first operation is a screen projection or screen sharing, step S2104 may further include the first electronic device sending the fourth image to a second electronic device, the second electronic device receiving the fourth image, and the second electronic device displaying the fourth image.
[0259] Optionally, in the scenario where the first operation is a screenshot or screen recording, step S2105 may further include the first electronic device displaying the fifth image. In the scenario where the first operation is a screen projection or screen sharing, step S2105 may further include the first electronic device sending the fifth image to the second electronic device, the second electronic device receiving the fifth image, and the second electronic device displaying the fifth image.
[0260] The foregoing mainly describes the solutions provided by the embodiments of the present invention from the perspective of method steps. It is understood that, in order to achieve the above functions, the terminal device includes corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, in conjunction with the units and algorithm steps of the various examples described in the embodiments disclosed herein, this application can be implemented in a combination of hardware and computer software. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of the present invention.
[0261] This application embodiment can divide electronic devices (including a first electronic device and a second electronic device) into functional modules. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated modules can be implemented in hardware or as software functional modules. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.
[0262] For example, when dividing functional modules in an integrated manner, such as Figure 22 The diagram shown is a structural block diagram of an electronic device provided in an embodiment of this application. For example, the electronic device may be a first electronic device or a second electronic device. Figure 22 As shown, the electronic device may include a processing unit 2210 and a transceiver unit 2220.
[0263] When the electronic device is the first electronic device, the processing unit 2210 is used to support the electronic device in executing the above steps S401-S403, S404, S408-S409, S1401-S1405, S1501-S1503, S1504-S1505, S2101-S2105, and / or other processes used in the technology described herein. The transceiver unit 1620 is used to send a second image, a third image, a fourth image, or a fifth image to the second electronic device, and / or other processes used in the technology described herein.
[0264] In one possible structure, such as Figure 23 As shown, the electronic device may further include a storage unit 2230. The storage unit 2230 is used to store computer programs and processing data and / or processing results in implementing the methods provided in the embodiments of this application.
[0265] It should be noted that the aforementioned transceiver unit 2220 may include radio frequency (RF) circuitry. Specifically, portable devices can receive and transmit wireless signals via RF circuitry. Typically, RF circuitry includes, but is not limited to, antennas, at least one amplifier, transceiver, couplers, low-noise amplifiers, and duplexers. Furthermore, the RF circuitry can also communicate with other devices wirelessly. This wireless communication can use any communication standard or protocol, including but not limited to Global System for Mobile Communications (GSMO), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WDMA), Long Term Evolution (LTE), email, and Short Message Service (SMS).
[0266] It should be understood that the various modules in an electronic device can be implemented in software and / or hardware, without specific limitations. In other words, the electronic device is presented in the form of functional modules. Here, "module" can refer to application-specific integrated circuits (ASICs), circuits, processors and memory executing one or more software or firmware programs, integrated logic circuits, and / or other devices that can provide the aforementioned functions. Optionally, in a simple embodiment, those skilled in the art will appreciate that portable devices can employ... Figure 24 The processing unit 2210 can be in the form shown. Figure 24 The processor 2410 shown is used for implementation. The transceiver unit 2220 can be implemented via... Figure 24 The transceiver 2420 shown is used for implementation. Specifically, the processor implements this by executing a computer program stored in memory. Optionally, the memory is an on-chip storage unit, such as a register or cache; the storage unit can also be an external storage unit located within the computer device, such as... Figure 24 The memory is 2430.
[0267] In an alternative approach, when data transmission is implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are implemented. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disk (DVD)), or a semiconductor medium (e.g., solid-state disk (SSD)).
[0268] The steps of the methods or algorithms described in conjunction with the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disk, portable hard disk, CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and storage medium can be located in an ASIC. Alternatively, the ASIC can be located in a probing device. Of course, the processor and storage medium can also exist as discrete components in the probing device.
[0269] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
Claims
1. A secure display method characterized by comprising: The method comprises: The first electronic device displays a first image; The first electronic device receives a first operation of a user, the first operation being used to acquire the first image; In response to the first operation of the user, if the first electronic device determines that a first layer in the first image comprises a security mark, the first electronic device synthesizes a plurality of layers of the first image with a first preset layer, the first preset layer being located above the first layer, so that the first preset layer covers the first layer, and generates a second image, the second image comprising the first preset layer and a second layer not comprising the security mark; The first electronic device receives a second operation of a user, the second operation being used to open a security switch control; In response to the second operation of the user, the electronic device filters a third layer in the second image to generate a third image; the third layer comprises a pop-up prompt information, and the third image comprises the first preset layer.
2. The method of claim 1, wherein, The method further comprises: The first electronic device replaces the first layer with the first preset layer; The first electronic device synthesizes a second layer in the first image with the first preset layer to generate the second image.
3. The method according to claim 1 or 2, characterized in that, The first preset layer comprises prompt information, the prompt information being used to prompt the user that the first image comprises security information.
4. The method according to claim 1 or 2, characterized in that, The first operation comprises a screenshot operation, a screen recording operation, a screen projection operation or a screen sharing operation.
5. The method of claim 4, wherein, In the case where the first operation is a screenshot operation or a screen recording operation, the method further comprises: The first electronic device displays the second image.
6. The method of claim 4, wherein, In the case where the first operation is a screen projection operation or a screen sharing operation, the method further comprises: The first electronic device sends the second image to a second electronic device.
7. The method of claim 1, wherein, In the case where the first operation is a screenshot operation or a screen recording operation, the method further comprises: The first electronic device displays the third image.
8. The method of claim 1, wherein, In the case where the first operation is a screen projection operation or a screen sharing operation, the method further comprises: The first electronic device sends the third image to a second electronic device.
9. A security display method characterized by comprising: The method comprises: The first electronic device displays a first image; The first electronic device receives a first operation of a user, the first operation being used to acquire the first image; In response to the first operation of the user, if the first electronic device determines that a first control in the first image comprises a security mark, the first electronic device locates a second preset layer above a layer where the first control is located, so that the second preset layer covers the first control, and generates a fourth image; The first electronic device receives a second operation of a user, the second operation being used to open a security switch control; In response to the second operation of the user, the electronic device filters a third layer in the fourth image to generate a fifth image; the third layer comprises a pop-up prompt information, and the fifth image comprises the first preset layer.
10. The method of claim 9, wherein, The first electronic device uses the second preset layer to cover the first control to generate the fourth image, comprising: The first electronic device acquires position information of the first control in the first image; Based on the position information, the first electronic device covers an area where the first control is located by a second preset layer to generate a fourth image.
11. The method according to claim 9 or 10, characterized in that, The second preset layer includes prompt information, and the prompt information is used to prompt the user that the first control includes security information.
12. The method of claim 9 or 10, wherein, The first operation includes a screenshot operation, a screen recording operation, a screen projection operation, or a screen sharing operation.
13. The method of claim 12, wherein, In a case where the first operation is the screenshot operation or the screen recording operation, the method further includes: The first electronic device displays the fourth image.
14. The method of claim 12, wherein, In a case where the first operation is the screen projection operation or the screen sharing operation, the method further includes: The first electronic device sends the fourth image to a second electronic device.
15. The method of claim 9, wherein, In a case where the first operation is the screenshot operation or the screen recording operation, the method further includes: The first electronic device displays the fifth image.
16. The method of claim 9, wherein, In a case where the first operation is the screen projection operation or the screen sharing operation, the method further includes: The first electronic device sends the fifth image to a second electronic device.
17. A security display method characterized by comprising: The method includes: A first electronic device displays a first image; The first electronic device receives a first operation of a user, and the first operation is used to acquire the first image; In a case where the first electronic device determines that a security switch control is not turned on, in response to the first operation, if the first electronic device determines that a first layer in the first image includes a security identifier, the first electronic device replaces or covers the first layer by a first preset layer to generate a second image, and the second image includes the first preset layer and a second layer that does not include the security identifier; In a case where the first electronic device determines that the security switch control is turned on, in response to the first operation, if the first electronic device determines that the first layer in the first image includes the security identifier, the first electronic device replaces or covers the first layer by the first preset layer and filters a third layer to generate a third image; the third layer includes pop-up prompt information.
18. The method of claim 17, wherein, The first operation includes a screenshot operation, a screen recording operation, a screen projection operation, or a screen sharing operation.
19. An electronic device, comprising: The electronic device includes: a memory for storing a computer program; a transceiver for receiving or sending radio signals; a processor for executing the computer program, so that the electronic device implements the method according to any one of claims 1-18.
20. A computer-readable storage medium, characterized in that, The computer program code stored on the computer readable storage medium is executed by the processing circuit to implement the method according to any one of claims 1-18.
21. A chip system, characterized by The chip system includes a processing circuit, a storage medium, and computer program code stored in the storage medium; the computer program code is executed by the processing circuit to implement the method according to any one of claims 1-18.
22. A computer program product, characterised in that, The computer program product is used to run on a computer to implement the method according to any one of claims 1-18.
Citation Information
Patent Citations
Display method and apparatus for sensitive data in interface
CN105138931A
Screen recording method, device, mobile terminal and storage medium
CN109040419A
Sensitive information processing method and computer readable storage medium
CN109495515A