Secret-related information display control method, zero terminal, medium and equipment

Abstract

The invention relates to a secret-related information display control method, a zero terminal, a medium and equipment. Comprising the following steps: based on a connection request with a target virtual machine initiated by a zero terminal to a cloud server, the cloud server authenticates the connection request through a digital certificate; after the authentication is passed, establishing connection between the target virtual machine and the zero terminal; the target virtual machine judges whether the zero terminal is in an anti-peeping mode or not; if the target virtual machine is in the peep shooting prevention mode, the target virtual machine collects a desktop image; performing secret-related content identification on the acquired desktop image by using a pre-trained deep learning model; and if the confidential content is identified, outputting confidential content information, encoding the desktop image containing the confidential content information to obtain a first encoding code stream, and sending the first encoding code stream to a zero terminal for decoding, peep-proof display processing and display. According to the method and the device, leakage of secret-related information can be effectively prevented, display of non-secret-related information is not hindered, and the experience feeling of a user is improved.

Description

Background Art

[0002] The cloud desktop zero terminal office system is based on the computer image real-time compression transmission protocol (VANXVMGraphic Transport Protocol, VGTP) of the human-computer interface, such as Figure 2 As shown in the figure, the basic structure of the virtual cloud desktop system mainly includes: VGTP-R end and VGTP-S end. Among them, the VGTP-R end is mainly used to receive the virtual desktop image from the cloud, and transmit the local mouse and keyboard information back to the cloud to inject into the virtual desktop (Virtual Desktop); the VGTP-S end is mainly an image acquisition and encoding module running in the cloud virtual operating system (Operation System, OS), and is also responsible for the Virtual Desktop server that performs the injection function of user input data. The Virtual Desktop server is generally based on the Infrastructure as a Service (IAAS) architecture and has a strong virtual host server. It can provide management functions for multiple virtual hosts through a virtual machine monitor (hypervisor) and provide a hardware environment for the virtual host to run.

[0003] The above-mentioned cloud office zero-terminal system is widely used in special industries with high confidentiality due to its high security. Its high security is mainly reflected in: the user has no data storage on the local end, all data sources and video images come from images in the cloud, and the user's watermark can be added to the image in the cloud, thus ensuring that the data cannot be easily leaked. However, this method still cannot solve the data leakage caused by human peeping at the display end.

[0004] In the related art, the technical solution adopted to prevent data leakage caused by human peeping is mainly: when a peeping event occurs on the display end, the original display content is directly replaced to prevent peeping. However, this method of directly replacing the original display content is relatively rigid. Once a peeping event occurs, regardless of whether the current display content involves information that needs to be kept confidential, the display is interrupted, which is a poor experience for users.

[0005] Therefore, it is necessary to provide a new technical solution to improve one or more problems existing in the above solutions.

[0006] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0007] The purpose of this application is to provide a display control method, zero terminal, medium and device for confidential information, thereby overcoming one or more problems caused by the limitations and defects of related technologies at least to a certain extent.

[0008] According to a first aspect of an embodiment of the present application, a method for controlling display of confidential information is provided, comprising:

[0009] Based on the connection request initiated by the zero terminal to the cloud server with the target virtual machine, the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes multiple virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the multiple virtual machines;

[0010] When the authentication is passed, a connection is established between the target virtual machine and the zero terminal;

[0011] The target virtual machine determines whether the zero terminal is in an anti-snooping mode;

[0012] If in the anti-spying mode, the target virtual machine collects the desktop image;

[0013] Using a pre-trained deep learning model to identify confidential content in the collected desktop image;

[0014] If confidential content is identified, the confidential content information is output, and the desktop image containing the confidential content information is encoded to obtain a first encoded code stream, and the first encoded code stream is sent to the zero terminal for decoding, anti-peeping display processing and display; wherein the confidential content information includes the coordinates of one or more confidential content display areas.

[0015] In an embodiment of the present application, the step of using a pre-trained deep learning model to identify confidential content on the collected desktop image includes:

[0016] If the confidential content is not identified, the desktop image without the confidential content information is encoded to obtain a second encoded code stream, and the second encoded code stream is sent to the null terminal for decoding and display.

[0017] In an embodiment of the present application, the step of the target virtual machine determining whether the zero terminal is in an anti-snooping mode includes:

[0018] If the anti-spying mode is entered based on the selection of the zero terminal user, it is determined that the zero terminal is in the anti-spying mode.

[0019] In an embodiment of the present application, the step of the target virtual machine determining whether the zero terminal is in an anti-snooping mode includes:

[0020] If the user images uploaded by the zero terminal only include authorized users, it is determined that the zero terminal is not in the anti-spying mode;

[0021] If the user images uploaded by the zero terminal include authorized users and unauthorized users, it is determined that the zero terminal is in the anti-peeping mode.

[0022] In an embodiment of the present application, the coordinates of the confidential content display area are obtained by:

[0023] A minimum rectangular frame that can cover the current confidential content display area is determined, and coordinate position information of two pixel points at both ends of any diagonal line of the minimum rectangular frame is recorded as the coordinates of the current confidential content display area.

[0024] According to a second aspect of an embodiment of the present application, a method for controlling display of confidential information is provided, the method comprising:

[0025] The zero terminal initiates a connection request with a target virtual machine to a cloud server, so that the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes a plurality of virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the plurality of virtual machines;

[0026] When the authentication is passed, a connection is established between the zero terminal and the target virtual machine;

[0027] The zero terminal receives the encoded code stream sent by the target virtual machine;

[0028] The null terminal determines whether the received coded code stream contains confidential content information; wherein the confidential content information includes coordinates of one or more confidential content display areas;

[0029] If the coded code stream contains the confidential content information, the null terminal decodes the coded code stream and performs anti-peeping display processing on the decoded frame image according to the confidential content information for display.

[0030] In an embodiment of the present application, the step of the zero terminal determining whether the received encoded code stream contains confidential content information further includes:

[0031] If the encoded code stream does not contain the confidential content information, the null terminal decodes and displays the encoded code stream.

[0032] In an embodiment of the present application, the step of performing anti-spying display processing on the decoded frame image according to the confidential content information includes:

[0033] The zero terminal determines one or more confidential content display areas in the current frame image according to the coordinates of one or more confidential content display areas;

[0034] The image in the determined confidential content display area is subjected to anti-peeping display processing to obtain the processed current frame image and display it.

[0035] In an embodiment of the present application, the anti-peeping display processing includes:

[0036] Performing masking processing on the image in the confidential content display area;

[0037] Alternatively, mosaic processing is performed on the image in the confidential content display area;

[0038] Alternatively, the image in the confidential content display area is filled with preset content;

[0039] Alternatively, the pixels in the confidential content display area are randomly shuffled.

[0040] According to a third aspect of an embodiment of the present application, a cloud server is provided, including:

[0041] An authentication module, configured to initiate a connection request with a target virtual machine to a cloud server based on a zero terminal, and the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes a plurality of virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the plurality of virtual machines;

[0042] A first connection module, used to establish a connection between the target virtual machine and the zero terminal after the authentication is passed;

[0043] A first judgment module, used for the target virtual machine to judge whether the zero terminal is in an anti-snooping mode;

[0044] A first judgment submodule is used for collecting a desktop image by the target virtual machine if the target virtual machine is in the anti-spying mode;

[0045] An identification module, used to identify confidential content in the collected desktop image using a pre-trained deep learning model;

[0046] The first identification submodule is used to output the confidential content information if confidential content is identified, and encode the desktop image containing the confidential content information to obtain a first encoded code stream, and send the first encoded code stream to the zero terminal for decoding, anti-peeping display processing and display; wherein the confidential content information includes the coordinates of one or more confidential content display areas.

[0047] According to a fourth aspect of an embodiment of the present application, a zero terminal is provided, including:

[0048] An initiating module, used for the zero terminal to initiate a connection request with a target virtual machine to a cloud server, so that the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes a plurality of virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the plurality of virtual machines;

[0049] A second connection module, used to establish a connection between the zero terminal and the target virtual machine;

[0050] A receiving module, used for receiving the encoded code stream sent by the target virtual machine by the zero terminal;

[0051] A second judgment module is used for the null terminal to judge whether the received coded code stream contains confidential content information; wherein the confidential content information includes the coordinates of one or more confidential content display areas;

[0052] The second judgment submodule is used for, if the coded code stream contains the confidential content information, the zero terminal decodes the coded code stream, and performs anti-peeping display processing on the decoded frame image according to the confidential content information for display.

[0053] According to a fifth aspect of an embodiment of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the steps of the display control method of confidential information described in any one of the above embodiments are implemented.

[0054] According to a sixth aspect of an embodiment of the present application, there is provided an electronic device, including:

[0055] Processor; and

[0056] A memory, configured to store executable instructions of the processor;

[0057] The processor is configured to execute the steps of the method for controlling display of confidential information in any one of the above embodiments by executing the executable instructions.

[0058] The technical solution provided by the embodiments of the present application may have the following beneficial effects:

[0059] In one embodiment of the present application, through the above method, when it is determined that the zero terminal is in anti-spying mode, the target virtual machine uses a pre-trained deep learning model to recognize the desktop image after acquiring the desktop image. When confidential content is identified, the desktop image containing confidential content information is encoded to obtain a first encoded code stream, which is sent to the zero terminal for decoding, anti-spying display processing and display. In this way, confidential information can be effectively prevented from being leaked without hindering the display of non-confidential information, thereby improving the user experience.

[0060] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0062] Figure 1 A flowchart schematically showing a method for controlling display of confidential information in an exemplary embodiment of the present application;

[0063] Figure 2 A schematic diagram schematically illustrates a cloud office zero terminal system in an exemplary embodiment of the present application;

[0064] Figure 3 The basic architecture diagram of the anti-spy camera system in the exemplary embodiment of the present application is schematically shown;

[0065] Figure 4 A flowchart schematically showing a method for controlling display of confidential information in an exemplary embodiment of the present application;

[0066] Figure 5 A block diagram schematically illustrates a cloud server in an exemplary embodiment of the present application;

[0067] Figure 6 A block diagram schematically shows a zero terminal in an exemplary embodiment of the present application;

[0068] Figure 7 A schematic diagram of a program product in an exemplary embodiment of the present application is schematically shown;

[0069] Figure 8 A schematic diagram of an electronic device in an exemplary embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0070] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

[0071] In addition, the accompanying drawings are only schematic illustrations of the present application and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0072] In the related art, in practice, not all content displayed on the display terminal needs to be protected from peeping. For example, for the desktop images sent to the zero terminal, some contain confidential content, while others do not. Moreover, for the desktop images containing confidential content, the local area contains the confidential area, while other areas do not contain confidential content. Therefore, when a peeping incident occurs, if the zero terminal directly replaces the original display content to prevent peeping, this method will display the terminal regardless of whether the current display content involves confidential content, which will affect the user experience.

[0073] Based on this, this example implementation first provides a method for controlling the display of confidential information. Figure 1 As shown in , the method may include: steps S101 to S1041.

[0074] Among them, step S101: based on the connection request initiated by the zero terminal to the cloud server with the target virtual machine, the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes multiple virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the multiple virtual machines.

[0075] Step S102: After the authentication is passed, a connection is established between the target virtual machine and the zero terminal.

[0076] Step S103: The target virtual machine determines whether the null terminal is in the anti-snooping mode.

[0077] Step S1031: If the target virtual machine is in the anti-snooping mode, the target virtual machine collects the desktop image.

[0078] Step S104: Use a pre-trained deep learning model to identify confidential content in the collected desktop image.

[0079] Step S1041: If confidential content is identified, the confidential content information is output, and the desktop image containing the confidential content information is encoded to obtain a first encoded code stream, and the first encoded code stream is sent to the zero terminal for decoding, anti-peeping display processing and display; wherein the confidential content information includes the coordinates of one or more confidential content display areas.

[0080] In one embodiment of the present application, through the above method, when it is determined that the zero terminal is in anti-spying mode, the target virtual machine uses a pre-trained deep learning model to recognize the desktop image after acquiring the desktop image. When confidential content is identified, the desktop image containing confidential content information is encoded to obtain a first encoded code stream, which is sent to the zero terminal for decoding, anti-spying display processing and display. In this way, confidential information can be effectively prevented from being leaked without hindering the display of non-confidential information, thereby improving the user experience.

[0081] Next, we will refer to Figure 1 and Figure 3 Each step of the above method in this example implementation is described in more detail.

[0082] Before discussing the present application, the basic architecture of the anti-spying camera system provided by the present application is first described. Figure 3 It can be seen that: the basic architecture includes a zero terminal and a virtual machine located on a cloud server. The cloud server includes multiple virtual machines, and each virtual machine corresponds to a zero terminal, which is equivalent to a piece of resource on the cloud server allocated to a specific user. As a user, you can use the zero terminal to establish a connection with the virtual machine and continuously obtain the desktop image obtained from the virtual machine. The desktop image is displayed in real time on the monitor connected to the zero terminal. The user operates the virtual machine through reverse control operations. For the zero terminal user, it is just like operating locally.

[0083] In step S101 and step S102, the connection request includes an account and a password. When a connection needs to be established between the zero terminal and the target virtual machine, first, the zero terminal initiates a connection request for the target virtual machine to the cloud server; then, the cloud server authenticates the connection request through a digital certificate (such as a CA certificate), and after the authentication is passed, a connection is established between the target virtual machine and the zero terminal. It should be noted that the connection request includes an account and a password, and through authentication, the identity of the user logging into the zero terminal can be authenticated to prevent data leakage and illegal access.

[0084] In step S103, in addition to the above-mentioned sub-step S1031, step S103 further includes: sub-step S1032 and sub-step S1033.

[0085] In sub-step S1032, if the anti-spying mode is entered based on the selection of the null terminal user, it is determined that the null terminal is in the anti-spying mode.

[0086] In sub-step S1033, if the user images uploaded by the null terminal include only authorized users, it is determined that the null terminal is not in the anti-spying mode;

[0087] If the user images uploaded by the zero terminal include authorized users and unauthorized users, it is determined that the zero terminal is in anti-snooping mode.

[0088] It is understandable that when the target virtual machine determines whether the zero terminal is in anti-snooping mode, it can be judged according to the above two sub-steps. That is: the user can set to choose to actively enter the anti-snooping mode; or, the cloud server can determine whether the zero terminal is in anti-snooping mode by intelligently identifying the collected user images sent by the zero terminal. For example: when the user images uploaded by the zero terminal only contain authorized users, the cloud server determines that the current use environment of the zero terminal is safe, that is, the zero terminal is not in anti-snooping mode. When the user images uploaded by the zero terminal include other users (such as unauthorized users) in addition to authorized users, the cloud server determines that the zero terminal is in anti-snooping mode. This application determines whether the zero terminal is in anti-snooping mode through the target virtual machine, so that the target virtual machine and the zero terminal can perform corresponding processing according to whether they are in anti-snooping mode.

[0089] It should be noted that the corresponding processing here is explained in the subsequent embodiments and will not be repeated in this application.

[0090] In step S104 and step S1041, if the cloud server determines that the zero terminal is in the anti-snooping mode, the target virtual machine collects the desktop image. Then, the target virtual machine uses the pre-trained deep learning model to identify the confidential content in the desktop image. If the cloud server identifies the confidential content from the desktop image, it outputs the confidential content information. Since the confidential content information includes the coordinates of one or more confidential content display areas, when the confidential content information is output, the coordinates of one or more confidential content display areas are output.

[0091] After the confidential content information is output, the desktop image containing the confidential content information is encoded to obtain a first encoded code stream, which is then sent to the null terminal for corresponding processing.

[0092] It should be noted that after the null terminal receives the first coded code stream, since the first coded code stream contains confidential content information, the null terminal first decodes the first coded code stream, and then performs anti-peeping display processing on the decoded frame image according to the confidential content information for display.

[0093] Furthermore, the anti-peeping display processing includes blocking the image in the confidential content display area, or mosaicing the image in the confidential content display area, or filling the image in the confidential content display area with preset content, or randomly shuffling the pixels in the confidential content display area.

[0094] In one embodiment, step S104 includes sub-step S1042 in addition to the above sub-step S1041. In sub-step S1042, if no confidential content is identified, the desktop image without confidential content information is encoded to obtain a second encoded code stream, and the second encoded code stream is sent to the null terminal for decoding and display.

[0095] It should be noted that when using the pre-trained deep learning model to identify confidential content in the collected desktop image, if the cloud server cannot identify confidential content from the desktop image, that is, the desktop image does not contain confidential content. At this time, the virtual machine encodes the desktop image without confidential content information to obtain a second encoded code stream, and sends it to the zero terminal for normal decoding and display.

[0096] It should be noted that the steps for pre-training the deep learning model in this application are as follows:

[0097] Pre-training step: Conduct deep learning model training in advance to obtain a deep learning model that can be used to identify confidential content, and apply the obtained deep learning model to the cloud server (i.e. virtual machine) to identify confidential content in desktop images. Confidential content includes but is not limited to: pictures, names, parameters, production processes and other information of confidential equipment; pictures, names, ages, telephone numbers, positions, addresses and other information of confidential personnel; pictures, maps, names, locations and other information of confidential places; organizational structure, address, personnel list and other information of confidential units. Different units or individuals need to manage different confidential information content. When training deep learning models, deep learning models that meet specific needs can be trained in a targeted manner.

[0098] The training methods of deep learning models include the following:

[0099] 1) Collect a large amount of image data containing confidential content display areas;

[0100] 2) Use annotation tools to annotate the confidential content display area in the image and generate an annotation file containing a bounding box and category label.

[0101] 3) Data preprocessing: Perform preprocessing operations such as scaling and normalization on the image to adapt to the input size of the convolutional neural network (CNN); perform data augmentation to increase the diversity of the data and the robustness of the model, convert the annotation information in the annotation file into the format required for CNN training, and normalize the bounding box coordinates to the range of [0, 1].

[0102] 4) The annotated file is input into a deep learning model such as CNN for continuous iterative training. When the recognition accuracy of the trained model reaches a preset threshold, it is used as the target deep learning model (i.e., the pre-trained deep learning model) and loaded into the system for confidential content display area recognition. The output data is the coordinates of the confidential content display area. If the current frame image contains multiple confidential content display areas, multiple sets of coordinates are output.

[0103] In the present application, after the target virtual machine and the zero terminal are established, when the target virtual machine determines that a peeping event occurs on the zero terminal (i.e., the zero terminal is in anti-peeping mode), the target virtual machine uses a pre-trained deep learning model to identify confidential content in the desktop image it collects. The identification process includes two situations: identifying confidential content or not identifying the identified content. Then, corresponding encoding is performed, and the corresponding encoding code stream (including the first encoding code stream or the second encoding code stream) is sent to the zero terminal, so that the zero terminal can process the confidential content in a targeted manner, and while not hindering the display of the confidential content, it can effectively prevent the leakage of confidential content while minimizing the impact on the user experience, thereby improving the user experience.

[0104] In one embodiment, the coordinates of the confidential content display area are obtained by:

[0105] The smallest rectangular frame that can cover the current confidential content display area is determined, and the coordinate position information of two pixel points at both ends of any diagonal line of the smallest rectangular frame is recorded as the coordinates of the current confidential content display area.

[0106] It is understandable that for a confidential content display area, only two coordinate points need to be transmitted to determine the position of the confidential content display area. The specific implementation method is: determine the positions of the two coordinates from the received confidential content information, and then deduce the two coordinate points at both ends of another diagonal line from the positions of the two coordinates. These four coordinate points are the four vertices of the rectangular frame. After obtaining the four vertices, the position of the rectangular frame can be determined. The method of determining coordinates by the present application can accurately determine the coordinates of the confidential content display area, which is convenient for better identification of confidential content.

[0107] This example implementation also provides a method for controlling the display of confidential information. Figure 4 As shown in , the method may include: steps S201 to S2041.

[0108] Among them, step S201: the zero terminal initiates a connection request with the target virtual machine to the cloud server, so that the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes multiple virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the multiple virtual machines.

[0109] Step S202: After the authentication is passed, a connection is established between the zero terminal and the target virtual machine.

[0110] Step S203: The null terminal receives the encoded code stream sent by the target virtual machine.

[0111] Step S204: the null terminal determines whether the received coded code stream contains confidential content information; wherein the confidential content information includes the coordinates of one or more confidential content display areas.

[0112] Step S2041: If the coded code stream contains confidential content information, the null terminal decodes the coded code stream and performs anti-peeping display processing on the decoded frame image according to the confidential content information for display.

[0113] In one embodiment, step S204 includes, in addition to the above sub-step S2041, a further sub-step S2042. In sub-step S2042, if the coded code stream does not contain confidential content information, the null terminal decodes and displays the coded code stream.

[0114] In one embodiment, the step of performing anti-spying display processing on the decoded frame image according to the confidential content information includes:

[0115] The zero terminal determines one or more confidential content display areas in the current frame image according to the coordinates of the one or more confidential content display areas;

[0116] The image in the determined confidential content display area is processed to prevent peeping and display, and the processed current frame image is obtained and displayed.

[0117] In one embodiment, the anti-privacy display processing includes:

[0118] Mask the images in the confidential content display area;

[0119] Alternatively, mosaic processing is performed on the image in the confidential content display area;

[0120] Alternatively, the image in the confidential content display area is filled with preset content;

[0121] Alternatively, the pixels in the confidential content display area are randomly shuffled.

[0122] It should be noted that the encoded code stream includes a first encoded code stream and a second encoded code stream, and the discussion of the control and display method of confidential information with the zero terminal as the main body in this application has been elaborated in detail in the above embodiment with the target virtual machine as the main body, and this application will not repeat it.

[0123] It should be noted that, although the steps of the method in the present application are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step for execution, and / or one step may be decomposed into multiple steps for execution, etc. In addition, it is also easy to understand that these steps may be, for example, executed synchronously or asynchronously in multiple modules / processes / threads.

[0124] Furthermore, in this example implementation, a cloud server is also provided. Figure 5 As shown in , the apparatus 300 may include an authentication module 310 , a first connection module 320 , a first judgment module 330 , a first judgment submodule 331 , an identification module 340 and a first identification submodule 341 . The authentication module 310 is used to initiate a connection request with a target virtual machine to a cloud server based on the zero terminal, and the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes multiple virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the multiple virtual machines; the first connection module 320 is used to establish a connection between the target virtual machine and the zero terminal after the authentication is passed; the first judgment module 330 is used for the target virtual machine to judge whether the zero terminal is in an anti-snooping mode; the first judgment submodule 331 is used for the target virtual machine to collect a desktop image if it is in an anti-snooping mode; the recognition module 340 is used to use a pre-trained deep learning model to identify confidential content in the collected desktop image; the first recognition submodule 341 is used to output confidential content information if confidential content is identified, and encode the desktop image containing confidential content information to obtain a first encoded code stream, and send the first encoded code stream to the zero terminal for decoding, anti-snooping display processing and display; wherein the confidential content information includes the coordinates of one or more confidential content display areas.

[0125] In one embodiment, it further includes:

[0126] The second identification submodule is used to encode the desktop image without confidential content information if no confidential content is identified to obtain a second encoded code stream, and send the second encoded code stream to the null terminal for decoding and display.

[0127] In one embodiment, it further includes:

[0128] The third judgment submodule is used to determine that the zero terminal is in the anti-peeping mode if the anti-peeping mode is entered based on the selection of the zero terminal user.

[0129] In one embodiment, it further includes:

[0130] A fourth judgment submodule, configured to determine that the zero terminal is not in an anti-spying mode if the user images uploaded by the zero terminal include only authorized users;

[0131] The fifth judgment submodule is used to determine that the zero terminal is in an anti-spying mode if the user images uploaded by the zero terminal include authorized users and unauthorized users.

[0132] Furthermore, in this exemplary embodiment, a zero terminal is also provided. Figure 6 As shown in , the device 400 may include an initiating module 410, a second connecting module 420, a receiving module 430, a judging module 440 and a second judging submodule 441. Among them: the initiating module 410 is used for the zero terminal to initiate a connection request with the target virtual machine to the cloud server, so that the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes multiple virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the multiple virtual machines; the second connecting module 420 is used to establish a connection between the zero terminal and the target virtual machine; the receiving module 430 is used for the zero terminal to receive the coded code stream sent by the target virtual machine; the judging module 440 is used for the zero terminal to judge whether the received coded code stream contains confidential content information; wherein the confidential content information includes the coordinates of one or more confidential content display areas; the second judging submodule 441 is used for, if the coded code stream contains confidential content information, the zero terminal decodes the coded code stream, and performs anti-peeping display processing on the decoded frame image according to the confidential content information for display.

[0133] In one embodiment, it further includes:

[0134] The sixth judgment submodule is used to decode and display the encoded code stream if the encoded code stream does not contain confidential content information.

[0135] In one embodiment, it further includes:

[0136] A determination module, used for the zero terminal to determine one or more confidential content display areas in the current frame image according to the coordinates of one or more confidential content display areas;

[0137] The processing module is used to perform anti-peeping display processing on the image in the determined confidential content display area, obtain the processed current frame image, and display it.

[0138] In one embodiment, it further includes:

[0139] A processing submodule, used for performing masking processing on the image in the confidential content display area;

[0140] Or, it is used to mosaic the image in the confidential content display area;

[0141] Or, used to fill the image in the confidential content display area with preset content;

[0142] Alternatively, it is used to randomly shuffle the pixels in the confidential content display area.

[0143] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0144] It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the implementation mode of the present application, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of a module or unit described above can be further divided into multiple modules or units for concretization. The components displayed as modules or units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the present application scheme. Those of ordinary skill in the art can understand and implement it without paying creative work.

[0145] In an exemplary embodiment of the present application, a computer-readable storage medium is also provided, on which a computer program is stored, and when the program is included in a processor and executed, the steps of the display control method of confidential information described in any of the above embodiments can be implemented. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps of various exemplary embodiments of the present invention described in the above-mentioned display control method of confidential information section of this specification.

[0146] refer to Figure 7 As shown, a program product 400 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0147] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0148] The computer readable storage medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by an instruction execution system, an apparatus, or a device or used in combination with it. The program code contained on the readable storage medium may be transmitted with any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.

[0149] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device, partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0150] In an exemplary embodiment of the present application, an electronic device is further provided, which may include a processor and a memory for storing executable instructions of the processor, wherein the processor is configured to execute the steps of the display control method of confidential information in any of the above embodiments by executing the executable instructions.

[0151] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0152] Refer to the following Figure 8 The electronic device 600 according to this embodiment of the present invention is described. Figure 8 The electronic device 600 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0153] like Figure 8 As shown, the electronic device 600 is in the form of a general computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different system components (including the storage unit 620 and the processing unit 610), a display unit 640, etc.

[0154] The storage unit stores program codes, which can be executed by the processing unit 610, so that the processing unit 610 executes the steps of various exemplary embodiments of the present invention described in the above-mentioned display control method of confidential information of this specification. For example, the processing unit 610 can execute the following steps: Figure 1 Follow the steps shown in .

[0155] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache memory unit 6202 , and may further include a read-only memory unit (ROM) 6203 .

[0156] The storage unit 620 may also include a program / utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each of which or some combination may include the implementation of a network environment.

[0157] Bus 630 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0158] The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 600, and / or communicate with any device that enables the electronic device 600 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 650. Furthermore, the electronic device 600 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 660. The network adapter 660 may communicate with other modules of the electronic device 600 via a bus 630. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0159] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation method of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server or a network device, etc.) to execute the above-mentioned display control method of confidential information according to the implementation method of the present application.

[0160] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary technical means in the art that are not disclosed in the present application.

Claims

1. A method for controlling the display of confidential information, characterized in that: include: Based on the connection request initiated by the zero terminal to the cloud server with the target virtual machine, the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes multiple virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the multiple virtual machines; When the authentication is passed, a connection is established between the target virtual machine and the zero terminal; The target virtual machine determines whether the zero terminal is in an anti-snooping mode; If in the anti-spying mode, the target virtual machine collects the desktop image; Using a pre-trained deep learning model to identify confidential content in the collected desktop image; If confidential content is identified, the confidential content information is output, and the desktop image containing the confidential content information is encoded to obtain a first encoded code stream, and the first encoded code stream is sent to the zero terminal for decoding, anti-peeping display processing and display; wherein the confidential content information includes the coordinates of one or more confidential content display areas.

2. The method for controlling the display of confidential information according to claim 1, characterized in that: The step of using a pre-trained deep learning model to identify confidential content on the collected desktop image includes: If the confidential content is not identified, the desktop image without the confidential content information is encoded to obtain a second encoded code stream, and the second encoded code stream is sent to the null terminal for decoding and display.

3. The method for controlling the display of confidential information according to claim 1, characterized in that: The step of the target virtual machine determining whether the zero terminal is in the anti-snooping mode includes: If the anti-spying mode is entered based on the selection of the zero terminal user, it is determined that the zero terminal is in the anti-spying mode.

4. The method for controlling the display of confidential information according to claim 1, characterized in that: The step of the target virtual machine determining whether the zero terminal is in the anti-snooping mode includes: If the user images uploaded by the zero terminal only include authorized users, it is determined that the zero terminal is not in the anti-spying mode; If the user images uploaded by the zero terminal include authorized users and unauthorized users, it is determined that the zero terminal is in the anti-peeping mode.

5. The method for controlling the display of confidential information according to claim 1, characterized in that: The coordinates of the confidential content display area are obtained in the following way: A minimum rectangular frame that can cover the current confidential content display area is determined, and coordinate position information of two pixel points at both ends of any diagonal line of the minimum rectangular frame is recorded as the coordinates of the current confidential content display area.

6. A method for controlling the display of confidential information, characterized in that: The method includes: The zero terminal initiates a connection request with a target virtual machine to a cloud server, so that the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes a plurality of virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the plurality of virtual machines; When the authentication is passed, a connection is established between the zero terminal and the target virtual machine; The zero terminal receives the encoded code stream sent by the target virtual machine; The null terminal determines whether the received coded code stream contains confidential content information; wherein the confidential content information includes coordinates of one or more confidential content display areas; If the coded code stream contains the confidential content information, the null terminal decodes the coded code stream and performs anti-peeping display processing on the decoded frame image according to the confidential content information for display.

7. The method for controlling the display of confidential information according to claim 6, characterized in that: The step of the null terminal determining whether the received coded code stream contains confidential content information includes: If the encoded code stream does not contain the confidential content information, the null terminal decodes and displays the encoded code stream.

8. The method for controlling the display of confidential information according to claim 6, characterized in that: The step of performing anti-spying display processing on the decoded frame image according to the confidential content information includes: The zero terminal determines one or more confidential content display areas in the current frame image according to the coordinates of one or more confidential content display areas; The image in the determined confidential content display area is processed to prevent peeping and display, and the processed current frame image is obtained and displayed.

9. The method for controlling the display of confidential information according to claim 6, characterized in that: The anti-privacy display processing includes: Performing masking processing on the image in the confidential content display area; Alternatively, mosaic processing is performed on the image in the confidential content display area; Alternatively, the image in the confidential content display area is filled with preset content; Alternatively, the pixels in the confidential content display area are randomly shuffled.

10. A cloud server, characterized in that: include: An authentication module, configured to initiate a connection request with a target virtual machine to a cloud server based on a zero terminal, and the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes a plurality of virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the plurality of virtual machines; A first connection module, used to establish a connection between the target virtual machine and the zero terminal after the authentication is passed; A first judgment module, used for the target virtual machine to judge whether the zero terminal is in an anti-snooping mode; A first judgment submodule is used for collecting a desktop image by the target virtual machine if the target virtual machine is in the anti-spying mode; An identification module, used to identify confidential content in the collected desktop image using a pre-trained deep learning model; The first identification submodule is used to output the confidential content information if confidential content is identified, and encode the desktop image containing the confidential content information to obtain a first encoded code stream, and send the first encoded code stream to the zero terminal for decoding, anti-peeping display processing and display; wherein the confidential content information includes the coordinates of one or more confidential content display areas.

11. A zero terminal, characterized in that: include: An initiating module, used for the zero terminal to initiate a connection request with a target virtual machine to a cloud server, so that the cloud server authenticates the connection request through a digital certificate; wherein the cloud server includes a plurality of virtual machines, and the target virtual machine is a virtual machine corresponding to the connection request determined from the plurality of virtual machines; A second connection module, used to establish a connection between the zero terminal and the target virtual machine; A receiving module, used for receiving the encoded code stream sent by the target virtual machine by the zero terminal; A second judgment module is used for the null terminal to judge whether the received coded code stream contains confidential content information; wherein the confidential content information includes the coordinates of one or more confidential content display areas; The second judgment submodule is used for, if the coded code stream contains the confidential content information, the zero terminal decodes the coded code stream, and performs anti-peeping display processing on the decoded frame image according to the confidential content information for display.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the display control method of confidential information described in any one of claims 1 to 9 are implemented.

13. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; Wherein, the processor is configured to execute the steps of the display control method of confidential information according to any one of claims 1 to 9 by executing the executable instructions.

Images