Display device, screen information protection method, storage medium, and program product

Abstract

The invention discloses a display device, a screen information protection method, a storage medium and a program product, and belongs to the technical field of information security. According to the invention, the infrared device is arranged on the display device, and the infrared device emits the infrared light capable of covering part or all of the display area of the display screen, so that the quality of the screen image obtained by shooting the display area is reduced through the infrared light, namely, the quality of the screen image is improved. Infrared light is utilized to influence the imaging quality of candid shooting behaviors, so that the purpose of protecting screen information is achieved.

Description

Technical Field

[0001] The present application relates to the field of information security technology, and in particular to a display device, a method for protecting screen information, a storage medium, and a program product. Background Art

[0002] Currently, there are many scenarios where information confidentiality is required, for example, in conference scenarios, the content displayed on the screen must be kept confidential. In order to ensure the security of screen information, some means are needed to prevent the screen information from being secretly photographed. How to effectively prevent the screen information from being secretly photographed is a hot topic in the industry. Summary of the invention

[0003] The present application provides a display device, a method for protecting screen information, a storage medium and a program product, which can effectively prevent the screen information from being secretly photographed. The technical solution is as follows:

[0004] In one aspect, a display device is provided, the display device comprising a display screen and an infrared device;

[0005] The display screen is used to display screen information;

[0006] The infrared device is used to emit infrared light, and the infrared light is used to cover part or all of the display area of ​​the display screen to reduce the quality of the screen image obtained by shooting the display area.

[0007] In a possible implementation, the infrared device includes N infrared light-emitting panels, where N is a positive integer;

[0008] When N is greater than 1, the N infrared light-emitting panels are distributed on at least one frame side of the display screen.

[0009] In a possible implementation, the display device further includes a semi-transparent glass, and the semi-transparent glass covers the display screen;

[0010] The infrared device is specifically used to irradiate the infrared light toward the semi-transparent glass;

[0011] The semi-transparent glass is used to reflect the infrared light into the environment.

[0012] In a possible implementation, the semi-transparent glass includes a first glass and a second glass in a rectangular shape, a first side of the first glass overlaps with a second side of the second glass, and the first glass and the second glass have an angle, and the first glass and the second glass also have an angle with the display screen;

[0013] When N is 2, the first of the two infrared light-emitting panels is located on the frame side of the display screen close to the third side of the first glass, the third side is parallel to the first side, and the first light-emitting panel is used to irradiate infrared light to the first glass; the second of the two infrared light-emitting panels is located on the frame side of the display screen close to the fourth side of the second glass, the fourth side is parallel to the second side, and the second light-emitting panel is used to irradiate infrared light to the second glass.

[0014] In a possible implementation, the display screen includes a backlight system, the infrared device includes an infrared backlight source, and the infrared backlight source is integrated in the backlight system.

[0015] In a possible implementation, the display device further includes a light source control device;

[0016] The light source control device is used to obtain the intensity of the ambient light and adjust the light intensity of the infrared device based on the intensity of the ambient light.

[0017] In a possible implementation, the display device further includes an image sensor and a processor;

[0018] The image sensor is used to collect an image of the viewing area of ​​the display screen to obtain an environment image;

[0019] The processor is used to detect the shooting behavior in the environmental image, and execute the protection strategy of the screen information when the shooting behavior is detected in the environmental image.

[0020] On the other hand, a method for protecting screen information is provided, wherein the display device includes a display screen and an infrared device, and the method includes:

[0021] The infrared device is controlled to emit infrared light, and the infrared light is used to cover part or all of the display area of ​​the display screen to reduce the quality of the screen image obtained by shooting the display area.

[0022] In a possible implementation, the display device further includes a light source control device, and the method further includes: the light source control device acquires the intensity of ambient light, and adjusts the light emission intensity of the infrared device based on the intensity of the ambient light.

[0023] In a possible implementation, the display device further includes an image sensor and a processor. The method further includes: the image sensor collects an image of the viewing area of ​​the display screen to obtain an environment image; the processor detects a shooting behavior in the environment image, and executes the screen information protection strategy when a shooting behavior is detected in the environment image.

[0024] On the other hand, a screen information protection device is provided, which includes: an infrared device that controls a display device to emit infrared light, wherein the infrared light is used to cover part or all of a display area of ​​a display screen of the display device, so as to reduce the quality of a screen image obtained by photographing the display area.

[0025] In a possible implementation, the infrared device includes N infrared light-emitting panels, where N is a positive integer;

[0026] When N is greater than 1, the N infrared light-emitting panels are distributed on at least one frame side of the display screen.

[0027] In a possible implementation, one infrared light-emitting panel is distributed on one side of a frame, and N does not exceed the total number of frames of the display screen.

[0028] In a possible implementation, the display device further includes a semi-transparent glass, and the semi-transparent glass covers the display screen;

[0029] The infrared device is specifically used to irradiate infrared light to the semi-transparent glass;

[0030] The semi-transparent glass is used to reflect the infrared light into the environment.

[0031] In a possible implementation, the semi-transparent glass includes a first glass and a second glass in a rectangular shape, a first side of the first glass overlaps with a second side of the second glass, and the first glass and the second glass have an angle, and the first glass and the second glass also have an angle with the display screen;

[0032] When N is 2, the first of the two infrared light-emitting panels is located on the frame side of the display screen close to the third side of the first glass, the third side is parallel to the first side, and the first light-emitting panel is used to irradiate infrared light to the first glass; the second of the two infrared light-emitting panels is located on the frame side of the display screen close to the fourth side of the second glass, the fourth side is parallel to the second side, and the second light-emitting panel is used to irradiate infrared light to the second glass.

[0033] In a possible implementation, the display screen includes a backlight system, the infrared device includes an infrared backlight source, and the infrared backlight source is integrated in the backlight system.

[0034] In a possible implementation, the protection device further includes a light source control device;

[0035] The light source control device is used to obtain the intensity of the ambient light and adjust the light intensity of the infrared device based on the intensity of the ambient light.

[0036] In a possible implementation, the protection device further includes an image sensor and a processor;

[0037] The image sensor is used to capture an image of the viewing area of ​​the display screen to obtain an environmental image;

[0038] The processor is used to detect shooting behavior in the environmental image, and execute the protection strategy of the screen information when the shooting behavior is detected in the environmental image.

[0039] On the other hand, a display device is provided, which includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus, the memory is used to store computer programs, and the processor is used to execute the programs stored in the memory to implement the steps of the above-mentioned screen information protection method.

[0040] On the other hand, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned method for protecting screen information are implemented.

[0041] On the other hand, a computer program product including instructions is provided, which, when executed on a computer, enables the computer to execute the steps of the above-mentioned method for protecting screen information.

[0042] The technical solution provided by this application can at least bring the following beneficial effects:

[0043] By setting an infrared device on the display device, the infrared device emits infrared light that can cover part or all of the display area of ​​the display screen, thereby reducing the quality of the screen image obtained by photographing the display area through infrared light, that is, using infrared light to affect the image quality of the candid photography behavior, thereby achieving the purpose of protecting the screen information. When the naked eye views the display screen, the infrared light cannot be perceived, that is, this solution does not affect the viewing effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0045] Figure 1 is a schematic diagram of a display device provided in an embodiment of the present application;

[0046] Figure 2 is a schematic diagram of another display device provided in an embodiment of the present application;

[0047] Figure 3 It is a schematic diagram of a voyeuristic photography behavior detection provided by an embodiment of the present application;

[0048] Figure 4 This is a flow chart of a method for protecting screen information by detecting surreptitious photography provided by an embodiment of the present application;

[0049] Figure 5 It is a structural schematic diagram of a screen information protection device provided in an embodiment of the present application;

[0050] Figure 6 It is a structural block diagram of a display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0051] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0052] Currently, there are many scenarios where information confidentiality is required, for example, in conference scenarios, the content of the meeting displayed on the screen must be kept confidential. In order to ensure the security of screen information, some means are needed to prevent the screen information from being secretly photographed. How to effectively prevent screen information from being secretly photographed is a hot topic in the industry. The display device and screen content protection method provided in the embodiments of the present application can be applied to small and medium-sized conference scenarios, and can also be applied to other scenarios with confidentiality requirements, and the embodiments of the present application are not limited to this.

[0053] To facilitate understanding, the display device provided in the embodiment of the present application is first introduced.

[0054] The display device provided in the embodiment of the present application includes a display screen and an infrared device, wherein the display screen is used to display screen information, and the infrared device is used to emit infrared light, and the infrared light is used to cover part or all of the display area of ​​the display screen to reduce the quality of the screen image obtained by photographing the display area. That is, infrared light is used to affect the photosensitive element of the hidden camera, thereby affecting the image quality of the hidden camera, and achieving the purpose of protecting the screen information.

[0055] There are many ways to implement the infrared device, and several of them are introduced below.

[0056] In one implementation, the infrared device includes N infrared light-emitting panels (also referred to as near-infrared light-emitting panels), where N is a positive integer. When N is greater than 1, the N infrared light-emitting panels are distributed on at least one frame side of the display screen. At least one infrared light-emitting panel can be distributed on a frame side, which is related to the size and number of the infrared light-emitting panels. In addition, different numbers of infrared light-emitting panels can be distributed on different frame sides, or the same number of infrared light-emitting panels can be distributed, which is not limited in the embodiments of the present application.

[0057] In some embodiments, when the length of the infrared light-emitting panel is close to the length of the frame of the display screen, one infrared light-emitting panel may be distributed on one frame side. Here, "close in length" means, for example, that the frame length of the display screen is less than twice the length of the infrared light-emitting panel. When the length of the infrared light-emitting panel is significantly less than the frame length of the display screen, two or more infrared light-emitting panels may be distributed on one frame side. Here, "significantly less than" means, for example, that the length of the display screen is not less than twice the length of the infrared light-emitting panel.

[0058] As an example, an infrared light-emitting panel is distributed on one side of a frame of the display screen, and N does not exceed the total number of frames of the display screen. For example, if the display screen has 4 frames in total, then N can be 1, 2, 3 or 4.

[0059] Figure 1 is a schematic diagram of a display device provided in an embodiment of the present application. Taking the infrared device including two infrared light-emitting panels as an example, see Figure 1 The two infrared light emitting panels are distributed on the upper frame side and the lower frame side of the display device, and the angles of infrared light emitted by the two infrared light emitting panels can be θ1 and θ2 respectively. θ1 and θ2 can be the same or different.

[0060] It should be understood that one infrared light emitting board is distributed with multiple infrared light sources, and these multiple infrared light sources can all emit infrared light. In one possible implementation, the angles of infrared light emitted by the multiple infrared light sources on each infrared light emitting board are the same, so the angle of infrared light emitted by each infrared light emitting board is a numerical value, that is, θ1 and θ2 refer to a numerical value. In another possible implementation, the angles of infrared light emitted by the multiple infrared light sources on each infrared light emitting board may be different, so the angle of infrared light emitted by each infrared light emitting board is a numerical range, that is, θ1 and θ2 refer to a numerical range, specifically, θ1 refers to 0~θ1, and θ2 refers to 0~θ2.

[0061] It should also be understood that each infrared light emitting panel can be a rectangular light emitting panel. Figure 1It is a side view, and when looking directly at the display screen, each infrared light emitting plate has a certain length and can be parallel to the frame of the display screen. In this way, the infrared light emitted by the two infrared light emitting plates can cover part or all of the display area of ​​the display screen.

[0062] In order not to affect the display effect of the display screen, in a possible implementation, the display device further includes a semi-transparent glass, which covers the display screen. The infrared device is specifically used to irradiate infrared light to the semi-transparent glass; the semi-transparent glass is used to reflect the infrared light into the environment. That is, by adding the semi-transparent glass, on the one hand, it does not affect the display effect, and on the other hand, it can further reflect the infrared light into the environment, thereby interfering with the candid photography behavior.

[0063] In a possible implementation, the semi-transparent glass includes a first glass and a second glass in a rectangular shape, a first side of the first glass overlaps with a second side of the second glass, and the first glass and the second glass have an angle, and the first glass and the second glass also have an angle with the display screen.

[0064] Figure 2 is a schematic diagram of another display device provided in an embodiment of the present application. Figure 2 The semi-transparent glass includes a first glass and a second glass with a clamp. For example, the first glass is on the top and the second glass is on the bottom. The overlap position of the first glass and the second glass is the overlap position of the first side and the second side. The first glass and the second glass each have a clamp with the display screen.

[0065] In a possible implementation, taking the above N as 2, that is, the infrared device includes 2 infrared light-emitting panels as an example, continue to refer to Figure 2 The first of the two infrared light-emitting panels (i.e., the upper infrared light-emitting panel) is located on the frame side of the display screen close to the third side (i.e., the upper side) of the first glass, the third side is parallel to the first side, and the first light-emitting panel is used to irradiate infrared light to the first glass. The second of the two infrared light-emitting panels (i.e., the lower infrared light-emitting panel) is located on the frame side of the display screen close to the fourth side (i.e., the lower side) of the second glass, the fourth side is parallel to the second side, and the second light-emitting panel is used to irradiate infrared light to the second glass.

[0066] Figure 2 The two infrared light emitting panels shown emit infrared light vertically, and the infrared light is reflected by the semi-transparent glass and irradiated horizontally into the environment. In other embodiments, the two infrared light emitting panels may not emit infrared light vertically, and the infrared light may not be reflected by the semi-transparent glass and irradiated horizontally into the environment, which does not affect the effect of the present solution, as long as the infrared light can cover part or all of the display area of ​​the display screen.

[0067] It should be understood that Figure 1 and Figure 2The description is made by taking two infrared light-emitting panels, and the two infrared light-emitting panels are respectively located on the upper frame side and the lower frame side of the display screen as an example. In other embodiments, the two infrared light-emitting panels may also be located on the left frame side and the right frame side of the display screen. In some other embodiments, the infrared device may also include one or more than two infrared light-emitting panels, for example, including 4 infrared light-emitting panels, and the 4 infrared light-emitting panels may be respectively located on the upper, lower, left and right frame sides of the display screen. In this case, in a possible implementation method, the semi-transparent glass may be a semi-circular arc glass, or a glass with 4 pyramids. In other words, there are many specific implementation methods of the infrared light-emitting panels and the semi-transparent glass. By combining or reasonably expanding the above schemes, more variants can be obtained. The embodiments of the present application do not introduce examples one by one.

[0068] In a possible implementation, in addition to setting an infrared light-emitting panel on the frame side of the display screen, the display screen also includes a backlight system, and the infrared device includes an infrared backlight source, which is integrated into the backlight system. That is, an infrared light source is integrated or embedded in the backlight system to interfere with the imaging of the hidden camera. It should be understood that the infrared backlight source here is actually an infrared light source, and it is called an infrared backlight source mainly to distinguish it from the infrared light source located outside the display screen (such as the frame side of the display screen) mentioned above.

[0069] Taking into account that changes in the intensity of ambient light will affect the imaging quality of the camera, in order to enhance the interference of the above-mentioned infrared light on voyeurism, in a possible implementation method, the display device also includes a light source control device, which is used to obtain the intensity of the ambient light and adjust the luminous intensity of the infrared device based on the intensity of the ambient light.

[0070] In a possible implementation, the light source control device is used to increase the luminous intensity of the infrared device when the intensity of the ambient light increases, and to reduce the luminous intensity of the infrared device when the intensity of the ambient light decreases.

[0071] Among them, the light source control device can adjust the luminous intensity of the infrared device according to the intensity adjustment curve. Among them, the intensity adjustment curve represents the relationship between the intensity of ambient light and the luminous intensity of the infrared device. The intensity adjustment curve can be a linear curve with a certain slope, or a non-linear curve, or a combination of a linear curve and a non-linear curve, which is not limited in the embodiments of the present application. Alternatively, the light source control device can also adjust the luminous intensity of the infrared device in other ways, which is not limited in the embodiments of the present application.

[0072] In a possible implementation, the light source control device includes a light sensor and a processor. The light sensor is used to obtain the intensity of ambient light, and the processor is used to adjust the light intensity of the infrared device based on the intensity of the ambient light.

[0073] In a possible implementation, the wavelength of the infrared light source of the infrared device may be between 850 nm (nanometers) and 940 nm, or the wavelength of the infrared light source may be determined according to actual conditions, which is not limited in the present application. The infrared light source may be an infrared LED (Light Emitting Diode) or other types of light sources.

[0074] It should be understood that the above-mentioned infrared light can be sensed by the camera shooting the display screen, thereby interfering with the imaging quality of the candid photography behavior, but the human eye cannot perceive infrared light, that is, it will not affect the viewing effect of the viewer.

[0075] In order to further protect the screen information, based on the above embodiments, it is also possible to combine the detection of secretly photographing behavior to further ensure the security of the screen information.

[0076] In a possible implementation, the display device further includes an image sensor and a processor. The image sensor is used to capture an image of a viewing area of ​​the display screen to obtain an environment image. The processor is used to detect a shooting behavior in the environment image, and when a shooting behavior (also referred to as a candid shooting behavior) is detected in the environment image, a screen information protection strategy is executed.

[0077] Figure 3 is a schematic diagram of a voyeuristic camera detection method provided in an embodiment of the present application. Figure 3 An image sensor is arranged above the display screen to collect images of the viewing area and obtain an environmental image. In the case where there is a sneak photographer in the viewing area, for example, a viewer takes a sneak photo with a mobile phone, the processor can detect the sneak photography behavior from the environmental image and then execute the screen information protection strategy.

[0078] In a possible implementation, the image sensor can be located on any side of the frame of the display screen, or can also be located at any position away from the display screen, such as at other positions in the venue, and is not fixed to the display screen. That is, the embodiment of the present application does not limit the position of the image sensor, as long as it can capture the viewing area.

[0079] In addition, the image sensor can be any type of image sensor, such as a UVC (USB Video Class) camera sensor, and the embodiment of the present application does not limit the number of pixels, type, shooting angle, etc. of the image sensor. As an example, the image sensor uses a MIPI (Mobile Industry Processor Interface) 4K high-definition camera, which can capture images within a certain distance range, such as images within a range of 5 meters or 7 meters.

[0080] The processor may be a processor integrated in the display screen, or may be another processor. For example, if the display device includes a host and a display screen, the processor here may be a processor in the host, or may be a processor of a conference control system or a processor of other computer equipment. In addition, the processor here may be the same as the processor used to adjust the luminous intensity of the infrared device mentioned above, or may be a different processor, which is not limited in the embodiments of the present application.

[0081] In a possible implementation, the screen information protection strategy includes one or more of a display interruption strategy, a shooting reminder strategy, and an infrared interference strategy.

[0082] The display interruption strategy is to stop displaying screen information to the display screen, that is, the processor can control the display device to stop outputting screen information to the display screen.

[0083] The shooting reminder strategy is used to remind the user of the voyeuristic shooting behavior through text and / or voice, so as to warn the voyeur. That is, the processor can control the display screen to output the reminder text, and / or control the voice output device to output the reminder voice. The voice output device may be integrated into the display screen or may not be integrated into the display screen, and may be a part of the display device or may not be a part of the display device, which is not limited in the embodiments of the present application.

[0084] The infrared interference strategy is used to turn on the infrared device to emit infrared light when a voyeuristic shooting behavior is detected, thereby interfering with the voyeuristic shooting behavior. It should be understood that the image sensor is always in a working state, and the infrared device may not be turned on when no voyeuristic shooting behavior is detected.

[0085] Of course, in some other embodiments, both the image sensor and the infrared device are in working state, that is, the two screen information protection methods of detecting the secretly photographing behavior and interfering with the shooting by infrared light are performed together.

[0086] In one possible implementation, the processor uses a deep learning model to detect the candid photography behavior, which will be described below.

[0087] The processor inputs the environmental image into the deep learning model to obtain a detection result output by the deep learning model. The detection result may be the presence or absence of voyeuristic photography.

[0088] The environment image input to the deep learning model may be one or more images. The environment image may be a video frame, that is, the image sensor is used to capture the video, and the environment image includes one or more video frames. Alternatively, the environment image may be one or more images captured at a sampling interval.

[0089] When the environment image is a plurality of images or a plurality of video frames, the processor is used to detect the candid photography behavior from the plurality of continuous images or a plurality of video frames through a deep learning model, so as to ensure the accuracy and reliability of the detection result.

[0090] Before using a deep learning model to detect candid photography, it is necessary to obtain a deep learning model through model training. For example, collect images of viewers in different postures in similar scenes (such as meeting scenes) to obtain a sample image set, and / or obtain a third-party or public image set to obtain a sample image set. Use the sample image set to train the initial model, perform hyperparameter tuning on the initial model, evaluate model performance indicators (such as recall rate, F1 score), etc. during the training process, and use the trained model as the above-mentioned deep learning model.

[0091] In one possible implementation, the deep learning model includes a convolutional neural network or a recurrent convolutional neural network or a model of other structures, which is not limited in the embodiments of the present application. In addition, the embodiments of the present application do not limit the training method, model architecture, number of layers, etc. of the deep learning model. The training of the deep learning model can be implemented on a server or any other possible computing device, which is not limited in the embodiments of the present application.

[0092] Considering that current deep learning models are generally deployed on NPU (Neural-network Processing Unit), the resources of NPU are limited and the deep learning model cannot be too large. Therefore, the trained model can be converted to Tensor Flow Lite format through the TensorFlow Lite converter, and further pruning and quantization can be performed to reduce the model size to obtain a deep learning model.

[0093] In one possible implementation, the processor includes an NPU and a CPU (Central Processing Unit), the NPU is used to detect the environmental image to obtain a detection result, and the CPU is used to determine whether to execute a screen information protection strategy based on the detection result. For example, when the detection result indicates that there is a voyeuristic photography behavior in the environmental image, the screen information protection strategy is executed; when the detection result indicates that there is no voyeuristic photography behavior in the environmental image, the screen information protection strategy is not executed.

[0094] It should be understood that Figure 3 Embodiments may be used with Figure 1 or Figure 2 The embodiments are combined to protect the screen information as much as possible by combining active and passive methods. The active method refers to the method of interfering with the sneak photography behavior by infrared devices, and the passive method refers to the method of detecting the sneak photography behavior and thus warning the sneak photographer.

[0095] In summary, the embodiment of the present application sets an infrared device on the display device to emit infrared light that can cover part or all of the display area of ​​the display screen, thereby reducing the quality of the screen image obtained by photographing the display area through infrared light, that is, using infrared light to affect the imaging quality of the candid photography behavior, thereby achieving the purpose of protecting the screen information. When the naked eye views the display screen, the infrared light cannot be perceived, that is, this solution does not affect the viewing effect.

[0096] The device structure and business scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field can know that with the evolution of the device structure and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0097] Next, the screen information protection method provided by the embodiment of the present application is explained in detail. In a possible implementation, the screen information protection method can be applied to Figure 1 , Figure 2 or Figure 3 The display device shown in any embodiment. In one possible implementation, part or all of the steps of the method are executed by a processor in the display device. In another possible implementation, part or all of the steps of the method are executed by a central control system of the display device.

[0098] The method comprises controlling an infrared device to emit infrared light, wherein the infrared light is used to cover part or all of a display area of ​​a display screen so as to reduce the quality of a screen image obtained by photographing the display area.

[0099] The infrared device may be in working state all the time, or may be controlled to enter working state to emit infrared light when a shooting behavior is detected in the environment image. The specific implementation method may refer to the above related content, which will not be repeated here.

[0100] In a possible implementation, the display device further includes a light source control device, and the method further includes: the light source control device obtains the intensity of the ambient light, and adjusts the luminous intensity of the infrared device based on the intensity of the ambient light. The specific implementation method can also refer to the relevant content above, which will not be repeated here.

[0101] In a possible implementation, the display device further includes an image sensor and a processor. The method further includes: the image sensor collects an image of the viewing area of ​​the display screen to obtain an environment image; the processor detects a shooting behavior in the environment image, and executes a screen information protection strategy when a shooting behavior is detected in the environment image. The specific implementation method can also refer to the relevant content above, and will not be repeated here.

[0102] Figure 4 This is a flow chart of a method for protecting screen information by detecting candid photography provided by an embodiment of the present application. The method includes the following steps.

[0103] Step 401: The camera captures an image, that is, an image sensor (i.e., an image sensor in the camera) is used to collect an environmental image.

[0104] Step 402: The NPU processes and obtains the detection result. That is, the NPU uses the deep learning model to analyze the environmental image and obtains the detection result about the candid photography behavior.

[0105] Step 403: The CPU makes a judgment based on the detection result. That is, the CPU determines whether to execute the screen information protection strategy based on the detection result. If the detection result indicates that there is a candid shooting behavior in the environment image, step 404 is executed; if the detection result indicates that there is no candid shooting behavior in the environment image, step 405 is executed.

[0106] Step 404: Execute protection strategies, such as interrupting the program and popping up a warning.

[0107] Step 405: Continue running.

[0108] In summary, the embodiment of the present application sets an infrared device on the display device to emit infrared light that can cover part or all of the display area of ​​the display screen, thereby reducing the quality of the screen image obtained by photographing the display area through infrared light, that is, using infrared light to affect the imaging quality of the candid photography behavior, thereby achieving the purpose of protecting the screen information. When the naked eye views the display screen, the infrared light cannot be perceived, that is, this solution does not affect the viewing effect.

[0109] All the above optional technical solutions can be combined in any way to form optional embodiments of the present application, and the embodiments of the present application will not be described in detail one by one.

[0110] Figure 5 is a schematic diagram of the structure of a screen information protection device provided in an embodiment of the present application. The protection device 500 can be implemented by software, hardware or a combination of both to become part or all of a display device. The display device can be Figures 1 to 3 Any display device in the embodiment. In the embodiment of the present application, the display device includes a display screen and an infrared device, please refer to Figure 5 , the protection device 500 includes: a control module 501.

[0111] The control module 501 is used to control the infrared device to emit infrared light, and the infrared light is used to cover part or all of the display area of ​​the display screen to reduce the quality of the screen image obtained by shooting the display area.

[0112] Wherein, the display screen is used to display screen information;

[0113] The infrared device is used to emit infrared light, which is used to cover part or all of the display area of ​​the display screen to reduce the quality of the screen image obtained by photographing the display area.

[0114] In a possible implementation, the infrared device includes N infrared light-emitting panels, where N is a positive integer;

[0115] When N is greater than 1, the N infrared light-emitting panels are distributed on at least one frame side of the display screen.

[0116] In a possible implementation, one infrared light-emitting panel is distributed on one side of a frame, and N does not exceed the total number of frames of the display screen.

[0117] In a possible implementation, the display device further includes a semi-transparent glass, and the semi-transparent glass covers the display screen;

[0118] An infrared device, specifically used for irradiating infrared light onto the semi-transparent glass;

[0119] Semi-transparent glass to reflect infrared light into the environment.

[0120] In a possible implementation, the semi-transparent glass includes a first glass and a second glass in a rectangular shape, a first side of the first glass overlaps with a second side of the second glass, and the first glass and the second glass have an angle, and the first glass and the second glass also have an angle with the display screen;

[0121] When N is 2, the first of the two infrared light-emitting panels is located on the frame side of the display screen close to the third side of the first glass, the third side is parallel to the first side, and the first light-emitting panel is used to irradiate infrared light to the first glass; the second of the two infrared light-emitting panels is located on the frame side of the display screen close to the fourth side of the second glass, the fourth side is parallel to the second side, and the second light-emitting panel is used to irradiate infrared light to the second glass.

[0122] In a possible implementation, the display screen includes a backlight system, the infrared device includes an infrared backlight source, and the infrared backlight source is integrated in the backlight system.

[0123] In a possible implementation, the protection device 500 further includes a light source control device;

[0124] The light source control device is used to obtain the intensity of the ambient light and adjust the light intensity of the infrared device based on the intensity of the ambient light.

[0125] In a possible implementation, the protection device 500 further includes an image sensor and a processor;

[0126] An image sensor is used to collect an image of a viewing area of ​​the display screen to obtain an environmental image;

[0127] The processor is used to detect shooting behavior in the environment image, and execute a protection strategy for the screen information when shooting behavior is detected in the environment image.

[0128] In summary, the embodiment of the present application sets an infrared device on the display device to emit infrared light that can cover part or all of the display area of ​​the display screen, thereby reducing the quality of the screen image obtained by photographing the display area through infrared light, that is, using infrared light to affect the imaging quality of the candid photography behavior, thereby achieving the purpose of protecting the screen information. When the naked eye views the display screen, the infrared light cannot be perceived, that is, this solution does not affect the viewing effect.

[0129] It should be noted that: the screen information protection device provided in the above embodiment only uses the division of the above functional modules as an example to illustrate when protecting screen information. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the screen information protection device and screen information protection method embodiments provided in the above embodiment, as well as Figures 1 to 3 The embodiments of the display device shown all belong to the same concept, and their specific implementation processes are detailed in the method embodiments, which will not be repeated here.

[0130] Figure 6 6 is a structural block diagram of a display device 600 provided in an embodiment of the present application. The display device 600 may be: a projector, a projection TV, a smart screen, etc., or may be a smart phone, a tablet computer, a laptop computer or a desktop computer, etc. The display device 600 may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal, etc.

[0131] Typically, the display device 600 includes a processor 601 and a memory 602 .

[0132] The processor 601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 601 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 601 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU; the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 601 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 601 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0133] The memory 602 may include one or more computer-readable storage media, which may be non-transitory. The memory 602 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 602 is used to store at least one instruction, which is used to be executed by the processor 601 to implement the screen information protection method provided in the method embodiment of the present application.

[0134] In some embodiments, the display device 600 may further optionally include: a peripheral device interface 603 and at least one peripheral device. The processor 601, the memory 602 and the peripheral device interface 603 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 603 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 604, a display screen 605, a camera assembly 606, an audio circuit 607, a positioning assembly 608 and a power supply 609.

[0135] In the embodiment of the present application, the display device 600 further includes an infrared device (not shown), which can be Figure 1 to Figure 2 The infrared device in the embodiment is used to emit infrared light to cover part or all of the display area of ​​the display screen 605, thereby reducing the quality of the screen image obtained by photographing the display area.

[0136] The peripheral device interface 603 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 601 and the memory 602. In some embodiments, the processor 601, the memory 602, and the peripheral device interface 603 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 601, the memory 602, and the peripheral device interface 603 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0137] The radio frequency circuit 604 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 604 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 604 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 604 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 604 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 604 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0138] The display screen 605 is used to display the UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 605 is a touch display screen, the display screen 605 also has the ability to collect touch signals on the surface or above the surface of the display screen 605. The touch signal can be input to the processor 601 as a control signal for processing. At this time, the display screen 605 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 605 can be one, arranged on the front panel of the display device 600; in other embodiments, the display screen 605 can be at least two, respectively arranged on different surfaces of the display device 600 or in a folding design; in other embodiments, the display screen 605 can be a flexible display screen, arranged on a curved surface or a folding surface of the display device 600. Even, the display screen 605 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 605 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).

[0139] The camera assembly 606 is used to collect images or videos. In a possible implementation, the camera assembly 606 includes a front camera and a rear camera. Usually, the front camera is set on the front panel of the terminal, and the rear camera is set on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize the panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 606 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. The dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures. In some embodiments, the camera assembly 606 is used to collect an image of the viewing area of ​​the display screen 605 to obtain an environmental image. The processor 601 is also used to detect shooting behavior in the environmental image, and when the shooting behavior is detected in the environmental image, the protection strategy of the screen information is executed.

[0140] The audio circuit 607 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 601 for processing, or input them into the radio frequency circuit 604 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the display device 600. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 601 or the radio frequency circuit 604 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 607 may also include a headphone jack.

[0141] The positioning component 608 is used to locate the current geographical location of the display device 600 to implement navigation or LBS (Location Based Service). The positioning component 608 can be a positioning component based on the US GPS (Global Positioning System), China's Beidou system, Russia's Grenas system or the European Union's Galileo system.

[0142] The power supply 609 is used to power the various components in the display device 600. The power supply 609 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 609 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0143] In some embodiments, the display device 600 further includes a light source control device (not shown) for acquiring the intensity of the ambient light and adjusting the light intensity of the infrared device based on the intensity of the ambient light.

[0144] In some embodiments, the display device 600 further includes one or more sensors 610 , including but not limited to: an acceleration sensor 611 , a gyroscope sensor 612 , a pressure sensor 613 , a fingerprint sensor 614 , an optical sensor 615 , and a proximity sensor 616 .

[0145] The acceleration sensor 611 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the display device 600. For example, the acceleration sensor 611 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 601 can control the display screen 605 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 611. The acceleration sensor 611 can also be used to collect game or user motion data.

[0146] The gyro sensor 612 can detect the body direction and rotation angle of the display device 600, and the gyro sensor 612 can cooperate with the acceleration sensor 611 to collect the user's 3D actions on the display device 600. The processor 601 can implement the following functions based on the data collected by the gyro sensor 612: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0147] The pressure sensor 613 can be set on the side frame of the display device 600 and / or the lower layer of the display screen 605. When the pressure sensor 613 is set on the side frame of the display device 600, it can detect the user's holding signal of the display device 600, and the processor 601 performs left and right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 613. When the pressure sensor 613 is set on the lower layer of the display screen 605, the processor 601 controls the operability controls on the UI interface according to the user's pressure operation on the display screen 605. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0148] The fingerprint sensor 614 is used to collect the user's fingerprint, and the processor 601 identifies the user's identity based on the fingerprint collected by the fingerprint sensor 614, or the fingerprint sensor 614 identifies the user's identity based on the collected fingerprint. When the user's identity is identified as a trusted identity, the processor 601 authorizes the user to perform relevant sensitive operations, which include unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings. The fingerprint sensor 614 can be set on the front, back, or side of the display device 600. When a physical button or a manufacturer logo is set on the display device 600, the fingerprint sensor 614 can be integrated with the physical button or the manufacturer logo.

[0149] The optical sensor 615 is used to collect the ambient light intensity. In one embodiment, the processor 601 can control the display brightness of the display screen 605 according to the ambient light intensity collected by the optical sensor 615. Specifically, when the ambient light intensity is high, the display brightness of the display screen 605 is increased; when the ambient light intensity is low, the display brightness of the display screen 605 is reduced. In another embodiment, the processor 601 can also dynamically adjust the shooting parameters of the camera assembly 606 according to the ambient light intensity collected by the optical sensor 615.

[0150] The proximity sensor 616, also called a distance sensor, is usually disposed on the front panel of the display device 600. The proximity sensor 616 is used to collect the distance between the user and the front of the display device 600. In one embodiment, when the proximity sensor 616 detects that the distance between the user and the front of the display device 600 is gradually decreasing, the processor 601 controls the display screen 605 to switch from the screen-on state to the screen-off state; when the proximity sensor 616 detects that the distance between the user and the front of the display device 600 is gradually increasing, the processor 601 controls the display screen 605 to switch from the screen-off state to the screen-on state.

[0151] Those skilled in the art will understand that Figure 6 The structure shown in the figure does not constitute a limitation on the display device 600, and may include more or less components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0152] In some embodiments, a computer-readable storage medium is also provided, in which a computer program is stored, and when the computer program is executed by a processor, the steps of the screen information protection method in the above embodiment are implemented. For example, the computer-readable storage medium can be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

[0153] It is worth noting that the computer-readable storage medium mentioned in the embodiments of the present application may be a non-volatile storage medium, in other words, a non-transitory storage medium.

[0154] It should be understood that all or part of the steps to implement the above embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. The computer instructions can be stored in the above-mentioned computer readable storage medium.

[0155] That is, in some embodiments, a computer program product containing instructions is also provided, which, when executed on a computer, enables the computer to perform the steps of the screen information protection method described above. That is, in some embodiments, a computer program is also provided, which, when executed on a computer, enables the computer to perform the steps of the screen information protection method described above.

[0156] It should be understood that the "at least one" mentioned herein refers to one or more, and "multiple" refers to two or more. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second" and the like are used to distinguish the same items or similar items with basically the same functions and effects. Those skilled in the art can understand that the words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like do not limit them to be necessarily different.

[0157] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in the embodiments of the present application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0158] The above-mentioned embodiments are provided for the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A display device, characterized in that: The display device includes a display screen and an infrared device; The display screen is used to display screen information; The infrared device is used to emit infrared light, and the infrared light is used to cover part or all of the display area of ​​the display screen to reduce the quality of the screen image obtained by shooting the display area.

2. The display device according to claim 1, wherein: The infrared device includes N infrared light-emitting panels, where N is a positive integer; When N is greater than 1, the N infrared light-emitting panels are distributed on at least one frame side of the display screen.

3. The display device according to claim 2, wherein: The display device further comprises a semi-transparent glass, wherein the semi-transparent glass covers the display screen; The infrared device is specifically used to irradiate the infrared light toward the semi-transparent glass; The semi-transparent glass is used to reflect the infrared light into the environment.

4. The display device according to claim 3, characterized in that The semi-transparent glass comprises a first glass and a second glass in a rectangular shape, wherein a first side of the first glass overlaps with a second side of the second glass, and the first glass and the second glass have an angle, and the first glass and the second glass also have an angle with the display screen; When N is 2, the first of the two infrared light-emitting panels is located on the frame side of the display screen close to the third side of the first glass, the third side is parallel to the first side, and the first light-emitting panel is used to irradiate infrared light to the first glass; the second of the two infrared light-emitting panels is located on the frame side of the display screen close to the fourth side of the second glass, the fourth side is parallel to the second side, and the second light-emitting panel is used to irradiate infrared light to the second glass.

5. The display device according to claim 1, wherein: The display screen includes a backlight system, the infrared device includes an infrared backlight source, and the infrared backlight source is integrated in the backlight system.

6. The display device according to any one of claims 1 to 5, characterized in that: The display device also includes a light source control device; The light source control device is used to obtain the intensity of the ambient light and adjust the light intensity of the infrared device based on the intensity of the ambient light.

7. The display device according to any one of claims 1 to 5, characterized in that: The display device also includes an image sensor and a processor; The image sensor is used to collect an image of the viewing area of ​​the display screen to obtain an environment image; The processor is used to detect the shooting behavior in the environmental image, and execute the protection strategy of the screen information when the shooting behavior is detected in the environmental image.

8. A method for protecting screen information, characterized in that: The display device includes a display screen and an infrared device, and the method includes: The infrared device is controlled to emit infrared light, and the infrared light is used to cover part or all of the display area of ​​the display screen to reduce the quality of the screen image obtained by shooting the display area.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to claim 8 is implemented.

10. A computer program product, characterized in that The computer program product stores computer instructions, and when the computer instructions are executed by a processor, the method according to claim 8 is implemented.

Images